fabolous005 01dce2ffc6 prain: tune searches the auto CPU threshold and writes --cpu-threads; vLLM patch: fit Gemma 4 in 8 GB (tied lm_head without a copy, rope caches sized by max_model_len)

2026-10-27 23:52:53 +01:00

..

__init__.py

prain: skeleton

2026-10-27 13:52:04 +01:00

helpers.py

prain: skeleton

2026-10-27 13:52:04 +01:00

test_chat.py

prain: chat client with cancellable warm-up

2026-10-27 13:52:14 +01:00

test_cli.py

prain: command line

2026-10-27 13:52:10 +01:00

test_config.py

prain: stats planner and TOML writer

2026-10-27 13:52:06 +01:00

test_drafts.py

prain: draft rows from the batch layout

2026-10-27 13:52:25 +01:00

test_kernel_match.py

prain: vLLM tiered experts layer and plugin

2026-10-27 15:55:57 +01:00

test_plugin.py

prain: vLLM tiered experts layer and plugin

2026-10-27 15:55:57 +01:00

test_policy.py

prain: slot cache with eviction, scan, prefetch and CPU policies

2026-10-27 13:52:07 +01:00

test_sim.py

prain: tune searches the auto CPU threshold and writes --cpu-threads; vLLM patch: fit Gemma 4 in 8 GB (tied lm_head without a copy, rope caches sized by max_model_len)

2026-10-27 23:52:53 +01:00

test_tiered.py

prain: tiered forward with CPU path

2026-10-27 15:54:11 +01:00

test_tui.py

prain: terminal UI

2026-10-27 13:52:16 +01:00

test_web.py

prain: web UI with sessions and drafts

2026-10-27 13:52:25 +01:00