fabolous005 0f3911afb5 prain: span profiler with flame graphs (PRAIN_PROFILE: engine step, every model module, MoE route/plan/copy/round, call counts; python -m prain.profile); prain web --host

2026-10-29 08:39:28 +01:00

..

__init__.py

prain: skeleton

2026-10-27 13:52:04 +01:00

helpers.py

prain: skeleton

2026-10-27 13:52:04 +01:00

test_chat.py

prain: chat client with cancellable warm-up

2026-10-27 13:52:14 +01:00

test_cli.py

prain: span profiler with flame graphs (PRAIN_PROFILE: engine step, every model module, MoE route/plan/copy/round, call counts; python -m prain.profile); prain web --host

2026-10-29 08:39:28 +01:00

test_config.py

prain: int8/int4 experts quantized once on the GPU, rounds through vLLM's expert_map, [miss] min_weight skips experts not in VRAM; scripts: tune_moe, quality (answer NLL on identical token ids), bench --context, measure --quant

2026-10-28 22:07:25 +01:00

test_drafts.py

prain: draft rows from the batch layout

2026-10-27 13:52:25 +01:00

test_gemv.py

prain: Triton GEMV for decode GEMMs on gfx10 (rocBLAS ran bf16 GEMVs at 6% of the bandwidth; agent setup 1.58 -> 2.77 tok/s, same answers)

2026-10-28 22:07:25 +01:00

test_kernel_match.py

prain: int8/int4 experts quantized once on the GPU, rounds through vLLM's expert_map, [miss] min_weight skips experts not in VRAM; scripts: tune_moe, quality (answer NLL on identical token ids), bench --context, measure --quant

2026-10-28 22:07:25 +01:00

test_plugin.py

prain: vLLM tiered experts layer and plugin

2026-10-27 15:55:57 +01:00

test_policy.py

prain: slot cache with eviction, scan, prefetch and CPU policies

2026-10-27 13:52:07 +01:00

test_profile.py

prain: span profiler with flame graphs (PRAIN_PROFILE: engine step, every model module, MoE route/plan/copy/round, call counts; python -m prain.profile); prain web --host

2026-10-29 08:39:28 +01:00

test_quant.py

prain: int8/int4 experts quantized once on the GPU, rounds through vLLM's expert_map, [miss] min_weight skips experts not in VRAM; scripts: tune_moe, quality (answer NLL on identical token ids), bench --context, measure --quant

2026-10-28 22:07:25 +01:00

test_sim.py

prain: pin the RAM tier per expert (big pinned blocks take minutes on eGPU hosts); sim charges disk reads on the CPU path; measure CPU cost on cold experts

2026-10-28 00:33:34 +01:00

test_tiered.py

prain: int8/int4 experts quantized once on the GPU, rounds through vLLM's expert_map, [miss] min_weight skips experts not in VRAM; scripts: tune_moe, quality (answer NLL on identical token ids), bench --context, measure --quant

2026-10-28 22:07:25 +01:00

test_tui.py

prain: terminal UI

2026-10-27 13:52:16 +01:00

test_web.py

prain: web UI with sessions and drafts

2026-10-27 13:52:25 +01:00