 fabolous005
|
0f3911afb5
|
prain: span profiler with flame graphs (PRAIN_PROFILE: engine step, every model module, MoE route/plan/copy/round, call counts; python -m prain.profile); prain web --host
|
2026-10-29 08:39:28 +01:00 |
|
|
fabolous005
|
708e152549
|
prain: int8/int4 experts quantized once on the GPU, rounds through vLLM's expert_map, [miss] min_weight skips experts not in VRAM; scripts: tune_moe, quality (answer NLL on identical token ids), bench --context, measure --quant
|
2026-10-28 22:07:25 +01:00 |
|
|
fabolous005
|
7a78cdee79
|
prain: command line
|
2026-10-27 13:52:10 +01:00 |
|