fabolous005/prain
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
30 Commits 1 Branch 0 Tags
master
Commit Graph

3 Commits

Author SHA1 Message Date
fabolous005 16c3bf81f7 prain: pin the RAM tier per expert (big pinned blocks take minutes on eGPU hosts); sim charges disk reads on the CPU path; measure CPU cost on cold experts 2026-10-28 00:33:34 +01:00
fabolous005 01dce2ffc6 prain: tune searches the auto CPU threshold and writes --cpu-threads; vLLM patch: fit Gemma 4 in 8 GB (tied lm_head without a copy, rope caches sized by max_model_len) 2026-10-27 23:52:53 +01:00
fabolous005 168251e81c prain: traces, simulator and tuner 2026-10-27 13:52:09 +01:00