2 Commits

Author	SHA1	Message	Date
fabolous005	01dce2ffc6	prain: tune searches the auto CPU threshold and writes --cpu-threads; vLLM patch: fit Gemma 4 in 8 GB (tied lm_head without a copy, rope caches sized by max_model_len)	2026-10-27 23:52:53 +01:00
fabolous005	d69fd34492	prain: fix vLLM on ROCm (no CUDA capability families), smoke test and benchmark scripts	2026-10-27 16:44:40 +01:00