prain: web UI with a model monitor

A clear chat page (markdown, code blocks with copy, stop, new chat, kept in the browser,
drafts shown as such) and a monitor sidebar, a sheet on phones: tokens/s, a live map of the
30 x 128 experts (in VRAM, used now, copied in), VRAM hit rate, copies, context, prompt cache,
GPU VRAM/load/temperature/power/fan. GET /status merges vLLM /metrics, amdgpu sysfs and the
stats file, which now lists the experts in VRAM. /warm answers 202 when a warm-up starts.
README: the int4 kernels, their A/B, 2048-token chunks as a trade, prompt logprobs limit.

This commit is contained in:

fabolous005

2026-10-29 14:20:23 +01:00

parent d1ccc5c294

commit a14e3ade0b

11 changed files with 977 additions and 133 deletions

									
										pyproject.toml
									
		+3
		
												View File
												
				@@ -17,3 +17,6 @@ build-backend = "setuptools.build_meta"

				[tool.setuptools]

				packages = ["prain"]

				[tool.setuptools.package-data]

				prain = ["web.html"]