AI pill: several Ollama servers (pills.ai.servers, comma-separated, in order): the model list shows all their models, a question goes to the first server that has the chosen one; a local ollama is started only when no other server has it

2026-10-20 15:07:11 +02:00
parent 344d318959
commit e0d8a5479c
3 changed files with 119 additions and 40 deletions
@@ -526,7 +526,7 @@ settings! {
        ai {
            width: f32 = 760.0, 280..=1400; "Width of the AI card"
            height: f32 = 680.0, 200..=1200; "Height of the AI card"
-            server: String = String::from("http://localhost:11434"); "The Ollama server the AI card talks to"
+            servers: String = String::from("http://localhost:11434"); "The Ollama servers the AI card talks to, comma-separated, in order: the model list shows all their models, a question goes to the first that has the chosen one"
            model: String = String::from("gemma4:e4b"); "The Ollama model to chat with, with its tag (ollama list shows them)"
            start_service: bool = true; "Start the local ollama service (doas rc-service ollama start) when it isn't answering"
            system: String = String::from("You are a helpful assistant inside a Linux desktop shell. Answer briefly and plainly."); "What the model is told before every chat"