Have a way to not load mistral and sdxl

[eburnette]

For self-hosted runners, I just need text inference, so I don't want it to load Mistral for fine-tuning or Sdxl for images.

I tried setting:

RUNTIME_OLLAMA_WARMUP_MODELS=llama3:instruct

but it still loaded Mistral and Sdxl.

Luke suggested one of these options but the runner wouldn't even start:

#RUNTIME_AXOLOTL_WARMUP_MODELS=
#RUNTIME_AXOLOTL_WARMUP_MODELS=none

[lukemarsden]

try RUNTIME_AXOLOTL_ENABLED=false

[eburnette]

That causes the runner not to come up. It prints this to its log and nothing else:

2024-05-02 13:08:15 Connecting to controlplane ws://host.docker.internal/api/v1/ws/runner
2024-05-02 13:08:15 2024-05-02T17:08:15Z INF api/cmd/helix/runner.go:321 > Helix runner listening on 0.0.0.0:8080

The dashboard is empty.