Clairvoyance v0.85.0
Local AI hosting issues
Question regarding hosting models locally and fine-tuning the model settings for increased performance within clairvoyance:
When hosting local models and connecting them to Clairvoyance I am artificially limited at a small token count when using llama.cpp and lmstudio server. the models vary from 8,000 context tokens to 6,000 context tokens depending on if I load Gemma, MedGemma or Qwen3.8. My machine has an RTX 5090 so I know it wasn't that I was hitting any limit due to hardware.
I see no way to manually adjust the context token allocation within the GUI.
I pass the token limit from the host software but Clairvoyance overrides this and sets an artificial limit on context.
Questions:
1. Is there a way to set custom context tokens to match the amount specified in the local model instructionset?
2. Is there a granular GUI panel that allows for more control over the models we bring in locally?
3. Is there a hidden JSON file that allows for manual configuration of the local model properties?
4. Is there a way to disable reasoning of the self hosted Qwen3.8 model via ollama? (thinking chews through tokens)
Moved to Clairvoyance area