Using Instinct with Ollama in NextCLI

Learn how to run Instinct, NextCLI's leading open Next Edit model, on your own hardware with Ollama

Instinct is a 7 billion parameter model. You should expect slow responses if running on a laptop. To learn how to inference Instinct on a GPU, see our HuggingFace model card.
Instinct is an open Next Edit model, fine-tuned from Qwen2.5-Coder-7B. It predicts the next edit so you can stay in flow.

1. Install Ollama

If you haven't already installed Ollama, see our guide here.

2. Download Instinct

ollama run nate/instinct

3. Update your config.yaml

Open your config.yaml and add Instinct to the models section:
# ... rest of config.yaml ...

models:
  - uses: continuedev/instinct
Alternatively, you can just click to add the block at https://nextcli.dev/continuedev/instinct.