Skip to main content
To use Open Interpreter with a model from Anyscale, set the model flag: 
interpreter --model anyscale/<model-name>

from interpreter import interpreter

# Set the model to use from Anyscale:
interpreter.llm.model = "anyscale/<model-name>"
interpreter.chat()

​
Supported Models

We support the following completion models from Anyscale:
  • Llama 2 7B Chat
  • Llama 2 13B Chat
  • Llama 2 70B Chat
  • Mistral 7B Instruct
  • CodeLlama 34b Instruct
interpreter --model anyscale/meta-llama/Llama-2-7b-chat-hf
interpreter --model anyscale/meta-llama/Llama-2-13b-chat-hf
interpreter --model anyscale/meta-llama/Llama-2-70b-chat-hf
interpreter --model anyscale/mistralai/Mistral-7B-Instruct-v0.1
interpreter --model anyscale/codellama/CodeLlama-34b-Instruct-hf

interpreter.llm.model = "anyscale/meta-llama/Llama-2-7b-chat-hf"
interpreter.llm.model = "anyscale/meta-llama/Llama-2-13b-chat-hf"
interpreter.llm.model = "anyscale/meta-llama/Llama-2-70b-chat-hf"
interpreter.llm.model = "anyscale/mistralai/Mistral-7B-Instruct-v0.1"
interpreter.llm.model = "anyscale/codellama/CodeLlama-34b-Instruct-hf"

​
Required Environment Variables

Set the following environment variables (click here to learn how) to use these models.
Environment VariableDescriptionWhere to Find
ANYSCALE_API_KEYThe API key for your Anyscale account.Anyscale Account Settings