To use Open Interpreter with a model from Anyscale, set the model flag:

interpreter --model anyscale/<model-name>

​
Supported Models

We support the following completion models from Anyscale:

  • Llama 2 7B Chat
  • Llama 2 13B Chat
  • Llama 2 70B Chat
  • Mistral 7B Instruct
  • CodeLlama 34b Instruct
interpreter --model anyscale/meta-llama/Llama-2-7b-chat-hf
interpreter --model anyscale/meta-llama/Llama-2-13b-chat-hf
interpreter --model anyscale/meta-llama/Llama-2-70b-chat-hf
interpreter --model anyscale/mistralai/Mistral-7B-Instruct-v0.1
interpreter --model anyscale/codellama/CodeLlama-34b-Instruct-hf

​
Required Environment Variables

Set the following environment variables (click here to learn how) to use these models.

Environment VariableDescriptionWhere to Find
ANYSCALE_API_KEYThe API key for your Anyscale account.Anyscale Account Settings
AnthropicAWS Sagemaker