To use Open Interpreter with a model from Anyscale, set the model flag:

Supported Models

We support the following completion models from Anyscale:

  • Llama 2 7B Chat
  • Llama 2 13B Chat
  • Llama 2 70B Chat
  • Mistral 7B Instruct
  • CodeLlama 34b Instruct

Required Environment Variables

Set the following environment variables (click here to learn how) to use these models.

Environment VariableDescriptionWhere to Find
ANYSCALE_API_KEYThe API key for your Anyscale account.Anyscale Account Settings