To use Open Interpreter with DeepInfra, set the model flag:

Supported Models

We support the following completion models from DeepInfra:

  • Llama-2 70b chat hf
  • Llama-2 7b chat hf
  • Llama-2 13b chat hf
  • CodeLlama 34b instruct awq
  • Mistral 7b instruct v0.1
  • jondurbin/airoboros I2 70b gpt3 1.4.1

Required Environment Variables

Set the following environment variables (click here to learn how) to use these models.

Environment VariableDescriptionWhere to Find
DEEPINFRA_API_KEY'DeepInfra API keyDeepInfra Dashboard -> API Keys