To use Open Interpreter with Baseten, set the model flag:

interpreter --model baseten/<baseten-model>

Supported Models

We support the following completion models from Baseten:

  • Falcon 7b (qvv0xeq)
  • Wizard LM (q841o8w)
  • MPT 7b Base (31dxrj3)

interpreter --model baseten/qvv0xeq
interpreter --model baseten/q841o8w
interpreter --model baseten/31dxrj3

Required Environment Variables

Set the following environment variables (click here to learn how) to use these models.

Environment VariableDescriptionWhere to Find
BASETEN_API_KEY’`Baseten API keyBaseten Dashboard -> Settings -> Account -> API Keys