To use Open Interpreter with a model from Petals, set the model flag to begin with petals/:

interpreter --model petals/petals-team/StableBeluga2

Pre-Requisites

Ensure you have petals installed:

Terminal

pip install git+https://github.com/bigscience-workshop/petals

Supported Models

We support any model on Petals:

interpreter --model petals/petals-team/StableBeluga2
interpreter --model petals/huggyllama/llama-65b

No environment variables are required to use these models.