To use Open Interpreter with vLLM, you will need to:

1. pip install vllm
2. Set the api_base flag:

3. Set the model flag:

​

Supported Models

All models from VLLM should be supported