Documentation Index

Fetch the complete documentation index at: https://docs.openinterpreter.com/llms.txt

Use this file to discover all available pages before exploring further.

1. pip install vllm
2. Set the api_base flag:

interpreter --api_base <https://your-hosted-vllm-server>

3. Set the model flag:

interpreter --model vllm/<vllm-model>

​

Supported Models