> ## Documentation Index
> Fetch the complete documentation index at: https://docs.openinterpreter.com/llms.txt
> Use this file to discover all available pages before exploring further.

# vLLM

To use Open Interpreter with vLLM, you will need to:

1. `pip install vllm`
2. Set the api\_base flag:

<CodeGroup>
  ```bash Terminal theme={null}
  interpreter --api_base <https://your-hosted-vllm-server>
  ```

  ```python Python theme={null}
  from interpreter import interpreter

  interpreter.llm.api_base = "<https://your-hosted-vllm-server>"
  interpreter.chat()
  ```
</CodeGroup>

3. Set the `model` flag:

<CodeGroup>
  ```bash Terminal theme={null}
  interpreter --model vllm/<vllm-model>
  ```

  ```python Python theme={null}
  from interpreter import interpreter

  interpreter.llm.model = "vllm/<vllm-model>"
  interpreter.chat()
  ```
</CodeGroup>

# Supported Models

All models from VLLM should be supported