model
flag:
Supported Models
We support the following completion models from Anyscale:- Llama 2 7B Chat
- Llama 2 13B Chat
- Llama 2 70B Chat
- Mistral 7B Instruct
- CodeLlama 34b Instruct
Required Environment Variables
Set the following environment variables (click here to learn how) to use these models.Environment Variable | Description | Where to Find |
---|---|---|
ANYSCALE_API_KEY | The API key for your Anyscale account. | Anyscale Account Settings |