Supported providers

Get API key

• AZURE_OPENAI_API_KEY: This is the API key to authenticate with Azure. See their docs to get the API key.

Specify base url

You can specify the base URL of the Azure OpenAI endpoint by setting either one of the following environment variables:

• AZURE_OPENAI_RESOURCE_NAME: This the resource name which is used to create the endpoint base URL with the format https://$AZURE_OPENAI_RESOURCE_NAME.openai.azure.com
• AZURE_OPENAI_BASE_URL: This is if you want to specify the entire base URL used to access the chat completions API with the format $AZURE_OPENAI_BASE_URL/openai/deployments/<model>/chat/completions. For example - https://some-custom-url.com

Model configuration

In the configuration file,

• Set the provider to azure-openai
• Set model to the name of your model deployment

Additional parameters

• By default, the api-version parameter is set to “2024-02-15-preview”. If you need to override this, set the apiVersion parameter

"runs": [
  {
    "type": "model",
    "provider": "azure-openai",
    "model": "gpt-35-deployment",
    "prompt": "Hey I'm {{user_name}}",
    "parameters": {
      "apiVersion": "2024-02-15-preview"
    }
  }
]

Get API key

The Google AI studio is the easiest way to get API keys. Once you have the key, set it as the GOOGLE_API_KEY environment variable.

Supported models

We support the Gemini model codes, as defined in the official docs.

• Gemini 1.5 Pro: set model to gemini-1.5-pro-latest
• Gemini 1 Pro: set model to gemini-pro or gemini-1.0-pro