Cloudflare

Configure Cloudflare Workers AI with Continue to access various models for chat and autocomplete, including Llama 3 8B and DeepSeek Coder through Cloudflare's serverless AI platform

Cloudflare Workers AI can be used for both chat and tab autocompletion in Continue. Here is an example of Cloudflare Workers AI configuration:

name: My Config
version: 0.0.1
schema: v1

models:
  - name: Llama 3 8B
    provider: cloudflare
    apiKey: <YOUR_CLOUDFARE_API_KEY>
    model: "@cf/meta/llama-3-8b-instruct"
    contextLength: 2400
    defaultCompletionOptions:
      maxTokens: 500
    roles:
      - chat
    env:
      accountId: YOUR CLOUDFLARE ACCOUNT ID 
  - name: DeepSeek Coder 6.7b Instruct
    provider: cloudflare
    apiKey: <YOUR_CLOUDFARE_API_KEY>
    model: "@hf/thebloke/deepseek-coder-6.7b-instruct-awq"
    contextLength: 2400
    defaultCompletionOptions:
      maxTokens: 500
    roles:
      - chat
    env:
      accountId: YOUR CLOUDFLARE ACCOUNT ID
  - name: DeepSeek 7b
    provider: cloudflare
    apiKey: <YOUR_CLOUDFARE_API_KEY>
    model: "@hf/thebloke/deepseek-coder-6.7b-base-awq"
    roles:
      - autocomplete
    env:
      accountId: YOUR CLOUDFLARE ACCOUNT ID

Visit the Cloudflare dashboard to create an API key.

Review available models on Workers AI

View the source