For the complete documentation index, see llms.txt. Markdown versions of all docs pages are available by appending .md to any docs URL.

Configure VS Code Continue to use agentgateway running in Kubernetes

Configure Continue, the open-source AI code assistant for VS Code, to use agentgateway deployed in Kubernetes.

Before you begin

1. Set up an agentgateway proxy.
2. Set up access to the OpenAI LLM provider.

Get the gateway URL

export INGRESS_GW_ADDRESS=$(kubectl get svc -n agentgateway-system agentgateway-proxy \
  -o jsonpath="{.status.loadBalancer.ingress[0]['hostname','ip']}")

echo "Gateway address: $INGRESS_GW_ADDRESS"

kubectl port-forward -n agentgateway-system svc/agentgateway-proxy 8080:80

Configure Continue

1. Edit the ~/.continue/config.yaml file to add your agentgateway endpoint. If the file already has a models list, add the model to that list.
2. Replace <INGRESS_GW_ADDRESS> with your gateway address. Keep the /v1 path. This base URL needs the route from the OpenAI v1/chat/completions tab of the OpenAI provider guide, which forwards every path to the backend. The Custom route tab rewrites every request to /v1/chat/completions, so it does not work with clients that add their own path, such as /chat/completions.

name: agentgateway
version: 0.0.1
schema: v1
models:
  - name: agentgateway (Kubernetes)
    provider: openai
    model: gpt-4o-mini
    apiBase: http://<INGRESS_GW_ADDRESS>/v1
    apiKey: anything

Review the following table to understand this configuration.

Verify the connection

1. Open the Continue sidebar in VS Code (Cmd + L on macOS, Ctrl + L on Windows/Linux).
2. Select agentgateway (Kubernetes) from the model dropdown.
3. Send a test message to confirm the connection.