🤖 feat: add Cloudflare AI Gateway support #681
Closed
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Add support for routing AI requests through Cloudflare AI Gateway for caching, analytics, rate limiting, and cost control. Implementation: - Added cloudflareGateway config to ProviderConfig type with accountId and gatewayName fields - Updated aiService.ts to construct gateway URL when configured - Updated workspaceTitleGenerator.ts to use gateway baseURL - Gateway URL construction: https://gateway.ai.cloudflare.com/v1/{accountId}/{gatewayName}/{provider} - cloudflareGateway takes precedence over baseUrl when both present - Added helper function buildCloudflareGatewayURL() for URL construction - Updated providers.jsonc example comments with gateway configuration Documentation: - Created comprehensive docs/cloudflare-ai-gateway.md with setup, configuration, troubleshooting, and benefits - Added to docs/SUMMARY.md under Advanced section Configuration Example: { "anthropic": { "apiKey": "sk-ant-...", "cloudflareGateway": { "accountId": "your-account-id", "gatewayName": "your-gateway-name" } } } All providers (Anthropic, OpenAI, Google, etc.) are supported. Gateway is optional - omit config for direct connections. _Generated with `mux`_
_Generated with `mux`_
![chatgpt-codex-connector[bot]](https://avatars.githubusercontent.com/in/1144995?s=60&v=4){kind=small}
There was a problem hiding this comment.
💡 Codex Review
Here are some automated review suggestions for this pull request.
ℹ️ About Codex in GitHub
Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you
- Open a pull request for review
- Mark a draft as ready
- Comment "@codex review".
If Codex has suggestions, it will comment; otherwise it will react with 👍.
Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".
Updated regex to match /responses anywhere in path, not just /v1/responses.
This ensures truncation: auto is applied when routing through Cloudflare
gateway which uses paths like /v1/{account}/{gateway}/openai/responses.
Without this fix, large messages routed through Cloudflare gateway would
fail with 413 errors due to missing automatic truncation.
_Generated with `mux`_
Member
Author
|
This was just for a demo. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Add support for routing AI requests through Cloudflare AI Gateway for caching, analytics, rate limiting, and cost control.
Implementation
cloudflareGatewayconfig toProviderConfigtype withaccountIdandgatewayNamefieldsaiService.tsto construct gateway URL when configuredworkspaceTitleGenerator.tsto use gateway baseURLhttps://gateway.ai.cloudflare.com/v1/{accountId}/{gatewayName}/{provider}cloudflareGatewaytakes precedence overbaseUrlwhen both presentbuildCloudflareGatewayURL()for URL constructionproviders.jsoncexample comments with gateway configurationDocumentation
docs/cloudflare-ai-gateway.mdwith setup, configuration, troubleshooting, and benefitsdocs/SUMMARY.mdunder Advanced sectionConfiguration Example
{ "anthropic": { "apiKey": "sk-ant-...", "cloudflareGateway": { "accountId": "your-account-id", "gatewayName": "your-gateway-name" } } }All providers (Anthropic, OpenAI, Google, etc.) are supported. Gateway is optional - omit config for direct connections.
Benefits
Generated with
mux