Skip to content

Commit 6397f0e

Browse files
authored
prompt caching docs; and edge out of alpha (#7056)
1 parent 8867280 commit 6397f0e

10 files changed

Lines changed: 489 additions & 25 deletions

File tree

docs/deployment-guides/config-json/providers.mdx

Lines changed: 8 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -67,6 +67,14 @@ Concurrency and buffering per provider:
6767
| `concurrency_and_buffer_size.concurrency` | integer | Max concurrent requests to this provider |
6868
| `concurrency_and_buffer_size.buffer_size` | integer | Request queue depth |
6969

70+
Prompt-cache breakpoint injection per provider (see [Auto Prompt Caching](/features/prompt-caching)):
71+
72+
| Field | Type | Description |
73+
|-------|------|-------------|
74+
| `prompt_cache.auto_inject` | boolean | Mark the first cacheable block when the caller sent no cache markers. Off by default |
75+
| `prompt_cache.ttl` | string | Lifetime for injected markers. Only `"1h"` is accepted; omit for the provider default |
76+
| `prompt_cache.cache_control_injection_points` | array | Target specific messages by `role` and/or `index`. Replaces the first-block strategy when set |
77+
7078
---
7179

7280
<Tabs>

docs/deployment-guides/config-json/storage.mdx

Lines changed: 0 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -135,10 +135,6 @@ This is the recommended setup for [multinode OSS deployments](/deployment-guides
135135

136136
Use `client.hidden_request_types` to hide selected request types from dashboard and log API reads while continuing to store their logs. The same setting is editable in the UI under **Logs Settings**. See [Hiding request types from the dashboard](/architecture/framework/log-store#hiding-request-types-from-the-dashboard) for configuration examples and behavior.
137137

138-
<Tabs>
139-
140-
<Tab title="SQLite">
141-
142138
### SQLite
143139

144140
```json

docs/edge/overview.mdx

Lines changed: 0 additions & 18 deletions
Original file line numberDiff line numberDiff line change
@@ -8,24 +8,6 @@ icon: "globe"
88
<img src="/media/edge/edge-hero.png" alt="Bifrost edge"/>
99
</Frame>
1010

11-
<Tip>
12-
**Bifrost Edge is in alpha.** Be among the first to bring AI on every computer of your organization under governance. Register below and our team will reach out to onboard you.
13-
14-
<button
15-
data-tally-open="aQzaGb"
16-
data-tally-layout="modal"
17-
data-tally-width="700"
18-
data-tally-hide-title="1"
19-
data-tally-transparent-background="1"
20-
className="not-prose mt-2 inline-flex cursor-pointer items-center gap-2 rounded-lg border-0 bg-[rgb(var(--primary-dark))] px-5 py-2.5 text-sm font-semibold text-white no-underline transition-opacity hover:opacity-90"
21-
>
22-
Register for Alpha
23-
<svg width="14" height="14" viewBox="0 0 16 16" fill="none" xmlns="http://www.w3.org/2000/svg" aria-hidden="true">
24-
<path d="M3 8h10M9 4l4 4-4 4" stroke="currentColor" strokeWidth="1.5" strokeLinecap="round" strokeLinejoin="round" />
25-
</svg>
26-
</button>
27-
</Tip>
28-
2911
---
3012

3113
Bifrost Edge extends your AI gateway all the way to the endpoint. Instead of relying on every user to point their tools at Bifrost, Edge runs quietly on each machine and brings **all** AI traffic under governance automatically: desktop chat apps, AI in the browser, coding agents in the terminal and IDE, and the MCP servers those tools connect to. Your existing virtual keys, budgets, audit logs, and guardrails now apply to the AI people actually use, not just the traffic that happened to be configured.

0 commit comments

Comments
 (0)