Skip to content

Commit 81fdc3b

Browse files
committed
docs: document session ingestion tradeoffs
1 parent e2fa16b commit 81fdc3b

2 files changed

Lines changed: 15 additions & 1 deletion

File tree

docs/INTEGRATION.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -179,6 +179,8 @@ printf '%s\n' '{"jsonrpc":"2.0","id":"schema","method":"mge_schema","params":{}}
179179
- optional `max_bytes`, default `4096`
180180
- the same kind/scope/trust/status/sensitivity/passphrase fields as `mge_remember`
181181

182+
The default eight-turn chunk is the quality-first setting. Local strict top-5 LoCoMo adapter measurements found four turns to be a useful token/quality knee for compact conversational context. Hosts can set `max_turns: 4` when context budget matters more; this is workload guidance, not a universal replacement for the default.
183+
182184
`mge_recall` input:
183185

184186
- `store_path`

docs/RELEASE.md

Lines changed: 13 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -300,7 +300,7 @@ cargo run --locked --release --manifest-path tools/agent-memory-eval/Cargo.toml
300300

301301
cargo run --locked --release --manifest-path tools/agent-memory-eval/Cargo.toml -- \
302302
--input <locomo10.json> --input-format locomo \
303-
--top-k 5 --repeats 1 --index both --modes focused-broad \
303+
--ingest-mode raw-turn --top-k 5 --repeats 1 --index both --modes focused-broad \
304304
--baselines bm25 --output json --report <REPORT.json>
305305
```
306306

@@ -324,6 +324,18 @@ LoCoMo converted into 5,881 memories and 1,977 evidence-bearing queries; nine qu
324324
| MGE BinaryFuse sealed | broad | 0.544 | 0.499 | 0.402 | 0.411 |
325325
| Eval-only BM25 | focused | 0.545 | 0.499 | 0.415 | 0.421 |
326326

327+
The LoCoMo adapter also measures ingestion granularity with the production session chunker. On the same file and strict focused top-5 run, the local trade-off was:
328+
329+
| Ingestion | Memories | Hit@5 | Recall@5 | MRR@5 | nDCG@5 | Average context tokens |
330+
|---|---:|---:|---:|---:|---:|---:|
331+
| Raw turn | 5,881 | 0.533 | 0.489 | 0.393 | 0.402 | 295 |
332+
| Session chunk, 2 turns | 3,010 | 0.626 | 0.574 | 0.488 | 0.492 | 462 |
333+
| Session chunk, 4 turns | 1,570 | 0.737 | 0.686 | 0.575 | 0.586 | 788 |
334+
| Session chunk, 8 turns | 848 | 0.797 | 0.747 | 0.640 | 0.649 | 1,407 |
335+
| Whole session | 272 | 0.861 | 0.810 | 0.698 | 0.710 | 3,715 |
336+
337+
This is a granularity trade-off inside MGE, not a competitor comparison. Whole-session ingestion scores highest but returns much larger context. Four-turn chunks are the measured compact recommendation; the production default remains eight turns because it preserves the quality-first behavior. Override it in the eval harness with `--session-chunk-max-turns 4`; `--session-chunk-max-bytes` controls the independent byte cap.
338+
327339
LongMemEval-S converted into 85,253 session chunks and 500 queries:
328340

329341
| Retrieval path | Mode | Hit@5 | Recall@5 | MRR@5 | nDCG@5 |

0 commit comments

Comments
 (0)