Skip to content

Request metadata extractor: in-flight tracking per model #374

Open
Task
#1630
Open
Request metadata extractor: in-flight tracking per model#374
Task
#1630
Assignees
crstrn13
Labels
triage/accepted
Milestone
v0.6.0

Description

@shaneutt
shaneutt
opened on Jul 15, 2026
  • Track in-flight request counts and token sums per model across requests
  • Increment count and add max_tokens on request start
  • Decrement both on response completion (floor at zero)
  • Write per-model metadata to the datastore for use by scorers (e.g. in-flight requests scorer)

Activity

  1. shaneutt
    added a parent issue on Jul 15, 2026
  2. github-project-automation
    added this to AI Gateway - Model Servingon Jul 15, 2026
  3. shaneutt
    added this to the v0.1.0 milestone on Jul 15, 2026
  4. github-project-automation
    moved this to Next in AI Gateway - Model Servingon Jul 15, 2026
  5. shaneutt
    added the
    Task
    issue type on Jul 15, 2026
  6. leseb
    modified the milestones: v0.1.0, v0.2.0 on Jul 23, 2026
  7. github-project-automation
    added this to Advanced Token-Based Rate-Limitingon Aug 20, 2026
  8. github-project-automation
    moved this to Todo in Advanced Token-Based Rate-Limitingon Aug 20, 2026
  9. shaneutt
    removed this from Advanced Token-Based Rate-Limitingand Advanced Token-Based Rate-Limitingon Aug 20, 2026
  10. github-project-automation
    added this to Advanced Token-Based Rate-Limitingon Aug 21, 2026
  11. github-project-automation
    moved this to Todo in Advanced Token-Based Rate-Limitingon Aug 21, 2026
  12. github-project-automation
    added this to Core Proxyon Aug 21, 2026
  13. github-project-automation
    moved this to Next in Core Proxyon Aug 21, 2026

  14. 15 remaining items

  15. praxis-bot-app
    removed
    triage/accepted
    on Sep 17, 2026
  16. leseb
    modified the milestones: v0.4.0, v0.5.0 on Sep 21, 2026
  17. praxis-bot-app
    added
    triage/accepted
    triage/needs-triage
    and removed
    triage/needs-triage
    triage/accepted
    on Sep 21, 2026
  18. leseb
    modified the milestones: v0.5.0, v0.6.0 on Sep 24, 2026
  19. praxis-bot-app
    added
    triage/accepted
    and removed
    triage/needs-triage
    on Sep 24, 2026
  20. crstrn13
    self-assigned this
    on Oct 1, 2026
  21. crstrn13
    added 3 commits that reference this issue on Oct 7, 2026

    feat(inflight): register filter, install registry, add example config (…

    7bcb11a

    feat(inflight): add in-flight per-model tracking filter (praxis-proxy…

    1c42981

    feat(inflight): register filter, install registry, add example config (…

    4514ea9
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

triage/accepted

Type

Task

Projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions