Skip to content

gen-ai-proxy 0.9.0

Latest

Choose a tag to compare

@Tafeen Tafeen released this 20 Jul 17:10
· 6 commits to master since this release
  • Track token usage per model/provider
  • Exposes Prometheus metrics - ready for Grafana dashboards
  • Supports OpenAI-compatible endpoints
  • Multiple models/providers per user
  • API-key base auth
  • full Docker-compose deployment