semantic-routing

Open‑WebUI Tools is a modular toolkit designed to extend and enrich your Open WebUI instance, turning it into a powerful AI workstation. With a suite of over 15 specialized tools, function pipelines, and filters, this project supports academic research, agentic autonomy, multimodal creativity, workflows, and more

Low latency, High Accuracy, Custom Query routers for Humans and Agents. Built by Prithivi Da

Zero trust LLM gateway. OpenAI-compatible proxy with semantic routing and load balancing across OpenAI, Anthropic, Ollama, vLLM, and any compatible backend. Identity-based access, virtual API keys, and end-to-end encryption via OpenZiti

A flexible and easy to use tool for Semantic Routing

Redis Vector Library (RedisVL) -- the AI-native Java client for Redis.

A self-hosted knowledge broker for homelabs. Routes and fuses queries across Kiwix, FreshRSS, Open-Meteo, SearXNG, Uptime Kuma, and Home Assistant — and tracks what changed over time. REST API and MCP server, integrates natively with Open WebUI and Home Assistant.

A comprehensive AI companion leveraging advanced semantic analysis, sentiment detection, and voice processing to provide personalized and context-aware interactions using Autogen, semantic-router, and VoiceProcessingToolkit.

Sentinel-Triage is a content moderation system that uses semantic routing to classify user-generated content and route it to the optimal AI model based on intent, risk level, and language.

🚀 MCP Gateway with Semantic Routing — One API for all your MCP tools. Natural language in → right tool executed. Blazing fast (Cerebras) + always reliable (multi-LLM fallback).

A high-throughput semantic routing engine for AI agents and LLM applications. Executes local intent classification using ONNX embeddings, FAISS indexing, and asynchronous micro-batching.

Open-source local-first AI assistant runtime with graph memory, semantic tool routing, markdown-governed tools, FastAPI/Next.js frontend surfaces, and verified tool calling.

A high-performance request router for vLLM — smart load balancing, response caching, prefill/decode disaggregation, semantic routing, Anthropic/OpenAI API translation, and operational tooling out of the box.

An Agentic Workflow built with LangGraph and LangChain that implements AI Orchestration via Conditional State Graphs, using Semantic Routing and Persistent Memory to deterministically triage user queries

UNIONAI Omega Infinity - public testnet of an open AI-agent federation layer (research initiative). DID-lite trust, memory anchoring, semantic routing, EU AI Act readiness (NOT certification/compliance). Under legal umbrella of Grass Roots Lobbing. Status: GO CONTROLLED / PUBLIC TESTNET.

SCGP reference implementation in Rust: compile large codebases into verified semantic graphs, deterministic glyphs, and token-budgeted AI context.

Lightweight, auditable intent router for LiteLLM and OpenAI-compatible model gateways.

面向生产环境的 AI Agent 动态技能网关与自进化底座：三层级联意图路由(R@1=98%)、8维沙箱评估、8重防御防线、LangGraph状态图旁路与SQLite原子发布状态机。

A multi-head classifier using SetFit for query preprocessing

Intent-aware KV execution prototype for agentic long-context inference: semantic block selection, dynamic scoring, KV quantization modeling, speculative prefetch simulation, CPU references, and future Triton/CUDA kernels.

Intelligent MCP router for AI subagents with config-driven rules and LLM semantic tagging