English | 繁體中文
Ready to build the future of on-device AI on Android? You're in the right place!
BreezeApp Engine is a next-generation framework for creating powerful, modular, and extensible AI-driven experiences. It's built with a focus on type safety, modern Android practices, and a great developer experience.
BreezeApp-engine
:v0.1.1
EdgeAI
:v0.1.7
The most important part of this project is the android/breeze-app-engine
.
Think of it as a powerful, "headless" AI Brain for Android. It runs as a background service, completely separate from any user interface. Its sole purpose is to manage, execute, and serve AI capabilities (like text generation, speech recognition, etc.) to any application that needs them.
By decoupling the complex AI logic from the UI, we empower app developers to add sophisticated AI features with minimal effort.
At runtime, your app (the client) sends an AIRequest
to the engine. The engine processes it and responds with an AIResponse
. This interaction is completely decoupled from UI logic.
%%{init: {'flowchart': {'useMaxWidth': false, 'width': 800}}}%%
graph TD
A["📱 Client App<br/>(breeze-app-client)"]
B["🧠 AI Engine<br/>(breeze-app-engine)"]
A -- "Send AIRequest<br>(e.g. EdgeAI.chat/EdgeAI.tts/EdgeAI.asr)" --> B
B -- "Return AIResponse" --> A
style A fill:#E8F5E9,stroke:#4CAF50
style B fill:#E3F2FD,stroke:#2196F3
This clean separation allows the engine to remain UI-agnostic and service-oriented.
BreezeApp Engine integrates with multiple AI providers, each bringing unique capabilities:
Provider | Type | LLM | VLM | ASR | TTS | Guardian | Streaming |
---|---|---|---|---|---|---|---|
MediaTek | Local NPU | ✅ | 🚧 | ❌ | ❌ | ❌ | ✅ |
ExecuTorch | Local | ✅ | 🚧 | ❌ | ❌ | ❌ | ✅ |
LlamaStack | Remote | ✅ | ✅ | ❌ | ❌ | ✅ | ❌* |
OpenRouter | Remote | ✅ | ✅ | ❌ | ❌ | ❌ | ✅ |
Sherpa | Local | ❌ | ❌ | ✅ | ✅ | ❌ | ✅ |
Legend: ✅ Supported | 🚧 Experimental | ❌ Not Supported
*Note: LlamaStack streaming is not yet supported by the official SDK. Falls back to non-streaming mode.
For detailed technical implementation, see Engine Architecture →
Your path depends on your goal. Are you building an app with the engine, or building a new feature for the engine?
If you want to add AI features to your Android app, this is your path.
- Start Here: Our BreezeApp Client Guide is the best place to begin. It provides a step-by-step tutorial on how to integrate the
EdgeAI
SDK and make your first API call. - Explore the API: The
EdgeAI
SDK is the public API for the engine. You can explore its features and data models in the EdgeAI README.
If you want to add a new model or AI capability to the engine itself.
- Understand the Design: The Architecture Guide explains the internal design of the engine and how all the pieces fit together.
- Build a Runner: Follow the Runner Development Guide to learn how to implement a new
Runner
that can be discovered by the engine.
Whether you're fixing a bug, improving the docs, or adding a revolutionary new runner, we welcome your contributions!
- Contribution Guidelines: Please read our Contributing Guide.
- Have Questions? Don't hesitate to open an issue! We're happy to help.