# BreezeApp **Repository Path**: github_syn/BreezeApp ## Basic Information - **Project Name**: BreezeApp - **Description**: No description available - **Primary Language**: Unknown - **License**: Apache-2.0 - **Default Branch**: main - **Homepage**: None - **GVP Project**: No ## Statistics - **Stars**: 0 - **Forks**: 0 - **Created**: 2025-12-12 - **Last Updated**: 2025-12-12 ## Categories & Tags **Categories**: Uncategorized **Tags**: None ## README # BreezeApp - AI on phone [![License: Pending](https://img.shields.io/badge/License-Pending-yellow.svg)](LICENSE) [![GitHub issues](https://img.shields.io/github/issues/mtkresearch/BreezeApp)](https://github.com/mtkresearch/BreezeApp/issues) [![Google Play](https://img.shields.io/badge/Google_Play-Coming_Soon-green.svg?style=flat&logo=google-play)](https://play.google.com) [![App Store](https://img.shields.io/badge/App_Store-Coming_Soon-blue.svg?style=flat&logo=app-store&logoColor=white)](https://apps.apple.com) English | [繁體中文](./docs/i18n/README_zh.md) ## πŸ”„ BreezeApp v2 Upgrade We have upgraded to **BreezeApp v2** with a new modular architecture using Git Submodules: - **[`BreezeApp-engine`](https://github.com/mtkresearch/BreezeApp-engine)** - Core AI engine (inference framework) - **[`BreezeApp-client`](https://github.com/mtkresearch/BreezeApp-client)** - Engineering app (demo and testing platform) - **`BreezeApp`** 🚧 **(Coming Soon)** - Production app (official consumer application) ### ✨ Key v2 Upgrade Features 1. **Modernized Codebase (Java β†’ Kotlin)** - Migrated the entire codebase from Java to Kotlin for improved readability, safety, and modern Android development practices. 2. **Modular Architecture: Decoupled AI Engine & UI** - Fully separated the AI inference engine from the user interface, enabling independent development, easier maintenance, and better scalability. 3. **EdgeAI SDK: Unified Developer-Friendly API** - Introduced the EdgeAI SDK with standardized APIs for integrating AI features (chat, speech, vision) into any application. > [!IMPORTANT] > **Migration Notice**: The legacy `breeze-app` directory is deprecated. All new features and development are implemented in the v2 modular architecture. ## Overview BreezeAPP is a mobile AI application developed for both Android and iOS platforms. Users can download it directly from the App Store and enjoy a variety of features offline, including speech-to-text, text-to-speech, text-based chatbot interactions, and image question-answering. Currently, BreezeApp defaults to the Breeze 2 series of models developed by MediaTek Research and we provide simple installation instructions for changing your backend to Llama 3.2 See the [Roadmap](/Roadmap.md) for additional planned integrations. This project aims to create a community-driven platform for running AI capabilities locally on Android devices. Our goal is to provide a privacy-focused solution where all AI features work completely offline (airplane mode supported), ensuring your data never leaves your device.

NPU Backend Demo CPU Backend Demo

Left: NPU Backend Right: CPU Backend

**Speech-to-Text** (In preparation) **Text-to-Speech**

Text-to-Speech Demo

## πŸ“§ Our Purpose of Open-Sourcing We are [MediaTek Research](https://i.mediatek.com/mediatekresearch), a member of the [AI Alliance](https://thealliance.ai/). Our main purpose for developing this application is to change the common perception that LLM capabilities can only be used on expensive devices and are limited by device providers. We aim to raise awareness and promote the concept that anyone can freely choose and run different LLMs on their phones. Another main purpose of developing this application is to eliminate the obstacles developers may face when creating mobile AI applications by open-sourcing our Kotlin source code. We hope to inspire developers to create more innovative mobile applications. If you are interested in BreezeApp, please contact us via [info@mtkresearch.com](info@mtkresearch.com) ## πŸš€ Quick Start ### πŸ“₯ Download & Try - **Latest Release**: [Download APK](https://huggingface.co/MediaTek-Research/BreezeApp/resolve/main/BreezeApp.apk) - **First Launch**: The app will automatically prompt you to download required AI models ### πŸ‘¨β€πŸ’» Developer Setup **Prerequisites**: Git with submodule support ```bash # Clone with submodules git clone --recursive https://github.com/mtkresearch/BreezeApp.git # Or initialize submodules after cloning git submodule update --init --recursive ``` πŸ“– **Detailed Instructions**: See our [Setup Guide](/docs/setup/installation.md) ### Working with Submodules This project uses Git Submodules for component management. See [Submodules Guide](/docs/setup/submodules.md) for detailed instructions on: - Initial setup and cloning - Updating submodules - Contributing to components - Troubleshooting ## ✨ Features ### πŸ€– AI Capabilities - πŸ’¬ **Chat**: Text-based conversational AI - πŸ—£οΈ **Voice**: Speech input/output support - πŸ‘οΈ **Vision**: Image understanding and Q&A - πŸ”’ **Privacy**: 100% offline operation (airplane mode supported) ### ⚑ Backend Support | Feature | CPU Backend | MediaTek NPU | Status | | ---------------------- |:-----------:|:------------:|:-------:| | **LLM Chat** | βœ… Ready | βœ… Ready | Stable | | **Vision (VLM)** | 🚧 Beta | ❌ Planned | Testing | | **Speech Recognition** | 🚧 Beta | ❌ Planned | Testing | | **Text-to-Speech** | βœ… Ready | ❌ Planned | Stable | **Legend**: βœ… Production Ready | 🚧 In Development | ❌ Planned ## πŸ” Project Structure ``` BreezeApp/ β”œβ”€β”€ BreezeApp-engine/ # πŸ”§ Core AI Engine (Git Submodule) β”œβ”€β”€ BreezeApp-client/ # πŸ“± Engineering/Demo App (Git Submodule) β”œβ”€β”€ BreezeApp/ # 🚧 Production App (Coming Soon) β”œβ”€β”€ docs/ # πŸ“š Documentation β”‚ β”œβ”€β”€ setup/ # Installation guides β”‚ β”œβ”€β”€ architecture/ # System design β”‚ β”œβ”€β”€ contributing/ # Contribution guidelines β”‚ └── i18n/ # Internationalization β”œβ”€β”€ assets/ # 🎨 Static resources └── legacy/ # ⚠️ Deprecated v1 code ``` ## 🀝 Contributing Contributions are welcome! See our [Contributing Guide](/docs/contributing/guidelines.md) to get started. ## πŸ“„ License The license for this project is pending determination - see the [LICENSE](/LICENSE) file for details. ## πŸ™ Acknowledgments - [Executorch](https://github.com/pytorch/executorch) for LLM/VLM framework - [k2-fsa/sherpa-onnx](https://github.com/k2-fsa/sherpa-onnx) for ASR/TTS capabilities - MediaTek Research for core AI engines ## πŸ”— Links - [Known Issues](https://github.com/mtkresearch/BreezeApp/issues) ## πŸ“§ We are [MediaTek Research](https://i.mediatek.com/mediatekresearch), a member of the [AI Alliance](https://thealliance.ai/). Contact us: [info@mtkresearch.com](info@mtkresearch.com) --- TWM Open Source Contributions Summary: - [fix: gradle failed due to ClassNotFoundException: org.gradle.wrapper.GradleWrapperMain](https://github.com/mtkresearch/BreezeApp/pull/89) - [fix: ClassCastException in MainActivity after closing the SettingsActivity](https://github.com/mtkresearch/BreezeApp/pull/99) - [Implement Instrumented Tests for LLMEngineService](https://github.com/mtkresearch/BreezeApp/pull/104) - [Implement Instrumented Tests for TTSEngineService, ASREngineService and VLMEngineService](https://github.com/mtkresearch/BreezeApp/pull/106) - [Code coverage report by unit test (Robolectric + Mockito) and instrumented test (JaCoCo) ](https://github.com/mtkresearch/BreezeApp/pull/107)