Qualcomm® AI Hub Apps

The Qualcomm® AI Hub Apps are a collection of sample apps and tutorials to help deploy machine learning models on Qualcomm® devices.

Each app is designed to work with one or more models from Qualcomm® AI Hub Models.

With this repository, you can...

• Explore apps optimized for on-device deployment of various machine learning tasks.
• View open-source app recipes for running Qualcomm® AI Hub Models on local devices.
• Find tutorials for end-to-end workflows.

Overview

Supported runtimes

• TensorFlow Lite
• ONNX
• Genie SDK (Generative AI runtime on top of Qualcomm® AI Engine Direct SDK)

Supported Deployment Targets

• Android 11 Red Velvet Cake & Newer, API v30+
• Windows 11
• Ubuntu 24.04+

Supported compute units

• CPU, GPU, NPU (includes hexagon HTP)

Chipsets supported for NPU Acceleration

• Snapdragon X2 Elite
• Snapdragon X Elite
• Snapdragon 8 Elite Gen 5
• Snapdragon 8 Elite
• Snapdragon 8 Gen 3
• Snapdragon 8 Gen 2
• ... and all other Snapdragon® chipsets supported by the QAIRT SDK

Weight and activation type required for NPU Acceleration:

• Floating Point: FP16 (All Snapdragon® chipsets with Hexagon® Architecture v69 or newer)
• Integer : INT8 or INT16 (All Snapdragon® chipsets)

NOTE: Some of these apps will run without NPU acceleration on non-Snapdragon® chipsets.

Getting Started with Apps

1. Search for your desired OS & app in the tables below.

2. The README of the selected app will contain build & installation instructions.

Contributors: See CONTRIBUTING.md for dev setup, repo architecture, and how to add new apps.

Android App Directory

Windows App Directory

Ubuntu App Directory

* Source available on GitHub; not included in the CLI release.

Tutorials Directory

LICENSE

Qualcomm® AI Hub Apps is licensed under BSD-3. See the LICENSE file.