Out-of-the-Box AI Model Deployment Pipelines and Full-Link Conversion Tutorials Based on D-Robotics BPU
English | 简体中文
Mission: Dedicated to providing D-Robotics developers with extreme performance, out-of-the-box, and full-scenario AI deployment validation experiences.
This repository is the official collection of BPU model examples and tools (Model Zoo) provided by D-Robotics. It is oriented towards AI model deployment and application development on BPU (Brain Processing Unit), helping developers to quickly get started with BPU and fast-track model inference workflows.
The repository includes BPU-ready models across multiple AI domains and provides complete reference implementations from Original Model (PyTorch/ONNX) -> Fixed-point Quantization -> Inference Execution -> Result Parsing -> Example Validation, helping users understand and utilize BPU capabilities at minimal cost.
.bin / .hbm). Includes model loading, preprocessing, BPU inference execution, post-processing, and result visualization.hbm_runtime) and C/C++ interfaces for easy understanding, secondary development, and reduced integration/maintenance costs.This repository uses hardware-specific branches to keep maintained samples, legacy demos, and board-specific documents clearly separated. The current rdk_x5 branch is the primary delivery branch for RDK X5. The previous main branch has been renamed to rdk_x5_legacy and is kept only as the historical archive branch.
| Target Hardware | Branch | Description |
|---|---|---|
| RDK X5 | rdk_x5 | Primary delivery branch for RDK X5. Recommended system version: RDK OS >= 3.5.0, based on Ubuntu 22.04 aarch64 and TROS-Humble. |
| RDK X5 legacy demos | rdk_x5_legacy | Historical archive branch for the previous RDK X5 demos. Use it only when you need to reference legacy demo content. |
| RDK X3 | rdk_x3 | Branch for RDK X3 devices. |
| RDK S series | rdk_s | Branch for RDK S series boards. Historical archived demos for RDK S series boards are kept in RDK Model Zoo S. |
Browse the online model catalog →
The online catalog presents released models as searchable cards with model assets, measured performance and accuracy results, and their documented test conditions.
rdk_model_zoo/
|-- samples/
| |-- robotics/
| | `-- himloco/ # Unitree Go2 locomotion policy
| |-- vision/
| | |-- clip/ # Image-text multimodal matching
| | |-- convnext/ # Image classification
| | |-- edgenext/ # Image classification
| | |-- efficientformer/ # Image classification
| | |-- efficientformerv2/ # Image classification
| | |-- efficient_sam/ # Promptable image segmentation
| | |-- mobile_sam/ # Promptable image segmentation
| | |-- efficientnet/ # Image classification
| | |-- efficientvit/ # Image classification
| | |-- fasternet/ # Image classification
| | |-- fastvit/ # Image classification
| | |-- fcos/ # Object detection
| | |-- googlenet/ # Image classification
| | |-- hgnetv2/ # Image classification
| | |-- lprnet/ # License plate recognition
| | |-- mobilenetv1/ # Image classification
| | |-- mobilenetv2/ # Image classification
| | |-- mobilenetv3/ # Image classification
| | |-- mobilenetv4/ # Image classification
| | |-- mobileone/ # Image classification
| | |-- modnet/ # Image matting
| | |-- paddleocr/ # OCR text detection and recognition
| | |-- pp_liteseg/ # Semantic segmentation
| | |-- repghost/ # Image classification
| | |-- repvgg/ # Image classification
| | |-- repvit/ # Image classification
| | |-- resnet/ # Image classification
| | |-- resnext/ # Image classification
| | |-- unet/ # Semantic segmentation
| | |-- ultralytics_yolo/ # Detection, segmentation, pose, classification
| | |-- ultralytics_yolo26/ # Detection, segmentation, pose, classification
| | |-- vargconvnet/ # Image classification
| | |-- yolo26_depth/ # Monocular depth estimation
| | |-- yolov5/ # Object detection
| | `-- yoloworld/ # Open-vocabulary object detection
|-- docs/ # Project guidelines and reference documentation
| `-- tros/ # TROS integration guides and examples
|-- datasets/ # Sample datasets and download scripts
|-- skills/ # RDK Model Zoo skills (placeholder)
|-- utils/ # Shared C++ / Python utilities
RDK OS >= 3.5.0.README.md before running commands.cd samples/vision/ultralytics_yolo/model
wget -nc https://archive.d-robotics.cc/downloads/rdk_model_zoo/rdk_x5/ultralytics_YOLO/yolo11x_detect_bayese_640x640_nv12.bin
cd ../runtime/python
python3 main.py \
--task detect \
--model-path ../../model/yolo11x_detect_bayese_640x640_nv12.bin \
--test-img ../../../../../datasets/coco/assets/bus.jpg \
--img-save-path ../../test_data/inference_yolo11x.jpg
Inference Result:
| Category | Model Name | Model Path | Supported Platform | Details |
|---|---|---|---|---|
| Image Classification | ConvNeXt | samples/vision/convnext | RDK X5 | Details |
| Image Classification | EdgeNeXt | samples/vision/edgenext | RDK X5 | Details |
| Image Classification | EfficientFormer | samples/vision/efficientformer | RDK X5 | Details |
| Image Classification | EfficientFormerV2 | samples/vision/efficientformerv2 | RDK X5 | Details |
| Image Classification | EfficientNet | samples/vision/efficientnet | RDK X5 | Details |
| Image Classification | EfficientViT | samples/vision/efficientvit | RDK X5 | Details |
| Image Classification | FasterNet | samples/vision/fasternet | RDK X5 | Details |
| Image Classification | FastViT | samples/vision/fastvit | RDK X5 | Details |
| Image Classification | GoogLeNet | samples/vision/googlenet | RDK X5 | Details |
| Image Classification | HGNetV2 | samples/vision/hgnetv2 | RDK X5 | Details |
| Image Classification | MobileNetV1 | samples/vision/mobilenetv1 | RDK X5 | Details |
| Image Classification | MobileNetV2 | samples/vision/mobilenetv2 | RDK X5 | Details |
| Image Classification | MobileNetV3 | samples/vision/mobilenetv3 | RDK X5 | Details |
| Image Classification | MobileNetV4 | samples/vision/mobilenetv4 | RDK X5 | Details |
| Image Classification | MobileOne | samples/vision/mobileone | RDK X5 | Details |
| Image Classification | RepGhost | samples/vision/repghost | RDK X5 | Details |
| Image Classification | RepVGG | samples/vision/repvgg | RDK X5 | Details |
| Image Classification | RepViT | samples/vision/repvit | RDK X5 | Details |
| Image Classification | ResNet | samples/vision/resnet | RDK X5 | Details |
| Image Classification | ResNeXt | samples/vision/resnext | RDK X5 | Details |
| Image Classification | VargConvNet | samples/vision/vargconvnet | RDK X5 | Details |
| Promptable Image Segmentation | EfficientSAM-Tiny | samples/vision/efficient_sam | RDK X5 | Details |
| Promptable Image Segmentation | MobileSAM | samples/vision/mobile_sam | RDK X5 | Details |
| Semantic Segmentation | PP-LiteSeg | samples/vision/pp_liteseg | RDK X5 | Details |
| Semantic Segmentation | UNet ResNet Family | samples/vision/unet | RDK X5 | Details |
| Object Detection | FCOS | samples/vision/fcos | RDK X5 | Details |
| Object Detection | YOLOv5 | samples/vision/yolov5 | RDK X5 | Details |
| Object Detection / Instance Segmentation / Pose Estimation / Image Classification | Ultralytics YOLO (YOLOv5u / YOLOv8 / YOLOv9 / YOLOv10 / YOLO11 / YOLO12 / YOLO13) | samples/vision/ultralytics_yolo | RDK X5 | Details |
| Object Detection / Instance Segmentation / Pose Estimation / Image Classification | Ultralytics YOLO26 | samples/vision/ultralytics_yolo26 | RDK X5 | Details |
| Monocular Depth Estimation | YOLO26 Depth | samples/vision/yolo26_depth | RDK X5 | Details |
| Image Matting | MODNet | samples/vision/modnet | RDK X5 | Details |
| OCR Text Detection and Recognition | PaddleOCR | samples/vision/paddleocr | RDK X5 | Details |
| License Plate Recognition | LPRNet | samples/vision/lprnet | RDK X5 | Details |
| Image-Text Multimodal Matching | CLIP | samples/vision/clip | RDK X5 | Details |
| Open-Vocabulary Object Detection | YOLOWorld | samples/vision/yoloworld | RDK X5 | Details |
| Legged Locomotion | HIMLoco (Unitree Go2) | samples/robotics/himloco | RDK X5 | Details |
README.md provides an overview and run guide.libdnn.so versions are up-to-date.Update the resolution in preprocess.py to match your ONNX model's input size. Delete old calibration data and re-run the calibration script.
pycocotools).Yes. Non-quantizable or BPU-unsupported operators fallback to CPU. Even for pure BPU models, input/output quantization/dequantization nodes are executed by the CPU.
We warmly welcome contributions! Please raise an issue on GitHub Issues or discuss on the Developer Community.
This project is licensed under the Apache License 2.0 agreement.
Python
99.3%
Out-of-the-Box AI Model Deployment Pipelines and Full-Link Conversion Tutorials Based on D-Robotics BPU
English | 简体中文
Mission: Dedicated to providing D-Robotics developers with extreme performance, out-of-the-box, and full-scenario AI deployment validation experiences.
This repository is the official collection of BPU model examples and tools (Model Zoo) provided by D-Robotics. It is oriented towards AI model deployment and application development on BPU (Brain Processing Unit), helping developers to quickly get started with BPU and fast-track model inference workflows.
The repository includes BPU-ready models across multiple AI domains and provides complete reference implementations from Original Model (PyTorch/ONNX) -> Fixed-point Quantization -> Inference Execution -> Result Parsing -> Example Validation, helping users understand and utilize BPU capabilities at minimal cost.
.bin / .hbm). Includes model loading, preprocessing, BPU inference execution, post-processing, and result visualization.hbm_runtime) and C/C++ interfaces for easy understanding, secondary development, and reduced integration/maintenance costs.This repository uses hardware-specific branches to keep maintained samples, legacy demos, and board-specific documents clearly separated. The current rdk_x5 branch is the primary delivery branch for RDK X5. The previous main branch has been renamed to rdk_x5_legacy and is kept only as the historical archive branch.
| Target Hardware | Branch | Description |
|---|---|---|
| RDK X5 | rdk_x5 | Primary delivery branch for RDK X5. Recommended system version: RDK OS >= 3.5.0, based on Ubuntu 22.04 aarch64 and TROS-Humble. |
| RDK X5 legacy demos | rdk_x5_legacy | Historical archive branch for the previous RDK X5 demos. Use it only when you need to reference legacy demo content. |
| RDK X3 | rdk_x3 | Branch for RDK X3 devices. |
| RDK S series | rdk_s | Branch for RDK S series boards. Historical archived demos for RDK S series boards are kept in RDK Model Zoo S. |
Browse the online model catalog →
The online catalog presents released models as searchable cards with model assets, measured performance and accuracy results, and their documented test conditions.
rdk_model_zoo/
|-- samples/
| |-- robotics/
| | `-- himloco/ # Unitree Go2 locomotion policy
| |-- vision/
| | |-- clip/ # Image-text multimodal matching
| | |-- convnext/ # Image classification
| | |-- edgenext/ # Image classification
| | |-- efficientformer/ # Image classification
| | |-- efficientformerv2/ # Image classification
| | |-- efficient_sam/ # Promptable image segmentation
| | |-- mobile_sam/ # Promptable image segmentation
| | |-- efficientnet/ # Image classification
| | |-- efficientvit/ # Image classification
| | |-- fasternet/ # Image classification
| | |-- fastvit/ # Image classification
| | |-- fcos/ # Object detection
| | |-- googlenet/ # Image classification
| | |-- hgnetv2/ # Image classification
| | |-- lprnet/ # License plate recognition
| | |-- mobilenetv1/ # Image classification
| | |-- mobilenetv2/ # Image classification
| | |-- mobilenetv3/ # Image classification
| | |-- mobilenetv4/ # Image classification
| | |-- mobileone/ # Image classification
| | |-- modnet/ # Image matting
| | |-- paddleocr/ # OCR text detection and recognition
| | |-- pp_liteseg/ # Semantic segmentation
| | |-- repghost/ # Image classification
| | |-- repvgg/ # Image classification
| | |-- repvit/ # Image classification
| | |-- resnet/ # Image classification
| | |-- resnext/ # Image classification
| | |-- unet/ # Semantic segmentation
| | |-- ultralytics_yolo/ # Detection, segmentation, pose, classification
| | |-- ultralytics_yolo26/ # Detection, segmentation, pose, classification
| | |-- vargconvnet/ # Image classification
| | |-- yolo26_depth/ # Monocular depth estimation
| | |-- yolov5/ # Object detection
| | `-- yoloworld/ # Open-vocabulary object detection
|-- docs/ # Project guidelines and reference documentation
| `-- tros/ # TROS integration guides and examples
|-- datasets/ # Sample datasets and download scripts
|-- skills/ # RDK Model Zoo skills (placeholder)
|-- utils/ # Shared C++ / Python utilities
RDK OS >= 3.5.0.README.md before running commands.cd samples/vision/ultralytics_yolo/model
wget -nc https://archive.d-robotics.cc/downloads/rdk_model_zoo/rdk_x5/ultralytics_YOLO/yolo11x_detect_bayese_640x640_nv12.bin
cd ../runtime/python
python3 main.py \
--task detect \
--model-path ../../model/yolo11x_detect_bayese_640x640_nv12.bin \
--test-img ../../../../../datasets/coco/assets/bus.jpg \
--img-save-path ../../test_data/inference_yolo11x.jpg
Inference Result:
| Category | Model Name | Model Path | Supported Platform | Details |
|---|---|---|---|---|
| Image Classification | ConvNeXt | samples/vision/convnext | RDK X5 | Details |
| Image Classification | EdgeNeXt | samples/vision/edgenext | RDK X5 | Details |
| Image Classification | EfficientFormer | samples/vision/efficientformer | RDK X5 | Details |
| Image Classification | EfficientFormerV2 | samples/vision/efficientformerv2 | RDK X5 | Details |
| Image Classification | EfficientNet | samples/vision/efficientnet | RDK X5 | Details |
| Image Classification | EfficientViT | samples/vision/efficientvit | RDK X5 | Details |
| Image Classification | FasterNet | samples/vision/fasternet | RDK X5 | Details |
| Image Classification | FastViT | samples/vision/fastvit | RDK X5 | Details |
| Image Classification | GoogLeNet | samples/vision/googlenet | RDK X5 | Details |
| Image Classification | HGNetV2 | samples/vision/hgnetv2 | RDK X5 | Details |
| Image Classification | MobileNetV1 | samples/vision/mobilenetv1 | RDK X5 | Details |
| Image Classification | MobileNetV2 | samples/vision/mobilenetv2 | RDK X5 | Details |
| Image Classification | MobileNetV3 | samples/vision/mobilenetv3 | RDK X5 | Details |
| Image Classification | MobileNetV4 | samples/vision/mobilenetv4 | RDK X5 | Details |
| Image Classification | MobileOne | samples/vision/mobileone | RDK X5 | Details |
| Image Classification | RepGhost | samples/vision/repghost | RDK X5 | Details |
| Image Classification | RepVGG | samples/vision/repvgg | RDK X5 | Details |
| Image Classification | RepViT | samples/vision/repvit | RDK X5 | Details |
| Image Classification | ResNet | samples/vision/resnet | RDK X5 | Details |
| Image Classification | ResNeXt | samples/vision/resnext | RDK X5 | Details |
| Image Classification | VargConvNet | samples/vision/vargconvnet | RDK X5 | Details |
| Promptable Image Segmentation | EfficientSAM-Tiny | samples/vision/efficient_sam | RDK X5 | Details |
| Promptable Image Segmentation | MobileSAM | samples/vision/mobile_sam | RDK X5 | Details |
| Semantic Segmentation | PP-LiteSeg | samples/vision/pp_liteseg | RDK X5 | Details |
| Semantic Segmentation | UNet ResNet Family | samples/vision/unet | RDK X5 | Details |
| Object Detection | FCOS | samples/vision/fcos | RDK X5 | Details |
| Object Detection | YOLOv5 | samples/vision/yolov5 | RDK X5 | Details |
| Object Detection / Instance Segmentation / Pose Estimation / Image Classification | Ultralytics YOLO (YOLOv5u / YOLOv8 / YOLOv9 / YOLOv10 / YOLO11 / YOLO12 / YOLO13) | samples/vision/ultralytics_yolo | RDK X5 | Details |
| Object Detection / Instance Segmentation / Pose Estimation / Image Classification | Ultralytics YOLO26 | samples/vision/ultralytics_yolo26 | RDK X5 | Details |
| Monocular Depth Estimation | YOLO26 Depth | samples/vision/yolo26_depth | RDK X5 | Details |
| Image Matting | MODNet | samples/vision/modnet | RDK X5 | Details |
| OCR Text Detection and Recognition | PaddleOCR | samples/vision/paddleocr | RDK X5 | Details |
| License Plate Recognition | LPRNet | samples/vision/lprnet | RDK X5 | Details |
| Image-Text Multimodal Matching | CLIP | samples/vision/clip | RDK X5 | Details |
| Open-Vocabulary Object Detection | YOLOWorld | samples/vision/yoloworld | RDK X5 | Details |
| Legged Locomotion | HIMLoco (Unitree Go2) | samples/robotics/himloco | RDK X5 | Details |
README.md provides an overview and run guide.libdnn.so versions are up-to-date.Update the resolution in preprocess.py to match your ONNX model's input size. Delete old calibration data and re-run the calibration script.
pycocotools).Yes. Non-quantizable or BPU-unsupported operators fallback to CPU. Even for pure BPU models, input/output quantization/dequantization nodes are executed by the CPU.
We warmly welcome contributions! Please raise an issue on GitHub Issues or discuss on the Developer Community.
This project is licensed under the Apache License 2.0 agreement.
Python
99.3%