Seeed-Projects/mobile-robot-full-stack-course

An open-source, hands-on mobile robotics course covering Jetson, ROS 2, AI perception, SLAM, autonomous navigation, semantic understanding, and robotic manipulation.

Python

48

49 commits

updated Oct 12, 2026

See the code

See what people are saying

SourceMessageScoreDate

Can a Jetson run vision-language navigation locally? Here's my robot simulation dem (r/robotics)

Following up on last week's MicroDuck experiment. Same brain, different body! This time, I connected **LightNav-0**, an open vision-language navigation (VLN) model, to a MuJoCo digital twin of our **DM-H65 two-wheel differential-drive robot**. we are working on it. The goal: "Locate the…

2

Oct 19, 2026

I wired an open VLN model into the Microduck sim: instruction in, look-plan-walk out (on-device on a Jetson) (r/robotics)

Small experiment from this week. I connected LightNav-0 (an open vision-language navigation model) to the Microduck sim in MuJoCo. The duck takes an instruction like "go to the wooden doorframe and stop", predicts a path from its first-person frames, and the motion is executed via MPC + its…

7

Oct 15, 2026

README

Mobile Robot Full-Stack Development in Practice

An open-source embodied intelligence and autonomous systems course based on reComputer J501 (Jetson AGX Orin)

Build a complete mobile robotics development loop from sensor integration, AI perception, SLAM, and autonomous navigation to semantic understanding, active vision, and robotic grasping.

Status Platform JetPack ROS License


image

Project Overview

This project is an open-source hands-on course for robotics developers, AI engineers, and university students. It uses Seeed Studio reComputer J501 (Jetson AGX Orin 32GB/64GB) as the core compute platform and covers:

Perception -> Cognition -> Decision -> Actuation -> Deployment

The course emphasizes system integration on real robots rather than explaining only a single algorithm in isolation. The content will be opened progressively. If you are interested in this project, Star it and contribute with us.


Course Highlights

  • Complete technology stack: covers Jetson, ROS 2, vision, LiDAR, SLAM, Nav2, VLN, robotic arms, and deployment optimization.
  • Strict progression: starts from sensors and coordinate-system fundamentals, then moves into navigation, semantic understanding, and grasping.
  • Real hardware practice: uses J501, cameras, LiDAR, chassis, PTZ, and robotic arms as the main validation platform.
  • Verifiable chapter outputs: each module provides code, configuration, experiment steps, expected results, and common issues.
  • Engineering-oriented: the course ends with TensorRT, DeepStream, Isaac ROS, system monitoring, and OTA.

Course Roadmap

flowchart LR
    M1[M1 Platform and Environment]
    M2[M2 Vision System]
    M3[M3 Multi-Sensor Fusion]
    M4[M4 AI Perception]
    M5[M5 SLAM and Reconstruction]
    M6[M6 Autonomous Navigation]
    M7[M7 Semantic Navigation]
    M8[M8 Active Vision]
    M9[M9 Robotic Arm Manipulation]
    M10[M10 Integrated Projects]
    M11[M11 Engineering Deployment]

    M1 --> M2
    M1 --> M3
    M2 --> M4
    M2 --> M5
    M3 --> M5
    M5 --> M6
    M4 --> M7
    M6 --> M7
    M4 --> M8
    M6 --> M8
    M4 --> M9
    M7 --> M10
    M8 --> M10
    M9 --> M10
    M10 --> M11

Course Modules

The course is planned as 11 modules, about 43 class hours in total. Starting from July 22, 2026, the plan is to complete one module every two weeks. If there are no major changes, all modules are planned to be completed before December 22, 2026.

ModuleThemeMain ContentPlanned Window
M1Platform Introduction and Development EnvironmentJ501, JetPack, Docker, ROS 2✅ Completed
M2Vision System FoundationsCSI, GMSL2, RGB-D, calibration, BEV✅ Completed
M3LiDAR and Sensor FusionLiDAR, IMU, GNSS, CAN-FD, PTP, EKF✅ Completed
M4AI Vision and Edge AccelerationYOLO, tracking, segmentation, 6D pose, Isaac ROS✅ Completed
M53D Reconstruction and SLAMORB-SLAM3, Fast-LIO, R3LIVE, 3DGS, semantic maps⏳ Planned 10-02
M6Localization, Navigation, and Path PlanningNav2, planning, dynamic obstacle avoidance, multi-robot collaboration⏳ Planned
M7VLN Semantic Navigationinstruction parsing, topological maps, semantic landmarks⏳ Planned
M8PTZ and Active VisionPTZ control, target tracking, chassis coordination⏳ Planned
M9Robotic Arm and ManipulationMoveIt 2, Pinocchio, hand-eye calibration, GraspNet⏳ Planned
M10Integrated Projectsinspection, BEV+3DGS, VLN, semantic grasping⏳ Planned
M11Deployment Optimization and EngineeringONNX, TensorRT, DeepStream, monitoring, OTA⏳ Planned

The progress status will be updated to ✅ Completed after each module is released, together with the corresponding documentation, code, configurations, test results, and demo videos.


Core Hardware

CategoryRecommended Configuration
Main ControllerreComputer Robotics J5012
VisionCSI / GMSL2 / RGB-D cameras
LocalizationLiDAR, IMU, GNSS
ActuationMobile chassis, 2-axis PTZ, reBot or compatible robotic arm
BusCAN-FD, UART, Ethernet
PowerMobile robot power supply system

You do not need to purchase all hardware at once. Early modules can be completed with only the J501 and a single camera. Navigation- and robotic-arm-related hardware can be added gradually later.

image

DM-H65 Chassis Python SDK

The repository includes an installable DM-H65 two-wheel chassis Python SDK with SocketCAN communication, differential-drive control, CLI diagnostics, Jetson services, and a remote debugging WebUI. This integration is Python-only; no C++ implementation is included.


Repository Layout

mobile-robot-full-stack-course/
├── hardware/             # Hardware-related files
├── docs/                 # Course documentation
├── modules/              # Per-module course code
├── projects/             # Integrated projects
├── robot_drivers/        # Mobile chassis Python drivers and WebUI
├── assets/               # Images and videos
├── README.md
├── README_CN.md
├── CONTRIBUTING.md
└── LICENSE

Intended Audience and Prerequisites

Suitable for:

  • beginners in ROS 2 and robotics development;
  • AI, computer vision, and edge computing engineers;
  • developers of AMR, AGV, inspection robots, and service robots;
  • university students, instructors, and lab teams.

Basic knowledge of Linux, Python, Git, and linear algebra is recommended. ROS 2, Docker, and Jetson basics will be introduced in the course.


Open-Source License

This project will be released in a fully open-source manner. All self-developed course content will be made public, including:

  • course documentation and lab instructions;
  • ROS 2 source code and configuration files;
  • Dockerfiles, installation scripts, and deployment tools;
  • model conversion, testing, and performance evaluation scripts;
  • integrated project code and system integration solutions;
  • publicly distributable sample data, images, and demo resources.

The specific license terms will be defined in the root LICENSE file and in any subdirectory-specific license notes. Code, documentation, data, and hardware design files may use different open-source licenses depending on content type.


Safety Notes

Robotic systems involve batteries, motors, robotic arms, and high-speed moving parts. Before operating real hardware, make sure to:

  • configure an emergency stop;
  • limit chassis and robotic-arm speed;
  • check power and wiring;
  • clear the motion range;
  • finish simulation or low-speed validation first;
  • avoid running unverified policies in crowded environments.

Acknowledgements

This course will use or reference open-source projects including ROS 2, NVIDIA Jetson, Isaac ROS, Nav2, MoveIt 2, OpenCV, PyTorch, Open3D, ORB-SLAM3, Fast-LIO, LIO-SAM, 3D Gaussian Splatting, GraspNet, and LeRobot.


From “seeing” to “understanding,” from “autonomous mobility” to “autonomous manipulation.”

Star, Watch, Fork, and contribute.

autonomous-navigation
computer-vision
embodied-ai
isaac-ros
mobile-robots
nvidia-jetson
robotic-manipulation
robotics
ros2
slam

Seeed-Projects/mobile-robot-full-stack-course

An open-source, hands-on mobile robotics course covering Jetson, ROS 2, AI perception, SLAM, autonomous navigation, semantic understanding, and robotic manipulation.

Python

48

49 commits

updated Oct 12, 2026

See the code

See what people are saying

SourceMessageScoreDate

Can a Jetson run vision-language navigation locally? Here's my robot simulation dem (r/robotics)

Following up on last week's MicroDuck experiment. Same brain, different body! This time, I connected **LightNav-0**, an open vision-language navigation (VLN) model, to a MuJoCo digital twin of our **DM-H65 two-wheel differential-drive robot**. we are working on it. The goal: "Locate the…

2

Oct 19, 2026

I wired an open VLN model into the Microduck sim: instruction in, look-plan-walk out (on-device on a Jetson) (r/robotics)

Small experiment from this week. I connected LightNav-0 (an open vision-language navigation model) to the Microduck sim in MuJoCo. The duck takes an instruction like "go to the wooden doorframe and stop", predicts a path from its first-person frames, and the motion is executed via MPC + its…

7

Oct 15, 2026

README

Mobile Robot Full-Stack Development in Practice

An open-source embodied intelligence and autonomous systems course based on reComputer J501 (Jetson AGX Orin)

Build a complete mobile robotics development loop from sensor integration, AI perception, SLAM, and autonomous navigation to semantic understanding, active vision, and robotic grasping.

Status Platform JetPack ROS License


image

Project Overview

This project is an open-source hands-on course for robotics developers, AI engineers, and university students. It uses Seeed Studio reComputer J501 (Jetson AGX Orin 32GB/64GB) as the core compute platform and covers:

Perception -> Cognition -> Decision -> Actuation -> Deployment

The course emphasizes system integration on real robots rather than explaining only a single algorithm in isolation. The content will be opened progressively. If you are interested in this project, Star it and contribute with us.


Course Highlights

  • Complete technology stack: covers Jetson, ROS 2, vision, LiDAR, SLAM, Nav2, VLN, robotic arms, and deployment optimization.
  • Strict progression: starts from sensors and coordinate-system fundamentals, then moves into navigation, semantic understanding, and grasping.
  • Real hardware practice: uses J501, cameras, LiDAR, chassis, PTZ, and robotic arms as the main validation platform.
  • Verifiable chapter outputs: each module provides code, configuration, experiment steps, expected results, and common issues.
  • Engineering-oriented: the course ends with TensorRT, DeepStream, Isaac ROS, system monitoring, and OTA.

Course Roadmap

flowchart LR
    M1[M1 Platform and Environment]
    M2[M2 Vision System]
    M3[M3 Multi-Sensor Fusion]
    M4[M4 AI Perception]
    M5[M5 SLAM and Reconstruction]
    M6[M6 Autonomous Navigation]
    M7[M7 Semantic Navigation]
    M8[M8 Active Vision]
    M9[M9 Robotic Arm Manipulation]
    M10[M10 Integrated Projects]
    M11[M11 Engineering Deployment]

    M1 --> M2
    M1 --> M3
    M2 --> M4
    M2 --> M5
    M3 --> M5
    M5 --> M6
    M4 --> M7
    M6 --> M7
    M4 --> M8
    M6 --> M8
    M4 --> M9
    M7 --> M10
    M8 --> M10
    M9 --> M10
    M10 --> M11

Course Modules

The course is planned as 11 modules, about 43 class hours in total. Starting from July 22, 2026, the plan is to complete one module every two weeks. If there are no major changes, all modules are planned to be completed before December 22, 2026.

ModuleThemeMain ContentPlanned Window
M1Platform Introduction and Development EnvironmentJ501, JetPack, Docker, ROS 2✅ Completed
M2Vision System FoundationsCSI, GMSL2, RGB-D, calibration, BEV✅ Completed
M3LiDAR and Sensor FusionLiDAR, IMU, GNSS, CAN-FD, PTP, EKF✅ Completed
M4AI Vision and Edge AccelerationYOLO, tracking, segmentation, 6D pose, Isaac ROS✅ Completed
M53D Reconstruction and SLAMORB-SLAM3, Fast-LIO, R3LIVE, 3DGS, semantic maps⏳ Planned 10-02
M6Localization, Navigation, and Path PlanningNav2, planning, dynamic obstacle avoidance, multi-robot collaboration⏳ Planned
M7VLN Semantic Navigationinstruction parsing, topological maps, semantic landmarks⏳ Planned
M8PTZ and Active VisionPTZ control, target tracking, chassis coordination⏳ Planned
M9Robotic Arm and ManipulationMoveIt 2, Pinocchio, hand-eye calibration, GraspNet⏳ Planned
M10Integrated Projectsinspection, BEV+3DGS, VLN, semantic grasping⏳ Planned
M11Deployment Optimization and EngineeringONNX, TensorRT, DeepStream, monitoring, OTA⏳ Planned

The progress status will be updated to ✅ Completed after each module is released, together with the corresponding documentation, code, configurations, test results, and demo videos.


Core Hardware

CategoryRecommended Configuration
Main ControllerreComputer Robotics J5012
VisionCSI / GMSL2 / RGB-D cameras
LocalizationLiDAR, IMU, GNSS
ActuationMobile chassis, 2-axis PTZ, reBot or compatible robotic arm
BusCAN-FD, UART, Ethernet
PowerMobile robot power supply system

You do not need to purchase all hardware at once. Early modules can be completed with only the J501 and a single camera. Navigation- and robotic-arm-related hardware can be added gradually later.

image

DM-H65 Chassis Python SDK

The repository includes an installable DM-H65 two-wheel chassis Python SDK with SocketCAN communication, differential-drive control, CLI diagnostics, Jetson services, and a remote debugging WebUI. This integration is Python-only; no C++ implementation is included.


Repository Layout

mobile-robot-full-stack-course/
├── hardware/             # Hardware-related files
├── docs/                 # Course documentation
├── modules/              # Per-module course code
├── projects/             # Integrated projects
├── robot_drivers/        # Mobile chassis Python drivers and WebUI
├── assets/               # Images and videos
├── README.md
├── README_CN.md
├── CONTRIBUTING.md
└── LICENSE

Intended Audience and Prerequisites

Suitable for:

  • beginners in ROS 2 and robotics development;
  • AI, computer vision, and edge computing engineers;
  • developers of AMR, AGV, inspection robots, and service robots;
  • university students, instructors, and lab teams.

Basic knowledge of Linux, Python, Git, and linear algebra is recommended. ROS 2, Docker, and Jetson basics will be introduced in the course.


Open-Source License

This project will be released in a fully open-source manner. All self-developed course content will be made public, including:

  • course documentation and lab instructions;
  • ROS 2 source code and configuration files;
  • Dockerfiles, installation scripts, and deployment tools;
  • model conversion, testing, and performance evaluation scripts;
  • integrated project code and system integration solutions;
  • publicly distributable sample data, images, and demo resources.

The specific license terms will be defined in the root LICENSE file and in any subdirectory-specific license notes. Code, documentation, data, and hardware design files may use different open-source licenses depending on content type.


Safety Notes

Robotic systems involve batteries, motors, robotic arms, and high-speed moving parts. Before operating real hardware, make sure to:

  • configure an emergency stop;
  • limit chassis and robotic-arm speed;
  • check power and wiring;
  • clear the motion range;
  • finish simulation or low-speed validation first;
  • avoid running unverified policies in crowded environments.

Acknowledgements

This course will use or reference open-source projects including ROS 2, NVIDIA Jetson, Isaac ROS, Nav2, MoveIt 2, OpenCV, PyTorch, Open3D, ORB-SLAM3, Fast-LIO, LIO-SAM, 3D Gaussian Splatting, GraspNet, and LeRobot.


From “seeing” to “understanding,” from “autonomous mobility” to “autonomous manipulation.”

Star, Watch, Fork, and contribute.

autonomous-navigation
computer-vision
embodied-ai
isaac-ros
mobile-robots
nvidia-jetson
robotic-manipulation
robotics
ros2
slam