nvidia/PhysicalAI-Robotics-GR00T-X-Embodiment-Sim

Dataset

263

stars

502

commits

2

linked in READMEs

Mar 5, 2026

updated

robotics

README

PhysicalAI-Robotics-GR00T-X-Embodiment-Sim

image/png

Github Repo: Isaac GR00T N1

We provide a set of datasets used for post-training of GR00T N1. Each dataset is a collection of trajectories from different robot embodiments and tasks.

Cross-embodied bimanual manipulation: 9k trajectories

Dataset Name#trajectories
bimanual_panda_gripper.Threading1000
bimanual_panda_hand.LiftTray1000
bimanual_panda_gripper.ThreePieceAssembly1000
bimanual_panda_gripper.Transport1000
bimanual_panda_hand.BoxCleanup1000
bimanual_panda_hand.DrawerCleanup1000
gr1_arms_only.CanSort1000
gr1_full_upper_body.Coffee1000
gr1_full_upper_body.Pouring1000

Humanoid robot tabletop manipulation: 240k trajectories

Dataset Name#trajectories
gr1_arms_waist.CanToDrawer10000
gr1_arms_waist.CupToDrawer10000
gr1_arms_waist.CuttingboardToBasket10000
gr1_arms_waist.CuttingboardToCardboardBox10000
gr1_arms_waist.CuttingboardToPan10000
gr1_arms_waist.CuttingboardToPot10000
gr1_arms_waist.CuttingboardToTieredBasket10000
gr1_arms_waist.PlaceBottleToCabinet10000
gr1_arms_waist.PlaceMilkToMicrowave10000
gr1_arms_waist.PlacematToBasket10000
gr1_arms_waist.PlacematToBowl10000
gr1_arms_waist.PlacematToPlate10000
gr1_arms_waist.PlacematToTieredShelf10000
gr1_arms_waist.PlateToBowl10000
gr1_arms_waist.PlateToCardboardBox10000
gr1_arms_waist.PlateToPan10000
gr1_arms_waist.PlateToPlate10000
gr1_arms_waist.PotatoToMicrowave10000
gr1_arms_waist.TrayToCardboardBox10000
gr1_arms_waist.TrayToPlate10000
gr1_arms_waist.TrayToPot10000
gr1_arms_waist.TrayToTieredBasket10000
gr1_arms_waist.TrayToTieredShelf10000
gr1_arms_waist.WineToCabinet10000

Humanoid robot tabletop manipulation - downsampled: 24k trajectories

Dataset Name#trajectories
gr1_unified.PnPBottleToCabinetClose_GR1ArmsAndWaistFourierHands_10001000
gr1_unified.PnPCanToDrawerClose_GR1ArmsAndWaistFourierHands_10001000
gr1_unified.PnPCupToDrawerClose_GR1ArmsAndWaistFourierHands_10001000
gr1_unified.PnPMilkToMicrowaveClose_GR1ArmsAndWaistFourierHands_10001000
gr1_unified.PnPPotatoToMicrowaveClose_GR1ArmsAndWaistFourierHands_10001000
gr1_unified.PnPWineToCabinetClose_GR1ArmsAndWaistFourierHands_10001000
gr1_unified.PosttrainPnPNovelFromCuttingboardToBasketSplitA_GR1ArmsAndWaistFourierHands_10001000
gr1_unified.PosttrainPnPNovelFromCuttingboardToCardboardboxSplitA_GR1ArmsAndWaistFourierHands_10001000
gr1_unified.PosttrainPnPNovelFromCuttingboardToPanSplitA_GR1ArmsAndWaistFourierHands_10001000
gr1_unified.PosttrainPnPNovelFromCuttingboardToPotSplitA_GR1ArmsAndWaistFourierHands_10001000
gr1_unified.PosttrainPnPNovelFromCuttingboardToTieredbasketSplitA_GR1ArmsAndWaistFourierHands_10001000
gr1_unified.PosttrainPnPNovelFromPlacematToBasketSplitA_GR1ArmsAndWaistFourierHands_10001000
gr1_unified.PosttrainPnPNovelFromPlacematToBowlSplitA_GR1ArmsAndWaistFourierHands_10001000
gr1_unified.PosttrainPnPNovelFromPlacematToPlateSplitA_GR1ArmsAndWaistFourierHands_10001000
gr1_unified.PosttrainPnPNovelFromPlacematToTieredshelfSplitA_GR1ArmsAndWaistFourierHands_10001000
gr1_unified.PosttrainPnPNovelFromPlateToBowlSplitA_GR1ArmsAndWaistFourierHands_10001000
gr1_unified.PosttrainPnPNovelFromPlateToCardboardboxSplitA_GR1ArmsAndWaistFourierHands_10001000
gr1_unified.PosttrainPnPNovelFromPlateToPanSplitA_GR1ArmsAndWaistFourierHands_10001000
gr1_unified.PosttrainPnPNovelFromPlateToPlateSplitA_GR1ArmsAndWaistFourierHands_10001000
gr1_unified.PosttrainPnPNovelFromTrayToCardboardboxSplitA_GR1ArmsAndWaistFourierHands_10001000
gr1_unified.PosttrainPnPNovelFromTrayToPlateSplitA_GR1ArmsAndWaistFourierHands_10001000
gr1_unified.PosttrainPnPNovelFromTrayToPotSplitA_GR1ArmsAndWaistFourierHands_10001000
gr1_unified.PosttrainPnPNovelFromTrayToTieredbasketSplitA_GR1ArmsAndWaistFourierHands_10001000
gr1_unified.PosttrainPnPNovelFromTrayToTieredshelfSplitA_GR1ArmsAndWaistFourierHands_10001000

Robot Arm Kitchen Manipulation: 72K trajectories

Dataset Name#trajectories
single_panda_gripper.CloseDoubleDoor3000
single_panda_gripper.CloseDrawer3000
single_panda_gripper.CloseSingleDoor3000
single_panda_gripper.CoffeePressButton3000
single_panda_gripper.CoffeeServeMug3000
single_panda_gripper.CoffeeSetupMug3000
single_panda_gripper.OpenDoubleDoor3000
single_panda_gripper.OpenDrawer3000
single_panda_gripper.OpenSingleDoor3000
single_panda_gripper.PnPCabToCounter3000
single_panda_gripper.PnPCounterToCab3000
single_panda_gripper.PnPCounterToMicrowave3000
single_panda_gripper.PnPCounterToSink3000
single_panda_gripper.PnPCounterToStove3000
single_panda_gripper.PnPMicrowaveToCounter3000
single_panda_gripper.PnPSinkToCounter3000
single_panda_gripper.PnPStoveToCounter3000
single_panda_gripper.TurnOffMicrowave3000
single_panda_gripper.TurnOffSinkFaucet3000
single_panda_gripper.TurnOffStove3000
single_panda_gripper.TurnOnMicrowave3000
single_panda_gripper.TurnOnSinkFaucet3000
single_panda_gripper.TurnOnStove3000
single_panda_gripper.TurnSinkSpout3000

Unitree G1 Loco-Manipulation: 102 trajectories

Dataset Name#trajectories
unitree_g1.LMPnPAppleToPlateDC102

Download the dataset from Huggingface

Users can download a specific subset of data by specifying the dataset name.

  1. Option 1: with huggingface-cli
huggingface-cli download nvidia/PhysicalAI-Robotics-GR00T-X-Embodiment-Sim \
  --repo-type dataset \
  --include "gr1_arms_only.CanSort/**" \
  --local-dir $HOME/gr00t_dataset

Replace gr1_arms_only.CanSort/** with the dataset name you want to download.

  1. Option 2: Github LFS
# Clone the repo without downloading files
git clone --filter=blob:none --no-checkout https://huggingface.co/datasets/nvidia/PhysicalAI-Robotics-GR00T-X-Embodiment-Sim
cd PhysicalAI-Robotics-GR00T-X-Embodiment-Sim

# Configure sparse-checkout for just your folder
git sparse-checkout init --cone
git sparse-checkout set gr1_arms_waist.CupToDrawer   << Select the specific dataset to download

Replace the "gr1_arms_waist.CupToDrawer" with the intended dataset folder

Contributors

nvlm

389 commits

youliangt

107 commits

runyud

2 commits

NV-DLynch

1 commits

nvidia/PhysicalAI-Robotics-GR00T-X-Embodiment-Sim

Dataset

263

stars

502

commits

2

linked in READMEs

Mar 5, 2026

updated

robotics

README

PhysicalAI-Robotics-GR00T-X-Embodiment-Sim

image/png

Github Repo: Isaac GR00T N1

We provide a set of datasets used for post-training of GR00T N1. Each dataset is a collection of trajectories from different robot embodiments and tasks.

Cross-embodied bimanual manipulation: 9k trajectories

Dataset Name#trajectories
bimanual_panda_gripper.Threading1000
bimanual_panda_hand.LiftTray1000
bimanual_panda_gripper.ThreePieceAssembly1000
bimanual_panda_gripper.Transport1000
bimanual_panda_hand.BoxCleanup1000
bimanual_panda_hand.DrawerCleanup1000
gr1_arms_only.CanSort1000
gr1_full_upper_body.Coffee1000
gr1_full_upper_body.Pouring1000

Humanoid robot tabletop manipulation: 240k trajectories

Dataset Name#trajectories
gr1_arms_waist.CanToDrawer10000
gr1_arms_waist.CupToDrawer10000
gr1_arms_waist.CuttingboardToBasket10000
gr1_arms_waist.CuttingboardToCardboardBox10000
gr1_arms_waist.CuttingboardToPan10000
gr1_arms_waist.CuttingboardToPot10000
gr1_arms_waist.CuttingboardToTieredBasket10000
gr1_arms_waist.PlaceBottleToCabinet10000
gr1_arms_waist.PlaceMilkToMicrowave10000
gr1_arms_waist.PlacematToBasket10000
gr1_arms_waist.PlacematToBowl10000
gr1_arms_waist.PlacematToPlate10000
gr1_arms_waist.PlacematToTieredShelf10000
gr1_arms_waist.PlateToBowl10000
gr1_arms_waist.PlateToCardboardBox10000
gr1_arms_waist.PlateToPan10000
gr1_arms_waist.PlateToPlate10000
gr1_arms_waist.PotatoToMicrowave10000
gr1_arms_waist.TrayToCardboardBox10000
gr1_arms_waist.TrayToPlate10000
gr1_arms_waist.TrayToPot10000
gr1_arms_waist.TrayToTieredBasket10000
gr1_arms_waist.TrayToTieredShelf10000
gr1_arms_waist.WineToCabinet10000

Humanoid robot tabletop manipulation - downsampled: 24k trajectories

Dataset Name#trajectories
gr1_unified.PnPBottleToCabinetClose_GR1ArmsAndWaistFourierHands_10001000
gr1_unified.PnPCanToDrawerClose_GR1ArmsAndWaistFourierHands_10001000
gr1_unified.PnPCupToDrawerClose_GR1ArmsAndWaistFourierHands_10001000
gr1_unified.PnPMilkToMicrowaveClose_GR1ArmsAndWaistFourierHands_10001000
gr1_unified.PnPPotatoToMicrowaveClose_GR1ArmsAndWaistFourierHands_10001000
gr1_unified.PnPWineToCabinetClose_GR1ArmsAndWaistFourierHands_10001000
gr1_unified.PosttrainPnPNovelFromCuttingboardToBasketSplitA_GR1ArmsAndWaistFourierHands_10001000
gr1_unified.PosttrainPnPNovelFromCuttingboardToCardboardboxSplitA_GR1ArmsAndWaistFourierHands_10001000
gr1_unified.PosttrainPnPNovelFromCuttingboardToPanSplitA_GR1ArmsAndWaistFourierHands_10001000
gr1_unified.PosttrainPnPNovelFromCuttingboardToPotSplitA_GR1ArmsAndWaistFourierHands_10001000
gr1_unified.PosttrainPnPNovelFromCuttingboardToTieredbasketSplitA_GR1ArmsAndWaistFourierHands_10001000
gr1_unified.PosttrainPnPNovelFromPlacematToBasketSplitA_GR1ArmsAndWaistFourierHands_10001000
gr1_unified.PosttrainPnPNovelFromPlacematToBowlSplitA_GR1ArmsAndWaistFourierHands_10001000
gr1_unified.PosttrainPnPNovelFromPlacematToPlateSplitA_GR1ArmsAndWaistFourierHands_10001000
gr1_unified.PosttrainPnPNovelFromPlacematToTieredshelfSplitA_GR1ArmsAndWaistFourierHands_10001000
gr1_unified.PosttrainPnPNovelFromPlateToBowlSplitA_GR1ArmsAndWaistFourierHands_10001000
gr1_unified.PosttrainPnPNovelFromPlateToCardboardboxSplitA_GR1ArmsAndWaistFourierHands_10001000
gr1_unified.PosttrainPnPNovelFromPlateToPanSplitA_GR1ArmsAndWaistFourierHands_10001000
gr1_unified.PosttrainPnPNovelFromPlateToPlateSplitA_GR1ArmsAndWaistFourierHands_10001000
gr1_unified.PosttrainPnPNovelFromTrayToCardboardboxSplitA_GR1ArmsAndWaistFourierHands_10001000
gr1_unified.PosttrainPnPNovelFromTrayToPlateSplitA_GR1ArmsAndWaistFourierHands_10001000
gr1_unified.PosttrainPnPNovelFromTrayToPotSplitA_GR1ArmsAndWaistFourierHands_10001000
gr1_unified.PosttrainPnPNovelFromTrayToTieredbasketSplitA_GR1ArmsAndWaistFourierHands_10001000
gr1_unified.PosttrainPnPNovelFromTrayToTieredshelfSplitA_GR1ArmsAndWaistFourierHands_10001000

Robot Arm Kitchen Manipulation: 72K trajectories

Dataset Name#trajectories
single_panda_gripper.CloseDoubleDoor3000
single_panda_gripper.CloseDrawer3000
single_panda_gripper.CloseSingleDoor3000
single_panda_gripper.CoffeePressButton3000
single_panda_gripper.CoffeeServeMug3000
single_panda_gripper.CoffeeSetupMug3000
single_panda_gripper.OpenDoubleDoor3000
single_panda_gripper.OpenDrawer3000
single_panda_gripper.OpenSingleDoor3000
single_panda_gripper.PnPCabToCounter3000
single_panda_gripper.PnPCounterToCab3000
single_panda_gripper.PnPCounterToMicrowave3000
single_panda_gripper.PnPCounterToSink3000
single_panda_gripper.PnPCounterToStove3000
single_panda_gripper.PnPMicrowaveToCounter3000
single_panda_gripper.PnPSinkToCounter3000
single_panda_gripper.PnPStoveToCounter3000
single_panda_gripper.TurnOffMicrowave3000
single_panda_gripper.TurnOffSinkFaucet3000
single_panda_gripper.TurnOffStove3000
single_panda_gripper.TurnOnMicrowave3000
single_panda_gripper.TurnOnSinkFaucet3000
single_panda_gripper.TurnOnStove3000
single_panda_gripper.TurnSinkSpout3000

Unitree G1 Loco-Manipulation: 102 trajectories

Dataset Name#trajectories
unitree_g1.LMPnPAppleToPlateDC102

Download the dataset from Huggingface

Users can download a specific subset of data by specifying the dataset name.

  1. Option 1: with huggingface-cli
huggingface-cli download nvidia/PhysicalAI-Robotics-GR00T-X-Embodiment-Sim \
  --repo-type dataset \
  --include "gr1_arms_only.CanSort/**" \
  --local-dir $HOME/gr00t_dataset

Replace gr1_arms_only.CanSort/** with the dataset name you want to download.

  1. Option 2: Github LFS
# Clone the repo without downloading files
git clone --filter=blob:none --no-checkout https://huggingface.co/datasets/nvidia/PhysicalAI-Robotics-GR00T-X-Embodiment-Sim
cd PhysicalAI-Robotics-GR00T-X-Embodiment-Sim

# Configure sparse-checkout for just your folder
git sparse-checkout init --cone
git sparse-checkout set gr1_arms_waist.CupToDrawer   << Select the specific dataset to download

Replace the "gr1_arms_waist.CupToDrawer" with the intended dataset folder

Contributors

nvlm

389 commits

youliangt

107 commits

runyud

2 commits

NV-DLynch

1 commits