facebook/jepa-wms

Model

This 🤗 HuggingFace repository hosts pretrained JEPA-WM world models.

11

22 commits

2 linked in READMEs

updated Feb 6, 2026

See the code

README

🤖 JEPA-WMs Pretrained Models

Github HuggingFace ArXiv

Meta AI Research, FAIR

This 🤗 HuggingFace repository hosts pretrained JEPA-WM world models.
👉 See the main repository for training code and datasets.

This repository contains pretrained world model checkpoints from the paper "What Drives Success in Physical Planning with Joint-Embedding Predictive World Models?"

Available Models

JEPA-WM Models

ModelEnvironmentResolutionEncoderPred. Depth
jepa_wm_droidDROID & RoboCasa256×256DINOv3 ViT-L/1612
jepa_wm_metaworldMetaworld224×224DINOv2 ViT-S/146
jepa_wm_pushtPush-T224×224DINOv2 ViT-S/146
jepa_wm_pointmazePointMaze224×224DINOv2 ViT-S/146
jepa_wm_wallWall224×224DINOv2 ViT-S/146

DINO-WM Baseline Models

ModelEnvironmentResolutionEncoderPred. Depth
dino_wm_droidDROID & RoboCasa224×224DINOv2 ViT-S/146
dino_wm_metaworldMetaworld224×224DINOv2 ViT-S/146
dino_wm_pushtPush-T224×224DINOv2 ViT-S/146
dino_wm_pointmazePointMaze224×224DINOv2 ViT-S/146
dino_wm_wallWall224×224DINOv2 ViT-S/146

V-JEPA-2-AC Baseline Models

ModelEnvironmentResolutionEncoderPred. Depth
vjepa2_ac_droidDROID & RoboCasa256×256V-JEPA-2 ViT-G/1624
vjepa2_ac_ossDROID & RoboCasa256×256V-JEPA-2 ViT-G/1624

VM2M Decoder Heads

ModelEncoderResolution
dinov2_vits_224DINOv2 ViT-S/14224×224
dinov2_vits_224_INetDINOv2 ViT-S/14224×224
dinov3_vitl_256_INetDINOv3 ViT-L/16256×256
vjepa2_vitg_256_INetV-JEPA-2 ViT-G/16256×256

Usage

import torch

# Load JEPA-WM models
model, preprocessor = torch.hub.load('facebookresearch/jepa-wms', 'jepa_wm_droid')
model, preprocessor = torch.hub.load('facebookresearch/jepa-wms', 'jepa_wm_metaworld')

# Load DINO-WM baselines
model, preprocessor = torch.hub.load('facebookresearch/jepa-wms', 'dino_wm_metaworld')

# Load V-JEPA-2-AC baseline
model, preprocessor = torch.hub.load('facebookresearch/jepa-wms', 'vjepa2_ac_droid')

Via Hugging Face Hub

from huggingface_hub import hf_hub_download
import torch

# Download a specific checkpoint
checkpoint_path = hf_hub_download(
    repo_id="facebook/jepa-wms",
    filename="jepa_wm_droid.pth.tar"
)

# Load checkpoint (contains 'encoder', 'predictor', and 'heads' state dicts)
checkpoint = torch.load(checkpoint_path, map_location="cpu")
print(checkpoint.keys())  # dict_keys(['encoder', 'predictor', 'heads', 'opt', 'scaler', 'epoch', 'batch_size', 'lr', 'amp'])

Note: This only downloads the weights. To instantiate the full model with the correct architecture and load the weights, we recommend using PyTorch Hub (see above) or cloning the jepa-wms repository and using the training/eval scripts.

Citation

@misc{terver2025drivessuccessphysicalplanning,
      title={What Drives Success in Physical Planning with Joint-Embedding Predictive World Models?},
      author={Basile Terver and Tsung-Yen Yang and Jean Ponce and Adrien Bardes and Yann LeCun},
      year={2025},
      eprint={2512.24497},
      archivePrefix={arXiv},
      primaryClass={cs.AI},
      url={https://arxiv.org/abs/2512.24497},
}

License

These models are licensed under CC-BY-NC 4.0.

jepa
planning
pytorch
robotics
world-model

Contributors

Basile-Terv

21 commits

meta-bot

1 commits

facebook/jepa-wms

Model

This 🤗 HuggingFace repository hosts pretrained JEPA-WM world models.

11

22 commits

2 linked in READMEs

updated Feb 6, 2026

See the code

README

🤖 JEPA-WMs Pretrained Models

Github HuggingFace ArXiv

Meta AI Research, FAIR

This 🤗 HuggingFace repository hosts pretrained JEPA-WM world models.
👉 See the main repository for training code and datasets.

This repository contains pretrained world model checkpoints from the paper "What Drives Success in Physical Planning with Joint-Embedding Predictive World Models?"

Available Models

JEPA-WM Models

ModelEnvironmentResolutionEncoderPred. Depth
jepa_wm_droidDROID & RoboCasa256×256DINOv3 ViT-L/1612
jepa_wm_metaworldMetaworld224×224DINOv2 ViT-S/146
jepa_wm_pushtPush-T224×224DINOv2 ViT-S/146
jepa_wm_pointmazePointMaze224×224DINOv2 ViT-S/146
jepa_wm_wallWall224×224DINOv2 ViT-S/146

DINO-WM Baseline Models

ModelEnvironmentResolutionEncoderPred. Depth
dino_wm_droidDROID & RoboCasa224×224DINOv2 ViT-S/146
dino_wm_metaworldMetaworld224×224DINOv2 ViT-S/146
dino_wm_pushtPush-T224×224DINOv2 ViT-S/146
dino_wm_pointmazePointMaze224×224DINOv2 ViT-S/146
dino_wm_wallWall224×224DINOv2 ViT-S/146

V-JEPA-2-AC Baseline Models

ModelEnvironmentResolutionEncoderPred. Depth
vjepa2_ac_droidDROID & RoboCasa256×256V-JEPA-2 ViT-G/1624
vjepa2_ac_ossDROID & RoboCasa256×256V-JEPA-2 ViT-G/1624

VM2M Decoder Heads

ModelEncoderResolution
dinov2_vits_224DINOv2 ViT-S/14224×224
dinov2_vits_224_INetDINOv2 ViT-S/14224×224
dinov3_vitl_256_INetDINOv3 ViT-L/16256×256
vjepa2_vitg_256_INetV-JEPA-2 ViT-G/16256×256

Usage

import torch

# Load JEPA-WM models
model, preprocessor = torch.hub.load('facebookresearch/jepa-wms', 'jepa_wm_droid')
model, preprocessor = torch.hub.load('facebookresearch/jepa-wms', 'jepa_wm_metaworld')

# Load DINO-WM baselines
model, preprocessor = torch.hub.load('facebookresearch/jepa-wms', 'dino_wm_metaworld')

# Load V-JEPA-2-AC baseline
model, preprocessor = torch.hub.load('facebookresearch/jepa-wms', 'vjepa2_ac_droid')

Via Hugging Face Hub

from huggingface_hub import hf_hub_download
import torch

# Download a specific checkpoint
checkpoint_path = hf_hub_download(
    repo_id="facebook/jepa-wms",
    filename="jepa_wm_droid.pth.tar"
)

# Load checkpoint (contains 'encoder', 'predictor', and 'heads' state dicts)
checkpoint = torch.load(checkpoint_path, map_location="cpu")
print(checkpoint.keys())  # dict_keys(['encoder', 'predictor', 'heads', 'opt', 'scaler', 'epoch', 'batch_size', 'lr', 'amp'])

Note: This only downloads the weights. To instantiate the full model with the correct architecture and load the weights, we recommend using PyTorch Hub (see above) or cloning the jepa-wms repository and using the training/eval scripts.

Citation

@misc{terver2025drivessuccessphysicalplanning,
      title={What Drives Success in Physical Planning with Joint-Embedding Predictive World Models?},
      author={Basile Terver and Tsung-Yen Yang and Jean Ponce and Adrien Bardes and Yann LeCun},
      year={2025},
      eprint={2512.24497},
      archivePrefix={arXiv},
      primaryClass={cs.AI},
      url={https://arxiv.org/abs/2512.24497},
}

License

These models are licensed under CC-BY-NC 4.0.

jepa
planning
pytorch
robotics
world-model

Contributors

Basile-Terv

21 commits

meta-bot

1 commits