NVlabs/imaginaire

NVIDIA's Deep Imagination Team's PyTorch Library

Python

4,078

45 commits

updated Nov 29, 2022

See the code

README

imaginaire_logo.svg

Imaginaire

Docs | License | Installation | Model Zoo

Imaginaire is a pytorch library that contains optimized implementation of several image and video synthesis methods developed at NVIDIA.

License

Imaginaire is released under NVIDIA Software license. For commercial use, please consult NVIDIA Research Inquiries.

What's inside?

IMAGE ALT TEXT

We have a tutorial for each model. Click on the model name, and your browser should take you to the tutorial page for the project.

Supervised Image-to-Image Translation

Algorithm NameFeaturePublication
pix2pixHDLearn a mapping that converts a semantic image to a high-resolution photorealistic image.Wang et. al. CVPR 2018
SPADEImprove pix2pixHD on handling diverse input labels and delivering better output quality.Park et. al. CVPR 2019

Unsupervised Image-to-Image Translation

Algorithm NameFeaturePublication
UNITLearn a one-to-one mapping between two visual domains.Liu et. al. NeurIPS 2017
MUNITLearn a many-to-many mapping between two visual domains.Huang et. al. ECCV 2018
FUNITLearn a style-guided image translation model that can generate translations in unseen domains.Liu et. al. ICCV 2019
COCO-FUNITImprove FUNIT with a content-conditioned style encoding scheme for style code computation.Saito et. al. ECCV 2020

Video-to-video Translation

Algorithm NameFeaturePublication
vid2vidLearn a mapping that converts a semantic video to a photorealistic video.Wang et. al. NeurIPS 2018
fs-vid2vidLearn a subject-agnostic mapping that converts a semantic video and an example image to a photoreslitic video.Wang et. al. NeurIPS 2019

World-to-world Translation

Algorithm NameFeaturePublication
wc-vid2vidImprove vid2vid on view consistency and long-term consistency.Mallya et. al. ECCV 2020
GANcraftConvert semantic block worlds to realistic-looking worlds.Hao et. al. ICCV 2021

NVlabs/imaginaire

NVIDIA's Deep Imagination Team's PyTorch Library

Python

4,078

45 commits

updated Nov 29, 2022

See the code

README

imaginaire_logo.svg

Imaginaire

Docs | License | Installation | Model Zoo

Imaginaire is a pytorch library that contains optimized implementation of several image and video synthesis methods developed at NVIDIA.

License

Imaginaire is released under NVIDIA Software license. For commercial use, please consult NVIDIA Research Inquiries.

What's inside?

IMAGE ALT TEXT

We have a tutorial for each model. Click on the model name, and your browser should take you to the tutorial page for the project.

Supervised Image-to-Image Translation

Algorithm NameFeaturePublication
pix2pixHDLearn a mapping that converts a semantic image to a high-resolution photorealistic image.Wang et. al. CVPR 2018
SPADEImprove pix2pixHD on handling diverse input labels and delivering better output quality.Park et. al. CVPR 2019

Unsupervised Image-to-Image Translation

Algorithm NameFeaturePublication
UNITLearn a one-to-one mapping between two visual domains.Liu et. al. NeurIPS 2017
MUNITLearn a many-to-many mapping between two visual domains.Huang et. al. ECCV 2018
FUNITLearn a style-guided image translation model that can generate translations in unseen domains.Liu et. al. ICCV 2019
COCO-FUNITImprove FUNIT with a content-conditioned style encoding scheme for style code computation.Saito et. al. ECCV 2020

Video-to-video Translation

Algorithm NameFeaturePublication
vid2vidLearn a mapping that converts a semantic video to a photorealistic video.Wang et. al. NeurIPS 2018
fs-vid2vidLearn a subject-agnostic mapping that converts a semantic video and an example image to a photoreslitic video.Wang et. al. NeurIPS 2019

World-to-world Translation

Algorithm NameFeaturePublication
wc-vid2vidImprove vid2vid on view consistency and long-term consistency.Mallya et. al. ECCV 2020
GANcraftConvert semantic block worlds to realistic-looking worlds.Hao et. al. ICCV 2021

Significant stargazers

(top 24 of 31)

Xintao

4,155 followers · starred Oct 2020

Jun-Yan Zhu

7,036 followers · starred Aug 2021

Ben Feuer

37 followers · starred Jun 2021

Robin Rombach

1,108 followers · starred Sep 2020