zelaki/eq-vae

Model

EQ-VAE: Equivariance Regularized Latent Space for Improved Generative Image Modeling

7

5 commits

2 linked in READMEs

updated Feb 21, 2025

See the code

README

EQ-VAE: Equivariance Regularized Latent Space for Improved Generative Image Modeling

Arxiv: https://arxiv.org/abs/2502.09509

EQ-VAE regularizes the latent space of pretrained autoencoders by enforcing equivariance under scaling and rotation transformations.


Model Description

This model is a regularized version of SD-VAE. We finetune it with EQ-VAE regularization for 5 epochs on OpenImages.

Model Usage

  1. Loading the Model
    You can load the model from the Hugging Face Hub:
    from transformers import AutoencoderKL
    model = AutoencoderKL.from_pretrained("zelaki/eq-vae")
    

Metrics

Reconstruction performance of eq-vae-ema on Imagenet Validation Set.

MetricScore
FID0.82
PSNR25.95
LPIPS0.141
SSIM0.72

diffusers
safetensors

zelaki/eq-vae

Model

EQ-VAE: Equivariance Regularized Latent Space for Improved Generative Image Modeling

7

5 commits

2 linked in READMEs

updated Feb 21, 2025

See the code

README

EQ-VAE: Equivariance Regularized Latent Space for Improved Generative Image Modeling

Arxiv: https://arxiv.org/abs/2502.09509

EQ-VAE regularizes the latent space of pretrained autoencoders by enforcing equivariance under scaling and rotation transformations.


Model Description

This model is a regularized version of SD-VAE. We finetune it with EQ-VAE regularization for 5 epochs on OpenImages.

Model Usage

  1. Loading the Model
    You can load the model from the Hugging Face Hub:
    from transformers import AutoencoderKL
    model = AutoencoderKL.from_pretrained("zelaki/eq-vae")
    

Metrics

Reconstruction performance of eq-vae-ema on Imagenet Validation Set.

MetricScore
FID0.82
PSNR25.95
LPIPS0.141
SSIM0.72

diffusers
safetensors