Meta Human Demo

Preparation

1. Clone the Repository

   git clone https://github.com/ariannaliu/metahuman-demo.git
   cd metahuman-demo
   

2. Download the models from Google Drive

   # unzip the files, put the folders of models under ./checkpoints
   # remove the files generated by mac zip (optional)
   metahuman-demo
   |
    ---checkpoints
      |
      |---camera
      |  |
      |   ---cctv1
      |  |
      |   ---cctv2   
      |
       ---human
         |
          ---ip-adapter-faceid_sdxl.bin
      
   

Camera New Style Customization

Installation

Prerequisites

• Anaconda or Miniconda
• Python 3.10

Steps

1. Clone the Repository

   git clone https://github.com/ariannaliu/metahuman-demo.git
   cd metahuman-demo
   # Download the model mention in the preparation part
   

2. Create a Conda Environment

   Create a new conda environment and install the required packages:

   conda create -n metahuman python=3.10
   conda activate metahuman
   pip install accelerate transformers safetensors diffusers datasets numpy scipy
   

Usage

Navigate to the src directory and run the inference script with a prompt:

cd src
python3 inference.py --prompt "a photo of camera PE204 in pink color"

Prompt Requirements

The prompt must contain one of the following cameras:

Examples

Metahuman Wearing Safety Equipment

This project generates images of metahumans wearing safety equipment based on a given input image and text prompt.

Installation

Prerequisites

• Anaconda or Miniconda
• Python 3.10

Steps

1. Clone the Repository

   git clone https://github.com/ariannaliu/metahuman-demo.git
   cd metahuman-demo
   # Download the model mention in the preparation part
   

2. Create a Conda Environment

   conda create -n ip python=3.10
   conda activate ip
   

3. Install Required Packages

   pip install diffusers==0.22.1 accelerate transformers safetensors datasets numpy scipy insightface
   pip install git+https://github.com/tencent-ailab/IP-Adapter.git
   pip install onnxruntime einops
   

Usage

To generate an image of a metahuman wearing safety equipment, run the following command:

cd src_human
python3 demo.py --image_path "1.png" --prompt "a man wearing yellow working uniform"

• --image_path: Path to the input image.
• --prompt: Text prompt describing the desired output.

Examples

Acknowledgements

• IP-Adapter by Tencent AI Lab
• Diffusers Library by Hugging Face