Sanster/PowerPaint_v2

Model

Model from: https://huggingface.co/JunhaoZhuang/PowerPaint_v2

4

3 commits

3 linked in READMEs

updated Apr 16, 2024

See the code

README

Model from: https://huggingface.co/JunhaoZhuang/PowerPaint_v2

Tokens (P_ctxt, P_shape, P_obj) added by PowerPaint has been integrated into the text_encoder and tokenizer.

Unlike PowerPaint_v1, PowerPaint_v2 uses a method similar to BrushNet, so it can be applied to any sd1.5 type basic model.

Clone demo code and models:

git lfs install
git clone https://huggingface.co/Sanster/PowerPaint_v2

Run main.py:

python3 main.py runwayml/stable-diffusion-v1-5

The demo code will generate following results:

Original ImageMask
original_imagemask_image

Object Removal Task

object-removal

Shape Guided Task

shape-guided

Context aware Task

context-aware

Inpaint Task

inpaint

Outpaint Task

outpaint

diffusers
safetensors

Contributors

Sanster

3 commits

Sanster/PowerPaint_v2

Model

Model from: https://huggingface.co/JunhaoZhuang/PowerPaint_v2

4

3 commits

3 linked in READMEs

updated Apr 16, 2024

See the code

README

Model from: https://huggingface.co/JunhaoZhuang/PowerPaint_v2

Tokens (P_ctxt, P_shape, P_obj) added by PowerPaint has been integrated into the text_encoder and tokenizer.

Unlike PowerPaint_v1, PowerPaint_v2 uses a method similar to BrushNet, so it can be applied to any sd1.5 type basic model.

Clone demo code and models:

git lfs install
git clone https://huggingface.co/Sanster/PowerPaint_v2

Run main.py:

python3 main.py runwayml/stable-diffusion-v1-5

The demo code will generate following results:

Original ImageMask
original_imagemask_image

Object Removal Task

object-removal

Shape Guided Task

shape-guided

Context aware Task

context-aware

Inpaint Task

inpaint

Outpaint Task

outpaint

diffusers
safetensors

Contributors

Sanster

3 commits