Take a prompt, generate an image using Stable Diffusion, feed the image into BLIP to generate a description, and use that as a prompt for Stable Diffusion. Repeat this until a BLIP description is produced that has already been seen, or until we reach the maximum number of steps.

You can try it out sd-blip attraction on huggingface at:
https://huggingface.co/spaces/ciyer/sd-blip-attraction
Be warned, though, that you will need to have some patience to see the output.
To run, you need the dioxus cli (and all its dependencies) installed. Once you have that, you can run the app with:
dx serve
And then connect a web browser to http://localhost:8080.
To build for distribution, run:
dx build --release --platform fullstack
The app should be in the dist directory, and can be run with:
dist/sd-blip-attraction
The app runs much faster with hardware acceleration, but requires a slightly different command for the build.
To build using Metal on Apple hardware, use the following sequence of commands:
dx build --release --platform fullstack --server-feature metal
cargo build --release --features server,metal
And then run with:
target/release/sd-blip-attraction
Connect a web browser to http://localhost:8080, where you should see the app. You may see some complaints in the logs, but they can be ignored.
It should be possible to replace metal with cuda in the command above, but I have not tested this myself, since I do not have the right hardware.
2 commits
Rust
97.8%
Dockerfile
2.2%
Take a prompt, generate an image using Stable Diffusion, feed the image into BLIP to generate a description, and use that as a prompt for Stable Diffusion. Repeat this until a BLIP description is produced that has already been seen, or until we reach the maximum number of steps.

You can try it out sd-blip attraction on huggingface at:
https://huggingface.co/spaces/ciyer/sd-blip-attraction
Be warned, though, that you will need to have some patience to see the output.
To run, you need the dioxus cli (and all its dependencies) installed. Once you have that, you can run the app with:
dx serve
And then connect a web browser to http://localhost:8080.
To build for distribution, run:
dx build --release --platform fullstack
The app should be in the dist directory, and can be run with:
dist/sd-blip-attraction
The app runs much faster with hardware acceleration, but requires a slightly different command for the build.
To build using Metal on Apple hardware, use the following sequence of commands:
dx build --release --platform fullstack --server-feature metal
cargo build --release --features server,metal
And then run with:
target/release/sd-blip-attraction
Connect a web browser to http://localhost:8080, where you should see the app. You may see some complaints in the logs, but they can be ignored.
It should be possible to replace metal with cuda in the command above, but I have not tested this myself, since I do not have the right hardware.
2 commits
Rust
97.8%
Dockerfile
2.2%