Daydream Scope

Scope is a tool for running and customizing real-time, interactive generative AI pipelines and models.

Table of Contents

• Table of Contents
• Features
• System Requirements
• Quick Start
• Runpod
• Firewalls
• Contributing
• Troubleshooting
• License

Features

• Autoregressive video diffusion models with configurable VAEs
  • StreamDiffusionV2 (text-to-video, video-to-video)
  • LongLive (text-to-video, video-to-video)
  • Krea Realtime Video (text-to-video)
  • RewardForcing (text-to-video, video-to-video)
  • MemFlow (text-to-video, video-to-video)
  • Additional models including Waypoint-1 via plugins
• Composable pipeline architecture enabling using additional video processing techniques such as real-time depth mapping and frame interpolation together with video diffusion
• Plugins to extend Scope's capabilities with new models, visual effects and more
• LoRAs to customize concepts and styles used with autoregressive video diffusion models
• VACE to use reference images and control videos to guide autoregressive video diffusion models
• API with WebRTC real-time streaming
• NDI real-time video sharing across local networks
• Spout (Windows only) and Syphon (macOS only) real-time video sharing with local applications
• Low latency async video processing pipelines
• Interactive UI with timeline editor, text prompting, model parameter controls and video/camera/text input modes

...and more to come!

System Requirements

Check out the Systems Requirements reference.

Quick Start

Check out the Quick Start.

Runpod

Check out the instructions for deploying Scope on Runpod using a template.

[!IMPORTANT] The template will store model files under /workspace/models because RunPod mounts a volume disk at /workspace allowing any files there to be retained across pod restarts.

[!NOTE] If you want to use the version from the main branch, you need to use the daydreamlive/scope:main docker image. You can configure this in the RunPod template by editing the Docker image setting.

Firewalls

If you run Scope in a cloud environment with restrictive firewall settings (eg. Runpod), Scope supports using TURN servers to establish a connection between your browser and the streaming server.

The easiest way to enable this feature is to follow the HuggingFace Auth guide which walks through using a HuggingFace account to access Cloudflare's TURN servers.

Environment Variables

Check out the Environment Variables reference.

Contributing

Check out the contribution guide.

Troubleshooting

Check out the Troubleshooting page.

License

The alpha version of this project is licensed under CC BY-NC-SA 4.0.

You may use, modify, and share the code for non-commercial purposes only, provided that proper attribution is given.

We will consider re-licensing future versions under a more permissive license if/when non-commercial dependencies are refactored or replaced.