ussoewwin/CCSR-TensorRT-Engine

Model

0

stars

10

commits

3

linked in READMEs

Sep 4, 2026

updated

ccsr
comfyui
controlnet
image-to-image
rtx
super-resolution
tensorrt
upscaling

README

CCSR: TensorRT RTX Acceleration Engine

Ultra-fast TensorRT RTX execution engine and auxiliary modules for CCSR (Creative Content Super-Resolution), designed for real-time generative image upscaling in ComfyUI.

πŸ“¦ ComfyUI Loader & Upscaler Extension: All nodes supporting TensorRT engine execution are available in: πŸ‘‰ https://github.com/ussoewwin/ComfyUI-NunchakuFluxLoraStacker


🌟 Overview

Creative Content Super-Resolution (CCSR) is a diffusion-based super-resolution framework leveraging a Controlled UNet and ControlNet structure to synthesize rich photorealistic textures and fine details.

This repository provides an optimized NVIDIA TensorRT RTX Engine implementation for CCSR:

  • Fused Denoising Engine (ccsr_apply_f16io.rtxplan):
    • Fuses the ControlNet and Controlled UNet denoising computation into a single compiled TensorRT engine.
    • Fixed 512px tile resolution (64Γ—64 latent tile) executing at 24 ms/step (4.7Γ— speedup over PyTorch FP16 at ~113 ms/step on modern RTX GPUs).
    • Synchronized stream execution on current PyTorch CUDA streams to eliminate race conditions and deadlocks.
  • Engine-Only Deployment (ccsr_trt_aux.safetensors):
    • Contains only the essential companion modules: FP16 AutoencoderKL (VAE encoder/decoder) and condition encoder.
    • Automatically loaded alongside the engine, eliminating the need to download large full checkpoints (~3.2 GB saved).

πŸ“¦ Available Files

FilenameDescriptionArchitecture / ComponentsFile SizeRecommended LocationLicense
ccsr_apply_f16io.rtxplanTensorRT Fused Denoising EngineControlNet + UNet fused RTX Engine (Tile 512px / Latent 64Γ—64)~1.4 GBcustom_nodes/.../nodes/CCSR/trt_engines/Apache-2.0
ccsr_trt_aux.safetensorsTRT Auxiliary WeightsFP16 VAE AutoencoderKL + Condition Encoder~450 MBcustom_nodes/.../nodes/CCSR/trt_engines/Apache-2.0

βš™οΈ Performance & Benchmark Comparison

Measurements conducted on an NVIDIA RTX 4090 / RTX 5090 environment:

Execution ModeFiles RequiredVRAM Overhead (Denoising)Step Latency (Tile 512)Speedup
Stock CCSR (FP16 PyTorch)Full Checkpoint (~3.2 GB)~3.8 GiB~113 ms / step1.0Γ— (Baseline)
CCSR TensorRT RTXEngine + Aux (~1.85 GB total)~2.2 GiB~24 ms / step~4.7Γ— faster

πŸš€ Usage in ComfyUI

TensorRT engine execution for CCSR is integrated natively into the ComfyUI-NunchakuFluxLoraStacker custom-node pack.

Workflow Example

CCSR TensorRT RTX Engine Workflow in ComfyUI

Installation & Setup

  1. Install the Custom Node Pack:

    cd ComfyUI/custom_nodes
    git clone https://github.com/ussoewwin/ComfyUI-NunchakuFluxLoraStacker.git
    
  2. Place Engine & Aux Files: Download both ccsr_apply_f16io.rtxplan and ccsr_trt_aux.safetensors and place them directly into the engine directory:

    ComfyUI/custom_nodes/ComfyUI-NunchakuFluxLoraStacker/nodes/CCSR/trt_engines/
    β”œβ”€β”€ ccsr_apply_f16io.rtxplan
    └── ccsr_trt_aux.safetensors
    
  3. In ComfyUI:

    • Add Load CCSR Model (TensorRT) (LoadCCSRModelTensorRT). The node automatically discovers .rtxplan files in trt_engines/ and loads the companion ccsr_trt_aux.safetensors.
    • Connect the ccsr_model output to CCSR Upscale (TRT) (CCSR_Upscale_TRT).
    • Connect an input image to image.
    • Configure upscale parameters:
      • tile_size: 512 (fixed to match the compiled static engine shape)
      • tile_stride: 256 (recommended for seamless blending)
      • color_fix_type: adain (or wavelet / none)
      • steps: Effective diffusion step count (densified schedule guarantees exact execution of requested step count)

πŸ“œ Credits & License

Contributors

ussoewwin

10 commits

ussoewwin/CCSR-TensorRT-Engine

Model

0

stars

10

commits

3

linked in READMEs

Sep 4, 2026

updated

ccsr
comfyui
controlnet
image-to-image
rtx
super-resolution
tensorrt
upscaling

README

CCSR: TensorRT RTX Acceleration Engine

Ultra-fast TensorRT RTX execution engine and auxiliary modules for CCSR (Creative Content Super-Resolution), designed for real-time generative image upscaling in ComfyUI.

πŸ“¦ ComfyUI Loader & Upscaler Extension: All nodes supporting TensorRT engine execution are available in: πŸ‘‰ https://github.com/ussoewwin/ComfyUI-NunchakuFluxLoraStacker


🌟 Overview

Creative Content Super-Resolution (CCSR) is a diffusion-based super-resolution framework leveraging a Controlled UNet and ControlNet structure to synthesize rich photorealistic textures and fine details.

This repository provides an optimized NVIDIA TensorRT RTX Engine implementation for CCSR:

  • Fused Denoising Engine (ccsr_apply_f16io.rtxplan):
    • Fuses the ControlNet and Controlled UNet denoising computation into a single compiled TensorRT engine.
    • Fixed 512px tile resolution (64Γ—64 latent tile) executing at 24 ms/step (4.7Γ— speedup over PyTorch FP16 at ~113 ms/step on modern RTX GPUs).
    • Synchronized stream execution on current PyTorch CUDA streams to eliminate race conditions and deadlocks.
  • Engine-Only Deployment (ccsr_trt_aux.safetensors):
    • Contains only the essential companion modules: FP16 AutoencoderKL (VAE encoder/decoder) and condition encoder.
    • Automatically loaded alongside the engine, eliminating the need to download large full checkpoints (~3.2 GB saved).

πŸ“¦ Available Files

FilenameDescriptionArchitecture / ComponentsFile SizeRecommended LocationLicense
ccsr_apply_f16io.rtxplanTensorRT Fused Denoising EngineControlNet + UNet fused RTX Engine (Tile 512px / Latent 64Γ—64)~1.4 GBcustom_nodes/.../nodes/CCSR/trt_engines/Apache-2.0
ccsr_trt_aux.safetensorsTRT Auxiliary WeightsFP16 VAE AutoencoderKL + Condition Encoder~450 MBcustom_nodes/.../nodes/CCSR/trt_engines/Apache-2.0

βš™οΈ Performance & Benchmark Comparison

Measurements conducted on an NVIDIA RTX 4090 / RTX 5090 environment:

Execution ModeFiles RequiredVRAM Overhead (Denoising)Step Latency (Tile 512)Speedup
Stock CCSR (FP16 PyTorch)Full Checkpoint (~3.2 GB)~3.8 GiB~113 ms / step1.0Γ— (Baseline)
CCSR TensorRT RTXEngine + Aux (~1.85 GB total)~2.2 GiB~24 ms / step~4.7Γ— faster

πŸš€ Usage in ComfyUI

TensorRT engine execution for CCSR is integrated natively into the ComfyUI-NunchakuFluxLoraStacker custom-node pack.

Workflow Example

CCSR TensorRT RTX Engine Workflow in ComfyUI

Installation & Setup

  1. Install the Custom Node Pack:

    cd ComfyUI/custom_nodes
    git clone https://github.com/ussoewwin/ComfyUI-NunchakuFluxLoraStacker.git
    
  2. Place Engine & Aux Files: Download both ccsr_apply_f16io.rtxplan and ccsr_trt_aux.safetensors and place them directly into the engine directory:

    ComfyUI/custom_nodes/ComfyUI-NunchakuFluxLoraStacker/nodes/CCSR/trt_engines/
    β”œβ”€β”€ ccsr_apply_f16io.rtxplan
    └── ccsr_trt_aux.safetensors
    
  3. In ComfyUI:

    • Add Load CCSR Model (TensorRT) (LoadCCSRModelTensorRT). The node automatically discovers .rtxplan files in trt_engines/ and loads the companion ccsr_trt_aux.safetensors.
    • Connect the ccsr_model output to CCSR Upscale (TRT) (CCSR_Upscale_TRT).
    • Connect an input image to image.
    • Configure upscale parameters:
      • tile_size: 512 (fixed to match the compiled static engine shape)
      • tile_stride: 256 (recommended for seamless blending)
      • color_fix_type: adain (or wavelet / none)
      • steps: Effective diffusion step count (densified schedule guarantees exact execution of requested step count)

πŸ“œ Credits & License

Contributors

ussoewwin

10 commits