Upscale-A-Video
PaidTemporal-consistent AI video upscaling with diffusion models.
About Upscale-A-Video
Upscale-A-Video is a diffusion-based model for real-world video super-resolution, presented at CVPR 2024 as a Highlight. Developed by researchers at Nanyang Technological University, it enhances video resolution while maintaining temporal consistency across frames. The model accepts low-resolution videos and optional text prompts to guide the upscaling process. It includes support for color correction (AdaIn, Wavelet), optional integration with LLaVA for automatic prompt generation, and provides a command-line inference script with tunable parameters such as noise level, guidance scale, and diffusion steps. The repository also supplies pretrained models and the YouHQ dataset for training and evaluation.
Key Features
Pros & Cons
- Open-source and free to use
- Published as a CVPR 2024 Highlight, indicating strong peer-reviewed research
- Specifically designed for temporal consistency, reducing flickering across frames
- Supports text prompts for guided upscaling
- Flexible color correction options to match output colors
- Requires manual setup: cloning repo, creating conda environment, installing dependencies
- Needs downloading large pretrained models before first use
- Optimized for GPU usage; may not run efficiently on CPU
- Command-line interface only; no graphical user interface or web service
- Inference time can be long for high-resolution or many frames
Best For
Alternatives to Upscale-A-Video
Final2x
Open-source AI image lossless upscaling tool with multiple models
Petalica Paint
Transform sketches into vibrant art effortlessly with Petalica Paint.
Variart
Transform copyrighted images into unique, copyright-free versions with Variart.
Recolorai
Unleash Your Creativity with ReColor AI
Secta Labs
Secta Labs advanced AI image tool converts selfies into professional headshots within hours with a selection of styles available in a private gallery.
Upscayl
Upscale low-res images 8x with stunning colors, details, and contrast, all for free.