Follow-Your-Click logo

Follow-Your-Click

Paid

Open-domain Regional Image Animation via Short Prompts

4.5
Inputs: imageOutputs: video
Type
Saas

About Follow-Your-Click

Follow-Your-Click is an open-domain regional image animation framework that allows users to animate specific regions of an image using short text prompts and mouse clicks. Developed by researchers from HKUST, Tencent Hunyuan, and Tsinghua University, it leverages a motion-augmented module and a short-prompt dataset to generate high-quality animations with user-guided control. The system supports various motion strengths through optical flow-based control (OFM) and demonstrates state-of-the-art results compared to methods like Animate-Anything, DynamiCrafter, and commercial tools such as Gen-2 and Pika Labs. The project is published at ECCV 2024 and provides code, paper, and demos.

Key Features

Regional image animation guided by user clicks
Short text prompt-driven animation generation
Optical flow motion strength control (OFM) for adjustable motion magnitude
Open-domain support for diverse subjects and scenes
Comparison with state-of-the-art animation methods (Animate-Anything, SVD, DynamiCrafter, I2VGen-XL, Gen-2, Genmo, Pika Labs)
Motion-augmented module and short-prompt dataset for improved quality

Pros & Cons

Pros
  • State-of-the-art open-domain animation quality with short prompts
  • User-friendly click-based region selection for targeted animation
  • Fine-grained motion strength control via optical flow magnitude
  • Supports a wide variety of subjects and motions without per-case tuning
  • Publicly available paper and code for research and experimentation
Cons
  • Limited in generating large and complex human motions due to complexity and training data rarity

Best For

Animating animal movements (e.g., flap wings, shake body)Generating human actions (dancing, running, swimming, nodding)Creating facial expression animations (smile, sad, blink, angry)Simulating object motion (fire, storm, drift, launch)Video content creation for creative projects and demonstrations

Alternatives to Follow-Your-Click

FAQ

Is the source code available?
Yes, the code is available on GitHub at the link provided on the project page.
What are the input requirements?
The system takes an image, a user click to specify the region to animate, and a short text prompt describing the desired motion.
What type of output does it produce?
It generates animated videos of the selected region following the prompt-driven motion.
What is the main limitation?
The approach struggles with large and complex human motions, possibly due to the complexity and rarity of related training samples.