Vidu Q4 (Reference-to-Video)
Vidu Q4 makes a 3 to 16 second clip from a prompt, up to 12 reference pictures and 3 voice clips that keep characters and voices consistent, up to 4K.
Vidu Q4 (Reference-to-Video) builds a scene from your references. Send up to 12 pictures (characters, products, objects, locations) and up to 3 voice clips, tag them in the prompt, and the model keeps each subject and voice consistent through a clip of 3 to 16 seconds, with optional native sound (dialogue and sound effects), from 540p up to 4K.
Use it for branded content and ads with a recurring product or mascot, character-driven stories and short dialogue scenes. Name the references in the prompt by position, in the order you send them: [@reference_image_1], [@reference_image_2] ... for the pictures and [reference_audio_1], [reference_audio_2] ... for the voice clips, for example: [@reference_image_1] walks along the beach holding [@reference_image_2], then turns to the camera and speaks in the voice of [reference_audio_1]. Use only pictures and voice clips you have the right to use: a real person's face or voice needs that person's permission.
Inputs: prompt (required, up to 5,000 characters), images (up to 12 reference pictures: PNG, JPEG or WebP), reference_audio_urls (up to 3 MP3 voice clips, 3-12 seconds and up to 50 MB each), duration (3-16 seconds, 5 by default), aspect_ratio (16:9, 9:16, 4:3, 3:4 or 1:1), resolution (540p, 720p, 1080p, 2K or 4K; 720p by default), audio (sound with dialogue and effects; on by default) and seed. Pictures and voices are optional. Outputs: video, one MP4 clip, and seed.
Price per second of video: $0.0315 at 540p, $0.0665 at 720p, $0.084 at 1080p, $0.133 at 2K and $0.273 at 4K. The default 5-second 720p clip costs $0.3325, 16 seconds at 4K $4.368. The pictures, the voices and the sound do not change the price. It takes pictures and voice clips only, not reference videos, and does not edit or extend a video; to animate one picture as the first frame use Vidu Q4 (Image-to-Video).
- Image to Video
Price: From $0.0315 per second of duration, depending on resolution. One run with default settings costs $0.3325.
Run Vidu Q4 (Reference-to-Video) via API
curl -X POST https://api.flymy.ai/api/v1/flymyai/vidu-q4-reference-to-video/predict \
-H "X-API-KEY: $FLYMYAI_API_KEY" \
-H "Content-Type: application/json" \
-d '{"prompt":"The red mug [@reference_image_1] on a wooden cafe table, steam rising","images":["https://flymy.ai/img/models/bytedance-seedream-5-0-pro.jpg"],"duration":3,"resolution":"540p"}'API documentation · Create a free account · Pricing