EdenLive prompt guide

Send EdenLive a video feed, one reference image, and a text prompt. The video guides the layout, camera, and motion. The reference and prompt guide the appearance. Use a reference and prompt that match the scene in the video.

Match the reference to the opening view

Capture a frame from the view you plan to stream. In a 3D scene, place the player and camera before you capture it. Restyle the frame with an image editor or image-generation tool, keeping the camera angle, perspective, and positions of the main objects. In a third-person view, keep the character in the same position and at about the same size. EdenLive scales and center-crops the reference to 1280 × 704. Check the crop before you start, especially around objects near the edges. The generated output is also 1280 × 704.

Do	Do not
Change materials, lighting, and visual style while retaining the scene layout.	Replace the opening view with an unrelated composition.
Keep the camera and player at the captured pose until you start the world.	Capture a reference, then move to a different view before starting.
Check where the main objects and character appear after cropping.	Assume an image with a different aspect ratio preserves its full framing.

In an image-generation tool, try this instruction to restyle the captured frame:

Restyle this campground as a cinematic environment with natural materials,
soft evening light, and warm firelight. Keep the camera angle, perspective,
and positions of the tent, benches, campfire, trees, and fence.

Use that instruction in your image tool and upload the resulting image as your reference. Then write a scene prompt for EdenLive.

Describe the scene you want to see

Describe the setting and what appears in it. Specify materials, lighting, or other details that matter to the appearance. If a simple shape represents a character, describe who you want to see in its place. Match that description to the reference image.

A woodland campground in a cinematic, realistic style. A canvas tent stands
near a stone-ring campfire between two wooden benches. Pine trees, bushes,
boulders, and a timber fence surround the clearing. Natural wood and stone
textures, soft evening light, and warm firelight.

Adapt this prompt to your own scene and reference image. For a third-person scene with a capsule-shaped player, you could add:

The capsule represents a traveler in an ochre jacket. Show the traveler at
the capsule's position and approximate scale as the player moves.

Test these prompts with your own scene. Movement, collisions, and game rules remain in your app, and its rendered video guides the camera movement and action.

Do	Do not
Describe visible details, such as canvas fabric, rough stone, or warm firelight.	Rely only on vague instructions such as “make it look better.”
Use the same character description in the prompt and reference.	Ask for a different character or style than the reference depicts.
Implement movement, collisions, and objectives in your app.	Expect prompt text to implement game logic or change the scene’s geometry.

Use a nonblank prompt of up to 4096 characters. See set_prompt for the command format.

Change the appearance during a world

Send a new prompt with set_prompt. It applies from the next generated chunk, while EdenLive retains the world’s visual history. A large style change can appear gradually. Updating the prompt leaves a paused world paused. For example, keep the campground and change its lighting:

A woodland campground with the same canvas tent, stone-ring campfire,
wooden benches, and surrounding pine trees. Cool moonlight lights the
clearing, with warm firelight on the nearby wood and stone.

To replace the reference image:

Pause the world with set_paused.
Upload the new image.
Call set_image with the upload reference. This ends the current world.
Call start to create a new world from the image. See the schema guide for the full sequence.

Do	Do not
Change one aspect at a time when comparing results.	Change the image, prompt, and video together and attribute the result to one input.
Resume a paused world when you want to see a prompt update.	Expect a prompt update to resume generation or reset the world’s visual history.

Try a webcam or another video source

In a custom client, source_video can carry a webcam feed or video played from a file. Publish that video at a steady 10 to 60 fps and use set_source with source: "client". The tutorial shows how to publish video from a canvas. Create the reference from the view where you plan to start the video. Check the framing and orientation of the frames your client actually sends. For a webcam, check whether mirroring affects only the preview or also the transmitted video. Keep the camera steady for your first test, then introduce movement gradually.

Do	Do not
Match the reference to the transmitted video, including its crop and orientation.	Assume the browser preview and transmitted frames always match.
Start file playback from the position used to create the reference.	Let playback advance to an unrelated shot before starting the world.

Our examples use rendered 3D scenes. We have not validated output quality for webcams or prerecorded video, including moving subjects. Treat the suggestions above as a starting point for your own tests.

Overview

FastH3-Omni

EdenLive

Vidu S2-Avatar

Vidu S2-Editing

H3 Reference Turbo Realtime

FastH3

Visko Orbis Stable

Visko Orbis Dynamic

HappyOyster

LingBot World 2

LingBot

X2

Helios

LongLive-2.0

SANA-Streaming

LTX

EdenLive prompt guide

Match the reference to the opening view

Describe the scene you want to see

Change the appearance during a world

Try a webcam or another video source

See also

​Match the reference to the opening view

​Describe the scene you want to see

​Change the appearance during a world

​Try a webcam or another video source

​See also

Match the reference to the opening view

Describe the scene you want to see

Change the appearance during a world

Try a webcam or another video source

See also