Why AI video needs a call sheet, not a prompt box
A shot is six independent decisions, not one paragraph. A director agent should be able to edit just one.
Almost every AI video tool has the same interface: one box, and you type a paragraph into it. “A woman in a red coat walks across a rain-slicked street at night, handheld camera, neon reflections, moody and tense.” That sentence is doing six jobs at once, and none of them are labeled.
Nobody runs a film set that way. A call sheet and a shot list exist precisely because a shot is not one decision — it’s several, and they change on different schedules for different reasons. Wardrobe doesn’t touch the camera department’s plan. A lighting change doesn’t imply a new performance. Treating all of it as one paragraph is a convenience for typing, not a description of how shots actually get made or changed.
Six fields, not six adjectives in a sentence
We store a scene as subject, action, camera, lighting, style, and ambience — six fields, each one answerable on its own. Subject and action are what’s in frame and what it’s doing. Camera is the framing and movement. Lighting and ambience are the mood and the atmosphere in it. Style is the rendering treatment sitting on top of all of it. None of these move in lockstep. You can swap a static wide shot for a slow dolly-in without touching what the subject is doing, or push the lighting from daylight to dusk without changing the camera at all.
Collapse that into one string and the fields stop being independent even though the underlying decisions still are. Change the lighting in prose and you’re rewriting a sentence that also names the subject, the action, and the camera — and prose rewrites drift. A word you didn’t mean to touch gets touched anyway.
Style inheritance needs somewhere to land
A project or a style group can set defaults — a consistent look across every scene, overridden only where a scene needs to differ. That only works if “lighting” is a slot a scene can leave empty and inherit into. A raw prompt string has no such slot; there’s no way to say “use the project’s lighting but override my camera” inside one blob of text. Structured fields are what make a style bible something other than a copy-paste starting point that immediately drifts from scene to scene.
The part that matters once an agent is editing the scene
This is where the prompt-box design really falls apart. Say “make this feel more claustrophobic” to a director agent working against a single text field, and it has two bad options: rewrite the whole paragraph and hope it preserves everything you didn’t ask about, or graft an addendum onto the end that reads like nothing a person would write and compiles into a worse prompt.
Against six fields, the same request is a small, specific diff: camera tightens, lighting drops, maybe ambience shifts — subject, action, and style stay exactly as you left them. That diff is something you can actually look at and approve. You’re not re-reading an entire paragraph trying to spot what changed; you’re looking at the one or two fields that did.
Structure is also what lets the agent’s proposal be checked before it ever reaches you. A camera move can be validated against what the target provider actually supports. A style change can be checked against the project’s style bible. A subject change can be checked for continuity against the shots on either side. None of that is possible against an opaque string — there’s nothing to check a sentence against except itself. The agent proposes a change to named fields, not a rewrite of prose, and that’s what makes the proposal reviewable instead of a leap of faith.
The prompt you send to the model is disposable; the six fields aren’t
The text that actually goes to Veo or to Gemini Omni Flash is generated from those six fields at render time, and it’s thrown away the moment the render finishes. It’s not what a scene is — it’s a translation of what a scene is, into whatever dialect this week’s provider prefers. Swap providers, or add a new one, and no scene needs to be rewritten by hand, because no scene was ever a string to begin with.
A call sheet works because it splits one shot into the handful of decisions that actually vary independently, so that changing one doesn’t put the rest at risk. That’s the design Lunar Canoe uses for every scene in a storyboard — six fields per shot, editable one at a time, by you or by the agent sitting next to you.
Written by the people building Lunar Canoe, a storyboard for AI video. More posts on the blog index, or subscribe by RSS.