Skip to content

AI video workflow: from a rough idea to a production plan

Start from what the person brings, offer a few concrete possibilities and recommend one, describe the treatment through what the viewer sees and hears, choose the approach from the material, and test the uncertain part cheaply, with two real productions followed from their first sentence to the finished film.

Updated

A good AI video workflow starts before the first generation: a rough idea becomes a direction the person can picture, and the direction becomes a plan the next maker can act on. Generation is the expensive, slow part, so the decisions that change what gets made should happen first. Here are two real productions made with Bald Rhino, followed from the first sentence to the finished film.

1. How do you turn a rough idea into a video plan?

Begin with whatever the person brings: a goal, a sentence, a reference, a recording, a feeling. Develop it with concrete suggestions they can react to, recommend one in ordinary language, and ask only the questions whose answers change what gets made. Someone unsure of the answer can react to the recommendation instead. Here’s one request, as it was typed:

From a sentence to a film

1 · The request

“I want to make instagram discussion about socrates and Aristoteles choosing a trendy common topic and discuss in a philosophical way with humor, can we can use thinking orbs and the hairline lib and the other tools a professional, entertaining video”

2 · What the agent asked

  1. Topic I chose doomscrolling at 2 a.m. as the trending topic. Keep it, or switch?

    • Doomscrolling at 2 a.m. recommended (chosen) Script already drafted; everyone recognises it
    • AI did my homework Socrates vs. ChatGPT-style answers: is it knowledge?
    • Texting your ex Desire, virtue, the golden mean of double-texting
  2. Characters How should the philosophers appear?

    • A: Still marble busts + Thinking Orbs recommended (chosen) Orbs act as their voices; clean and graphic, and much cheaper
    • B: Animated talking busts Lip-sync on about four key lines, at many times the media cost
  3. Language Which language should the voices and captions use?

    • English recommended (chosen)
    • Other (type it)

3 · The direction

The Unexamined Scroll

The idea
It's 2 a.m. and Aristotle is doomscrolling raccoon videos. Socrates catches him and asks innocent questions until Aristotle admits he feels terrible; Aristotle fights back with the golden mean and quotes himself wrong.
The hook
“02:00” glowing in the dark, and “Why are you still scrolling?” in the first seconds.
The payoff
A live fact check of a famous quotation, and a last line made to be screenshotted.
The look
Dark editorial, two marble busts in one consistent style; an orb above each comes alive while he speaks, taking the place of lip-sync.
The sound
Two cast voices, an older sly Socrates and a brisk, defensive Aristotle; a quiet late-night bed that drops out for the punchlines; a soft chime on each question.

4 · The plan's beats, in the film

Choose a beat to play the film from it.

The request named tools and a tone but not a topic, a look or a language, so those became the questions. Each question offered real alternatives, each with what it would mean, and one recommendation. Notice what wasn’t asked: which voice model, which image model, which font. The agent chooses those and explains them only when the explanation helps the person choose. The second question is about the experience (still busts with animated orbs, or talking busts), and the cost difference is part of the answer.

The direction then describes the piece the way a viewer would meet it: the hook, the turn, the payoff, the look and the sound, each tied to a moment. Most of the beats reached the film as planned; the fact check changed form but kept its job. A plan is a working document, not a contract with the first idea.

2. What goes in a creative direction?

Representative moments described through what happens, what the viewer sees, what they hear, and why the moment changes. Develop the opening, the important transitions and the ending as far as this idea needs, without forcing every brief into the same structure.

Translate references into choices. “Cinematic”, a channel’s name or a previous palette doesn’t specify anything; framing, contrast, graphic density, movement, rhythm and sound tied to a particular moment do. Decide where stillness or an uninterrupted performance helps as well as where a cut or a move does. There is no required cut frequency.

Think about the sound while choosing the picture: who carries the passage (the person, a narrator, a dialogue, the scene itself), what music or ambience should make perceptible, and where it should drop out. For a joke or a reveal, decide what is withheld and when it’s released, as the Socrates plan has its music drop out for “Raccoons…” and “Asleep”.

Before sharing a direction, test it: can the person picture a specific opening? Does the imagery support the point? Is it feasible with the material and tools? Would the same proposal survive unchanged if the subject were swapped for an unrelated one? If so, it’s interchangeable; make it specific.

3. Choose the production approach from the material

Read what the person supplied before proposing its role, then choose the approach passage by passage. These can coexist in one video:

What the passage needs A direction that does it Settle early
The person’s presence or demonstration Direct a recording, or build around their existing take Can they film? Does the framing leave room for later graphics? Is the take usable?
The person on screen, but no filming A generated performance from their photos and voice, where a model supports it Whether likeness, pronunciation, gestures and sync survive together
Proof of an interface, document or result The real screen or result, framed so the detail is readable What must be seen, what must stay private, whether it supports the claim
A relationship, quantity or process A diagram or designed animation whose changes explain it The facts, and the order in which the viewer needs them
A scene or place that can’t be filmed A generated scene, developed as action, viewpoint and sound What must recur across shots, and a fallback that keeps the scene’s purpose

Give every passage a reason for its medium: a reaction may need the speaker full frame, an explanation may need the diagram to take over. Assign each reference its job before making anything that depends on it, and say what it should not impose. A reference is not a guarantee: confirm that the chosen tool supports the use.

4. Storyboard or shot list: what’s the difference?

A storyboard shows the key moments as pictures, to agree on what the video looks like. A shot list describes every shot: its framing, its one main action, its sound and its length, to agree on what gets made. A short piece often needs only the shot list and two or three key frames. Low Tide’s plan was six shots of five seconds each, one main action per shot, in three beats: the walk, the rest, the empty space. How many shots does a 30-second video need? As many as it has changes worth showing; a single uninterrupted shot can be the right answer, and so can twelve.

For a connected production (dependent scenes, recordings, graphics, sound, several deliverables), develop the whole progression before substantial production and keep the plan current as real material arrives. A single image or a small edit doesn’t need a shared plan.

5. How do you test an idea before spending?

When a choice is uncertain enough to change the treatment, find the smallest way to settle it: inspect an existing take, sketch the difficult composition, assemble a rough passage or generate a short trial with the real references. Say what the trial will decide. Here is how Low Tide went from a sentence to a film, step by step:

Low Tide, decision by decision
  1. The person

    Asks for “a 30 second sad short film, an old man and his dog on a beach at sunset, realistic”.

    0%
  2. The agent

    Asks about the format, the sound and the checkpoints. The answers: widescreen; wordless, with ambience and a sparse score; show the script, then the plan and its cost, before anything is made.

    0%
  3. The person

    Adds: “love it, but make the dog a golden retriever”.

    0%
  4. The person Approved

    Approves the script: three beats, six shots, no words.

    0%
  5. The person Approved

    Approves the plan: one 30-second multi-shot generation, so the film keeps one continuous ambience, with room for up to three takes.

    0%
  6. The person Declined

    Declines the full 30-second draft probe and asks for something cheaper: one short test clip.

    0%
  7. The agent Made

    Makes a 4-second test clip at draft quality.

    2%
  8. The person Approved

    Declines the 30-second probe again and chooses two 15-second halves at draft quality, the second to start from the first one's last frame.

    2%
  9. The video provider Refused

    Refuses the first half on content grounds, and a reworded request too. Nothing is charged.

    2%
  10. The agent Passed

    Suspects the visible photoreal face (the provider doesn't confirm a cause) and tests a 4-second shot in silhouette.

    4%
  11. The person Made

    Chooses three 10-second clips with no faces. The agent makes them at draft quality with ambience only, and the piano separately.

    17%
  12. The person Made

    Watches the draft cut and asks for full-quality finals, approves only the middle clip's, and has the other two upscaled from the draft.

    26%

Three things to notice. The expensive single take was never made: the cheap trials found the blocker first. The refusals cost nothing, and after the second one the agent stopped rewording and tested the suspected cause instead: a content refusal isn’t fixed by changing the duration or the size. And when the approach changed (three clips instead of one take, no faces), the story didn’t: the script’s beats survived because each one said what it was for.

A trial that costs money follows the person’s authorization, every time. Routine work with material that already exists needs no ceremony.

6. Present the direction, then revise what feedback changes

Recommend a direction in a few clear sentences about the experience. Offer an alternative only when it changes the look, the feeling, the cost or the feasibility in a way that matters. Mention costs and unresolved decisions, with estimates labelled as estimates. The person should be able to choose between experiences without comparing model names or directing every cut.

When feedback arrives, find the moment or decision it changes and revise those parts, keeping what still works. “Make the dog a golden retriever” changed the cast, not the story. Then hand each part to the craft that makes it: the script, the scenes, the images, the motion graphics and the music and sound.