Storyboarding for AI and Hybrid Productions

Why storyboards matter more in generative production than in conventional filming, what belongs on a panel, and how a board becomes a generation plan.

Storyboards are often treated as an optional courtesy in conventional production, because a director on set can adapt and a good editor can find the film in the rushes. In generative production that safety net does not exist. Nothing is captured incidentally, there is no coverage to fall back on, and every shot that ends up in the film has to have been deliberately produced. The board stops being a communication document and becomes the production plan.

The practical consequence is that a generative board must be more specific than a conventional one. A panel that says product hero shot is unusable, because someone has to generate it and the model will produce whatever the description implies. A usable panel states the subject, the angle, the framing, the lens character, the light direction and quality, the palette, the movement, the duration in seconds, and what the viewer should understand by the end of it. That level of specification is what makes the shot reproducible rather than accidental.

Duration belongs on every panel and is routinely omitted. Generated shots have practical length limits, and a board that calls for a continuous twelve second move is describing something that will need to be built from segments or reconsidered entirely. Assigning seconds at board stage forces that conversation while it is still cheap, and it also produces an early check that the film fits its runtime, which scripts alone reliably fail to reveal.

The board should also carry a method column, and this is the addition that makes it a hybrid document. For each shot, name how it will be produced: generated, generated with composited brand elements, 3D render, live action, stock, or graphics. Making that decision shot by shot at board stage, rather than choosing a method for the whole film, is what produces projects that are both affordable and credible. Shots requiring documentary truth or exact brand geometry go to camera or to composited 3D. Shots requiring a world go to generation.

Approved still frames should be attached to the board wherever they exist, because in generative work the still is the specification. A board panel accompanied by an approved frame removes almost all ambiguity about what the shot should look like, and it gives whoever generates the shot something to condition from rather than describe. Boards without reference frames put the visual language back into words, which is precisely where it performs worst.

The review value of a board is higher in this workflow than in any other, because the client is being asked to approve something that does not yet exist and cannot be improvised later. A board review should establish that the story works in order, that the runtime is realistic, that the mandatory elements appear, and that the visual language matches what was approved at the stills stage. Vakratsas and Wang (2021) framed artificial intelligence as operating within the creative process rather than replacing the judgement that directs it, and the board is where that judgement is recorded in a form other people can act on.

Boards also prevent the most expensive failure mode in generative projects, which is unbounded exploration. Without a board, generation becomes a search: attractive shots accumulate, none of them quite fit together, and the project consumes time without converging. With a board, generation is a list of defined targets with a clear finishing condition. The difference in cost between these two modes is large and is usually the difference between a profitable project and a painful one.

The level of drawing quality required is lower than clients expect and lower than studios sometimes pretend. A board exists to communicate composition, scale and intent, and rough frames with clear annotation do that job. Where a project benefits from higher fidelity is at the hero shots, which are worth generating properly as stills, and at any moment where a client is likely to imagine something different from what is intended.

For hybrid films the board is also the document that keeps the joins invisible. It should note where a generated environment meets a filmed subject, where a composited element sits, and what has to match between adjacent shots in colour, light direction and lens character. Those matching notes are what the grade and the compositing work are checked against later, and their absence is why some hybrid films have a visible seam between the real and the constructed.

The simplest test of whether a board is adequate is to hand it to someone who was not in the briefing and ask them to describe the finished film. If they can describe it accurately, including how long it runs and what each shot is doing, the board is a production plan. If they can only describe the topic, it is a mood board with numbers on it, and the project will discover its actual decisions during production at the highest possible cost.

References

Vakratsas, D., & Wang, X. S. (2021). Artificial intelligence in advertising creativity. Journal of Advertising, 50(1), 39–51. https://doi.org/10.1080/00913367.2020.1843090