Voia AI Production Platform

Product Datasheet

Voia brings AI to real video productions. Our online platform covers the production workflow from storyboard to render. Our AI is designed around live action performance, rendering actors inside 3D virtual worlds. The process gives filmmakers unprecedented control in post production, with the ability to control positioning, lighting, camera motion and even lensing. With Voia video producers can achieve the cinematic look in full 4K without volumetric stages or even a green screen. With Voia you can produce 3x faster, 10x cheaper and with unparalleled creative freedom.

​

​

​

​

​

​

​

​

​

​

​

​

​

​

​

​

1. Workflow
Voia supports the production workflow from storyboard to render:
Storyboard: Voia’s web app starts new projects in the storyboard builder. You can build your storyboard with AI generated images or upload your own. You can reorganize shots inside and across scenes with a simple drag and drop. Tag individual shots with built in tags like “daytime” or “indoors” or your own custom tags.
Location search: Attach a virtual location for each shot in your storyboard. See below for more about virtual locations.
Set planning: Arrange your shots for filming day. Use tags to group them by actors, wardrobe etc to maximize efficiency on set.
Filming: Your ordered shot list is automatically synced to our iPhone app to streamline filming. Use our iPhone app (independently or in coupled with another camera) to film one or more takes for each shot. The app will show real time previsualization of the actor inside the virtual location selected for each shot, and track camera movement in 3D space. Data is automatically uploaded to the cloud to streamline post processing. You can mark individual takes (red, green or yellow) on set for future reference.
Dailies: Review your footage online in a timeline based on your original storyboard. You can view the original footage or our quick preview rendering inside the virtual location. Select the desired takes for post production and make sure you have coverage for your entire scene(s).
3D composition: Voia uses Unreal Engine to compose your actor’s footage into the selected 3D virtual world. Our plugin automatically loads the footage into Unreal and allows you to fine tune the actor’s positioning and camera angles. We automatically sync camera tracking with the video so real more camera motion is automatically replicated in Unreal. You can use Unreal Engine’s controls to edit the virtual world, change lighting, control camera motion, pull focus or even change lenses. All in post production. Once ready, you can use the plugin to initiate cloud rendering of your composed video.
Rendering: Voia uses the cloud to accelerate rendering and run AI post processing to finalize the cinematic look. You can review the rendered videos online and iterate in Unreal as necessary. Voia shows you the rendered videos on top of your original timeline and when you have coverage you can download the entire pipeline for final edit and color grading in your favorite NLE.

2. Physical filming location
Voia uses AI for background removal and relighting, so no special equipment is required for filming. However, there are a few guidelines to follow in order to achieve the best results:

Avoid clutter: Use a clean background. Voia will remove large objects but in order to optimize background removal avoid a cluttered background with many small objects.
Avoid background people: Our AI is optimized for recognizing human actors. Crew or even people in pictures will be recognized as actors and will have to be keyed out manually later.
Soft even lighting: Voia will relight actors in post production. If you use soft and even lighting across your scene you can usually avoid relighting between shots. 

3. Camera
Primary camera: Voia uses the iPhone as a primary camera. This has multiple advantages:
High quality high resolution image
Real time previz showing the actor inside a virtual world
Built in tracking across 6 degrees of freedom
Automatic shot list sync from the cloud
Automatic video and data sync to the cloud

Minimum hardware specifications:
iPhone Pro (or Max) 13 or later

Recommended hardware specifications:
iPhone Pro (or Max) 15 or later
Stabilizing rig
External battery pack
Recorded video specifications:
4K resolution
30 frames per second
sRGB color space
H.265 encoding

Additional camera (Coming soon): Voia supports video capture from an external camera. You will need to mount the iPhone to that camera for tracking. You will then need to upload footage through our web app and provide camera intrinsics and parallax (mounting dimensions) information.

4. Virtual locations
Voia includes a library with thousands of virtual locations. Locations are searchable using textual or image based prompts.
Voia can ingest custom environments designed for Unreal Engine 5. Voia can assist with designing and crafting such environments for select projects.

5. Composition
Voia uniquely enables video composition in 3D. Our AI converts live action footage into a 3D asset that is then embedded in an Unreal virtual world. This gives filmmakers unparalleled control in post production:
Positioning: Fine tune actor positioning inside the 3D world. Because composition happens in 3D the actor may be occluded by virtual foreground elements.
Camera angle: You can control the initial angle of the camera and actor relative to the virtual environment. Camera angles in the subsequent frames are then determined by the tracking info captured alongside the original video.
Camera distance: You can push and pull the camera in post production to create drone-like shots.
Virtual location: You can edit the virtual location. Add, move or remove any object.
Lighting: You can add, move or remove any lights. Lighting can be animated.
Focus: You can change or animate focus and depth of field.
Lensing: You can change lenses and sensor size.
Visual effects: You can use Unreal’s extensive marketplace of virtual objects, effects and animations to level up your scene.

In order to run Unreal Engine for 3D composition you will need a workstation or laptop with these minimum specs:
CPU: Intel Core i7 or later (or the AMD equivalent)
RAM: 32GB (64GB+ recommended)
GPU: NVIDIA RTX 4080 or 4090
Storage: SSD with 128GB of free space
OS: Windows 10 or later
Network: Stable internet connection at 50 Mbps minimum

6. Rendering
You can initiate cloud rendering directly through our Unreal plugin. Voia will always render the selected range in Unreal and automatically align it with your scene’s timeline.

Voia offers two rendering options:
Quick render: Uses the gaming optimized rendering engine (Lumen) and usually takes around 1 second per frame. This is a lower quality render designed to give you an idea of the composition and look of your final render.
Cinematic render: Uses the quality optimized rendering engine (path tracing) but can take around 1 min per frame. We render in full 4K and 30 frames per second, and use an AI post processing pass to improve shadow quality and the overall look.

Both rendering processes are handled in the cloud to avoid blocking your local workstation. Voia leverages cloud resources to parallelize and accelerate your renders.
Once renders are ready you can review them online and download the video for final editing. Voia offers two download options:
Video: An H.265 encoded video.
XML: A timeline ready to be imported into an NLE for editing. The timeline mainly includes image sequences for different components of your video. Images are 4K resolution with 8 bit color depth. You can choose which of the

 

following components to include in your XML download:
Original capture
Original audio
Tracking data
AI generated background removal mask
Masked capture
Virtual background only render
Foreground (actor) only render
Composited (background and actor) render