Creators of film, TV, and animation need specialized tools to tell their stories. Read on to discover some of the latest workflows and features that make Unity easier and more powerful for cinematic artists.
[UPDATED November 2021 to reflect improvements and releases in 2021.2]
For a while now, our users have been out ahead of the real-time wave in the film and television space. From Dead Pixels to Fixi in Playland to Hero Dad, you’ve demonstrated how real-time 3D development in Unity adds power to the moviemaking process. And of course our internal teams haven’t been watching from the sidelines, working on one or two narrative examples along the way.
Our R&D team is making significant strides right now to support this important and growing segment of creators. Over the summer, we released an open beta of new tools for cinematic creators. Today we're pleased to announce that all these tools are in general release.
Broadly speaking, we've released two groups of tools: Cinematic Studio and the cinematic companion apps.
Cinematic Studio is a group of tools that, taken together, enable the creation of cinematic content as a first-class experience within the Unity Editor. It comes in three forms:
Here are the specific features included in all versions of Cinematic Studio:
The second group is comprised of two cinematic companion apps, new tools that leverage the capabilities of augmented reality (AR)-enabled iPads and iPhones to capture performances within Unity:
Both sets of tools are foundational for all storytellers across all industries and all levels of user experience. As such, these tools will be released to all users, regardless of license.
In this post, I want to highlight four of the key new workflows we’re supporting:
I don’t need to tell you that Unity is a great tool for making games and all sorts of interactive experiences. But that very interactivity comes at the cost of increased complexity: an interactive story can have many Timelines, triggered when needed. This requires some fairly complicated wiring in order to express exactly what needs to happen when.
A linear story is different. Everything happens in a predictable order, so a lot of the process can be automated and steps eliminated. And your project can be organized using industry-standard terms and folder structures. This is what Sequences does.
Check out the video below to see how Sequences accelerates the creation of your cinematic while simultaneously keeping you organized and flexible.
Key benefits Sequences provides:
You’re telling a story, right? A movie or animation or cinematic? Presumably at some point you’ll want to show it to someone. That, in a nutshell, is what Recorder does, enabling you to export what’s on your Timeline and in your Game View. You can export content in a wide variety of formats, from still images to videos, from final pixel to intermediates for comp or effects work. And Recorder supports the most requested formats for release, including ProRes and H.264, so you can send your creations off for your audience to enjoy.
The following video details many of the great features in Recorder.
Key benefits with the Recorder:
The new Unity Virtual Camera is an iOS app that leverages Apple’s ARKit to drive the movement of a camera in the Unity Editor using real-world AR tracked motion from your device. You can use this capability to shoot scenes in an organic, hand-held style with intuitive control over depth of field, zoom, motion damping, and more. Using the included take system, you can work directly in Timeline and even build up a shot over multiple takes – for example, pulling focus on a second pass.
Unity Virtual Camera is available on Apple's App Store. System requirements:
Unity Virtual Camera’s key features:
Face tracking is an incredibly useful feature on modern mobile devices. iOS’s ARKit in particular does a great job of capturing expressions. For an animator, capturing this information and applying it to a character can turn the work of dozens of hours into a few minutes.
Unity Face Capture allows you to use your Face ID-enabled iPhone or iPad to capture, preview, and record performances and bind them to a model. We think the applications for movies and games will be immense, saving artists untold hours.
Unity Face Capture is available on Apple's App Store. System requirements:
Unity Face Capture’s key features include:
We really hope these new real-time animation tools resonate with you, our users. As I said at the outset, you’ve been leading the way in this area, and we’re delighted to be able to support you with tools that make Unity easier and more powerful for cinematic creators.
We want to hear what you think. Are we working on the capabilities that will best help your animation projects succeed? What more can we do to answer your needs in this area? Please tell us either in the comments below or on our forum.