4D Processing In Your Hands
We present 4 new applications specifically designed for processing 4D sequences.
4D performance capture is used by many high-end studios as it captures the movements of every millimeter of an actor’s face. For a long time this technology has mainly been available as a service provided by a few vendors.
R3DS Wrap4D, R3DS Track, R3DS Rush, and R3DS Node provide an easy, efficient, and controllable way to process 4D sequences in your company.
R3DS Wrap4D
R3DS Wrap4D is an extended version of Wrap designed specifically for 4D processing. It takes a sequence of textured 3D scans as an input and produces a sequence of meshes with a consitent topology as an output.
The solution includes 12 new nodes. At the heart of the pipeline is the FacialWrapping node which combines the power of the BlendWrapping node with the results from the lip and eyelid detector. The idea behind the node is to provide a robust result that doesn’t require cleanup.
R3DS Track
R3DS Track is stand-alone software for tracking markers and detecting facial features. It brings all the labor-intensive work into a 2D space so that you don’t have to cleanup models in 3D.
The appearance of skin can change drastically during a performance. By using tracking markers it makes it possible to wrap even very extreme expressions. R3DS Track provides generic and personalized detectors to track lip and eyelid contours. You can train a personalized detector by giving it a set of manualy annotated frames to achive an exeptional level of accuracy.
R3DS Rush
Each frame may take several minutes of computation. When processing 4D sequences you have thousands of frames, which may take weeks.
R3DS Rush allows running the computation on dozens of machines with just a few clicks. You can stop, pause, track progress, and assign different projects to different machines from a single easy-to-use interface.
It works in combination with R3DS Node, which is a headless computational node, so that you don’t need to buy a R3DS Wrap4D license for every machine.
Request a free trial of all the products today
Parallel Processing
With R3DS Wrap4D you can compute any frame of the sequence independently, meaning the entire sequence can be computed in parallel on multiple machines.
Full Control
The wrapping pipeline is split into clear controlable steps. You can easily check and correct the result of each step before moving onto the next one.
2D Workflow
Thanks to R3DS Track all the labor-intensive work, such as tracking markers and detecting contours, is done in 2D so you don’t have to cleanup the models in 3D.
Flexibility
Different projects have different requirements and different scanning capabilities. You are free to use the topology that suits your needs, adapt the pipeline to work with missing data and noisy scans, add annotation frames to provide more accurate lip and eyelid tracking, and extend the set of training blendshapes to improve wrapping quality.
Handling Large Rotations
Because R3DS Wrap4D works directly with 3D scans it can handle large head rotations giving actors more freedom of action. Using a pre-stabilization step the rest of the pipeline works as if the actor’s head position is static.
Scalability
With R3DS Rush and R3DS Node you can easily scale computations to dozens of machines meet your deadlines.
R3DS Wrap4D in Production
Our solution was first used in the shortfilm “The Heretic” by Unity®. 5 shots with Jake’s performance were captured by Infinite Realities and their AEONX Motion Scanning System and processed with R3DS Wrap4D.
It took our team a single day to process the animation for the final shots of the movie. Eyes, skin detail, shading, and grooming were later added by the Unity® team. Things like gaze direction and the neck shape were also art directed.
“It’s been a pleasure to use Wrap4D and seeing it evolve over the years. It’s literally plug & play!”
Lee Perry-Smith / IR-Entertainment Ltd. / ir-ltd.net
Getting Started
It’s very easy to start with our 4D processing pipeline. We prepared 7 video tutorials explaining each step in detail.
Sample Projects And Demo 4D Sequence
In R3DS Wrap4D gallery you can find several sample projects and a demo 4D sequence. The sequence was kindly provided by Infinite Realities and captured with their AEONX Motion Scanning System.
Documentation
Didn’t find what you were looking for in the tutorials? Check out these documentation pages: R3DS Wrap4D Docs, R3DS Track Docs
Tutorials
| Wrap | Wrap4D | |
|---|---|---|
| LoadScreenPoints node | ||
| BlendStabilization node | ||
| ProjectScreenPoints node | ||
| FacialDetection node | ||
| FacialAnnotation node | ||
| FacialWrapping node | ||
| EditFacialDetection node | ||
| SaveFacialDetection node | ||
| LoadFacialDetection node | ||
| LoadFacialAnnotation node | ||
| PointsToScreenPoints node | ||
| SaveScreenPoints node | ||
| Temporal smoothing tool for 4D sequences | ||
| Compatibility with R3DS Rush for distributed computations |
Any questions about Wrap4D?