Camera Tracking in Nuke with Klaudija Cermak

Camera Tracking in Nuke with Klaudija Cermak

In this video tutorial VFX Programme Leader Klaudija Cermak explains the process of Camera Tracking in Nuke. 

Matchmoving - or camera tracking - has traditionally been the responsibility of a 3D department or 3D VFX artists. However, 2D compositors can now do camera tracking in Nuke.

You can find Klaudija's video tutorial here.  The password is the same as for all our Vimeo Tutorial Videos.

Camera Tracking in Nuke With Klaudija Cermak

Klaudija Cermak - VFX Programme Leader

The purpose of the Matchmove Process is to replicate the real live action camera motion - so that we can add to (or remove) elements from the moving shot.  

As 2D VFX Compositors we don’t always need to wait for a Matchmove Department to pass us the camera they have created in a dedicated matchmoving software such as 3D Equalizer.  

No Matchmove Dept?

Sometimes there isn’t a Matchmove department, or sometimes they are just too busy - and we need to carry out the Matchmove Process ourselves.  Luckily we can do that in Nuke - as it has a very good Camera Tracker.  As 2D VFX Compositing students you should always create a camera track whenever you need to do some cleanup or add elements at different levels of a shot. 

Camera tracking in Nuke

Learn the Art of Matchmove
Even if you are expecting a camera from 3D department, learning this process will give you an opportunity to develop your matchmoving skills; the more one knows, the better.  

Nuke Camera Tracker

There are a lot of benefits to Nuke's Camera Tracker.  You can extract individual trackers to use in a 2D Tracker node and also there is an automatic Point Cloud that can aid in positioning of the cards one can project to cleanup patches or new elements for the shot.

---Klaudija Cermak

Video Tutorial - Camera Tracking in Nuke with Klaudija Cermak

To watch Klaudija's introduction to Camera Tracking in Nuke, follow the link below. The password is the same as for all our video tutorials at the Escape Studios Vimeo Tutorial Channel.

Introduction to Camera Tracking in Nuke - Part 1
https://vimeo.com/manage/videos/874761677 

Vimeo Tutorial Channel

The Escape Studios Vimeo Tutorial Channel is our main hub for our animation and VFX video tutorials, making it easy for our students to find tutorials to support their classroom studies. 

Our tutorials cover Animation, 3D VFX, Compositing, Rigging, Motion Graphics, Storyboarding & Character Design, Unreal Engine and Cinematography.

What is Matchmove?

Matchmove

Matchmove is an important part of the 3D visual effects pipeline, and a traditional entry-level position for junior VFX artists, a great way to get your foot in the door in the industry. 

For example, for many years London VFX house Cinesite would put recent graduates into the matchmove department to ensure that they fully understood the digital pipeline before moving to other departments, such as animation.

Matchmove Dept
Matchmove - aka "tracking" - artists are responsible for re-creating the actual world camera within a virtual CG environment.  The camera that was used on set (while live-action filming takes place) needs to be re-created in the 3d world in order to place 3d objects into the scene seamlessly.

3D Equaliser

3d Equalizer

Matchmove is generally done in 3d Equalizer (but can also be done in Nuke per Klaudija's tutorial above).  

3d Equalizer allows the user to place mulitple points through the camera onto the photographic plate in order to create a 3d scene. 

Live Action Reference 

It is helpful if we have reference photographs from the live-action set, as this allows us to create photogrammetry scenes, where we place the same point in all reference photos, giving that point a real place in space. From there we can make scaled geometry or buildings.

In shots where a cg character, for example, might need to be touching the ground, we need to supply information on where that ground is exactly, and where the building is he is to walk around (for example). We do our work at the start of the cg pipeline, so without Matchmove work the rest of the elements cannot be placed accurately in the shot.

Matchmove Challenges
The biggest challenge in matchmove is Information - or the lack of it. If we can get as much information from the live action set as possible, then our job is a lot easier. If we have camera data such as precise lens information, the name of the manufacturer, the exact model used, the film type or the digital media used - and plenty of reference images - then this can really speed up the matchmove process.

Lens Distortion
Distortion in lenses is a common problem and this means that we need to have lens grids shot on set in order for us to be able to un-distort the image. There are so many different types of media on which to film these days, and shooting types are changing too. Zooming and handheld shots require extra information, and each camera comes with its own 'quirks' like the RED camera and the Alexa format with its rolling shutter. It can get pretty technical.

The Escape Studios Animation Blog offers a personal view on the art of animation and visual effects. To find out more about our new BA/MArt, now recruiting for September 2024, follow this link. To apply, visit the official page here.