This month I was being able to hold the first “node-based compositing with Nuke” workshop at the institute for music and media in duesseldorf. The institute is part of the Robert Schuhmann conservatoire which in conjunction with the university of applied sciences teaches audio and video engineering. The students are therefore able to achieve both a technical engineering degree as well as an artistic education in the fields of audio- and videoproductions. Being a graduate myself I am more than happy to help the students
develop their skills in the field of computer graphics and digital compositing. The students were able to figure out Nukes node-based workflow very quickly and I am looking forward to seeing their first comps especially in context of the visual music module with Prof. Dr. Heike Sperling. I am sure this wasn´t the last workshop and I am also looking forward to teaching again at the institute.
Bazooka Zirkus one of the most exciting german hardcore bands these days are releasing their new album ” Der Gang vor die Hunde” next month. To get you in the mood you can already watch their new video “Straight outta Lützel”on youtube. The video was shot and directed by Andreas Simon, a talented young director from Duesseldorf, while I did the color grading and some effects. For more information you can go to www.atarisafari.de and check out Andreas latest work.
The use of grain is probably one the most disregarded topics in stereoscopic productions.
And yet – it can most certainly enhance the perception of a stereoscopic movie. So I thought I take the time to write about the experiences I made concerning grain management and also give you some examples to see and judge for yourself.
So, why did I even come to the point of caring about grain?
If you read any of the articles in this blog you might have noticed that I made a stereoscopic movie with the Panasonic AG 3DA1 twin lens camera to get some experiences with stereoscopic postproduction techniques. Due to the fact that renting the camera waspretty expensive for a student I wasn´t able to get an extra SDI recording device which is why I had to rely on the inbuilt AVCHD Recorder. I actually thought it would not make a huge difference but after processing the clips through colour correction the artifacts were pretty obvious which is why I decided to go back to the start and try to denoise the plates as best as I could to then ad back the noise on top.
Below you can see the denoised plate on the left and the original image on the right.
To view the images contained in this article in full size, please click on the image.
Adding grain or rather a noise pattern actually isn´t that big of a deal. But how would you do that in a stereoscopic movie? Here are my experiences and a lot of pictures, so grab your anaglyph glasses and compare for yourself!
For the sake of making the effect more obvious I exaggerated the noise-pattern massively.
The effect would otherwise be impossible to see with with an anaglyph viewing method.
In the first image below you can see what a normal image would look like whiteout any grain treatment. The noise patterns are unequal for both views and thus aren´t perceiving any depth information. Because there are no correlating patterns, our brain can´t fuse the noise patterns and it produces eyestrain and an uncomfortable feeling that is more obvious in this exaggerated version.
In the next to pictures you can see a planar noise pattern. The noise Pattern acts like a window that can be either on the screen plane thus allowing elements to brake trough(left image) or in front of the closest object to minimize false depth interpretations(right image).
The most elegant method I find – also the most extensive one – would be to map the noise pattern to the proper depth positions of the contained objects. This can be done with a disparity map. A disparity map displays the disparity of corresponding pixels in a single 32bit float image. This image can then be used to shift the pixels of the noise pattern accordingly to generate a depth perception. The effect can be compared to the images of “the magic eye” books which used to be popular in the early nineties. Below you can see the picture of a disparity map as well as the stereoscopic noise-pattern and the combined picture.
The disadvantages – besides the huge amount of time it takes to generate such a stereoscopic noise-pattern – are also the accuracy of disparity maps. Parts of the image that don´t contain enough information to let the algorithm find enough corresponding points will result in false depth interpretations.
Another important question is: Do we even need grain in stereoscopic movies? Digital projections methods in movie theatres are already taking away the once so appreciated filmlook. 48-FPS and 4k projections now seem to be a way to go. But there are still people who would rather shoot on film and then convert to stereo3D later on – like Men in Black III.
I am excited to see where stereoscopic cinema is going!
It´s been a while.. but it is on!
I am proud to finally present “Industrie Dschungel 3D” to the world. The stereoscopic short film is about a boy who discovers a secret place hidden behind a wall where his surroundings interact with the scruffy industry scenery. The movie was being done as an appendix to my diploma thesis “Analysis of structure from motion methods for stereoscopic camera-rigs in order to place computer generated imagery into live action footage”. The movie was actually being finished in summer 2012. But I wasn´t quite confident about the high amount of artifacts caused by the poor AVCHD Codec that was being captured by the camera. After several renderings and a final color correction the artifacts were way too prominent to maintain a proper stereoscopic viewing experience which is why I decided to denoise the plates as best as I could and also try to improve the shots as much as possible in a “short” amount of time. And while I am talking about grain and noise… what do you think? Should grain in stereoscopic movies be like:
B. equal on both plates, which means it has a layer that can move in 3D space – or
C. on each element in 3D space (disparity map)
I tested many different settings and there will be an article about that topic in the next couple of days. But this is indeed something that can certainly define the look of a movie.
I also want to say thanks to the people who helped me with this movie and gave their support and their passion to create this movie with absolutely no budget. Thanks to all your kindness and support!
For a perfect viewing experience I recommend to watch the video on a fullHD Monitor with lineinterlaced polarisation with the 1080p setting on youtube. You can also watch it in anaglyph on youtube if you don´t have a stereoscopic monitor or on vimeo where you can find an anaglyph dubois version which has fewer ghosting issues.
I am very excited to release the stereoscopic short film ”Industrie Dschungel” in the next couple of weeks. Just as a reminder: The shooting for “Industrie Dschungel” was done last year as part of my Diploma thesis about stereoscopic matchmoving and postproduction for Visual FX. Since my thesis was only about the technical aspects and challenges of building a robust stereo pipeline between matchmoving, compositing and 3D it took me almost another year to finish the VFX shots for the movie. A few shot breakdowns of the the movie can already be viewed in my VFX Demoreel which can be found under the ” My Work” tab. In the near future I am also planning on publishing some tutorials or excerpts of my thesis on this site. So you should better have an eye on this site every once in a while.
This little animation was done for the great people of the agency Bungart & Bessler in Hamburg with support from Boris Kantzow. It´s simple: warm and humid air is being
converted to cold and dry air. The modelling and rendering was done in Maya with an Image Based Lighting Setup to get some nice anisotropic reflections while the animation was done directly in After effects.
When I put up this website about two weeks ago I was thinking about taking a picture with a wide aspect ratio to have it as a cover picture. Now… since I am doing VFX work I decided to take a panoramic HDR Image of my hometown Duesseldorf in autumn and try to enhance it with some lines of a groundplane and have you – the audience – think about
what is actually possible when you have an HDRI Lighting Setup. Also… I thought it looked kinda fancy.
Stitching up an HDRI actually isn’t that big of a deal. But have you ever tried to render out a 180 or 360 degrees render from your 3D application? I never did… and it took me quite a while to figure out how I could achieve that look. First of all… there are some Camera-shaders out there. But they are for older versions of Maya and you have to compile them by yourself and people on the forums are complaining that they cannot get it working. Besides… I am on a Mac and I guess there are not so many people to ask about that out there.
But after playing around with some lens distortion (ok… it was late) I remembered some tutorials by Frank Rueter that are available on www.thefoundry.co.uk about spherical transformations. So what I ended up doing was basically taking three “90° field of view” cameras and rotate them around by 90°. In Nuke I used a spherical transform node and converted the sides of the panoramic cube to a 180° picture. Simples! If some of you guys know any better solutions or found different ways to render panoramic CG Images, please feel free to leave a comment.
One and a half years ago I finished my studies of audio and video engineering with a thesis
about stereoscopic matchmoving and stereoscopic postproduction techniques. While my thesis was basically just about the technical aspects and challenges of building a robust stereo pipeline between matchmoving, compositing and 3D it took me almost another year to finish the VFX shots for the movie. Now that I am about to release the darn thing I took some time to evaluate this one little shot that I always took for granted… but… after a few month of not working on it I started to hate the little rascal. While the movie was shot on a Panasonic AG 3DA1 it was actually not possible to change the interocular distance. So I decided to avoid extremely wide or close shots. But in one shot at the end of the movie the camera had to approach the main hero to a very close distance so my two views ended up with a massive parallax shift. I sort of tried to get them together as close as possible. And.. on a small monitor it somehow works. But lets be honest… That wasn´t a proper solution. So I eventually decided to pull a conversion. Actually conversions are a very tedious progress. You have to roto as hell to get a desirable amount of control over your scene.
But… with this scene I was really lucky to get the work done in only a couple of hours. Lucky, because I had a stereocam. Even though I wasn´t able to use my second view I could still use it as a wittness camera for the matchmoving process to get a more accurate result due to the second cameraposition and the thus resulting parallax to start from there on.
Another decision that saved me a couple of hours was to not roto the whole shot but only one frame and project it onto static geometry. even though there was some subtle motion I decided to go the easy way at first and check out whether I could get away with that approach. The geometry was done in Maya and is really simple with some overlapping faces to avoid wholes during the camera movement. And boy.. Am I looking forward to working with Nuke7 and its new modeling tools. Honestly.. working with a fixed camera in Maya is hell because you are unable to Zoom into the viewport to make proper adjustments which would again save so much time if you can shift one or two vertices from the nuke viewport.
So .. just some little tweaks and some paint fixes and its done. Voilá: nice stereo!
Fell free to compare for yourself !
The finished shot will be released during the next couple of weeks being part of the
stereoscopic short movie “Industrie Dschungel”.
let´s face the fact: VisualFX work is full of challenges and every now and then
artists face certain issues that will drive them crazy, make them stay up all night
and let them do funny dances at 5 am after solving an issue.
This part of my blogs is about telling geek stuff as well as showing work in progress
projects or releasing plug-ins, gizmos or whatever I feel should be contributed or shouted out to the world. In any case… feel free to leave comments.