Screen Tracking & Replacement in AE

[hype]

*******************************************************************************************************************************************************************************
*********WITH THE RELEASE OF TRACKERVIZ, THIS TUTORIAL IS OUTDATED. TRACKERVIZ PRESENTS A MUCH EASIER WAY TO ROTOTRACK.**********
***********TRACKERVIZ LINK viewtopic.php?f=31&t=5477 **************
*******************************************************************************************************************************************************************************

Ok, I made another one. it's half an hour long, downloadable as an EXE file, but, as usual with me, it doesn't install anything on your computer, it just has to be an EXE because it comes with it's own self-extractor.

This one covers something I've done on almost every movie I've ever worked on, TV screen and computer monitor replacement. But, this technique could also be used for TONS of other things, like putting posters on walls, pinning a matte painting to an area, changing book and magazine covers, etc, etc... The applications are almost limitless. The entire tutorial is for After Effects only, no 3D, even though it's a handheld, perspective changing camera move.

If you want to use every technique I use in the tutorial, you'll need this AE script (which is absolutely amazing!):

http://www.aenhancers.com/viewtopic.php?t=329

Here's the before and after:

http://www.mackdadd.com/tutorials/monit ... ore_01.mov
http://www.mackdadd.com/tutorials/monit ... nal_01.mov

And here's the files you'll need:

This is the tutorial, 215Megs:
http://www.mackdadd.com/tutorials/monit ... torial.exe

This is the field-blended footage, uncompressed, maybe 140Megs:
http://www.mackdadd.com/tutorials/lapto ... r_1_DI.mov

This is the picture I used, but you can use anything you want:
http://www.mackdadd.com/tutorials/simpl ... een_01.jpg

This tutorial does NOT cover putting a reflection back over top of the image, since there was no reflection in my laptop screen footage. If anyone really wants to know how to do that perfectly, I can make a supplemental tutorial on how to do it (it's more for TV screens than computer monitors).

*******************************************************************************************************************************************************************************
*********WITH THE RELEASE OF TRACKERVIZ, THIS TUTORIAL IS OUTDATED. TRACKERVIZ PRESENTS A MUCH EASIER WAY TO ROTOTRACK.**********
***********TRACKERVIZ LINK viewtopic.php?f=31&t=5477 **************
*******************************************************************************************************************************************************************************

[quinn paynter]

Hey man im keen to try out this tutorial but im kinda new to After Effects. Could you tell me where to place the Script and then how to load it into AE so I can do the tutorial. Thanks for your help man.

[zachm]

you can put the script anywhere you want, but if you put it in

C:\Program Files\Adobe\Adobe After Effects 7.0\Support Files\Scripts

then AE will automatically find it, if you want to run a script, simply select the layer you want to run it on and select file, run script, choose your script and that's it. It's actually a really great function that is understated if you ask me. hope that helps man.

also, it might be fun to add, that when and if you do a track and want to add other stuff in, many of the after effects effects are capable of using the after effects camera, one of my favorites is the trapcode particular one. 3d cameras, so you can spin through the particles and stuff. Super cool. And Hype, is it just me, or does the tracker in 7 seem to work better than in 6.5? or am I just imagining it because the interface is pretty?


-Z

[hype]

yep, quinn, put it where zach said.

(I also keep a seperate folder on another hard drive that has all my 3rd party AE and Max scripts in it, because someimtes, if I have to reformat or reinstall, I always forget to back that kind of stuff up, then I have to scour the net looking for it again. so it might be a good idea to have a copy somewhere else besides the script folder)

yeah, zach, scripting in AE can be just as powerful as scripting in a 3D program, which I think I clearly demonstrate in this tutorial (even though i don't write scripts). This script is amazing! i think you use shake alot, right? shake probably has built in mask point tracking capabilities, doesn't it? fusion does, i think, and R&H's proprietary stuff does (kind of). Combustion and Commotion (not made anymore) do, as well. Silhouette Roto for AE is still the straight-up, hands-down BEST rotoscoping tools anywhere on earth, but it's kind of expensive for something that you never want to do anyway! hahaha... But this script I demonstrate in this tutorial is REALLY amazing, and every AE user should have it!

and yeah, i think the tracker is a little better in 7. i noticed it got a little better from 6 to 6.5, too. I think they're always making little tweaks on it.

I'm still looking online for a script for AE that will allow you to select 2 layers with position keyframes and average them together to create a new layer with the averaged keyframes applied. This is exactly what the script I have from work does, and I can't live without it, but I also can't post it for everyone to use since it's a proprietary thing i didn't write. But i'm dying to show everyone the power of track averaging!

[mechis]

YAY!!!! I can't wait to get started on more of your tutorials Hype! I have to wait till Chrismas so that I have time, but your tutes make me really excited to learn about compositing!

I've noticed that in making of featurettes, that computer screens and tv screens always have green screen on them. Is that because they don't want the reflection of the camera in it? Or because it allows them flexibility to change the image later if they want?

Oh, and I'm interested in learning about reflections too... I was asking you about that earlier, I think. I'd love to see tips on having the reflection blend into the window, mirror, tv, etc.

COOL!!!!!
~Mechis

[hype]

Is that because they don't want the reflection of the camera in it? Or because it allows them flexibility to change the image later if they want?

it could be for numerous reasons. perhaps they haven't shot the footage that will go in there yet, or maybe they're not sure yet what should be in it. and have you ever videotaped a tv or a monitor? you can see the refresh rate updating the screen, it looks like this wierd bright bar that moves slowly up or down the screen. to make that not happen on film, you have to set up the tv a special way (i don't know anything about it). so there can be technical issues related to frame rates. also, depending on the moniotr or screen, it might just plain look terrible on film or video. there's tons of reasons.

maybe i'll do something where i show how to get the natural reflections back over top.

let me know what you think of it when you do it!

[MikeWilson]

I think this tutorial is a technique, not just an exact practice.

[hype]

i agree, and i think i say that in the beginning of it, that there are millions of ways to do this stuff, and i'm just showing you one way. However many compositors there are in the world, that's how many techniques there are. the important thing is that it gets done, not how it gets done.

[mechis]

Hey Hype,

I was checking out that AE enhancer's site and found this track averaging script. Is this what you were looking for?

http://www.aenhancers.com/viewtopic.php ... ight=track

~Mechis

[iest_rob]

Wow - that's some solid tracking you've got yourself there man, and was all that done within AE? I didnt even know AE had this function! Ill definatly download the tut on Monday, thanks a lot for doing these man, good stuff!

[hype]

amazing find, mechis! that's exactly what i've been looking for! i'll try it out and do a tutorial with it - it's something everyone should have!

iest - yep, all AE.

[quinn paynter]

Hey man, Ive been doing your tutorial today with my own footage. The tracking part where you lock track 1-4 to each corner messes up. It follows the corner for a while then goes all over the place >_< do I have to mannualy move every fram into the right spot or any easier way to fix this? The track slides ALL over the ouside edge, and doesnt stay in the corner. Everythings been done the exact same way as you r clip. Any way to fix this, any help would be huge man. Thanks for taking the time to help us.

Cheers

[Global]

Fantastic Hype, thanks! Will pass these around to my English speaking compositor friends

[hype]

thanks guys, for liking it!

quinn, i'm running to dinner right now, when i get back i'll suggest a million things to help your track! like, maybe an hour from now...

[Global]

heh... just seen the demo vids. Dude, you have so many candles... are you into ritual sacrafice? The way the camera pans on that it looked pretty ominous... I mean... If I was that laptop I'd be kinda scared!

...um... don't mind me, I think the morning coffee has just kicked in!

[hype]

globes, hahaha... actually, the lit candle is a yummy frosted cranberry smelling candle, and its awesome! the ones behind my laptop are holders that my old roommate left here when she moved out, i need to give that stuff away. (anyone want them? hahaha)

quinn... i'd need to see the footage to really give a proper suggestion, but some things you might want to try would include:

- in the options setting in the tracker panel, there's a pulldown menu that says something like "continue tracking" if accurracy is less than 80%. try changing that percentage to something like 70 or 65 (i wouldn't go much lower than that, though, but try it if you want), or change the pulldown part to say "adapt feature". you could also click on the "adapt feature on every frame" check box. although, when this is checked, it may stay on the area for the entire duration, but you may notice it drifts over the course of the track. it would be slight, but it would be enough to make the track not accurrate. but try it.

- the reason it worked so good on the footage i provided is because the contrast on the areas i tracked was huge. if your footage doesn't have that much contrast in the area you're tracking, take a look at the color channels. if one of the channels has a pretty decent contrast, you can set it to track the RGB or the saturation instead of the luminance (in the options panel).

- another thing you could try is to pre-comp your footage, and in that pre-comp, apply a levels effect to the footage and CRANK the contrast WAY up. then track the pre-comp composition in a different composition. even throw on a hue/saturation and make it greyscale, then crank the levels to get contrast up. totally mess with the footage however you have to to make the area you want to track contrasty, or easy to pick out. then, once you have the track done, you can just get rid of all those effects and use the track like normal.

- or, you could manually move the tracker box on every frame. which sucks, but is sometimes neccessary. be careful with this though, because depending on where you click to grab the box to move it, it does different things. If I ever do a tutorial called "everything you ever wanted to know about tracking", i'd cover this. if you click in the box when the cursor is a black arrow, when you move the tracker box, your track will actually shift at that point in your finished track. if you click directly on the edge of the tracker box, when the arrow turns white, you will change the actual area the tracker is tracking, but the center point will continue on from it's current position. If you click on the little plus sign in the middle, you're only changing the center point, or where it pins the track when it's done, not the area it's searching for. that's all kind of confusing, which is why it would work much better as a video tutorial than a written explanation. and this doesn't even cover what to do when your tracking feature leaves the frame and comes back on later.

i don't if that helps. maybe i'll do the "everything you ever wanted to know about 2D tracking" tutorial.

[zachm]

Just my two cents, If you change your footage to just the R, G or B channel, (whichever has the most luminance contrast.) and then blur it, precomp that layer, and then track it, you might get a better result.

The reason this works is because the tracker works based on contrast values per pixel, and if you have your pixels blurred, then neighboring pixels dance back and forth less, making them more of a stable color for the tracker to see. (hopefully that makes sense) This almost always provides me with a good solid track when working with DV especially.


-Z

[quinn paynter]

Cool cheers man, ill try all these new things tomorrow morning. Thanks for the help.

[hype]

you can tell AE to pre-blur the footage for you in the options panel of the tracker, but i usually find that makes the track slowly drift over the course of the track. but, yeah, its certainly worth a try!

[quinn paynter]

Hey man its nothing to do with this, but do you know how to keep camera in same place, film yourself like 4 times and have all 4 shot together as one so looks like all four of you are doing something? Cause I really wanna learn that. Such a cool effect.