Compositing in live video?

[ZodiaQ]

If I wanted to show houses in a live video street shot, what software would I need.
Anyone ideas for workflow in combination with LW/Kray ?

[Janusz Biela]

Can you precise idea? I suspect, you want add render houses into real video material.

[Leftover]

AE CS6 has built in camera tracker, as well there are Boujou and Autodesk MatchMover

Workflow in general is.
1. Track you footage,
2. Get camera and reference data to LW.
3. Clean up motion if necessary.
4. Move you house model, matte objects to position you need
5. Render animation
7. Composit to source footage

[ZodiaQ]

Sorry for the late reply.
Yes I was referring to placing 3D house model into live video street view.

[Janusz Biela]

A while ago I did that test:

[youtube]bYnvhTLOsps[/youtube]


Problem is only with shadows (shadow catcher is not supported in Kray) so I render it under LW Native.
In YouTube you can find a lot tutorials for exchanging datas between AE and LW.
Also this can help (I used it):
http://www.motion-graphics-exchange.com ... f8b4034916

[ZodiaQ]

Thx but this is all very new to me.
No experience at all with live video inside of LW

If I understand correctly I import my (lowres) video in LW, place 3D content, render and use AE to combine render with live video?

How to track video motion in LW? and how to sync 3D objects with video movement?

edit :

Think I already found a decent youtube tutorial
https://www.youtube.com/watch?v=Kp49jSF9-gs

[Janusz Biela]

Something that. Just use build in AE tracking points - is very good.
One hint: very good idea is to have video without free hand. I made test by crap mobile phone + free hand and I had to stabilize video after (shake from hand). It is necessary because you will get problems with correct tracking points.
Keep also in both software same frame ratio...if you mix 25 frames with 30 frames between AE and LW you will get bad composition. So if you stick with 30 frames (I suggest it, is standard now) then keep always 30 frames everywhere.

[ZodiaQ]

thx for the tips! Gonna try as soon as I have some time.

[ZodiaQ]

Have done some tests.
Was able to track my video motion in AE and send camera motion (and Null) to LW.
So far so good .... the exported Null nicely stuck to scene in LW but 'scene orientation' is totally off.
If I load an object in LW it's orientation/rotation doesn't match the camera view at all
is there any way to get the groundplane match in LW
Can't imagine to have to manually eyeball the whole scene to match the LW groundplane
Have tried but it's getting me nowere

[Janusz Biela]

Check this script from the link above. After export from AE to LW it should be everything match: camera and nulls.
Sorry but I do not remember whole procedures but is very basic (just did once for test)
Here also tutorial - I think I used this one:
[youtube]TKrY6bGQzrI[/youtube]

[ZodiaQ]

Thx for the quick reply.
Gonna try again

[mdharrington]

here's an old test I did with syntheyes....
the track is a little off because of rolling shutter, but the main exercise was getting scene reflections onto the CG object

the video explains the process somewhat
https://vimeo.com/95061758

it appears the vimeo link tags on this forum dont work

[Janusz Biela]

I changed HTML replacement it should work now number link from vimeo.
Thanks.

[mdharrington]

I see that thanks

[ZodiaQ]

Thx for sharing, don't have time right now but surely gonna check out later!