Compositing in live video?

Post your tutorials and help questions in this forum
Locked
ZodiaQ
Posts: 232
Joined: Mon Mar 25, 2013 4:52 pm

Compositing in live video?

Post by ZodiaQ »

If I wanted to show houses in a live video street shot, what software would I need.
Anyone ideas for workflow in combination with LW/Kray ?
User avatar
Janusz Biela
Posts: 3265
Joined: Mon Mar 13, 2006 10:39 am
Location: Finland
Contact:

Re: Compositing in live video?

Post by Janusz Biela »

Can you precise idea? I suspect, you want add render houses into real video material.
Leftover
Posts: 51
Joined: Thu Feb 14, 2008 8:58 am

Re: Compositing in live video?

Post by Leftover »

AE CS6 has built in camera tracker, as well there are Boujou and Autodesk MatchMover

Workflow in general is.
1. Track you footage,
2. Get camera and reference data to LW.
3. Clean up motion if necessary.
4. Move you house model, matte objects to position you need
5. Render animation
7. Composit to source footage :)
ZodiaQ
Posts: 232
Joined: Mon Mar 25, 2013 4:52 pm

Re: Compositing in live video?

Post by ZodiaQ »

Sorry for the late reply.
Yes I was referring to placing 3D house model into live video street view.
User avatar
Janusz Biela
Posts: 3265
Joined: Mon Mar 13, 2006 10:39 am
Location: Finland
Contact:

Re: Compositing in live video?

Post by Janusz Biela »

A while ago I did that test:

[youtube]bYnvhTLOsps[/youtube]


Problem is only with shadows (shadow catcher is not supported in Kray) so I render it under LW Native.
In YouTube you can find a lot tutorials for exchanging datas between AE and LW.
Also this can help (I used it):
http://www.motion-graphics-exchange.com ... f8b4034916
ZodiaQ
Posts: 232
Joined: Mon Mar 25, 2013 4:52 pm

Re: Compositing in live video?

Post by ZodiaQ »

Thx but this is all very new to me.
No experience at all with live video inside of LW

If I understand correctly I import my (lowres) video in LW, place 3D content, render and use AE to combine render with live video?

How to track video motion in LW? and how to sync 3D objects with video movement?

edit :

Think I already found a decent youtube tutorial :)
https://www.youtube.com/watch?v=Kp49jSF9-gs
User avatar
Janusz Biela
Posts: 3265
Joined: Mon Mar 13, 2006 10:39 am
Location: Finland
Contact:

Re: Compositing in live video?

Post by Janusz Biela »

Something that. Just use build in AE tracking points - is very good.
One hint: very good idea is to have video without free hand. I made test by crap mobile phone + free hand and I had to stabilize video after (shake from hand). It is necessary because you will get problems with correct tracking points.
Keep also in both software same frame ratio...if you mix 25 frames with 30 frames between AE and LW you will get bad composition. So if you stick with 30 frames (I suggest it, is standard now) then keep always 30 frames everywhere.
ZodiaQ
Posts: 232
Joined: Mon Mar 25, 2013 4:52 pm

Re: Compositing in live video?

Post by ZodiaQ »

thx for the tips! Gonna try as soon as I have some time.
ZodiaQ
Posts: 232
Joined: Mon Mar 25, 2013 4:52 pm

Re: Compositing in live video?

Post by ZodiaQ »

Have done some tests.
Was able to track my video motion in AE and send camera motion (and Null) to LW.
So far so good .... the exported Null nicely stuck to scene in LW but 'scene orientation' is totally off.
If I load an object in LW it's orientation/rotation doesn't match the camera view at all
is there any way to get the groundplane match in LW
Can't imagine to have to manually eyeball the whole scene to match the LW groundplane
Have tried but it's getting me nowere
User avatar
Janusz Biela
Posts: 3265
Joined: Mon Mar 13, 2006 10:39 am
Location: Finland
Contact:

Re: Compositing in live video?

Post by Janusz Biela »

Check this script from the link above. After export from AE to LW it should be everything match: camera and nulls.
Sorry but I do not remember whole procedures but is very basic (just did once for test)
Here also tutorial - I think I used this one:
[youtube]TKrY6bGQzrI[/youtube]
ZodiaQ
Posts: 232
Joined: Mon Mar 25, 2013 4:52 pm

Re: Compositing in live video?

Post by ZodiaQ »

Thx for the quick reply.
Gonna try again :)
mdharrington
Posts: 33
Joined: Sun Sep 20, 2009 8:21 am

Re: Compositing in live video?

Post by mdharrington »

here's an old test I did with syntheyes....
the track is a little off because of rolling shutter, but the main exercise was getting scene reflections onto the CG object

the video explains the process somewhat
https://vimeo.com/95061758

it appears the vimeo link tags on this forum dont work

User avatar
Janusz Biela
Posts: 3265
Joined: Mon Mar 13, 2006 10:39 am
Location: Finland
Contact:

Re: Compositing in live video?

Post by Janusz Biela »

I changed HTML replacement it should work now number link from vimeo.
Thanks.
mdharrington
Posts: 33
Joined: Sun Sep 20, 2009 8:21 am

Re: Compositing in live video?

Post by mdharrington »

I see that thanks :)
ZodiaQ
Posts: 232
Joined: Mon Mar 25, 2013 4:52 pm

Re: Compositing in live video?

Post by ZodiaQ »

Thx for sharing, don't have time right now but surely gonna check out later!
Locked