Page 1 of 1

Compositing in live video?

Posted: Fri Dec 11, 2015 6:44 pm
by ZodiaQ
If I wanted to show houses in a live video street shot, what software would I need.
Anyone ideas for workflow in combination with LW/Kray ?

Re: Compositing in live video?

Posted: Sat Dec 12, 2015 12:44 am
by Janusz Biela
Can you precise idea? I suspect, you want add render houses into real video material.

Re: Compositing in live video?

Posted: Sat Dec 12, 2015 12:49 am
by Leftover
AE CS6 has built in camera tracker, as well there are Boujou and Autodesk MatchMover

Workflow in general is.
1. Track you footage,
2. Get camera and reference data to LW.
3. Clean up motion if necessary.
4. Move you house model, matte objects to position you need
5. Render animation
7. Composit to source footage :)

Re: Compositing in live video?

Posted: Tue Mar 01, 2016 6:32 pm
by ZodiaQ
Sorry for the late reply.
Yes I was referring to placing 3D house model into live video street view.

Re: Compositing in live video?

Posted: Tue Mar 01, 2016 8:21 pm
by Janusz Biela
A while ago I did that test:

[youtube]bYnvhTLOsps[/youtube]


Problem is only with shadows (shadow catcher is not supported in Kray) so I render it under LW Native.
In YouTube you can find a lot tutorials for exchanging datas between AE and LW.
Also this can help (I used it):
http://www.motion-graphics-exchange.com ... f8b4034916

Re: Compositing in live video?

Posted: Wed Mar 02, 2016 6:17 pm
by ZodiaQ
Thx but this is all very new to me.
No experience at all with live video inside of LW

If I understand correctly I import my (lowres) video in LW, place 3D content, render and use AE to combine render with live video?

How to track video motion in LW? and how to sync 3D objects with video movement?

edit :

Think I already found a decent youtube tutorial :)
https://www.youtube.com/watch?v=Kp49jSF9-gs

Re: Compositing in live video?

Posted: Wed Mar 02, 2016 7:51 pm
by Janusz Biela
Something that. Just use build in AE tracking points - is very good.
One hint: very good idea is to have video without free hand. I made test by crap mobile phone + free hand and I had to stabilize video after (shake from hand). It is necessary because you will get problems with correct tracking points.
Keep also in both software same frame ratio...if you mix 25 frames with 30 frames between AE and LW you will get bad composition. So if you stick with 30 frames (I suggest it, is standard now) then keep always 30 frames everywhere.

Re: Compositing in live video?

Posted: Thu Mar 03, 2016 9:57 am
by ZodiaQ
thx for the tips! Gonna try as soon as I have some time.

Re: Compositing in live video?

Posted: Fri Mar 04, 2016 11:55 am
by ZodiaQ
Have done some tests.
Was able to track my video motion in AE and send camera motion (and Null) to LW.
So far so good .... the exported Null nicely stuck to scene in LW but 'scene orientation' is totally off.
If I load an object in LW it's orientation/rotation doesn't match the camera view at all
is there any way to get the groundplane match in LW
Can't imagine to have to manually eyeball the whole scene to match the LW groundplane
Have tried but it's getting me nowere

Re: Compositing in live video?

Posted: Fri Mar 04, 2016 12:00 pm
by Janusz Biela
Check this script from the link above. After export from AE to LW it should be everything match: camera and nulls.
Sorry but I do not remember whole procedures but is very basic (just did once for test)
Here also tutorial - I think I used this one:
[youtube]TKrY6bGQzrI[/youtube]

Re: Compositing in live video?

Posted: Fri Mar 04, 2016 12:38 pm
by ZodiaQ
Thx for the quick reply.
Gonna try again :)

Re: Compositing in live video?

Posted: Sat Mar 05, 2016 12:30 am
by mdharrington
here's an old test I did with syntheyes....
the track is a little off because of rolling shutter, but the main exercise was getting scene reflections onto the CG object

the video explains the process somewhat
https://vimeo.com/95061758

it appears the vimeo link tags on this forum dont work


Re: Compositing in live video?

Posted: Sat Mar 05, 2016 1:08 am
by Janusz Biela
I changed HTML replacement it should work now number link from vimeo.
Thanks.

Re: Compositing in live video?

Posted: Sat Mar 05, 2016 6:17 am
by mdharrington
I see that thanks :)

Re: Compositing in live video?

Posted: Mon Mar 07, 2016 11:27 am
by ZodiaQ
Thx for sharing, don't have time right now but surely gonna check out later!