Depth extraction from two cameras applications?

[Peter Karlsson]

Does anyone have a recommendation for a application that renders out a depth map from two images? Sofar the only plug-in I found is the Ocula for Nuke, but its waaaay out of my pricerange.

I want to do a technical test to see how good depth map I can extract from two red cameras, and use the depth map as a tool to get rid of much of the painstaking rotoscope labor I need to do on a for a short film.

[Eric Lange]

Hi Peter,

We have been developing software for the extraction 3d geometries and textures from stereographic data sources (still and dynamic). We are soon to be looking for Beta testers but we are also looking to scrounge/borrow various example stereo footage so that we can test the range of capability of the software [sw launch some time in 2009]. Please feel free to P.M. me some of your requirements. Would be interested in what price point down from NUKE/OCULA that would allow you to pull the trigger on such an application? The software has a vast array of capabilities (been in development for over six years) but we have been looking to chop it down into highly simplified application specific modules. So for example in one simple version we are playing with you can just drop in stereo key frames, and then pull out very clean and compact texture mapped models of a very high precision to be exported to other applications. The interface if fully stereo immersive and features a terrific level of control to enable very high quality results.
Interested to learn of how you intend to apply your rotoscoping technique?

[GPSchnyder]

Hi Eric/VERAXYZ,

If you are searching for Beta Testers I'd also like to be on your List. But my Entry (for now) will be at a very low budget Range. Till I get my two Scarlets :-) But I also would like to be in your Testergroup, as I am working on a LowBudget 3d Filmmaking Technique, that could really use a Depth-Map for the VFX (which are kind of harder to do in 3d)

The Rotoscoping (I think) would be a black/white Map cut at short behind the Subjects depth. At least this is how I would do it. As you basically get a white to black over grey as the depthmap there should be no problem to get the right depth to cut between black and white. Even the feather could be used from the map, which would make it more realistic than a feather that is for instance 14 pixels wide everywhere...

George

[Peter Karlsson]

Hi Eric,

I will drop you a p.m. This solution sounds even better than only getting a depth map out of it!!

[markusm]

I'd be curious to learn more about it as well when you are further along.

Markus

[vsv]

Does anyone have a recommendation for a application that renders out a depth map from two images? Sofar the only plug-in I found is the Ocula for Nuke, but its waaaay out of my pricerange.

I want to do a technical test to see how good depth map I can extract from two red cameras, and use the depth map as a tool to get rid of much of the painstaking rotoscope labor I need to do on a for a short film.

Disparity channel generated by Ocula(Nuke) is not the same as Depth Map.
Extraction of Depth Map from the left+right images - not easy task:wink:
Philips has solution: "WOWvx Spacer" included in BlueBox with "WOWvx Compositor"
http://www.business-sites.philips.com/3dsolutions/3dcontentinterfaceformats/2dplusdepthformat/index.page

[Peter Karlsson]

Mmm... And how much is this Bluebox?!?!? Looks interesting, but expensive..

[mikeburton]

I would be interested in working on the beta team as well.

[neivinha]

Hi,

yes, I think that BlueBox is expensive, and is used for conversion between 2D to 2D-plus-depth and 3D(2 streams) to 2D-plus-depth.
the format 2D-plus-depth is used in Philips 3DWOW autostereoscopic multiview displays.

see this example: http://www.wowvx.com/videos/DetailedView.aspx?PostID=158&View=TwoDPlusDepth

soccer is my favorite sport (great images) :)


Marco Neiva.

[vsv]

Low cost solution Triaxes StereoTracer (http://www.3dmasterkit.com/index.php?id=59)


http://www.3dmasterkit.ru/forum/img/StereoTracer/sergm/girl_original_and_dm.jpg

http://www.3dmasterkit.ru/forum/img/StereoTracer/sergm/girl.gif

Download demo StereoTracer v3.5 (http://www.3dmasterkit.com/assets/download/setup-StereoTracer-3.5-en.zip)

Also try demo of Depth Map Creator (http://www.3dmix.com/files/demo/demo-mapcreator.zip)

[Peter Karlsson]

Thanks vsv! I'll try it out asap!

Can you describe the pictures you uploaded? What kind of source (resolution), is it from a stereopair etc?

/Regards Peter K * CG Sweden

[vsv]

Thanks vsv! I'll try it out asap!

Can you describe the pictures you uploaded? What kind of source (resolution), is it from a stereopair etc?

/Regards Peter K * CG Sweden

Peter, pics from russian forum, but you can learn process with flowers instead of girl:) there:

Multi-view rendering from a stereo pair (http://www.3dmasterkit.com/index.php?id=82)

http://triaxes.com/assets/images/usecase/stereotracer/step1.jpg

[Peter Karlsson]

I got only a grey line on the depth map when going above 2K images.. Do you know if this is a limitation of the demo? I already tried it and if works "ok".. But it misses the possibility to import framestacks, or batch convert two folders. So going frame-by-frame for an entire short isn't possible :/

[markusm]

I also think the new PFTrack (5.0) has this functionality.

http://www.thepixelfarm.co.uk/products/products.aspx?PID=3

"Integrated Z depth extraction tools assign depth data, on a per pixel basis, to sequences for exporting as a grey map or as a 3D mesh. This data can be viewed within PFTrack, in 3D, using the new orthographic view options which can then be broken down into any number of layers."

[Peter Karlsson]

No, I think PFTrack only uses motionanalysis for depth map extraction. I don't think it uses stereo for depth map generation.

[markusm]

It's basically the same thing. Take two (or more) images from different vantage points and construct a depth map (or 3d object) from it.

The new PFTrack has stereo capability, but I haven't looked at it yet, so I can't tell you what they encompass.

[Peter Karlsson]

Well, one more application to check out then! :) Atleast pixelfarm has a demo that I can try out. I'll give it a run and see whats comes out of it.

Snyggt jobbat med pandan! Madelein halsar till Anette forresten. (varlden ar bra liten ibland ;) ).

[Peter Karlsson]

Folow-up.. Just talked to a user of PFtrack.. It does indeed produce depthmaps with the information from both cameras! So now I'll just need that evaluation to start some testing. I'll let you all know my findings!

[Benni Diez]

Peter, would you mind putting up some examples once you have tested it? I'd love to see if those depth maps are suitable for atmospherics, masking and additional depth of field tweaking!
Imagine if you could just film with a simple stereo rig and then tackle all the juicy stuff in post. This would allow for much cheaper camera setups and easier handling during the shoot.
And no more worries about that bloody fog continuity! :)