PDA

View Full Version : Are you still shooting RED 3D with a beamsplitter?



Clyde DeSouza
08-27-2010, 03:54 PM
Well... there is an option now.
Just Fix two REDs side by Side and shoot.

Reshape the "3D Volume" in post using the RealFlex method
http://realvision.ae/blog/2010/08/3d-camera-interaxial-and-convergence-using-the-realflex-method/

No, it's not guaranteed to work with every conceivable shot/scene out there, but you'll be surprised what can be done even with basic tweaking of the parameters.

Regards.

jonnycom
08-27-2010, 08:34 PM
That link does not work. I don't understand how you can cheat IO on shots that require a IO smaller then a side by side would allow. Do you have any frames that we can see?

Johnny Friday
08-27-2010, 09:12 PM
Interesting....I'd also like to know how you get away with changing IO in software. There must be a down side.

That said, this I came up with a down and dirty 3d parallel rig solution for $12usd. Convergence was set to just about 18' as i recall. And stereo YES, did work. My final upgrade was a strap to allow me to Run and Gun with two REDS Parallel. Now....if the software actually works?? Very promising. Yeah...i know, does not look great, but worked as a lat minute solution.

Pedro Guimaraes
08-27-2010, 09:21 PM
Interesting....I'd also like to know how you get away with changing IO in software. There must be a down side.

That said, this I came up with a down and dirty 3d parallel rig solution for $12usd. Convergence was set to just about 18' as i recall. And stereo YES, did work. My final upgrade was a strap to allow me to Run and Gun with two REDS Parallel. Now....if the software actually works?? Very promising. Yeah...i know, does not look great, but worked as a lat minute solution.



"Run and gun with 2 reds..." I'm sorry but I had to have a chuckle with this statement. I hear it from producers all the time too. Right now nothing about 3D production is very run and gun.....especially if your talking about a 65lbs camera.

You can shoot alot with 6" IO, just ask Eli Jarra, he's shot hours of material like this. I've seen the SGO Mistika software alter IO in post and it's a 300k dollar tool.

It can work okay is some situations but the technology is limited. I would never shoot like this on purpose by choice.

Beam splitters are what we live on and will be living on at least for a few more years until someone comes out with a proper purpose built 3D camera that is flexible.

Johnny Friday
08-27-2010, 09:26 PM
Funny indeed, but it worked and i could move easily from one location to the next and not be nailed to a tripod under the conditions i was shooting....which were skydivers---moving fast from air to ground....yeah, it's a joke i know...but for $12usd and not $90k or $300k it worked. Was merely an idea i had and when shooting 2d and thought to get two reds working onset while the two SI-2k's were working in the air.

Clyde DeSouza
08-28-2010, 04:27 AM
That link does not work. I don't understand how you can cheat IO on shots that require a IO smaller then a side by side would allow. Do you have any frames that we can see?

The link should be working.
Anyhow here's a shorter version of the link: http://bit.ly/bYfWi3

As a few have asked for examples, I've uploaded one case scenario and updated the article with it.

There was no way possible (or at least it would be extremely cumbersome) to maneuver a Beamsplitter and do sharp turns down alleyways in this run n gun type SlumDog millionaire shoot.

Regards.

Clyde DeSouza
08-28-2010, 04:38 AM
Johnny Friday,
I salute you! Seriously I have all admiration for people who break or bend the rules when it comes to innovation.

Great looking rig.
While it's true that you get what you pay for... it can also be said, that never before in the history of Cinematography has technology and falling prices reached such a (cliche phrase coming up)..."tipping point".

Rigs and methodologies are evolving rapidly. The only people who will suffer, will be those who refuse to evolve mentally.

Regards

Brian D. Goff
08-28-2010, 04:52 AM
The link should be working.
Anyhow here's a shorter version of the link: http://bit.ly/bYfWi3

As a few have asked for examples, I've uploaded one case scenario and updated the article with it.

There was no way possible (or at least it would be extremely cumbersome) to maneuver a Beamsplitter and do sharp turns down alleyways in this run n gun type SlumDog millionaire shoot.

Regards.

Hi

How close can a subject get to the lens when using this method - will it actually replace Beamsplitter rigs most of the time?

Clyde DeSouza
08-28-2010, 05:21 AM
Brian,
I don't expect it to completely replace a beam-splitter. I am optimistic yes, but I will refrain from saying it's a sure fire thing.

The best advice I would give is, do a short take of the scene, and feed the clip through a good powered laptop running CS5 in-the-field. Adobe CS5 reads Red Raw natively, so it's easy to test.

You will quickly be able to see what's possible. Actually the Previz crew can do this before hand while at the blocking stage.

What I normally recommend is a combination of different techniques.

1) The right tool for the job - If it's an Si2k mini.. then use it.
2) If the scene can be covered with a pair of Parallel Reds (ie you don't need to get extremely close to the talent) then use Reds.
3) getting really close to the subject does have pitfalls in 3D - ie Exaggerated or deformed looking noses, eye sockets or curvature on objects if shot with primes...so if you anyway shoot with a zoom lens to avoid this effect... then shoot with the "shortest" long lens so that they don't take too much physical space when placed side by side, back up a bit, and nudge the zoom to taste.

then, with proper framing in mind, and techniques like H.I.T, floating the window, and the fact that you can now re-shape 3D volume, it could work for many shots.

All the best!

Johnny Friday
08-28-2010, 08:13 AM
Agreed....won't completely replace beam-splitter, but certainly gives you a variety of options when you NEED to look at a shot or replace a shot. I recently got off of a shoot using SI2k's in parallel for skydiving. That was what we were there to shoot for a feature test. BUT i took it upon myself to take our two REDS and make a quick parallel setup for shooting from the ground as our skydive team approached. Might not have been the most ergonomically designed nor most functional rig Pedro--in fact ugly as hell and not something that would likely ever work on a feature set---in fact never i'm sure. But it did work and we got our 2 shots.....that we never even expected or proposed. And yes, running around with it---yes, "running" i was able to accomplish what i set out to do. What certainly is or has been an issue though is the rolling shutter and actually syncing the left/right eye perfectly---something i am not very familiar with, or why....however seems to be a new fix with build 30.6 i hear. Anyway.....my cents and i think innovation on the fly is good to see on a shoot. We've all been there with duct tape and crazy ass ideas to get a shot. I don't work much (if ever) in feature world....all nat. history, so there's a lot of duct tape and bailing wire in my kit.

Rudi Herbert
08-28-2010, 03:41 PM
I don't want to contradict Pedro, he's been one of the first contributors to the 3D section and he's constantly working on 3D projects, so his knowledge and wisdom is not something to dismiss...But, I also disagree that 3D can only be shot a certain way, and for as many advantages as beamsplitters have, they have tons of disadvantages as well. I've always been one of those not to accept commonly accepted wisdom if it doesn't make sense, preferring to put it to the test instead. Shooting underwater for the last 8 months or so, and always with side-by-side configurations, I've learned a lot actually.
If you have a good way to adjust convergence in post then shooting SbS actually works surprisingly well for a very large percentage of situations. If you manage to replicate that magical 2.5-3" humanlike IO, this setup will result in "normal" parallax perception that, by simulating the separation between our eyes, yields images that feel "right", no matter the distance to the subject. Remember, our eyes don't move in or out in our skull as we look at different planes of depth, the adjustment happens in the brain, much the same way we adjust when looking at images shot within that under 3" IO. And no amount of argument from experts will convince me otherwise, I have the images to prove it.
So far, I've been shooting with a couple of Canon HF-S10 AVCHD cameras that have a minimum IO of 2.65", pretty much letting me cover anything from 7 ft to infinity.
To overcome the crappy format, I've hooked the cameras to dual Nanoflash recorders and gotten much, much higher quality, and I will start using a Cinedeck 3D recorder soon, which is specifically designed for the task, recording both streams as an already muxed file. I've tested dual Sony EX-1's as well, and although the IO is about 4.2", anything from 10 ft onwards looks great. I'm hoping that Scarlet or Epic will come in at somewhere
similar to the EX-1 and most likely even smaller, probably around 3.5", in which case you'd only need a beamsplitter for things closer than 8 ft or so. HOWEVER, and this is very important, you can use any of the above rigs and IO distances to shoot anything way closer than that, the only drawback being that to merge the images, you need to zoom in considerably, loosing resolution. I've shot some macro experimental work in this manner with my cameras just 5" from the subjects, and the results look great in anything up to a 40" plasma. Of course, for feature work, you'd need something with far more resolution to spare, not miserable 1/3" sensors, but that is the forte of RED, isn't it? Just saying that although a lot of the established rules of 3D hold on their own, like most rules, they can bent, flexed, modified and rewritten just so long as you're willing to try...

Rudi Herbert
08-28-2010, 03:47 PM
...and how are you Johnny by the way? :-)

Johnny Friday
08-28-2010, 03:59 PM
Rudi....doing well thanks. Been on a couple 3d shoots recently and i am a sibling merely sucking up it up.

Michael Hastings
08-28-2010, 04:13 PM
What are the limitations (or advantages) for overall 3d work using this revision plug in vs. The dashwood plugin or cineform 3d neo3d?

Rudi, glad to hear it is working well, with my ear surgery I haven't been able to do much. (should get clearance monday).

Clyde DeSouza
08-29-2010, 01:40 AM
Rudi,
I like your approach to stereoscopy.

>>If you have a good way to adjust convergence in post then shooting SbS actually works surprisingly well for a very large percentage of situations.

This is true. Especially on large cameras like the RED, Shoot full sensor, and this will allow you enough crop room to do H.I.T (image translation and crop)."think TV safe" like the old days.. and use those on-screen guides to frame your shot.

You can also float the stereo window for some shots..
Then there's reshaping of the 3D volume using tools from Nuke/Ocula, Mistika and now lastly a cheaper option of a 600$ plugin and after effects.

>>..." If you manage to replicate that magical 2.5-3" humanlike IO, this setup will result in "normal" parallax perception that, by simulating the separation between our eyes, yields images that feel "right", no matter the distance to the subject"....

However, beware, there may be too much positive parallax on background objects, that while easier to "fuse" on a 42 inch plasma or even a 15 foot projection screen...may be quite a challenge for the eyes to fuse when projected on a 40 foot cinema screen. This is one of the reasons that people shoot with a less than 6.5cm interaxial on cameras. (interocular when referring to normal human eyes and being "victorian" about stereo lingo)

>> ...."So far, I've been shooting with a couple of Canon HF-S10 AVCHD cameras that have a minimum IO of 2.65", pretty much letting me cover anything from 7 ft to infinity."...

This is one of the reasons you are blessed with sharp stereo that is easier to fuse at interaxials of 3 inches or thereabouts.
The fact is that the lenses on these cameras when focussed at infinity do not exhibit depth of field blur...AND the cams have an (advantage?) of small sensor size, This helps in keeping everything pin sharp.. a.k.a Stereo3D loves the pin-hole camera.

we all know the downside: less dynamic range, latitude, fixed glass, more light needed and no creative usage of depth of field or what I call.. circle of Isolation:
http://realvision.ae/blog/2010/07/circle-of-isolation-shooting-good-stereoscopic-3d-for-live-sports/

>>..."To overcome the crappy format, I've hooked the cameras to dual Nanoflash recorders and gotten much, much higher quality, and I will start using a Cinedeck 3D recorder soon"...

I love this approach! It's exactly what I would do, to squeeze extra bitrate encoding to overcome AVCHD compression limits.

some tips (ignore if your already aware of them). Since your shooting with Canon AVCHD, I'm assuming those particular models work with a LANC sync unit?

I would suggest you try the SONYs. The reason being on the Sony's, both the lanc port and the HDMI output are on the back of the cameras. This means you can get the cameras closer together side-by-side. I think on the canons the ports are on the sides?

One good LANC sync unit is from www.digi-dat.de
At least it allows a minute or two or very good sync (not compared to genlock) before it drifts off...

>>..."Just saying that although a lot of the established rules of 3D hold on their own, like most rules, they can bent, flexed, modified and rewritten just so long as you're willing to try"...
:rant:

Amen! Also what some people don't realize is that for the first time ever (barring the past fads) in the history of Cinema, we can record "spatial resolution" ..something that no one has yet done conclusive experiments on; i.e a comparison of the perceived "resolution" of an image simply by pixel count of say a 2k image versus the "Spatial resolution" of a 3D image on the brain even if its 1920 x 1080.

This does not mean that we should go about comparing AVCHD output at whatever bitrate to a Red 4K image...

...what we can do is experiment with the RED's overscan ability to create great 2k images on the sensor.

Then use a Ken burns horizontal slide to get that much coveted "smaller interxial" look!
:rant:

Regards

Clyde DeSouza
08-29-2010, 01:44 AM
[QUOTE=Michael Hastings;644675]What are the limitations (or advantages) for overall 3d work using this revision plug in vs. The dashwood plugin or cineform 3d neo3d?

No, I believe the Dashwood plugin does H.I.T (horizontal image translation) to re-converge the images.

This then needs cropping the edges (you lose image data from the left/right sides), and/or floating the stereowindow.
If you keep your framing within safe guides, no reason not to use HIT.

Also the Dashwood plugin implements a lot of other stereoscopic tools in a very intuitive interface.

Regards

Rudi Herbert
08-30-2010, 01:42 PM
Clyde,

I would much prefer to use Sony than Canon, but the equivalent size Sony cams, the 500 and 520, don't have any progressive modes, only interlaced, and that's a no-no when recording for 3D as you can imagine. The Canons have the SF progressive modes that are not truly progressive but don't have any interlace lines just the same when the pull down is removed. Yes, the Canons have the plugs on the side but there is still space for the mini HDMI plug since the cameras have a separation of about 3/4 inch between them due to the wide angle lenses at the front pushing the cameras out just that much...what I am really looking forward to is Epic or Scarlet, that should be something!

Philippe Van Horebeek
08-30-2010, 02:48 PM
....What certainly is or has been an issue though is the rolling shutter and actually syncing the left/right eye perfectly...

Do you mean the syncing of the two cameras ?

Johnny Friday
08-30-2010, 03:05 PM
Do you mean the syncing of the two cameras ?

yes

Rudi Herbert
08-30-2010, 06:34 PM
yes

when I first contemplated using a pair of small Canon camcorders or even a pair of EX-1's, my options for jam syncing the cameras were basically non existent, save for some very expensive and not really proven dual infrared trigger units. A few experts told me I would not be able to get decent 3D unless I solved that problem, and understandably my heart fell to the floor, since those same experts told me unless I used a beamsplitter, I could not use a pair of RED side by side either since their IO was too big. It seemed my 3D career was dead in the water before it even took off, so since I had already had a housing made, I went anyway and tried to sync the cameras through that old method...what's the name...of yeah, a clapper. And what do you know, through the use of a clapper and sound syncing, I can get my cameras within half a frame of each other, and specially when shooting at 30 frames, that difference is basically of no consequence. I know what some will say, that even those minute, intraframe separations will create a mess in post, but I cannot think of a more difficult medium than underwater, with fish that can twist from left to right in one frame, or corals swaying in the current constantly or the sun reflecting on and off on the sand the whole time. And despite all that, I've shown my converged footage to a couple of experts and first thing they asked is how I managed to sync those cameras perfectly :-) It's not perfect, but if there's a will, there's always a way to get things done acceptably well...

Johnny Friday
08-30-2010, 06:42 PM
Rudi,
yes it definately can be done and with a bit of work in post. I did the same with two reds side by side and sound/clapper. But as you say...and rolling shutter issue....not perfect, but definitely works. BUT with RED...there's also a camera reset time of something like 5ms on the new MX and i believe there may be some out of tolerance issue from camera to camera. at least up to build 30.5 I'm now on build 30.6 and have read that this is somewhat or is resolved. have not yet been able to shoot with the new build since no project at the moment. But RED introduces a few other hurdles to overcome. using the genlock devise had still been an issue even up to build 30.5

i give you credit for making it happen underwater.

Clyde DeSouza
08-31-2010, 04:20 AM
Rudi,
I'll admit i'm a bit skeptical and have pre-conceived notions about good sync that is only frame accurate, because i've seen what it does to scenes which i have shot of nature that has any kind of reasonably fast motion in it. example wings of birds flapping (strobing flutter) or of animals running (hind legs look like they cross over front legs).

Of course people walking in a crowd also exhibits temporal artifacts. These are from cameras that are lanc synced, not just frame synced. and at 1/30th

If this were a CCD camera I'd be less skeptical, but Cmos chips with their line scanning is what makes me want to see this first hand.

If at some point you have some example footage that shows motion, and can make it available it would be great. I do have an interest in learning more to what can be applied where.

Regards
Clyde

Clyde DeSouza
03-21-2012, 06:33 AM
for sake of completeness of the original topic, i'm reposting here...

For those of you shooting side by side, there *is* the possibility to now to change/tweak depth after the fact.

It's not new, this feature was there in Mistika/Nuke, but now a new software Emotion3D, promises better.

Read about it here: http://bit.ly/GDb6Cx

Regards.
Clyde


P.s Another feature of the software is that you can also shoot stereo and now easily create "tweens" for Autostereoscopic (glasses free) displays.

KETCH ROSSi
03-21-2012, 07:30 AM
Very interesting times indeed Clyde,

however as a 3D specialist I still love the fact of been able to visualize my Depth Budget form the actual Screen writing of the story, and then translated to the Story Board, to then been able to apply and distribute lighting in a completely different form, as to further enhance the depth and visualization of all layers within a scene, so that the light aid the shadows and illuminated areas to further isolate objects contained within, as well as a clearer separation form the subjects, as well of course continue to play with DOF as needed same as I would in 2D stander filming.

Definitely such SW is already bringing huge advantages in post, yet I still don't fill comfortable allowing such tools to take over my style of storytelling in narrating a 3D environment were I don't control IO and convergence on the spot aided by my ever good friend... The Stereographer and my Beam Splitter Rig of choice... ;)

But I say that it is great to see such implementation coming to life, as there will be much less shots gone to waist with such tools, and more and more scenes get saved.

For now, I much wish on ever smaller and easier to control 3D rigs... ;)

David Cole
03-21-2012, 07:34 AM
How does Emotion3D deal with occlusions when parallax is altered? With Ocula (and several other optical flow analysis / view synthesis based processes), you have destructive tearing in the frame around the occluded fronts. The tears often need to be hand repaired, frame by frame.

Clyde DeSouza
03-21-2012, 09:04 AM
@David, I suspect not every scene will work. I myself have not thoroughly put the software thru it's paces ( i guess I'm not a qualified After effects artist to extract everything from it as well).
Still, I believe you may have points there.

Ketch, what you say is true! No replacement for a live planned and executed shot. I think it's purpose will be tweaks, depth blends/cushioning and such in post, and to save many shots where positive parallax goes astray, since by default anything in after effects is keyframable.

The other points not directly related to the above are of course, multiview synthesis for autostereo displays (think ADs and Movie trailers of 3D films running on glasses free displays in Cinema lobbies and Malls) etc...

I'll brain-storm a couple ideas and put in an article on this, Let's see... food for thought.

(P.s I'm not getting paid or anything!
unless they buy a bunch of copies of my Think in 3D book to give away to clients :-)

Pedro Guimaraes
03-21-2012, 05:00 PM
I have seen a few demos of the "adjustable Io" in mystika. It "can" work on many scenes....it very much depends on the backgrounds and the textures in those backgrounds. How "homogenous" they are vs. geometrical or high contrast.....so many variables that play into adjusting IO in post. This is definitely the case of a shot by shot analysis and review of weather or not this technology can work to help the shot in question.

I can't imagine "depending" on this technology because I'm shooting side by side rig so I have to reduce my IO in post on many of my shots....

In other words, this technology in no way replaces the need for a beamsplitter.............in my view and opinion.

just my .02 cents.....

Björn Benckert
03-21-2012, 06:11 PM
Would not count on such solution.
Try this.... shoot a macro shot. Run it trough the plugin... :)

The 3D perception is depending of the distance both between cameras but also between the camera and object shot. Two epics side by side and shooting something thats, lets say 20 cm away from the lens will just not work without a mirror array.

For the same reason landscape shots are sometimes made with big camera offsets macro shots needs a small offset. So this solution will only work from mid range and away. Nothing closer than 2-4 meters from cameras would be my guess, a bit depending on what the objects are and what lenses you are on.

So it works for some shots but for the most part it does not.

Les Dittert
03-21-2012, 09:54 PM
As David mentioned, the fly in the ointment is the edges. The artifacts in current software show up as wiggly/fluttering edges or blurry edges. You can blur and pull details in the areas near big Z changes, but then your material will look a lot like 'clash of the titans' and can in no way be passed of as native 3D footage any more.
I like wide lens's, portability, and 3d, so I am pursuing the matter.

Clyde DeSouza
03-22-2012, 12:16 AM
:-) I know about the pros/cons Les, Bjorn,

I've been doing this a while, (back in 2004- 2007) for autostereo displays.
It works on a scene by scene basis, and this i've made clear in the article. (using the real flex plugin and Nuke+ocula solutions)

I've also mentioned that I've not thoroughly put the Emotions 3D app thru it's paces, but maybe if you guys are at NAB you can drop by them and let me know. (Ps. I have no affiliations with the company)

I like that it's got an intuitive tool-set for tweaking 3D in post, for dealing with depthmaps, and autostereo output all rolled in one.

Regards
Clyde

KETCH ROSSi
03-22-2012, 09:00 AM
No Clyde there is not... ;)

However as you said, it can sure serve a great POST propose especially in this occasions when something din't get quiet right on the original capture of the image when filming, or for very particular situations were simply there isn't a budget.

Either way at the end is nice to see advancements in post production tools such as this.





Ketch, what you say is true! No replacement for a live planned and executed shot. I think it's purpose will be tweaks, depth blends/cushioning and such in post, and to save many shots where positive parallax goes astray, since by default anything in after effects is keyframable.

The other points not directly related to the above are of course, multiview synthesis for autostereo displays (think ADs and Movie trailers of 3D films running on glasses free displays in Cinema lobbies and Malls) etc...

I'll brain-storm a couple ideas and put in an article on this, Let's see... food for thought.

(P.s I'm not getting paid or anything!
unless they buy a bunch of copies of my Think in 3D book to give away to clients :-)

Tom Funk
04-03-2012, 10:28 AM
for sake of completeness of the original topic, i'm reposting here...

For those of you shooting side by side, there *is* the possibility to now to change/tweak depth after the fact.

It's not new, this feature was there in Mistika/Nuke, but now a new software Emotion3D, promises better.

Read about it here: http://bit.ly/GDb6Cx

Regards.
Clyde


P.s Another feature of the software is that you can also shoot stereo and now easily create "tweens" for Autostereoscopic (glasses free) displays.


I'd seen Emotion 3D last year at NAB as a prototype, but nothing since. But I wanted to also point out Eyeon Fusion's new plugin, Dimension: http://eyeonline.com/web/eyeonweb/products/Dimension/Dimension.aspx - which can also change IA, in addition to a number of other stereoscopically aware tools, such as re-timing. If I'm not mistaken, the plugin is only $1000, though I don't remember how much Fusion itself is. But from what I remember Emotion 3D was considerably more expensive.

I've got two Epics now, and am using both a side by side rig and a beamsplitter, depending on what I'm shooting of course. For the sbs, though, I'm converging around 18' and keeping everything mostly that far out. But - I am hoping to get some testing in with Eyeon / Dimension soon. It sure would be sweet to just shoot sbs. With the size and weight of the two Epics, it's pretty nicely manageable.