Amazing Roto Technology

[Lucas Wilson]

http://www.milkandcookies.com/link/66481/detail/

This has been making its way around the web for awhile... but damn...

Anybody who makes their money doing rotoscoping needs to look for other work. Soon. If this is viable technology at high-resolutions, then I can imagine that it's a very short time until these algorithms start making their way into apps in our industry.

Lucas
-----
ASSIMILATE, Inc.
LA, CA, USA

[Seung Han]

That's crazy!

Would like to see in higher res...

[Sanjin Jukic]

Thanks Luki this "Content Aware Image Resizing" is very interesting technology.
Hope it is coming up in Scratch too?!

[Hans von Sonntag]

Interesting!

Something for The Foundry...

Hans

[GlennChan]

Could you potentially get strange results if there is motion or lots of noise in the image?

[Desert Rune]

I read somewhere Adobe hired the guys responsible for this or bought the technology.

[Lucas Wilson]

Could you potentially get strange results if there is motion or lots of noise in the image?

I don't know... you can try it yourself by downloading the ultra-basic "proof of concept" freeware app these guys have put out there.

http://www.intuimage.com/

Lucas
-----
ASSIMILATE, Inc.
LA, CA, USA

[Adam Jeal]

That's crazy!

Would like to see in higher res...

Here you go..

http://www.faculty.idc.ac.il/arik/IMRet-All.mov

adam

[forkazoo]

http://www.milkandcookies.com/link/66481/detail/

This has been making its way around the web for awhile... but damn...

Anybody who makes their money doing rotoscoping needs to look for other work. Soon. If this is viable technology at high-resolutions, then I can imagine that it's a very short time until these algorithms start making their way into apps in our industry.

Lucas
-----
ASSIMILATE, Inc.
LA, CA, USA

I haven't researched this technology very thoroughly, but in the demonstrations I have come across, I only see reference to still images. It isn't at all obvious to me that this technique is coherent across frames in a useful way. There is now a GIMP plugin that says it impliments this which I haven't played with yet, but if you are interested, you may want to check it out.

http://registry.gimp.org/plugin?id=10292

[kmikami]

I'm failing to see the rotoscoping application here. It looks to me like it's just a smart rubber stamp that's able to add or remove repeated background information while protecting a predetermined foreground area.

It looks like it may be useful for camera projection though as a method to quickly and easily extend areas that are occluded in the original image and cause problems when you do your camera move.

[Lucas Wilson]

I'm failing to see the rotoscoping application here. It looks to me like it's just a smart rubber stamp that's able to add or remove repeated background information while protecting a predetermined foreground area.

It looks like it may be useful for camera projection though as a method to quickly and easily extend areas that are occluded in the original image and cause problems when you do your camera move.

Add some tracking points to this technology, and you have a pretty damned cool wire and rig removal tool.

Lucas
-----
ASSIMILATE, Inc.
LA, CA, USA

[Gavin Greenwalt]

I'm not sure that it would be very useful for wire and rig removal. All it does is delete a column or row of pixels.

It also as a result breaks very easily in urban settings (or any kind of image with straight lines that need to be maintained.)

[forkazoo]

I'm failing to see the rotoscoping application here. It looks to me like it's just a smart rubber stamp that's able to add or remove repeated background information while protecting a predetermined foreground area.

It looks like it may be useful for camera projection though as a method to quickly and easily extend areas that are occluded in the original image and cause problems when you do your camera move.

One of the demos was to remove a person from a beach scene, so I can see some roto uses. Getting rid of that boom mike nobody noticed, or the PA that didn't realise he was in the shot, etc. Even so, it'll be a long time before this technology becomes useful for production, and even then, it'll hardly replace everything that falls under the blanket of roto.

[Gavin Greenwalt]

But in the beach scene it still had to rescale the image to accomplish its goal. A healing brush does the same thing only on a localized area (as opposed to a full column basis and is specifically designed for reconstruction of an area.

[Greg Syverson]

Thanks for the links:greedy:

Greg

[kmikami]

One of the demos was to remove a person from a beach scene, so I can see some roto uses.

Right. They're removing a person from a background. That's the easy part. Roughly chop out the unwanted subject and clone the background image in its place. In this case a very simple texture of sand, water and sky. Rotoscoping is generally the reverse though. Remove the background and keep the subject with all of the tiny details such as hair intact. I seriously doubt this technology can do anything like that but maybe I'm wrong.