August 27, 2007
Trackbacks/Pings (Trackback URL)
- Incredible Image Resizing Process | Riley McArdle
August 27th, 2007 at 2:46 am - An Unquiet Mind
August 27th, 2007 at 3:18 am - ocho kilobytes
August 27th, 2007 at 1:22 pm - TiVo Lovers Blog
August 27th, 2007 at 5:55 pm - Arts numériques » Blog Archive » Vidéo d’une démonstration de la retouche du futur !
August 29th, 2007 at 6:49 am - Mellow Morning
September 1st, 2007 at 1:20 am - SmoothSpan Blog
September 2nd, 2007 at 1:58 pm - פאוזה
September 4th, 2007 at 12:39 am - Simpson Media :: Musings on Technology » Blog Archive » Adobe Is Developing Incredible Products
November 6th, 2007 at 7:56 am - Die Zukunft der Bildbearbeitung | ckay.de
November 13th, 2007 at 3:44 am - Content-aware image resizing
February 20th, 2008 at 3:50 pm - 3 Green Fish » Blog Archive » 3 Things: Present, Future, Past
June 27th, 2008 at 10:01 am





That’s really amazing. Can’t wait to get my hands on the application.
Wow, really neat! That’s what I call “thread less Stitching on the Fly”
Amazing!! I also want it on Photoshop! (or fireworks) :p
Interesting find! Mind you, as LCD / monitor screens get larger and larger, this function would become less needed in a web presence, in terms of confined screen size.
It makes checking the User Generated Content a hell of a job for editors…
the resizing and the ability to delete people towards the end is simply amazing.
It would be great to have this on HTML pages also. It is pretty easy to implement it. Are there existing implementations for this ?
Wow, this is great! This is gonna have a major impact in all arenas, from websites to game programming!
This is the kindda stuff you should put up on techcruch!
Please do keep us updated on this one.
Thats amazing.
Crazy stuff. ADBE will buy that I hope.
Yeah, I saw this before, but still amazing indeed!
I like to have my pictures untampered with. This way, you may never know if you’re looking at the original or a shrunk/expanded version of an image. If used carelessly, you might glance over an image and not see some essential detail because it’s been cut out.
Alright, this is very cool and I can see myself using it. But, I have to imagine Reuters will get a bit concerned once this is in the wild.
This is really amazing - almost as amazing as getting my hands on our first scanner (me and friends snuck into the school lab and played with it for 3 hours until getting caught by the guard), or seeing the first Photoshop demonstration.
Only question left is when! which version of PS?
Awesome!!!
what? photoshop? i want this in HTML.
-mp
thats pretty neat, you could use it as a compression I would think. I wander what its like for moving images. Take a movie down to its lowest size and then use this tech to shrink it. I love seeing what comes out of siggraph.
very interesting waaaaaaaouuuuuuu.
are you serious? professional photographers will cut your arms off if you do that to their images. solution in search of a problem.
Awesome! Nice job.
That whole person removal thing is awesome. It could be very useful for saving / rescuing vacation images after you have a nasty breakup.
Beautiful Hawaii beach saved…
…No good cheating ex gone.
Perfect picture!
aha, exactly Chris.
That’s awesome.
creative job.
Two entries from Israel in one day.
What a great idea! I wonder if the same ideas could be used for music in some way, too.
Fantastic find! If anybody ever tells you that innovation is dead, recall Drs. Shamir and Avidan’s paper. Who would have thought that there’s more left to do in regards to image scaling?! Kudos to you for finding it and kudos to the innovation!
This certainly does inspire other ideas. Imagine that when you resize a webiste, the vocabulary of the words automatically reduce also:
For example:
“Blogs with verbose and rambling content are likely to be less sticky than blogs that have a more a succinct and concise phraseology. ”
Might turn into:
“Blogs with verbose content are less sticky than blogs that have concise phraseology.”
The idea is to shrink the content without causing scrollbars to appear until it just can’t anymore. At that point, break out the scrollbars. This has got mobile devices written all over it!
–Ray Renteria
What exactly would you do with this in Photoshop? It seems obvious to me that this technique is intended for use in presentation of images, not editing or photo-correcting (cases in which working with the original image is crucial). Using this in HTML only makes sense if implemented (via a plug-in?) to adjust file (download) size when retargetting.
Btw, this was posted on dpreview last week.
This is pretty cool but realize that this will work only for certain types of pictures. For example, removing individual people (from the last part of the video) is easily doable only when the image is of a specific type. In all their examples, the key was to be able to find a path from left to right, or top to bottom, where the path did not intersect an edge/distinct feature.
So if you had a group photograph, where people were closer, and the background was a group of buildings, this would be much more difficult to accomplish…
Vijay,
Your observation is not entirely accurate. The algorithm finds the weakest path. Ultimately, it will intersect edges and distinct features. While the image is full size, there are many “quiet” paths that when removed don’t impact the interesting parts of the photograph. As the image becomes smaller there still exist weakest paths, obviously, but the image is likely more dense with interesting content and those paths are thus more likely to impact them.
Furthermore, as a photographer or image editor savvy in this algorithm, you can bias where those paths are. In your scenario with the buildings and people, you could designate which are the weakest and which are the strongest paths so the algorithm could truncate in the order you want.
–Ray Renteria
Vijay,
I’d say more. To shrink horizontally/vertically, you need a horizontal/vertical pattern with vertical/horizontal seams. In the absence of a pattern you are stuck. Or consider a circular pattern…
This is really cool. I would love to see this in Photoshop. It would be a great alternative to the rubber stamp tool.
When you think “Adobe Photoshop”, one of the best places to check for news is Product Manager John Nack’s blog (and on this one you might want to check out the comments):
http://blogs.adobe.com/jnack/2.....orthy.html
jd/adobe
Wide-spread ’seamed’ photos will surely confuse the hell out of Microsoft PhotoSynth. LOL.
When you change the layout of a web page and the text wrap, you don’t lose the text. You don’t have every other word dropped. The analogy to word wrapping is poor, and the concept is, well, frankly, horrid. It’s a boy toy, not the tool of a serious craftsperson.
This is incredible. I would totally love this in Photoshop.
I’d pay for a photoshop upgrade if this was included!
at first i thought the paper was by aDi Shamir, not aRi Shamir, but i guess not.
the top ’serious’ video on youtube recently (ie not funny cats, etc.) that’s viral!
I guess I must be losing touch with the Web2.0 world.
I see absolutely no use of this at all…. including 80% of the stuff the rest of the Web2.0 world churns out.
Too bad we can’t see a higher resolution photo, I bet you can see seams and other parts left behind… Adobe will buy them out soon, hopefully and perfect it…
Someone needs to buy it and buy it fast. Who ever gets it will make a mint.
“Adobe will buy them out soon, hopefully and perfect it…”
yeppers
and I will definitely buy that application of wait for the version of CS that has it!
I practice the very expensive hobby of amateur photography, and I would never use this on any of my photos & I doubt any pros would. However, I would definitely use this in document applications such as word, pages, etc. I think this is incredible technology.
I’m disappointed to see real innovation featured on TechCrunch.
Please post news about a new social network or LOLcats or something.
This is really cool. I do a lot of model editing or enhancing. I love this. Makes my job a lot easier. I am sure with this innovation, someone will come up with image protection technique which will prevent tampering of images. Really..cool..Kudos for the professors.
All you *real* photogs with your “not with my photos” need to get a life. Jesus. I suppose you never load your photos in Photoshop either.
I can tell you that Shai Avidan, one of the co-developers of this technology, started work at Adobe last Monday. Beyond that, we’ll see what happens.
J.
Wow, very cool. I wouldn’t want it to be applied to every image on the web but I can easily see its applications.
That is such an amazing demo.
love++
You are a bit late, Michael: this was all over Digg and Reddit last week =).
My jaw actually dropped. Incredible.
If this could be done at a server or PHP level, we wont need to wait for browsers to catch up. PHP already has some extensive image creation functions, adding this would be a very feasible way of gettng this into the wild without waiting years and years for browser support.
Someone in the Apache or PHP community should jump on this. Not to say that these guys shouldnt be paid for their incredible work.
You want it in Photoshop? Not GIMP? Oh, that’s right… open source projects don’t innovate, they just copy cheaply. It takes a company with an R&D budget, or the ability to buy patents and/or talent, to make such innovations possible… Something the open-source uber alles crowd still doesn’t grasp.
Got to admit that’s impressive - I hope they bring out an API so you can send and receive an image through their tech.
This is pretty amazing - love it. Can’t wait for the Photoshop implementation either.
Wow. Amazing.
Weakest paths etc? I like the photos I take to be presented the way I intend them not some software algorithm that decides whats important..
In music silence can be as important as the notes, together they make a complete work !
Maybe this is great for web site banners and other branding elements that identify a web site but are not essential to it’s content.. But if the image is the content then this is awful…
As I saw the video I kept on asking what the applicability was - even though I think it is supper cool - and then at the end I saw how to remove people. And you have no idea how many time at Pictage we got requests to remove Uncle Harry?
So … very cool technology but I really do not see the big picture of using it. Can it be used for a medical app? or military? etc.
So, before all jump in me … a lot of the image manipulation tools in PS or GIMP can be use to enhance images to discover tumors and other stuff!! Or enemy encampments, etc.
i commented on this app on another blog. i made a few observations but think that adobe would clearly be interested in technology like this. we will see.
http://cutcaster.blogspot.com/.....mages.html
Very nice! For non-artists and non-photographers like myself, this would be a fantastic app to have and be able to apply. Why? Because so many of the pics i have on hand too often are not just right or are could be perfect if not for some branch or arm or unwanted detail in the way or the pic itself it slightly too big. I love the way the app automatically resizes the text when resizing a picture and lets the user visually see and control this resizing feature. I hope this comes to market soon and at an attractive price point.
Let’s hear it for big old line company R&D departments! Mitsubishi rocks the hizzy!
Credit these two with some real innovation and executing solutions to some of the most serious problems right out the gate. Adobe apparently agrees.
Why are pro photogs even more snotty than the kids at my local music store? Every innovation isn’t going to be next moon landing or well-suited to YOUR personal needs. This would be powerful functionality for those looking to intelligently resize their images for any of a variety of reasons not necessarily for the pro photographer set who wouldn’t dare desecrate the sanctity of a single pixel. We get it. You don’t like to manipulate your images much.
Also, love the random GIMP hate.
This is truly amazing stuff. I was not expecting such clean retargeting of the images and smooth transitions. This technology is really key to having an interconnected multi-device net a closer reality. The text from a website I can get on my cell phone browser, but the images appropriately retargeted! Wow!
People who don’t understand the need for it, probably have ever had to agonise over how to crop an image to fit a layout / grid system before… sometimes it can be just a few pixels you need to shave, I think it’ll be really useful
“professional photographers will cut your arms off if you do that to their images. solution in search of a problem.”
Like professional photographers never touch up their images. Naive or moron?
OMG
Just shut up.
Shut up all of you and get back to work.
Lazy asses.
When have you contributed ANYTHING to the world except snipes?
“professional photographers will cut your arms off if you do that to their images. solution in search of a problem.”
I think this is all a question of who does it for what reason. I could see this as MAJORLY useful in my work, where I often have to extend images to fit a very specific space (on the other hand, it might cut into my hourly earnings drastically! ^_^). Think printed materials that need to be a certain size and no larger or smaller. For static images (get rid of Uncle Harvey!), this could be a godsend.
As for the web, well — who’s doing the resizing? It is something that the entire web will pick up, somehow, so that no matter what you post to your own site, your images are at the mercy of some kid with a 12-inch monitor at low resolution? Or is it something the site builder puts into her own site? Can some images be protected, and others open to resizing? As for cutting off people’s arms for vandalism, it seems that this technology would be infringe on copyright if used indiscriminately.Were this to become common web technology, there will HAVE to be ways to limit what is done to what image.
Chill. ^_^
Israelis are smart
Acid does much the same thing for music by adding or deleting the quietest parts of the music
http://www.sonycreativesoftwar.....p?pid=1005
He didn’t mention the file size or anything. I could imagine encrypting and decrypting this could be a hefty load. Maybe that means we can ditch jpeg as the standard.
Of course, it could take a while for IE to do this. It still hasn’t caught on to PNGs.
What a piece of crap, are you kidding me! Thats just distorting images horizonatilly or vertically, who cares…..
It can not be considered as resize as it modifies the image content and even distorts the aspect ration.
Stop being retarded all you petty nay-sayers. VISUALLY those images were PERFECTLY ACCEPTABLE after their manipulation so the fact that the aspect raio was technically lost and some of the content was missing doesn’t matter one bit. Stop whining like pathetic, snobby little brats. You are too trivial. Shamir and Avidan are true experts, you’re just wannabes and it’s all you’ll ever be. Sucks eh? Deal with it.
Can you image trying to do an image map on an image the resizes in the browser?
I can see that as being a potential pain in the ass.
Still awesome. I’ve watched the video about 5 times now.
This is absolutely incredible. I can’t wait to see this function in photoshop!!!
See it for yourself - download a prototype from Alex Kennberg’s site.
http://www.kennberg.com/project_resize.php
And no way should this end up in Photoshop.
A Java GPL command line resizer based on this algorithm is available at: http://www.semanticmetadata.ne.....mentation/
@Ray Renteria #27: Apple has a Summarize feature in OS X that can do this with language: http://www.macworld.com/2005/0...../index.php
@Jason #73: If the browser could do this it could also keep track of which source pixels the displayed pixels map to and just do the image map against that.
wow! that’s simply amazing! i really hope they can have a plugin for photoshop for that.
I’m also working on something, but the user interface logic still needs some work. However, it can do conventional resampling as well. It can only do downsizing so far, and there is no removing of things, but it already works.
It took quite some time to implement, 1380 lines of C++ code just for the seam carving part so far. And all that stuff ends up becoming a simple magic radio button saying “Retarget (downsizing only)…”
Screenshot with the image from the demo video resized to 250×250 using the program. The interface is modeled after Photoshop’s “Image Size” dialog box:
http://img410.imageshack.us/im.....nntje8.png
I’ll put it somewhere on the web when I’m done.
… as an editor I hope to be right when I say that this never will be a tool used in any press-relation, where photos are supposed to reflect reality. Maybe it can be usefull in other (illustrative, non-journalistic) connections, only I find it hard to believe … This kind of image-resizing contradicts the very meaning of photografy: to provide an image of a physical reality captured in a splitsecond.
I’ve done an implementation as a Photoshop plugin. It took 167 lines of C code for the algorithm itself.
Read all about it:
http://blog.picutel.com/2007/0.....photoshop/
There’s also an implemetation as a GIMP plugin, you can find the source code here:
http://web.tiscali.it/carlobaldassi
.. and I implemented this as a standalone program: http://www.intuimage.com
I cant believe you guys. You have fallen for a tool that will help put the END to honest photography. Why isn’t the truth good enough?. I hope this other wise promising team gets a lot of money for NOT doing this program. Please once in a while come to your senses folks. All the best. Photojournalist Sofus Comer, Denmark
Hi,
Can’t offer you a photoshop plugin - but if you are looking for a software to try out seam carving, take a look at http://www.thegedanken.com/retarget
The program that you can download there (for Windows and Linux, and free) is already highly optimized concerning speed, and apart from enlarging or decreasing image size you can also use masks to protect or delete certain parts of your image.
Have fun,
Irmgard