February 27, 2008

Make3D: Turn a 2D Picture Into a 3D Model

Duncan Riley

26 comments »


Stanford University service Make3D automatically converts a single picture into a 3D model. We covered similar technology from Fotowoosh in April 2007.

Make3D takes a two-dimensional image and creates a three-dimensional fly around model that includes depth and a range views. Photos can be uploaded directly or pulled into the site from Flickr.

The service is based on an algorithm created by Stanford students Andrew Ng, Ashutosh Saxena and Min Sun that won the best paper award at the 3D recognition and reconstruction workshop at the International Conference on Computer Vision in Rio de Janeiro in October 2007.

A January Stanford News Service piece explains it some more:

…the algorithm breaks the image up into tiny planes called “superpixels,” which are within the image and have very uniform color, brightness and other attributes. By looking at a superpixel in concert with its neighbors, analyzing changes such as gradations of texture, the algorithm makes a judgment about how far it is from the viewer and what its orientation in space is. Unlike some previous algorithms, the Stanford one can account for planes at any angle, not just horizontal or vertical. This allows it to create models for scenes that have planes at many orientations, such as the curved branches of trees or the slopes of mountains.

The service is in the same space as Microsoft Photosynth, but unlike Microsoft’s more extensive product that meshes many images together to create 3D models, Make3D is a one image only service. If you like, Make3D is Photosynth for the common man, quick, simple, and although the results don’t come close to Photosynth, they are still very impressive. A full gallery of Make3D renders can be found here.

  • Sphere It

Trackbacks/Pings (Trackback URL)

  1. pagespank.com
  2. Graphic design for life
  3. Make3D, transformar fotografías en modelos tridimencionales

Comments

RSS feed for comments on this post.

  1. Joke Cricket

    I checked the gallery…its amazing..nice article Duncan.

  2. Chris Ragobeer

    Looks really cool. Wonder how long it took them to create the algorithm.

  3. Andy

    Very impressive but this isnt that new, 3-4 years ago I saw a demo from Apples Quicktime Plugin that did excactly the same. I think they planned to put it into QuickTimeVR - but it seems they dropped it.

  4. soobrosa

    yep, a bit old, also check Videotrace
    http://soobrosa.wordpress.com/.....ideotrace/

  5. ElbertF

    How is this different from Fotowoosh?

    http://fotowoosh.com

  6. Maya

    Enjoy the MAZIC only on http://moviemazic.com

  7. Chris

    I think fotowoosh is better, fotowoosh recently launched their app in facebook and it blows my mind, im suprised TC didnt pick it up when it launched. oh well.

  8. Ram

    Lack of depth… in your article :)

    BTW, the last time I checked Andrew Ng was a professor.
    #5: Fotowoosh is work done at Carnegie Mellon from couple of years ago.

  9. nietsnut

    I’m a little bit disappointed Techcrunch. Normally you guys are on top off the latest news. This is old (http://www.nietnuttig.nl/2008/02/12/maak-van-je-2d-foto-een-3d-object/) ;)

    I tried the service myself but the result wasn’t what they show in the movie. The rendering didn’t worked ok.

  10. Lalo

    I think they developed their version to keep rights to their own software
    http://www.tech-exposed.com

  11. kuldeep

    I think from video ..the quality is pathetic….
    Actually thr are many similar technologies out thr, one even from Microsoft…and thy are much better.

  12. Peter

    The background objects look flat like a drawing on the wall. You can also see how a bridge bends as you move along it.

    What I would really like to see here is a true fly AROUND - show us what the house looks like on the other side!

  13. Anatoly

    @Peter Yup, figure out what the house looks like on the other side, from a single photograph.

    In Soviet Russia, the houses are flat on the other side!!
    (Oblig. Potemkin reference).

  14. panefsky

    false alarm..

  15. http://yooflix.com

    Cool :-)

    http://yooflix.com

  16. Chad

    That is really interesting. Turn 2D to 3D Make3D

  17. Rian

    @Peter - fly around?? why stop there? Let me zoom in through the door, turn the corner, navigate into the bedroom, and click the computer, and watch YouTube and THEN I’ll be impressed.

  18. Knowledge is power

    Andrew Ng is a professor at Stanford and one of the best people working on machine learning, pattern recognition, and robotics. The work is not old since if you just check the “publications” section, you will see that the most recent paper was published in IJCV, 2007. This also has nothing to do with Photosynth because the latter uses multiple images and it works much differently. You statement, “Make3D is Photosynth for the common man” is incorrect because the technologies are not similar at all. If you really want to know the differences, then take some time from posting on Twitter and read the relevant scientific literature; in the least, you will better understand the technology you write about.

  19. Arthur Dent

    They published their first work in 2005, I think.

    http://make3d.stanford.edu/publications.html

  20. mhamad

    how the fuck can we access this application

  21. dudeman

    potty mouths can’t

  22. jc

    Maybe if you want to create some textures, it would be great, but it´s not a tool for professionals.

  23. Jack Ives

    Pretty cool idea. If you want to make a truly 3D version of a person, CyberExtruder has the software to automatically (really!) convert a single, front-ish facing picture (like a passport photo) into a 3D model in about a second or less. This patented technology has been in service in Second Life as a self serve avatar maker since around June 2007. It’s now being rolled out to numerous other 3D virtual worlds.