March 27, 2008

First “Machine Listening” API Flies From The Echo Nest

Mark Hendrickson

21 comments »

“Machine Listening” is the idea that computers can be programmed to interpret audio signals the same way humans do. This means that they can tell when a song belongs to the blues genre rather than techno. And they can detect musical characteristics like tempos, transition types, and harmonies.

The technology has some obvious practical uses. It could be used to compile collections of music with the same sound or with similarities to the music someone already knows they like. Applications could also be designed to create the perfect mixtapes, with songs picked and ordered in just the right ways.

The Echo Nest is a company that’s bringing machine listening to Web 2.0. It was founded by two MIT PhD students and is supported by a government grant. Today, the company releases the first of several “Musical Brain” APIs intended to improve three main aspects of music-related web services: search, recommendations, and interactivity.

The first API, which focuses on signature analysis and is being released through Mashery, can be used to retrieve an XML file with information about a particular song. A proof of concept website called This is my jam has been set up to demonstrate its capabilities. Load up a few of your favorite artists and it will automatically arrange songs from them in an order deemed most suitable given their audio characteristics.

The Echo Nest will lend all of its APIs to non-commercial projects for free, but it will charge commercial sites with a usage fee. The company plans on showcasing a website for each of its APIs, but it doesn’t currently have any plans to create a consumer destination of its own with the tech.

  • Sphere It

Trackbacks/Pings (Trackback URL)

  1. Anonymous
  2. TechCrunch Japanese アーカイブ » 初の「マシンリスニング」API、Echo Nestから発進
  3. David Rusenko - Blog
  4. KillerStartups.com - The.EchoNest.com - A Musical Brain

Comments

RSS feed for comments on this post.

  1. velioncho

    Mark,
    Did you try use the service?

  2. Mark Hendrickson

    Yea, check out my jam here: http://techcrunch.thisismyjam.com/

  3. Champzilla

    Finally… complex computer software that will help me disearn the differences between

    Fallout Boy, Panic at the Disco, Interpol, and The Killers

    http://www.champzilla.com

  4. jason

    A little off topic but, does anybody know of a company that provides cheap voice-to-text for startups? Similart to what this company is doing with “machine listening”. Thanks.

  5. asha

    This can be a powerful concept, just seems wrong to waste it on organizing music. But hopefully that’s only to bring in revenue so they can develop better uses. At least with a government grand I hope they’ll do more.

    http://alliancesocial.org

  6. Andy

    Yeah I guess the question is, do we really need a computerized pandora? I for one am a huge pandora fan and I like that humans have made some decisions on how the music is categorized. Signature analysis of the sound is great, but will it compare to the human touch?

    Andy
    Facespacey.com
    Your one stop social media shop

  7. Igor Jablokov

    @4 Jason, I can help you locate that; please contact me offline.

  8. Brian Whitman

    Andy: there is so much more music out in the world than humans can manually categorize. We’re mixing automated analysis of what people are already saying with what it sounds like. The human touch is still the driving force, we wouldn’t have it any other way.

  9. EH

    Champzilla wins.

  10. Ronald Reagan

    interesting but has about a total of 10 tracks in the database. Think I’ll stick with http://www.last.fm

  11. Brian Whitman

    Ronald - i believe there are upwards of 2 million songs in the database.

  12. Alan

    looks great and can’t wait for people to discover it. how do we contact Echo Nest to use their technology on a commercial site?

  13. Brian Whitman

    Hi Alan, you can hit us up at the contact link on our site: http://the.echonest.com/contact.html .

  14. nice

    dude,
    this is not a web 2.0 company, its a real tech company(no offence to web 2)
    just bcos google provides api to its search doesnt make search a web 2.0 product.

  15. Great news

    Looking forward to the new API’s

    myplaylist

  16. Jeremy

    Andy,

    To go along with Brian Whiteman’s comments. The truth is that Pandora cannot keep up with the current rate of music as it is. They currently can list about 10,000 tracks a month and there are about that many albums (each with several tracks) made per month. Second, even though you would like to think so, your decisions about what you like does not entirely depend on raw acoustic attributes.

  17. rocablanca

    1. The website is absolutely horrid. You are doomed to fail unless you update to professional standards. This is a nice freshman web design class project circa 1998…
    2. http://www.thisismyjam.com =lamest website name ever? invented by MIT engineering students no doubt
    3. 10,000 new tracks a month is not enough?
    4. What can this tell me that amazon.com cannot?