Via an article in the New Scientist today, we were pointed to a Microsoft research project called MySong. MySong isn't web technology, but it is very, very cool technology, and clearly it would make one heck of a web application. The application takes user inputted voice and pairs it with machine generated musical accompaniment. Though MySong won't be spitting out any top 40 hits, the results are surprisingly good and can theoretically turn shower songsmiths into virtual virtuosos.
MySong is a project from Microsoft researchers Dan Morris, Sumit Basu, and Washington State grad student Ian Simon. The program is made to "give many folks who would never even taste songwriting a great opportunity to just get a glimpse of music creation," according to the project's web site. It is "more than good enough to make a cute birthday song for Mom or a Valentine's Day song for your significant other." Sounds like a great premise for a web app to us!
The program works by identifying the 12 standard musical notes in a sung melody, and then feeding those notes into an algorithm that has been trained by listening to 300 songs in varying genres and learning how to identify chords and melody fragments that work well together. The result is a series of musical accompaniments that users can adjust via sliders for "happy factor" and "jazz factor."
"I suspect musicians will argue that this is another step towards homogenized elevator music for all," Peter Bentley, a computer scientist at University College London, told New Scientist. "But I see a big market for this, whether it's liked by musicians or not." We agree, and we think the web is the perfect place to find that market.
Last year we reviewed a startup backed by Pete Townsend of "The Who," Method Music, that created personalized theme music based on user input (specifically: a voice sample, a picture, and a recording of a rhythm). The results were... not unimpressive, but neither were they very compelling. MySong, on the other hand, produces some very impressive (to my musically untrained ear) output and has a much more compelling set of use cases.
Though Microsoft hasn't decided how or if to market the MySong technology, Morris told the New Scientist that it wasn't very computationally demanding. "It could even run on a cellphone," he said.
Check out this sample of voice-only input, the MySong output, and a full musical arrangement after being fed through Band-in-a-Box. You can draw your own conclusions, but we were very impressed and hope that someone brings the MySong technology to a web browser in the future. We have a feeling this thing would kill as a Facebook or OpenSocial application. There are many more samples on the MySong page.
Comments
Subscribe to comments for this post OR Subscribe to comments for all Read/WriteWeb posts
i enjoyed the video and it's a gr8 application waiting for this new application from microsoft
Posted by: ajay | April 7, 2008 8:43 PMohh got american idol for dummies!!!
i think these top companies are running out of software ideas they just pump out anything that comes into their mind. i'm sure great deal programming has gone into this but the day my voice sounds good through a software is the day music industry will be dead for good... imagine if i start using a software that would allow me to perform at concerts as well! lol
Posted by: Bam Azizi | April 7, 2008 8:46 PMwow, that was truly amazing. this on par w/greeting card sites and other cool stuff to share between loved ones and friends. this app is worth making it accessible in all of the social networks as I believe it could be a BIG hit. I must admit that the final output through band-in-a-box really took it to that next level that leaves one stunned.
Posted by: p-airIn answer to (2) - as with the Microkernel discussions a couple of weeks back this is an MS Research Project, not a production app. As it happens, recording studios have long used auto-tuning for our more attractive but less vocally talented singers, and in fact the same technology can even be used in live performance, so that part isn't new - but it does need to know what notes you should be singing.
The clever bit here is the auto-composition, rather than the vocal tuning.
Whether it could be made a web app is another matter - try using something like Band in a Box or Garageband and you can see how CPU intensive they can become for even a moderately complex arrangement - and that is running native code, not Flash or Silverlight. In addition you're talking moving pretty large amounts of data up to the server (so probably VOIP quality vocals at best).
Posted by: JulesLt | April 8, 2008 12:40 AMSorry, but the idea is good but the software is very crude! Come on! If I've developed it nobody would give me attention! And the video? "With MySong I became a professional song writer!" HAHAHAHAHA! It looks like April 1st's joke!
It's been a long time I'm noticing RWW post everything about Microsoft, but after this I think I'll stop reding the site...
Posted by: Rodrigo Carvalho | April 8, 2008 5:45 AM