mechanical turk - ReadWriteWeb http://www.readwriteweb.com/feeds/tag/mechanical turk en Copyright 2009 Richard MacManus readwriteweb@gmail.com Tue, 24 Nov 2009 05:00:55 -0800 http://www.sixapart.com/movabletype/?v=4.23-en http://blogs.law.harvard.edu/tech/rss Project Management + Mechanical Turk? Smartsheet Looks Awesome smartsheetlogo.jpgWhy didn't we think of this? Project management startup Smartsheet released a new core feature this week - integration of Amazon's outsourcing service Mechanical Turk. The Smartsheet interface will now let you set up Turk research jobs that thousands of anonymous workers around the world will split up and perform quickly for a very low price.

In the example the company provides on its product page, the user publishes a series of small work orders for research on the names and profiles of top CEOs around the country. That kind of drudgery would take hours to perform, but with Mechanical Turk it can be done on the cheap, quickly.

]]>Sponsor

]]> The Smartsheet interface for Mechanical Turk looks good to us, though we must admit that we're not regular users of the service. This sounds like a great idea, though, and we'll be excited to see if it works well for people. Far too much of the work on Mechanical Turk is for publishing spam - so putting that energy to legitimate business uses is a great idea. There's a whole lot of untapped potential there. The possible applications of bulk human labor in information work are many and are just starting to be explored.

Smartsheetscreen3.jpg

How should a person feel about the Turks though? We admit that we were a little concerned at first; the last thing we want is to use some creepy neo-colonial crap like ODesk.com, which sends customers hourly webcam photos and screenshots of their contracted overseas labor in action, usually with their eyes flared with surprise at the intrusion.

Mechanical Turk seems different though. There appears to be a real art to using it well, and that is one thing that concerns us about the viability of Smartsheet's product.

We get our Mechanical Turk advice from Andy Baio's Waxy.org. Baio recently paid Turkers 50 cents each to upload a picture of themselves with a paper sign explaining "why you Turk." The responses were incredibly humanizing and more than a little amusing.

mechanicalturkpicsmall.jpg

Click to enlarge

Would you want a project management app that let you leverage those peoples' time at a low price? That sounds like a pretty intriguing idea to us.

]]>Discuss]]>
http://www.readwriteweb.com/archives/project_management_mechanical_turk_smartsheet_looks_awesome.php http://www.readwriteweb.com/archives/project_management_mechanical_turk_smartsheet_looks_awesome.php Products Thu, 12 Feb 2009 11:15:33 -0800 Marshall Kirkpatrick
Amazon's Mechanical Turk Used for Fraudulent Activities Amazon's Mechanical Turk has fallen prey to social media spammers and it is now full of requests to spam bookmarking services for pennies per link. Although these HITs may stop short of being "fraud" in the legal sense of the word, they are certainly dishonest and unsavory. In addition to these spam bookmarking requests, we're also seeing HITs for Diggs, Stumbles, Slashdots, etc. of spammers' web pages and web sites.

In case you're unfamiliar, Amazon's Mechanical Turk is a crowdsourced marketplace for tasks. A person needing work done can set up a HIT (human intelligence task) - the small job they need done. Others come along to perform the HITs, earning micro payments along the way. In this way, businesses, developers, and other individuals have access to an affordable, scalable workforce

]]>Sponsor

]]> The Dark Side to Mechanical Turk

Unfortunately, it appears that the convenience of the Turk marketplace has some appeal to social media spammers, who are now using the site to earn Diggs, bookmarks, and other social recommendations they do not deserve. Here's an example:

Photo courtesy of Brynn Evans

Anyone who uses Amazon's Mechanical Turk has no doubt come across similar HITs posted by spammers. For example, this guy is requesting someone create 29 social bookmark accounts from 29 sites:

A search for "bookmark" on MT today displays 48 results (at the time of writing) where spammers are requesting social bookmarking of their web site. Search for "digg" and you'll find people paying for Diggs.

Of course, whenever there is a system in place (like social media) that can help drive traffic to a web site, there will be those people who use it to generate traffic for their spam sites. But why are they able to use Amazon Mechanical Turk to do so? Shouldn't Amazon police the Turk to shut down these spam accounts?

Mechanical Turk Still Has Promise, Despite Spammers

However, this doesn't mean that Mechanical Turk doesn't hold any value - it's still an innovative and useful tool for many. In fact, members of the HCI community (Human Computer Interaction) have begun to use Turk for user research studies with great success. This work has inspired others like open source advocate, Chris Messina, to do the same. He plans to use Turk for usability studies on OpenID and OAuth. Since the HITs are spread out among many, the cost of performing these studies is greatly reduced. Being able to crowdsource research is a great way that MT can be used today, and one that will have a big impact on the future, too.

Thanks to Brynn Evans, a graduate student in the Department of Cognitive Science at University of California, San Diego for discovering this and thanks to open source advocate Chris Messina for sending it along to us.

]]>Discuss]]>
http://www.readwriteweb.com/archives/amazons_mechanical_turk_used_for_fraud.php http://www.readwriteweb.com/archives/amazons_mechanical_turk_used_for_fraud.php Trends Fri, 29 Aug 2008 08:36:17 -0800 Sarah Perez
Amazon Announces New Payment Services and Updates to Mechanical Turk amazon-logo.pngIn a quick succession of announcements, Amazon released a set of hosted e-commerce payment services, as well as an update to its Mechanical Turk service. The payment service, Checkout by Amazon, will allow online retailers to use Amazon's one-click checkout system, calculate shipping costs and tax, as well as allow their customers to track shipments. The updates to the Mechanical Turk are mostly meant to streamline the creation of new tasks by guiding businesses through the process more efficiently.

]]>Sponsor

]]> Checkout by Amazon

amazon-shopping-cart.jpgOut of the two announcements, the payment services service are the most interesting. Amazon gives its customers two options: Checkout by Amazon or Amazon Simple Pay. Simply Pay is basically a stripped-down version of the full Checkout package and doesn't include the one-click checkout and most of the order management features such as calculating sales tax and shipping rates, creating packing slips, or collecting buyer feedback. Simple Pay, on the other hand, allows sellers to use more payment options, including credit cards and bank accounts. Checkout by Amazon can only accept credit cards.

These services are basically an extension of Amazon's "Flexible Payment Service." This service (which has been in beta for quite a while now) gives developers a set of API that hook into Amazon's payment services. One area that Amazon is especially targeting with this is micro-payments.

With these new services, Amazon is going up against Google Checkout, as well as most credit card merchant accounts. However, with Amazon's already established reach among consumers, as well as the level of trust that most consumers have when it comes to working with Amazon, both Checkout and Simple Pay have a distinct advantage over their competition. For merchants, Amazon's Checkout service also offers a wider range of services than most credit card processors or Google Checkout currently offer. Google Checkout, however, is generally cheaper than Amazon's offerings - though it also offers fewer services.

Streamlined Mechanical Turk

Amazon's Mechanical Turk is basically a way to outsource menial tasks that would be too computing intensive or simply need human intelligence to be completed (Amazon calls them "Human Intelligence Tasks"). Applications reach from tagging photos to rewriting trivia questions, or digging a particular story.

With this latest update, 'requesters', as Amazon calls them, can look forward to a simpler user interface that will guide them through the process more effectively. Amazon has also created a set of more efficient tools to track and monitor the work that is being done.

amazon-mechanical-turk.jpg

]]>Discuss]]>
http://www.readwriteweb.com/archives/amazon_payment_services_mechanical_turk.php http://www.readwriteweb.com/archives/amazon_payment_services_mechanical_turk.php News Wed, 30 Jul 2008 09:43:32 -0800 Frederic Lardinois
10,000 Cents Buys You $100: Awesome Crowdsourced Art Project "Ten Thousand Cents" is a crowdsourced art project that led 10,000 artists, each paid one penny for their contribution, to recreate a US $100 bill one tiny section at a time. The brainchild of San Francisco artists Aaron Koblin and Takashi Kawashima, "Ten Thousand Cents" utilized Amazon's Mechanical Turk service and a bit of custom Flash software to lead 10,000 web workers in a coordinated, crowdsourced art project. The result is a rather impressive rendering of a US one hundred dollar bill drawn by an army of contributors.

]]>Sponsor

]]> Koblin and Kawashima first divided a high resolution scan of the $100 bill into 10,000 equal parts. Each part was then delivered to a turker who was paid a penny to duplicate it using a simple Flash-based drawing tool. Contributors didn't have any idea what they were working on while the were working on it.

The project took 5 months to complete and involved contributions from 51 different countries. Because some turkers participated more than once, there weren't truly 10,000 different artists contributing to the project, but it appears that most countries had unique visitor rates of above 60%. The end result was a reproduction of a $100 bill that cost $100 to create.

"The project explores the circumstances we live in, a new and uncharted combination of digital labor markets, 'crowdsourcing,' 'virtual economies,' and digital reproduction," according Koblin and Kawashima on the project web site.

The completed artwork is being displayed on the "Ten Thousand Cents" web site as an interactive video depicting all 10,000 pieces of the bill being drawn at once. A limited edition signed print (presumably signed by Koblin and Kawashima, not thousands of random turkers), is also available on the site for $100, with all proceeds going to the One Laptop Per Child project.

A video about "Ten Thousand Cents" is below.

]]>Discuss]]>
http://www.readwriteweb.com/archives/ten_thousand_cents.php http://www.readwriteweb.com/archives/ten_thousand_cents.php User Generated Content Wed, 16 Apr 2008 11:39:51 -0800 Josh Catone
Amazon's Other Service: A Virtual Sweatshop? Actually, No Amazon's web services get a ton of press, but mostly in the context of the Elastic Compute Cloud (EC2), the Simple Storage Service (S3), SimpleDB or one of the company's other developer-centric offerings. One that doesn't get much coverage in the tech media these days is the Mechanical Turk service, which Amazon refers to as the "on-demand workforce." When it does get coverage, it is sometimes to level accusations that Amazon is offering workers at sweatshop wages. But are those concerns really valid? Just who are these workers?

]]>Sponsor

]]> What is Mechanical Turk?

The Mechanical Turk service, which Amazon released in November of 2005, is a web service that allows companies to outsource simple, generally repetitive tasks to human workers for small sums of money. It now has 100,000 workers in 100 countries and counts corporations such as comparison search engine PriceGrabber among its users.

The service got mainstream attention when Amazon used it to help organize a virtual search for missing Microsoft researcher Jim Gray last year.

A quick survey of open assignments on the Mechanical Turk site reveal a handful that pay up to $15.00 but the vast majority paying out under $1, and many paying only a few cents. There are over 31,000 so-called Human Intelligence Tasks available on the site right now, but scanning through them by price makes it easy to imagine that collectively they're still probably not worth as much as what some of Amazon's executives can find in their couch cushions. So it's not hard to see how some people could accuse Amazon of creating a virtual sweatshop labor force.

Who Are These People?

A recent demographic survey done through Mechanical Turk sheds some surprising light on just who these "Turkers" are, however. Contrary to the pictures painted by some media outlets that Amazon has assembled a third world workforce of people willing to work for pennies, most Turkers are actually from the United States. According to the survey, 76.25% are from the US, with just over 8% from India.

Further, the vast majority of Mechanical Turk participants are under 40 years of age, and over 50% of them have bachelor's degrees. About half also make over $25,000 per year -- and a surprising percentage make over $40,000 per year.

So why participate in the Mechanical Turk program -- one which nets most people under $600 per year -- if you're well educated, already have a paying job, and there are so many other ways to make money? One answer is that people find the tasks offered on Mechanical Turk fun. The Amazon service provides people with time wasters that also pay a little money and for younger users, especially, the service offers an easy way to make a little pocket change.

A recent New York Times article relates a number of anecdotal stories about why people participate, as does an earlier post on Panos Ipeirotis's blog (Ipeirotis is responsible for the demographic survey referenced in this post). Clearly, very few people participate in Mechanical Turk solely to make money. Most people do it out of boredom, to make a little pocket change, or because they are limited in the type of work they can do due disability or some other reason.

Have you ever used Mechanical Turk to outsource a task? Have you ever participated as a worker? What was the result? Let us know in the comments.

]]>Discuss]]>
http://www.readwriteweb.com/archives/amazon_mechanical_turk_demographics.php http://www.readwriteweb.com/archives/amazon_mechanical_turk_demographics.php Trends Fri, 28 Mar 2008 12:23:32 -0800 Josh Catone