ReadWriteWeb

Finding Better Friends: Delicious and SPEAR

Written by Dana Oshiro / August 31, 2009 6:00 PM / 3 Comments

delicious_spear_aug09a.jpgBetween self-aggrandizing FriendFeeds, bottom-feeding link baiters, and perpetual Twitter spammers, finding cool online friends can be challenging. Michael G. Noll and Ching-man Au Yeung created the SPEAR (SPamming-resistant Expertise Analysis and Ranking) algorithm in the hopes of separating the social media wheat from the chaff. This morning the two postgraduate students offered their findings to Delicious in a blog post. The project was first evaluated using data sets collected from the popular bookmarking community.

Noll and Yeung presented SPEAR in a paper entitled, Telling Experts from Spammers: Expertise Ranking in Folksonomies at July's SIGR Conference. The solution is based on the information retrieval algorithm HITS (Hyperlink-Induced Topic Search), an algorithm best known for powering Google and Yahoo web page rankings. Rather than producing search results, SPEAR ranks and produces a list of experts and content. According to the duo, their method is more resistant to spammers for the following reasons:

1. Mutual reinforcement of user expertise and document quality: A user's expertise in a particular topic depends on the quality of the documents she or he has found, and the quality of documents in turn depends on the expertise of the users who have found them.
2. Discoverers vs. followers: Expert users should be discoverers - they tend to be faster than others to identify new and high quality documents...SPEAR gives more credit to users the earlier they find high quality documents.

spear_recommendation_aug09a.jpg
After analyzing more than 500,000 Delicious users and 2 million shared bookmarks, the solution produced a set of trustworthy users. No spammers were found in the top 200 recommendations.

While there are obvious uses for SPEAR in shopping and friend recommendation engines, says Noll, "The SPEAR algorithm itself is not restricted to the online world. We imagine to use SPEAR, for example, for estimating the expertise of researchers by analyzing scientific publications. Such publications - whether available as online versions or printed out on paper - provide all the information we need."

Expertise may have an algorithm across all industries. Be first and be fascinating. For more information on SPEAR visit Michael G. Noll's site.


Comments

Subscribe to comments for this post OR Subscribe to comments for all ReadWriteWeb posts

  1. At twenty years of age, the will reigns; at thirty, the wit; and at forty, the judgment.

    Posted by: chi hair tools | August 31, 2009 7:24 PM



  2. Wait for it: SAO – SPEAR Algorithm Optimisation.

    Posted by: Don Rocin | September 1, 2009 3:08 AM



  3. Great Article agreee that socila bookmarking is the way forward

    Posted by: Kyle Robinson | January 2, 2010 9:51 AM



Leave a comment

Optional: Sign in with Connect Facebook   Sign in with Twitter Twitter   Sign in with OpenID OpenID  |  

If you think Twitter is big, check out the Real-Time Web
RWW SPONSORS



FOLLOW @RWW ON TWITTER

ReadWriteWeb on Facebook
ReadWriteCloud - Sponsored by VMware and Intel



TEXT LINK ADS



RWW PARTNERS