<?xml version="1.0" encoding="utf-8"?>
<feed xmlns="http://www.w3.org/2005/Atom" 
      xmlns:thr="http://purl.org/syndication/thread/1.0">
  <link rel="alternate" type="text/html" href="http://www.readwriteweb.com/archives/richrelevance_adaptive_recommendations.php" />
  <link rel="self" type="application/atom+xml" href="http://www.readwriteweb.com/atom.xml" />
  <id>tag:,2009:/1/tag:www.readwriteweb.com,2009://1.13796-</id>
  <updated>2009-11-23T17:31:11Z</updated>
  <title>Comments for richrelevance: Is its Adaptive Recommender System the Next Generation?</title>
  
  <generator uri="http://www.sixapart.com/movabletype/">Movable Type 4.23-en</generator>
  <entry>
    <id>tag:www.readwriteweb.com,2009://1.13796</id>
    <link rel="alternate" type="text/html" href="http://www.readwriteweb.com/archives/richrelevance_adaptive_recommendations.php" />
    <link rel="service.edit" type="application/atom+xml" href="http://www.readwriteweb.com/cgi-bin/mt/mt-atom.cgi/weblog/blog_id=1/entry_id=13796" title="richrelevance: Is its Adaptive Recommender System the Next Generation?" />
    <published>2009-02-11T22:25:05Z</published>
    <updated>2009-02-11T22:36:06Z</updated>
    <title>richrelevance: Is its Adaptive Recommender System the Next Generation?</title>
    <summary><![CDATA[Last week we looked at Baynote, a recommendations company that focuses on real-time community behavior instead of personalization. Today we look at a company that takes a broader approach: richrelevance uses personalization extensively, plus the wisdom of the crowds when relevant. richrelevance claims that its approach is &quot;adaptive AI&quot; and that customers such as Sears...]]></summary>
    <author>
      <name>Richard MacManus</name>
      <uri>http://www.readwriteweb.com</uri>
    </author>
    
    <category term="NYT" />
    
    <category term="Products" />
    
    <category term="Recommendation" />
    
    <content type="html" xml:lang="en" xml:base="http://www.readwriteweb.com/">
      <![CDATA[<p><img src="http://www.readwriteweb.com/images/richrelevance_logo_feb09.jpg" />Last week we looked at <a href="http://www.readwriteweb.com/archives/baynote_recommendation_engine.php">Baynote, a recommendations company</a> that focuses on real-time community behavior instead of personalization. Today we look at a company that takes a broader approach: <a href="http://www.richrelevance.com/">richrelevance</a> uses personalization extensively, plus the wisdom of the crowds when relevant. richrelevance claims that its approach is &quot;adaptive AI&quot; and that  customers such as Sears and KMart are using its technology. We spoke to richrelevance founder and CEO David Selinger (ex-Amazon), to find out more about the product and what makes it different to Baynote and others.</p>
]]>
      <![CDATA[<p>As background, David Selinger once led the research and development arm of Amazon's Data Mining and Personalization team. Selinger told us that he worked for &quot;chief algorithms officer&quot; <a href="http://en.wikipedia.org/wiki/Udi_Manber">Udi Manber</a> at Amazon,
  where his role was to improve Amazon's recommendations technology (note: Manber is now one of Google's vice presidents of engineering). After Amazon, Selinger worked at Overstock and eventually created his own recommendations company, richrelevance, which licenses its technology to e-commerce websites.</p>
<p>As we noted in our previous post, <a href="http://www.readwriteweb.com/archives/recommendation/">our series on recommendation engines</a> has shown that  every company in this market - including those which create their own platform, like <a href="http://www.amazon.com">Amazon</a> and <a href="http://www.netflix.com">Netflix</a> - have  differing approaches and ideas on what makes a good recommendation engine. The key to richrelevance's approach, Selinger told ReadWriteWeb, is that people don't shop the same and so different recommendation types will be used for each shopper. This is markedly different from Baynote's approach, which specifically excludes a user's past shopping behavior and instead focuses on real-time community patterns.</p>
<p><img src="http://www.readwriteweb.com/images/richrecs_feb09a.jpg" /></p>
<p>In the worldview of richrelevance, shoppers at Amazon are different to the ones at Sears - one of the companies using richrelevance's technology. Furthermore, a person who has a shopping history at a store is different from someone who is totally new to that site. So, unlike Baynote, richrelevance takes into account a user's purchase history - if known. </p>
<p>If we look at an example from Sears, on <a href="http://www.sears.com/shc/s/p_10153_12605_00872352000P?vName=Appliances&cName=Cookware%2C+Bakeware+%26+Gadgets&sName=Cooking+Tools+%26+Gadgets">this item page</a> the richrelevance recommendations display in two places: on the left there is a 'People Who Viewed x Also Viewed' box, and at the bottom of the page there is a 'Top Sellers' section. Selinger told us that if a Sears user has a long purchase history, then they will see recommendations in Sears based on that. We asked if they need to be logged in to Sears as a registered user, but Selinger told us that it is cookie-based and so doesn't take into account their registered Sears user profile.</p>
<p><img src="http://www.readwriteweb.com/images/sears_screenshot_feb09.jpg" /></p>
<h2>richrelevance's Technology: Is it Better Than Baynote's?</h2>
<p>We were curious about why richrelevance thinks its approach is superior to those that exclude personal user bahavior, like purchase history (such as Baynote). Selinger told us that richrelevance constantly runs <a href="http://en.wikipedia.org/wiki/A/B_testing">A/B tests</a>, just as Amazon does, in order to find out what the most effective methods of recommendation are for any given customer (e.g. Sears) or individual user. This approach leads to using a mix of 'wisdom of the crowds' and 'personalization'. </p>
<p>The theory is that  the consumer will tell you what kind of recommendations they like - e.g. at Sears users may like item-based recommendations in certain products, but personalization in other products. Selinger used the analogy of the 'personal shopper'; richrelevance tries different ways to help users shop, finding the best way by trial and error. There are different types of interaction for each customer, said Selinger.</p>
<p>We asked how this approach works for a brand new customer, because presumably there will be no shopper history to use. Selinger replied that richrelevance &quot;works good straight away, but takes a while to get great recommendations&quot;. So they may start out with a new customer using existing data that richrelevance owns (e.g. from a similar vendor), and then gather and test data about the new customer.</p>
<p>As for the technology behind richrelevance, David Selinger has termed it &quot;ensemble learning&quot;. In <a href="http://richrelevance.com/forum/?p=100">a recent blog post</a>, in response to ReadWriteWeb's <a href="http://www.readwriteweb.com/archives/recommender_systems.php">Guide to Recommender Systems</a> post, David Selinger wrote that &quot;no 'single algorithmic' approach can hope to keep up with today's ever-changing consumer mindset&quot;, so richrelevance doesn't try to force retailers and consumers &quot;into a single bucket&quot;. Instead Selinger says that richrelevance has &quot;built a system that adapts to the retailer and to each customer in real-time&quot;, which is done via &quot;an adaptive type of artificial intelligence called Bayesian Ensemble Learning.&quot; </p>
<p>In <a href="http://www.readwriteweb.com/archives/5_problems_of_recommender_systems.php#comment-124853">a comment on a recent RWW post</a>, Selinger claimed that &quot;algorithms like collaborative filtering are a thing of the past&quot; and that ensemble learning is the next generation beyond that.</p>
<h2>Conclusion</h2>
<p>Ultimately, only the customers of richrelevance and Baynote know if their recommendations are working. Both companies claim that their technology results in higher sales for their e-commerce customers - richrelevance says it results in a &quot;5%-30% sustained sales lift&quot; for its customers. It's difficult for ReadWriteWeb to corroborate those kinds of figures. What we <em>do know</em> is that Baynote is more focused on community behavior, whereas richrelevance takes both community and personal data into account - including purchasing history, which Baynote excludes. </p>
<p>We get the impression that richrelevance's approach is very broad - perhaps <em>too</em> broad? In an email thread with David Selinger, he told us about some of the different forms of recommendations: </p>
<blockquote>
  <p>&quot;...there can be basic contextual (you're looking at Adidas, here's more Adidas) or social contextual (you're looking at these Adidas, people who looked at it eventually bought this); you can have basic behavioral (yesterday you looked at Adidas, here's more Adidas), or social behavioral (yesterday you looked at these 10 things, people who looked at those eventually ended up buying one of these 3 things); or basic profile (here's something from your wishlist) to social profile (you seem to like rock music, here's some new rock music).&quot;</p>
</blockquote>
<p>That's a lot of data that richrelevance is trying to process, in real time. Let us know in the comments whether you like richrelevance's adaptive approach to recommendations, or whether you think Baynote's more focused approach is better.</p>]]>
    </content>
  </entry>

  <entry>
    <id>tag:www.readwriteweb.com,2009://1.13796-comment:126244</id>
    <thr:in-reply-to ref="tag:www.readwriteweb.com,2009://1.13796" type="text/html" href="http://www.readwriteweb.com/archives/richrelevance_adaptive_recommendations.php"/>
    <link rel="alternate" type="text/html" href="http://www.readwriteweb.com/archives/richrelevance_adaptive_recommendations.php#c126244" />
    <title>Comment from sosComputer on 2009-02-11</title>
    <author>
        <name>sosComputer</name>
        <uri>http://www.soscomputer.at</uri>
    </author>
    <content type="html" xml:lang="en" xml:base="http://www.soscomputer.at">
        <![CDATA[<p>Baynote's is better.</p>]]>
    </content>
    <published>2009-02-11T22:49:28Z</published>
  </entry>

  <entry>
    <id>tag:www.readwriteweb.com,2009://1.13796-comment:126246</id>
    <thr:in-reply-to ref="tag:www.readwriteweb.com,2009://1.13796" type="text/html" href="http://www.readwriteweb.com/archives/richrelevance_adaptive_recommendations.php"/>
    <link rel="alternate" type="text/html" href="http://www.readwriteweb.com/archives/richrelevance_adaptive_recommendations.php#c126246" />
    <title>Comment from Scott on 2009-02-11</title>
    <author>
        <name>Scott</name>
        <uri></uri>
    </author>
    <content type="html" xml:lang="en" xml:base="">
        <![CDATA[<p>Baynote seems to be very focused with proven results and a clear definition of "Wisdom of the Crowds" while RichRelevance seems to be guessing at best "finding the best way by trial and error". </p>]]>
    </content>
    <published>2009-02-11T23:13:33Z</published>
  </entry>

  <entry>
    <id>tag:www.readwriteweb.com,2009://1.13796-comment:126255</id>
    <thr:in-reply-to ref="tag:www.readwriteweb.com,2009://1.13796" type="text/html" href="http://www.readwriteweb.com/archives/richrelevance_adaptive_recommendations.php"/>
    <link rel="alternate" type="text/html" href="http://www.readwriteweb.com/archives/richrelevance_adaptive_recommendations.php#c126255" />
    <title>Comment from Chris Sheehy on 2009-02-11</title>
    <author>
        <name>Chris Sheehy</name>
        <uri>http://www.iebusiness.com</uri>
    </author>
    <content type="html" xml:lang="en" xml:base="http://www.iebusiness.com">
        <![CDATA[<p>To be clear, it looks like richrelevance looks at Wisdom of the Crowds AND personal user behavior.  Plus, by constantly testing to determine what works and what doesn't, they effectively “custom fit” their product  for each site.  I vote richrelevance.”</p>]]>
    </content>
    <published>2009-02-12T01:22:32Z</published>
  </entry>

  <entry>
    <id>tag:www.readwriteweb.com,2009://1.13796-comment:126261</id>
    <thr:in-reply-to ref="tag:www.readwriteweb.com,2009://1.13796" type="text/html" href="http://www.readwriteweb.com/archives/richrelevance_adaptive_recommendations.php"/>
    <link rel="alternate" type="text/html" href="http://www.readwriteweb.com/archives/richrelevance_adaptive_recommendations.php#c126261" />
    <title>Comment from rick on 2009-02-11</title>
    <author>
        <name>rick</name>
        <uri></uri>
    </author>
    <content type="html" xml:lang="en" xml:base="">
        <![CDATA[<p>Who cares whether we *think* one is better than the other? In some cases, Baynote's approach will work well, in other cases it won't. Same for richrelevance. Your question presupposes that there is one 'better', a pernicious outlook that usually leads to "Will A kill B?" articles and other nonsense.</p>

<p>The question for prospective customers of the two companies is "Which will better fit our business and better serve our customers?" </p>]]>
    </content>
    <published>2009-02-12T01:44:02Z</published>
  </entry>

  <entry>
    <id>tag:www.readwriteweb.com,2009://1.13796-comment:126265</id>
    <thr:in-reply-to ref="tag:www.readwriteweb.com,2009://1.13796" type="text/html" href="http://www.readwriteweb.com/archives/richrelevance_adaptive_recommendations.php"/>
    <link rel="alternate" type="text/html" href="http://www.readwriteweb.com/archives/richrelevance_adaptive_recommendations.php#c126265" />
    <title>Comment from Michael P. Gusek on 2009-02-11</title>
    <author>
        <name>Michael P. Gusek</name>
        <uri>http://www.syntience.com</uri>
    </author>
    <content type="html" xml:lang="en" xml:base="http://www.syntience.com">
        <![CDATA[<p>I like the way you think, Rick.</p>]]>
    </content>
    <published>2009-02-12T01:56:51Z</published>
  </entry>

  <entry>
    <id>tag:www.readwriteweb.com,2009://1.13796-comment:126270</id>
    <thr:in-reply-to ref="tag:www.readwriteweb.com,2009://1.13796" type="text/html" href="http://www.readwriteweb.com/archives/richrelevance_adaptive_recommendations.php"/>
    <link rel="alternate" type="text/html" href="http://www.readwriteweb.com/archives/richrelevance_adaptive_recommendations.php#c126270" />
    <title>Comment from Vincent.H on 2009-02-11</title>
    <author>
        <name>Vincent.H</name>
        <uri>http://dindant.com</uri>
    </author>
    <content type="html" xml:lang="en" xml:base="http://dindant.com">
        <![CDATA[<p>IF A case that baynote work well is more frequent,could I say baynote is better?</p>]]>
    </content>
    <published>2009-02-12T02:23:58Z</published>
  </entry>

  <entry>
    <id>tag:www.readwriteweb.com,2009://1.13796-comment:126272</id>
    <thr:in-reply-to ref="tag:www.readwriteweb.com,2009://1.13796" type="text/html" href="http://www.readwriteweb.com/archives/richrelevance_adaptive_recommendations.php"/>
    <link rel="alternate" type="text/html" href="http://www.readwriteweb.com/archives/richrelevance_adaptive_recommendations.php#c126272" />
    <title>Comment from Richard MacManus on 2009-02-11</title>
    <author>
        <name>Richard MacManus</name>
        <uri>http://friendfeed.com/ricmac</uri>
    </author>
    <content type="html" xml:lang="en" xml:base="http://friendfeed.com/ricmac">
        <![CDATA[<p>Rick, that's a good point. I don't think how I framed it was "pernicious", because I think it's a fair question to ask if one of those approaches is generally better for e-commerce sites. </p>

<p>Re "The question for prospective customers of the two companies is "Which will better fit our business and better serve our customers?""</p>

<p>RM: And what would be the criteria for judging this? Do prospective customers need to try both systems?</p>]]>
    </content>
    <published>2009-02-12T02:33:32Z</published>
  </entry>

  <entry>
    <id>tag:www.readwriteweb.com,2009://1.13796-comment:126314</id>
    <thr:in-reply-to ref="tag:www.readwriteweb.com,2009://1.13796" type="text/html" href="http://www.readwriteweb.com/archives/richrelevance_adaptive_recommendations.php"/>
    <link rel="alternate" type="text/html" href="http://www.readwriteweb.com/archives/richrelevance_adaptive_recommendations.php#c126314" />
    <title>Comment from Siddharth on 2009-02-11</title>
    <author>
        <name>Siddharth</name>
        <uri>http://www.originalgood.com</uri>
    </author>
    <content type="html" xml:lang="en" xml:base="http://www.originalgood.com">
        <![CDATA[<p>I can't comment on Baynote but we use RichRelevance and have been very happy with our decision. It's very customizable, has multiple display options, and most importantly an algorithm that works and gets better over time as demonstrated by its ability our increase sales.</p>]]>
    </content>
    <published>2009-02-12T06:01:00Z</published>
  </entry>

  <entry>
    <id>tag:www.readwriteweb.com,2009://1.13796-comment:126316</id>
    <thr:in-reply-to ref="tag:www.readwriteweb.com,2009://1.13796" type="text/html" href="http://www.readwriteweb.com/archives/richrelevance_adaptive_recommendations.php"/>
    <link rel="alternate" type="text/html" href="http://www.readwriteweb.com/archives/richrelevance_adaptive_recommendations.php#c126316" />
    <title>Comment from Otis on 2009-02-11</title>
    <author>
        <name>Otis</name>
        <uri>http://www.goodreads.com</uri>
    </author>
    <content type="html" xml:lang="en" xml:base="http://www.goodreads.com">
        <![CDATA[<p>I can't say which is better, but my site uses RichRelevance, and we're quite happy with it.</p>]]>
    </content>
    <published>2009-02-12T06:41:26Z</published>
  </entry>

  <entry>
    <id>tag:www.readwriteweb.com,2009://1.13796-comment:126425</id>
    <thr:in-reply-to ref="tag:www.readwriteweb.com,2009://1.13796" type="text/html" href="http://www.readwriteweb.com/archives/richrelevance_adaptive_recommendations.php"/>
    <link rel="alternate" type="text/html" href="http://www.readwriteweb.com/archives/richrelevance_adaptive_recommendations.php#c126425" />
    <title>Comment from Gregory on 2009-02-12</title>
    <author>
        <name>Gregory</name>
        <uri></uri>
    </author>
    <content type="html" xml:lang="en" xml:base="">
        <![CDATA[<p>This is fascinating, as we are currently looking at  recommendation technologies for our site. Has anyone looked at ATG's solution? ATG Recommendations (i believe formerly Cleverset). We're impressed with the initial look we've had.</p>]]>
    </content>
    <published>2009-02-12T21:52:10Z</published>
  </entry>

  <entry>
    <id>tag:www.readwriteweb.com,2009://1.13796-comment:126428</id>
    <thr:in-reply-to ref="tag:www.readwriteweb.com,2009://1.13796" type="text/html" href="http://www.readwriteweb.com/archives/richrelevance_adaptive_recommendations.php"/>
    <link rel="alternate" type="text/html" href="http://www.readwriteweb.com/archives/richrelevance_adaptive_recommendations.php#c126428" />
    <title>Comment from Richard MacManus on 2009-02-12</title>
    <author>
        <name>Richard MacManus</name>
        <uri>http://friendfeed.com/ricmac</uri>
    </author>
    <content type="html" xml:lang="en" xml:base="http://friendfeed.com/ricmac">
        <![CDATA[<p>Gregory, I have a call scheduled with ATG soon. Watch this space ;-)</p>]]>
    </content>
    <published>2009-02-12T22:05:04Z</published>
  </entry>

  <entry>
    <id>tag:www.readwriteweb.com,2009://1.13796-comment:126497</id>
    <thr:in-reply-to ref="tag:www.readwriteweb.com,2009://1.13796" type="text/html" href="http://www.readwriteweb.com/archives/richrelevance_adaptive_recommendations.php"/>
    <link rel="alternate" type="text/html" href="http://www.readwriteweb.com/archives/richrelevance_adaptive_recommendations.php#c126497" />
    <title>Comment from Gregory on 2009-02-13</title>
    <author>
        <name>Gregory</name>
        <uri></uri>
    </author>
    <content type="html" xml:lang="en" xml:base="">
        <![CDATA[<p>Thanks Richard. Should have known you'd be on the case! Very helpful.</p>

<p>Gregory</p>]]>
    </content>
    <published>2009-02-13T14:03:48Z</published>
  </entry>

  <entry>
    <id>tag:www.readwriteweb.com,2009://1.13796-comment:126543</id>
    <thr:in-reply-to ref="tag:www.readwriteweb.com,2009://1.13796" type="text/html" href="http://www.readwriteweb.com/archives/richrelevance_adaptive_recommendations.php"/>
    <link rel="alternate" type="text/html" href="http://www.readwriteweb.com/archives/richrelevance_adaptive_recommendations.php#c126543" />
    <title>Comment from haydar on 2009-02-13</title>
    <author>
        <name>haydar</name>
        <uri></uri>
    </author>
    <content type="html" xml:lang="en" xml:base="">
        <![CDATA[<p>The question for prospective customers of the two companies is "Which will better fit our business and better serve our customers?  <a href="http://www.muhabbetim.in" rel="nofollow">muhabbet</a> , <a href="http://www.mIRC18.net" rel="nofollow">mIRC</a></p>]]>
    </content>
    <published>2009-02-13T18:27:46Z</published>
  </entry>

  <entry>
    <id>tag:www.readwriteweb.com,2009://1.13796-comment:126877</id>
    <thr:in-reply-to ref="tag:www.readwriteweb.com,2009://1.13796" type="text/html" href="http://www.readwriteweb.com/archives/richrelevance_adaptive_recommendations.php"/>
    <link rel="alternate" type="text/html" href="http://www.readwriteweb.com/archives/richrelevance_adaptive_recommendations.php#c126877" />
    <title>Comment from Doug on 2009-02-16</title>
    <author>
        <name>Doug</name>
        <uri></uri>
    </author>
    <content type="html" xml:lang="en" xml:base="">
        <![CDATA[<p>Disclaimer: I worked with the CEO of richrelevance at Amazon.com and still correspond with him occasionally.</p>

<p>Which I “like” better depends on the level of abstraction I’m viewing from: mathematical, algorithmic, or financial.  Baynote may be elegant and simple, but if the goal is to sell more stuff then richrelevance’s adaptive approach is likely to work better across a wide variety of customers and products.</p>

<p>To see if your customers shop differently, plot clicks per purchase by number of customers, for everyone who bought least year.  Many customers just need a few clicks to convert, but others shop for hours, even days, before converting.  We’re seeing that behavior across all properties --- from ad exchanges to search engines to individual stores --- and all product collections, from general merchandisers to highly specialized collections like Lee Valley Tools.<br />
</p>]]>
    </content>
    <published>2009-02-16T22:50:12Z</published>
  </entry>

  <entry>
    <id>tag:www.readwriteweb.com,2009://1.13796-comment:128862</id>
    <thr:in-reply-to ref="tag:www.readwriteweb.com,2009://1.13796" type="text/html" href="http://www.readwriteweb.com/archives/richrelevance_adaptive_recommendations.php"/>
    <link rel="alternate" type="text/html" href="http://www.readwriteweb.com/archives/richrelevance_adaptive_recommendations.php#c128862" />
    <title>Comment from Larry on 2009-03-05</title>
    <author>
        <name>Larry</name>
        <uri></uri>
    </author>
    <content type="html" xml:lang="en" xml:base="">
        <![CDATA[<p>Baynote also has a personalization capability which is useful for repeat visitors. The core of the service remains based on crowd wisdom but it is not the case that Baynote ignores the individual. </p>]]>
    </content>
    <published>2009-03-05T14:18:31Z</published>
  </entry>

  <entry>
    <id>tag:www.readwriteweb.com,2009://1.13796-comment:142936</id>
    <thr:in-reply-to ref="tag:www.readwriteweb.com,2009://1.13796" type="text/html" href="http://www.readwriteweb.com/archives/richrelevance_adaptive_recommendations.php"/>
    <link rel="alternate" type="text/html" href="http://www.readwriteweb.com/archives/richrelevance_adaptive_recommendations.php#c142936" />
    <title>Comment from kelebek on 2009-06-17</title>
    <author>
        <name>kelebek</name>
        <uri>http://www.kelebektr.org</uri>
    </author>
    <content type="html" xml:lang="en" xml:base="http://www.kelebektr.org">
        <![CDATA[<p>thank you very much</p>]]>
    </content>
    <published>2009-06-17T17:45:49Z</published>
  </entry>

</feed>