ReadWriteWeb

Watch Out Google, Vertical Search Is Ramping Up!

Written by Alex Iskold / September 29, 2006 8:02 AM / 15 Comments

Written by Alex Iskold and edited by Richard MacManus.

vertical search

This week at DEMOfall I saw two vertical search applications that made me think that this area is getting mature and ready for prime time. Pluggd and Retrevo launched technologies that are not only good at finding podcasts and consumer electronics (respectively) - these sites categorize and present information in fundamentally new, different and intelligent ways. They do it so well that generic search just can not compete.

In this article we look at the rise of vertical search and how it may end up threatening Google. We profile some of the more innovative and interesting vertical search engines - selected primarily based on how they organize the search results and allow the user to navigate through information. Try them out if you have not done so yet and let us know what you think... is vertical search ready for prime time?

Tradeoffs between generic and vertical search

There are always tradeoffs between generic and specialized applications, particularly in the area of information processing. The generic applications cover a wider spectrum, but specialized applications excel in their niche - because they have an intimate understanding of the semantics of information in their topics. 

In the end, there will always be place for generic search - because it may not be economical to have a vertical search engine for every vertical. However, in major verticals, specialized search engines might take a big bite out of the generic search engines' market share - including Google's advertising pie.

Vertical Search Engine Profiles

Technorati

Perhaps one of the most beloved companies of the social computing era, Technorati certainly deserves the attention that it gets. This company helped define the blogosphere and continues to innovate and pioneer in that space. Technorati turned blog search into a portal, a playground and an all around useful site for bloggers, techies, marketers and statisticians. You can use Technorati to find top blogs, links to your blog, popularity by topic and many other things. To be fair, I have to say that I do see occasional downtime, but I think that they are working hard to overcome this. [Richard's note: occasional downtime has been a constant issue for Technorati since their inception]

Other noteworthy blog search engines: 

Google blogsearch – very clean, simple and reliable; but too bare and lacks the cool factor of Technorati. 

Bloglines has a blog search which is very comprehensive, but the presentation is not up to par.

Pluggd

Pluggd was one of the most talked about companies at the recent DEMOfall. Pluggd's core business is essentially crawling podcasts. This is exciting, but it is not why this company is going to be written about in the mainstream media. Pluggd developed unique technology which searches for your keywords inside the podcasts. And to top it all, its not a straight search - but a semantic search which utilizes ontology. For example, if you search for the word 'PGA' in a podcast that has a segment on golf, you are going to get matches in sections that talk about PGA, golf and Tiger Woods. The interface utilizes heat maps to show importance and ranking of every match. In a single word – fantastic! We interviewed Jonathan Thompson, CTO of Pluggd during our DEMOfall coverage.

Other noteworthy podcast search engines: 

Odeo – nice interface, but it is somewhat slow and matches are not as good. 

Podzinger is actually really nice and was my favorite before Pluggd, because it was able to search inside podcasts.

Live Image Search

Microsoft is still coming up to speed in the new web market, with Windows Live. The Image search though is a clear winner in the images vertical, in my view. The features and functions are very useful - and make a huge difference in user experience. The less/more information slider is great and the zooming effect is not just fluff, but adds a lot to the user experience. All and all it is clean and very usable.

Other noteworthy image search engines: 

Riya is coming up very strong. They are very creative and focused on semantics. They just need more data and they will become a strong player. 

My second pick in this category is Google Image search. Its clean, like most Google searches, but it is also very precise.

Retrevo

Retrevo, which we covered during our DEMOfall coverage, just launched a vertical search engine for electronics. The most noteworthy feature and the one that took most work according to the Retrevo folks, is 'search inside product manuals'. The company managed to assemble and index a truly gargantuan collection of product manuals. But it was worth it, because you can now simply type in a question and get an answer straight from the manual. So throw away those piles of paper manuals and free up your offices and kitchen cabinets. In addition to the manuals search, Retrevo has a very intelligent interface and categorization of data. You see search results from product sites, blogs, reviews and discussion forms all neatly organized into easy to navigate categories. For me Retrevo drums the beat of vertical search louder than others – it knows its space, context and semantics very very well.

Other noteworthy electronics search engines: none!

People

People are such an integral part of the web today. For better or worse our digital adventures are being recorded. We leave our digital fingerprints as we touch what we think is intangible – information. ZoomInfo is a vertical search engine for People. To be upfront, I have a lot of problems with ZoomInfo, so many that I sent feedback email and exchanged emails with one of their product managers (I do not do this very often). But fundamentally, there are interesting and useful aspects of ZoomInfo - and the main one is that it lets you be found. It invites you to claim your digital fingerprints. And I do not think that is such a bad thing - if anything it is fun to look back and to see what you have done in the past! But I also recognize that this is a very sensitive and controversial issue, so please share your thoughts with us particularly on this topic.

Other noteworthy people search engines: 

LinkedIn is a great people search engine, you can use it to reconnect with your colleagues and probably locate a lot of business people who are online, particularly in the Technology sector. I am an avid Linked In user, I think they have an exemplary interface and great feature set.

Travel

Farecast is just purely brilliant. I am not sure if it is going to be widely adopted - because it is sophisticated - but it is a gem of an idea. This travel search engine applies idea of a stock market to help you decide when to buy an airline ticket. It does it by showing you prices of the ticket in the past and gives you a verdict if it makes sense to buy now (and if not, when it would be better to buy). I've heard the founder explain in a podcast what a battle it has been to get the data from travel companies and airlines. Well looks like he prevailed and launched the service, although it is not available in all cities yet.

Other travel search engines: 

Kosmix has an interesting collection of vertical search engines, which includes Travel. It is clear that with their technology, they can venture into many other verticals. Their claim to fame is a patented algorithm for automated clustering (I think hierarchical clustering would be more technically precise), which automatically organizes results by topic. It's very very good. To me this is sort of in between  generic and specialized search, but the algorithm is great - so it feels more like a specialized search.

Music

Yahoo and Google music are the best I've seen so far, with Yahoo's one being more user friendly. I think that both engines can be improved by being smarter and more context sensitive. Again Google does its usual plain interface, which in my mind just does not work when you go vertical.

Other music search engines: 

BiggerBoat is entertainment search, which just launched. They cover music and movies. It has been hyped up so I expected more. So far it underdelivers in the user interface. However, I was told that it has some interesting features like ability to narrow the results by category. For example, if you search for Madonna, you can then further slice it by sad or happy, slow or fast, etc. This is interesting and useful, but they need to do a better job presenting this to the user.

The Alexa twist

We conclude this post with an interesting twist. Late December 2005 Amazon announced Alexa Web Search Platform. This event went fairly unnoticed and even now there is not much hype about it. But it is really brilliant. As I have written previously, Amazon is becoming the real web services company and Alexa Web Search Platform is very much part of the play. This platform combines grid computing and crawling technology and allows anyone to very quickly build specialized vertical search applications. No doubt this is Amazon's clever move to overthrow Google with the help of techies of the world. Will it work? I think it might, but take a look at it and other vertical search technologies and let us know what you think.


5 TrackBacks

TrackBack URL for this entry: http://www.readwriteweb.com/cgi-bin/mt/mt-tb.cgi/2796

Comments

Subscribe to comments for this post OR Subscribe to comments for all ReadWriteWeb posts

  1. This is a great article exploring these tools. I really don't see any of them being a big threat to google however. I'm sure google would not have too hard a time bringing their own magic to vertical search should they choose to. Just look what they've done already with images and blogs.

    Posted by: anderson parker | September 29, 2006 12:00 PM



  2. Google has not displaced Technorati or Flickr for the matter of fact. I am think niche players will have a chance to own some turf if they use the right approach.

    Posted by: Innovation Zen | September 29, 2006 12:36 PM



  3. Great article, Alex!

    I agree - vertical search engines have an advantage because they have an intimate understanding of the semantics in that vertical.

    I think VSEs also have several other key advantages:
    - They can provide related tools and services that go beyond content search
    - They can take advantage of partnerships with related players in that vertical area, to offer a more complete solution
    - They can take advantage of specialized UI metaphors and search algorithms, relevant to the vertical area
    - Most important, from a marketing perspective, VSE users are strongly qualified, which can lead to a significantly higher conversion rate

    These and other advantages are detailed in my blog post The rise of Vertical Search Engines (VSEs) - I would be very interested in getting your comments.

    Posted by: nitink | September 29, 2006 7:07 PM



  4. Ntink,

    Just read your article - excellent arguments for reasons why VSE are better than generic search. I agree with all except for VSE being the long tail of search. This is a bit like apples to oranges comparison, I prefer to think of them as different views of the same underlying model. VSE is just much smarter about the data it has.

    Alex

    Posted by: Alex Iskold | September 29, 2006 7:17 PM



  5. Nice write-up, Alex.

    I completely agree that VSEs are here to stay and will become an increasingly important way for average people to find what they are looking for on the Internet.

    Posted by: Alex Castro | September 29, 2006 8:39 PM



  6. Great article, simplyhired and indeed are also great VSE examples. For me, Technorati's user experience is seamless; vertical search startups can focus on their core business and make it better than giants.

    Posted by: Emre Sokullu | September 30, 2006 3:52 AM



  7. Emre,

    I am glad you brought up vertical search engines for jobs - I hear these are great, although I never use them :)

    Alex

    Posted by: Alex Iskold | September 30, 2006 7:53 AM



  8. All the good points about VSEs aside, can someone please explain to me why Retrevo announces, "This site is best viewed with IE 6+, Firefox 1.5+, or Safari 1.3+ on Windows or Mac OS X"?

    Sorry, dudes, I use Firefox 1.5 and Epiphany on Debian GNU/Linux. Just for giggles, I compared the page on Firefox under Debian with Firefox on my iMac (under OS X). There's no difference, as of course there shouldn't be. So why the ignorant plug for Windows and OS X to the exclusion of every other operating system out there? What's the matter with, "This site conforms to W3C standards and should work with any standards compliant browser"? Are they getting kickbacks from Microsoft and Apple?

    Won't even try that search engine, whatever its merits, until they fix this.

    Posted by: Michael M. | October 1, 2006 1:09 PM



  9. Thank you so much for that info, i've recently started discovering info on search 2.0, especially in ru-net, and some of the articles and reviews helped me so much! Thanks again!

    Posted by: Alexandra | October 1, 2006 1:34 PM



  10. Michael, good point - I am not sure. But please do not be offended I know that company does not have anything against Linux. They do some sophisticated stuff with Ajax, it is possible that at some point it did not work well on some browsers.

    Alex

    Posted by: Alex Iskold | October 1, 2006 4:30 PM



  11. This is a well-written blog post -- nice work. I too have blogged about this topic in a previous post on my own blog. In the spirit of full-disclosure, I work at Google.

    I'd like to offer a slightly different take. I think the VSEs with the best prospects for business success (as opposed to those that will just be gee-whiz or novel) are those who actually build applications on top of search, not just offer search as is. Farecast and SimplyHired meet that standard in my opinion. Second, VSEs in categories that monetize well (jobs, travel, consumer electronics) have a decent shot at carving out a new way to make money and be viable. I think that VSEs whose principal value proposition is comprehensiveness or reach will have a hard time competing with larger players on the web.

    Posted by: Charles Hudson | October 1, 2006 7:30 PM



  12. Charles,

    I agree, in a way, at some point once you add more intelligence to UI a new application beyond just search emerges. In your view, is Pluggd still just a search? How about ZoomInfo?

    Thanks,

    Alex

    Posted by: Alex Iskold | October 1, 2006 7:51 PM



  13. Michael (#8),

    They originally had this text on their homepage:
    --
    Sorry, the Linux i686 is not supported.
    We currently support Windows or Mac OS X.
    You can try this browser. But not all
    features will work properly.
    --
    And it was in rectangle with a red background! I suggested they drop the special notice altogether, "Best Viewed With..." is an improvement, at least. They're all Windows+Java over there last I checked, so go easy on them ;-)

    Posted by: Dan Hugo | October 2, 2006 8:08 PM



  14. I agree with Charles above. Comprehensiveness and reach in a given vertical doesn’t necessarily alleviate the frustration of most searchers. People don’t want more results in a given category to thrash through -- they want smaller numbers of personally relevant results in every subject area -- ideally from a single source. Today, search is based on what’s popular (links, tags, diggs), not what’s relevant to me or domain-specific communities. If generic search engines ever crack the code on better personalization combined with effective collaborative filtering, it would allow them to go deep as well as wide. There would be no need for vertical search.

    Posted by: Rob Rustad | October 4, 2006 10:56 PM



  15. My sense is that vertical search + personalized search would be a better combination than generic + personalized.

    Alex

    Posted by: Alex Iskold | October 5, 2006 8:23 AM



The ReadWrite Real-Time Web Summit
RWW SPONSORS


FOLLOW @RWW ON TWITTER

ReadWriteWeb on Facebook



TEXT LINK ADS