My Search Sucks: Part 4 in a 4 part series

The final installment in the 4-part series, “My Search Sucks,” discussing why search, well, sucks.

Over the past few weeks, we’ve explored how there are three key principles that explain why site search just doesn’t perform like we expect it to and what we can consider to help mitigate this.  So far, we’ve learned that:

1. The critical information we need to make search great isn’t in the document – it’s in the users’ heads.
2. Asking users to explicitly provie us information that would improve search, while a seemingly good approach, is inherently flawed.

Today, we explore the third principle that shows that if we want to improve search, we need to focus on all of the things users are doing online.  What I mean here is that we need to look beyond search and at the entire site experience to truly understand what’s valuable, why it’s valuable, and in what context it’s found to be valuable.

Reason #3:  Search does not exist in a vacuum.

In order to improve search, we need to observe more than just search behavior.  Search and navigation have traditionally been seen as two separate paradigms: separate interfaces and separate systems driving them.  But in reality what’s happening?  A user is coming to your site and expressing an interest or intent through their actions.  They might have first expressed that intent through a Yahoo! or Google search that brought them to your site.  They might then express it in the pages they visit and engage with, the navigation they use, the links they click, and maybe the site searches they perform.  This expression of interest may span multiple searches and clicks.  And, finding documents that hold true value for that interest and intent may also take multiple steps.

Let’s think back to the “Insight/Incite” example once more.  Had we only looked at what search results users clicked on, the problem might never have been solved.  Why?  Because the valuable content was never in the results – it wasn’t there to be clicked on in the first place!  To learn what users really meant by “insight”, we had to watch their subsequent navigation, paying particular attention to the patterns of behavior that indicated engagement or that they had discovered content that was of value – even if it happened several steps after the initial search.  Observing search behavior alone is not enough!

What about users who don’t search at all?  What can we learn from them?  Users are actually giving us continual clues to their intent and interest with every link they click and every category they choose.  The documents that users engage with and the order in which they engage also tell us not only about relationships between documents, but intent.  If we take this valuable, implicit insight into account, then we really begin to see how this insight could be used to fix search.

What’s really remarkable is that once we take a step back and think of the entire online experience as a single unified expression of intent and value, we can do a lot more than fix search.  We can start to make recommendations and optimize the user experience with every interaction they make with your site; from the moment they arrive, every step they take through the site, as well as every search they perform. The true goal is to understand the user’s intent and then automatically surface documents that other like-minded peers have found valuable in that same context.  That’s the true wisdom of the crowd, and what Baynote’s Collective Intelligence Platform (CIP) is all about.