Web developers wiki ASP.NET Sitecore Sharepoint Kentico by Evident Interactive

Using a crawler to create a search index for your website internal search pages is implemented by Search Server and dtSearch. With dtSearch you can use the following trick to exclude parts of your webpage so they will not show up in the index.
<!––BeginNoIndex––> ... nothing here will be searchable... <!––EndNoIndex––> 
You can use this to exclude header, footer and menu items.

New for Search Server 2010 is the implementation of a CSS class noindex.

<div class=”noindex”> ... nothing here will be searchable...  </div>

Source of the search server information: http://blogs.msdn.com/b/markarend/archive/2010/06/07/control-search-indexing-crawling-within-a-page-with-noindex.aspx

 © Evident Interactive BV