Web developers wiki ASP.NET Sitecore Sharepoint Kentico by Evident Interactive

We were unable to exclude parts of our page content from Search Server crawler results. For example, Search Server would index the Site wide menu, so you could find every page by searching for 'Contact' or 'Homepage'. With other search engines (e.g. dtSearch) you can surround content you dont want to include in the search index with tags (e.g. <!––BeginNoIndex––> excluded content <!––EndNoIndex––> for dtSearch).

In Sitecore you can have several Presentations coupled with the same content item, based on the device that is browsing. This facilitates removing clutter when printing, or changing the layout of your website when browsing with a mobile device.

Since the Search Server crawler is identifiable by it's browser agent or user agent we decided to create an extra Device item in Sitecore especially for the purpose of displaying only the relevant content per page.

Here are the step:
1. Find out the user agent string in the registry of the Search Server machine.
→ HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Office Server\12.0\Search\Global\Gathering Manager\UserAgent
→ The value for search server: Mozilla/4.0 (compatible; MSIE 4.01; Windows NT; MS Search 5.0 Robot).
2. Create a new Device in Sitecore. Enter the value of the key in the Browser agent field.
3. Edit the presentation of the templates so only the relevant content is rendered.
4. Publish.

To test what the Search Server crawler will see, we used a browser agent switcher plugin for Firefox: User Agent Switcher 0.7.2

 © Evident Interactive BV