When you’re configuring crawling for FSIS it can take some time if you’re a newbie.

The crawler config is not for the faint of heart.

The simplest way I’ve found to monitor the crawling whilst initially configuring it is to just open up a fiddler (www.fiddler2.com) session from the box that is doing the crawling.

Yes it will slow down crawling slightly – and yes you will need to keep an eye on memory usage if you’re crawling many pages per second.

However, it will be a valuable tool in your arsenal to monitor the crawling quickly and drill into any authentication issues and notice 404 errors coming through.