Hello,
we are running some tests for a real estate only search engine. Main purpose right now is to test robot to see if robots.txt file is properly handled.
If someone wants her/his site crawled, send URL please.
In return I will send summary of any crawling problems of the site.
Biggest surprise so far was the fact that a few real estate sites do not want their sites indexed at all; all robots are told to stay off.
Wonder if the site owner knows that.
Sincerely
Helmut P. Fleischhauer