Hello,
we are running some tests for a real estate only search engine. Main purpose right now is to test robot to see if robots.txt file is properly handled.
If someone wants her/his site crawled, send URL please.
In return I will send summary of any crawling problems of the site.
Biggest surprise so far was the fact that a few real estate sites do not want their sites indexed at all; all robots are told to stay off.
Wonder if the site owner knows that.
Sincerely
Helmut P. Fleischhauer

crawl my site if you wish - www.premierlocation.com

Thanks

Yes .. over the weekend

crawl to mine

http://www.chriswlee.com

OK .. will send a report directly if anything is not spiderable

Do mine.

http://www.b4uclose.com

Let me know, please.

http://www.b4uclose.com
Done, no problem
.............

http://www.premierlocation.com/
Cannot follow frame structure
Several timeouts when including
http://arthurdossantos.point2homes.biz/

.............
http://www.chriswlee.com
Was crawled before .. cannot remember why not indexed
But in list and will automatically be crawled again after set update period

will you crawl mine?

www.kellyhallmortgages.com

Thanks,

Kelly

Some comments emailed

Sincerely

hpf

Well top, since you offered... could you crawl:

www.jasonkingrealtor.com

I'd appreciate any feedback or advice you might have.

Thanks,
JTKing

Done, Info sent by email

I think i'm going to have to drop point2agent, seem to have problems with the speed of that site.

P2A is not the problem. Put your site on your own domain and your good to go.

Please crawl:
http://www.VegasNewHomeFinders.com
http://www.TheNewVegas.com
http://www.VegasMortgageSolutions.com

Thanks!

Please give these a crawl,

www.BarryBTeam.com
www.HomeSearchSTL.com

These are both template sites. Therefore I can not easily edit them. One did not even come with Meta-tags. So it should be interesting to see if they are crawl-friendly.

Thanks!