Brian wrote: Bing does index the server in December there were over 31,000 hits from the Bing bot.
We do not block BING as an entity. We block IP addresses that attack the server in an uncontrolled manner.
We have all the search engines specified with the same control parameters in the system. Google and Yahoo have no issues obeying the parameters set, and index the server successfully without overwhelming the server.
The Bing bot and the MSN bot both do not follow the rules and consistently get blocked for bad behaviors, the blocks are temporary and expire after 60 minutes.
At this time we are not blocking any IP designated as BING or MSN bot IP
We do know what we are doing and do not need any arm chair quarterbacks. If your club is not happy with the FTH service your club is always permitted to find and manage its own hosting.
I understand you don't explicitly block Bing, but as you state, it's being blocked due to other rules you have in place.
When you do the following search on Bing:
site:toastmastersclubs.org -site:support.toastmastersclubs.org
as of now, only 2 results are found. On Google, that same search has 35,700 results.
So clearly, just about all the FTH club sites can't be found with Bing.
If there are so many other sites out there that can be indexed by Bing without an issue, there must be some change that can be made on the FTH side to make this work. As Steve said, perhaps you just need to find the correct settings to allow it to index the site at a rate that does not impact performance. I don't think simply saying "no" and not looking into a resolution is the right direction to go.
