TOPIC:

This query is regarding the club website: santacruztmclub.toastmastersclubs.org/

Club No: 07677706

The club website has very low in search rankings and I want to change that. Only 7 people visited the website in the last one month. This traffic also seems to be from the people who visit TM site and not direct to the website.

Here I am facing the Google and Bing issues mentioned below:

I have added Google tag and Bing HTML Meta Tag in the website but both Google and Bing are not able to recognise them.

I tried to add the website manually to Bing Webmaster tool, but I am getting the error: This might be a momentary issue. Please try again or check back later. This error I am getting even after one week. Screen shot is attached.

I did refer this to Google Support Forum. The reply I received was: Make sure your website is accessible to Google crawlers. In your robots.txt file make sure you are allowing it for all crawlers and is not blocking it. Also check with your web hosting company and ensure no server issues while accessing the website.

I did go through previous topics on Google Crawler error on FreeToastHost 3 site. I did find few topics mentioned but they are not of help to me. One topic take to a Google page where such problem is explained but it seems Google has revised the page and the page gives general information.

Please let me know what I need to do to get this search engine crawler error rectified.

Lawrence

I was able to add my own clubs site to the google tools without any issues and it was verified immediately.

Thank you Brian.

Then something must be amiss at Google's end. 

Please share your club website URL

www.catval.com

Thank you Brian for sharing your website URL.

Since the crawler of the club website is not resolved, I got in touch with Bing Webmaster Team and this is the reply I received from them:I have reviewed your query and see that your server may have been configured to only accept requests from Bingbot from specific IP ranges. Since Bingbot IP ranges may change over time, you may be accidentally blocking valid Bingbot requests this way. We would be pleased if you could check your server settings to avoid blocking our crawler so that we can properly index your website. To see whether Bingbot requests are really coming from Bing machines instead of suspicious crawlers that are spoofing the Bingbot user agent, use the methods described in  How to Verify Bingbot .Or alternatively, you can identify Bingbot by IP address by matching the crawler's IP address to the  list of Bingbot IP addresses .

Request you to address this.

Also, as mentioned in one of the Google help article, I also checked peek results at geopeeker.com/ for our clubs and both websites are not accessible in Singapore and California. Just for info. Screenshots attached.

If your site appears in one location then google bot has read it, after that it is google internals that sends it to all its Datacenters nothing we can do about it.

As far as bing bot it keeps getting blocked because Bing bot misbehaves by not obeying the robots.txt and by initiating port scans. I will remove the blocks again but it maybe blocked again in the future. Microsoft is not the god it thinks it is.