TOPIC:

Hi, I think there maybe some problems with allowing search engines to index FTH websites.

When I type into Google "Toastmasters Hoboken" I get the following results:
1) FTH milesquare.org
2) Facebook mile square toastmaster page

However in Yahoo, when typing the same phrase:
1) Facebook miles square toastmasters
... FTH not even on page 1.

Can you please investigate?

Thanks,
Dennis

One follow-up, when looking at the robots.txt, I wonder if it has to do with the wildcard rule you have: milesquare.org/robots.txt


User-agent: *
Disallow: /
Crawl-delay: 30

Hope this helps,
Dennis

What is your club number?

Club 6101

1) your site description and keywords should contain the words people are going to search for.

2) the text on your home page should contain the words that attract people. Who, what when where, why and how.

if i search for toastmasters Hoboken, NJ you are number 1 on google, as that is what you have in your diescription, keywords and texgton home page.

My issue is not with Google, it is with Yahoo search. There is no reason that we should not be showing up on page 1 of Yahoo. I think there is a larger issue with the robots.txt

Not sure why yahoo has not indexed your site, it has the same opportunities as google to index.

The crawl 30 is so that search engines don't over load the server, all search engines follow the same rules.

I just checked with our neighboring clubs using FTH and I'm seeing the same problem "new heights toastmasters jersey city". Not sure what the root cause is here but we can list manually with yahoo. I'm just concerned that we (and other clubs) are not being index across the web well.

Are the other clubs showing up in Google?

I just checked the logs and Yahoo! Slurp is accessing the site everyday.

Yes, FTH page is showing up in the #1 spot on Google, but yahoo again not even on page 1 (or 2 for that matter). It's like it's not indexed at all on yahoo.

Interesting.

My club website does not show up in Yahoo either. And since Yahoo search is basically the Bing algorithm, my club website does not show up in Bing either.

I am wondering if this is related to the TM HQ website overhaul, since a lot of search engines find clubs via the TM HQ website.

From an SEO perspective our site specifically has over a decade and a half's worth of domain authority, and our site has dense content. Not being attached to TMI at this age of our club should have an immaterial impact, in my opinion.

It looks like we have bingbot disabled, and Yahoo! is using bingbot for Yahoo! search, not Slurp anymore:
en.wikipedia.org/wiki/Yahoo!_Slurp

That is probably why bing webmaster tools are giving me an "unspecified error" when I do a fetch as bingbot.

If no bing search results, then no yahoo search results, either.