Google Email Warning: Googlebot found an extremely high number of URLs on your site

[mario06]

Google Email Warning: Googlebot found an extremely high number of URLs on your site

I received this email (warning) from Googles Webmaster Tools

Please Note that I do not have vBSEO Installed.

I want a fix for this problem before google lowers my page rank or bans me altogether, my adsense revenue has already decreased by half and the Google Bots have literally attacked my site.

The is the second case of such a problem with vBET described here: http://www.vbenterprisetranslator.co...ng-google.html

I have sent the email to all vBET admins in PM as requested, I cannot publicly post the email as you should know because it goes against Googles TOS with my Local Privacy Laws as it would be a sure ban for my Google Adsense account so don't ask.

I need an immediate fix for this problem without further delay, it is 3 days that I've been talking about this in the link above.

Regards

[yahoooh]

i think the reason that you enable all 52 languages
i feel that if vbe make the languages requst as ajax by click langages and thin bring the enabled links for other languages may help on this

[tavenger5]

i get the same warning and I only have 12 languages enabled

[vBET]

i think the reason that you enable all 52 languages
i feel that if vbe make the languages requst as ajax by click langages and thin bring the enabled links for other languages may help on this

No this is not the reason. Our and lot of other forums have included all languages and it is fine. So you can use as many languages as you can. The issue is somewhere else and at this moment we know 2 different reasons of that.

EDITED:
Now we know more reasons So please open your own thread and give us your mail from Google

[vBET]

i get the same warning and I only have 12 languages enabled

Hi - please create new thread about your isue with your email. You got different lniks and we kow 2 reasons of this issue. To help we must know your case. So please open new thread about it and we will help you

[vBET]

mario06 - I'm just during checking your links. I will give you answer in short time

Please note that as we described before - our staff is available to start working on issue when new ticked arrives in form of new thread about the issue. Otherwise we are not able to manage it and we inform our customer that he needs to open his own new thread about his issue. Just like you just did and now we are able to help you

[vBET]

Hi

One of reasons (there will be others - still during investigation) of your issue was that you allowed to index such pages as member pages. Those are not relevant and most member pages are in 99% same - only differs by member username. So when it was additionally translated you made 52 times more such pages which are almost same (same pages content after translation will give same translated content). We officially advise to block irrelevant pages by robot.txt - here you will find how to do this: http://www.vbenterprisetranslator.co....html#post1178

Please note that this will make those pages disappear form Google index and this is good for your SEO since Google will see and index only relevant pages with relevant content.

Also as I see you made changes since Google generated this email, because as I see you blocked member pages for guests. This also solves this part of issue. Still if you want guest see member pages, but Google not index it - just use robots.txt for that

I see that there are also links for archive and threads - I'm going to analyze this right now

[vBET]

Hi again

I think I know what can be the other cause - as I'm looking on flags links there is no link without language= at all... Please tell what is your default forum language - for this language link should be without language= because now every page you have duplicated fo Google. Once for normal URL and second time with language=YOUR_DEFAULT_LANGUAGE.

Also please tell did you changed our template named vbenterprisetranslator_flag? We need to know is it vBET bug or generated by customer change.

The reason I think could be also (cannot check it now but we already have TODO task which will allow to check it in the future) that you just had cleaned cache and there was issue with Google connection - in that case pages generate without content (because translation are not obtained) and literally content is same for all translations. But such things if happen are temporary and if you are no blocked by Google those disappears itself - those are issues between your and Google server and vBET can do nothing with this. I do not tell that it was the reason. I think it could be. As I'm looking now on links given by Google I see no described issue at all. So it could be it.

Still - please answer questions about default language and template.

I see there one more thing – your translated archive pages for subforums are not working and give empty results. Main and post pages are OK. For archive subforum pages there is error. This also makes lot of links going to same content – empty content and this also can be reason why Google wrote you this. Please tell which version of vB are you using? Supported 3.8 or some lower – as I remember such thing happens on 3.6 because of vB bug. If it is not supported version and vB bug – I will find thread about it and I strongly recommend to write to vB team about solving this bug. Unfortunately I expect that they will not do this since it is not supported version anymore. But – first please tell which version are you using, so I will no waist more words and your time for speculations

[vBET]

Hi again again

This time I checked your show thread links and I see 2 things here
1. No one is guilty - as I saw few of those links (not all see number 2) all those threads was very short having only one sentence in it. So all those were very similar by default - 99% of content was layout. It has nothing to do with vBET - it is just the content of your own threads. vBET only translates it so it really is more similar pages for those, but if you disable vBET not translated pages will still be similar to each other if you have only one sentence in only post in thread. So we have nothing to do here.
2. Maybe you are killing your forum yourself by limiting number of posts to see by guests. Now all pages for me have same content with communicate that I should register. Remember that Google is looking your page as guest - so if your limiting mod is stupid it will kill your forum, because Google will see everywhere same content telling him to register Please make sure that limiting mod is smart enough or disable it.

[mario06]

Hi again again

This time I checked your show thread links and I see 2 things here
1. No one is guilty - as I saw few of those links (not all see number 2) all those threads was very short having only one sentence in it. So all those were very similar by default - 99% of content was layout. It has nothing to do with vBET - it is just the content of your own threads. vBET only translates it so it really is more similar pages for those, but if you disable vBET not translated pages will still be similar to each other if you have only one sentence in only post in thread. So we have nothing to do here.
2. Maybe you are killing your forum yourself by limiting number of posts to see by guests. Now all pages for me have same content with communicate that I should register. Remember that Google is looking your page as guest - so if your limiting mod is stupid it will kill your forum, because Google will see everywhere same content telling him to register Please make sure that limiting mod is smart enough or disable it.

1. It's an Italian Forum, the content in the posts is average and this has nothing to do with what you said.

2. I'm not killing the forum because the please register mod after 3 visits (one of the most popular installed mods) has nothing to do with the bots as they go through, even children know that furthermore I've been using vBET ever since the free version came out (about a year?!?) and nothing has been changed or added since then.

The problem is that my forum is considered to be a medium forum with 368,000 threads, when Google sends it bots on my site they effectively see 368,000 threads BUT on www.google.52languages they were seeing 1.540,000 indexed threads which caused the google bot to attack my site trying to find where they are. My cache was set for five days with all languages being cached BUT now (testing) I've set it to 2 days with 4 languages being cached, at this point I can confirm that the problem IS vBET because now I'm down to 766,000 indexed threads and the Google bots have stopped attacking my site.

Example: Your site has 5,578 effective threads BUT Google sees 334,000 indexed threads, do you understand where the problem is?

Without offense you must find out what is happening with google and find a workaround for the problem BECAUSE Google has found out the 52x languages is fake|duplicate indexed links meaning that the translated links don't physically exist and I can't argue that since it's true, it's cached on our servers, it's like cheating.

On small forums they don't pay much attention but on medium|big forums it doesn't pass by unobserved.

You should start investing the language parameter to URL ('address?language=en') this is what is triggering Googles bots to verify vBET powered sites. You have vBSEO (I Don't) which means that you are using the different language parameter which at the moment is passing by Googles attention.

Alot of other vBET users are having the same problem so it's not a coincidence!!

PS. Google Help Center Statement: In general, this message is shown when we discover a relatively high number of URLs for your site.

Regards