Please keep in mind that:
1. Just as you said Google has lot of servers on whole the world and those have to periodically redistribute data between each others. That is why some pages can be saw already indexed on one continent but not yet on other.
2. Keep in mind that Google shows APROXIMATE number of results what means that:
a) it is not real number
b) number of results can change even when real number of indexed pages didn't
c) number of results can be still the same even if number of indexed pages changed
d) Google uses heuristics not algorithms, so results are really not deterministic - most probably you will not see this on top results, because of caches and so on, but if it could be visible when getting on to really low results
e) magic can happen
Seriously - please read my several last posts in this thread – I hope it can help
I just looked for wildcards in robots.txt (since according to my previous knowledge it shouldn't be in robots.txt) and found this article which says it should work:
Still I found very interesting authors sentence:Code:http://seogadget.co.uk/wildcards-in-robots-txt/
I will make some more research in this area.Some SEO’s don’t agree with the use of wildcards, or at least they see it as slightly risky or far from best practise.
EDITED.
Here I found more about wildcard in robots.txt:- according to information there Google and Yahoo allows to use wildcards.Code:http://tools.seobook.com/robots-txt/
Still - please make sure that you aren’t blocking all your translated content by some of wildcard rule. Please use webmaster tools to determine (first make vBET running again). As wrote author of last mentioned article:
Consider related URLs if you use Robots.txt wildcards: I accidentally cost myself over $10,000 in profit with one robots.txt error!
Last edited by vBET; 07-03-11 at 00:08.
I did tell him upfront to simplify his robot.txt - I am not an expert, but
I thought right off the bat to have such a crazy robots.txt did not
make since. a robot.txt needs to be simple, not overkill....
I think I also mentioned to him that it was not a good idea either to
remove the mod as that would not solve the problem, because what
happens if it starts all over again, does he then consider removing
the mod once again, since he did not solve this the first time, it
just does not make since just to un-install the mod without solving the issue.