Google not following URL's with special characters

[tavenger5]

In Google webmaster tools I have around 46k URL's that are not being followed by Google. The only thing that they all have in common are special characters in the URL. Here's an example:

http://cellphoneforums.net/fr/general-service-provider-forum/t348277-ting-code-promotionnel-rabais-de-50-$-sur-n-importe-quel-t%C3%A9l%C3%A9phone.html

notice how the special characters change - Google doesn't seem to like this

[vBET]

Google has no issue with special characters in URL for sure. As I see the URL you are giving here is actually working. Maybe the issue was historical (for example translation provider could response too slow or something like that) - it is hard to say.

What is Google error message? Can you provide more examples of such URLs?

[tavenger5]

In webmaster tools google is reporting URL's like the above as "not followed". This is because when Google goes to the URL it is redirected too many time. In this case it is because of the t%C3%A9l%C3%A9 characters.

[tavenger5]

Here's some more examples:

http://cellphoneforums.net/ru/apple-******/t347236-%D0%9A%D0%B0%D0%BA-%D1%84%D0%B0%D0%B1%D1%80%D0%B8%D0%BA%D0%B0-%D1%80%D0%B0%D0%B7%D0%B1%D0%BB%D0%BE%D0%BA%D0%B8%D1%80%D0%BE%D0%B2%D0%B0%D1%82%D1%8C-at-t-******-5-%D0%BE%D1%82-apple-%D0%B4%D0%BB%D1%8F-%D0%B8%D1%81%D0%BF%D0%BE%D0%BB%D1%8C%D0%B7%D0%BE%D0%B2%D0%B0%D0%BD%D0%B8%D1%8F-%D0%BD%D0%B0-***-%D1%81%D0%B5%D1%82%D1%8F%D1%85-%D0%B4%D1%80%D1%83%D0%B3%D0%B8%D1%85-%D0%B4%D0%BB%D1%8F-$19-99-a-2.html

http://cellphoneforums.net/fr/theunlock-ca/t347946-at-t-******-4s-4-3-gs-**-d%C3%A9blocage-usine-d%C3%A9marrage-@-$-5-a.html

http://cellphoneforums.net/es/*********/t300436-caballero-*********-jinete-*-mensaje-kitt-entrante-*-*-remix-*-y-*-tema-*-4.html

END

[vBET]

In webmaster tools google is reporting URL's like the above as "not followed". This is because when Google goes to the URL it is redirected too many time. In this case it is because of the t%C3%A9l%C3%A9 characters.

In case of too many redirects Google shows such information as I remember. Also the t%C3%A9l%C3%A9 do not make the redirects - this is STANDARD way of including special characters in URL. if you put it like this some browsers will display it nice URL field, some not (IE will display it as it is). In example under IE the only thing which changes in the URL you gage first time is $ - and we must check is it redirect or just browser changes it in URL field (we will confirm it).

In last post you gave some other examples - as I see some of those has also $ included. Only last one do not have it but it is cut by our filters so maybe it has $ also (can you confirm?). Please check does the links have $ included - this is the thing which I suspect at this moment. IT is not % notation - this is standard and Google handles it well.

[tavenger5]

Yes, a lot of the URL's either have $ or * characters in them.

Examples:

http://cellphoneforums.net/de/general-service-provider-forum/t348277-ting-*****-code-$-50-rabatt-auf-jedem-handy.html
http://cellphoneforums.net/fr/google-android/t348250-best-android-phone-for-up-tp-150$.html
http://cellphoneforums.net/es/virgin-mobile/t349005-beware-de-****ty-servicio-a-trav-s-de-m-vil-virgen.html

[Marcin Kalak]

I tested these cases on our forum, they do not cause redirect, but we can have a different configuration than you.
Please PM me access details to Admin CP and FTP. I will check what is going on there

[Marcin Kalak]

No response - considered the issue is gone.

[tavenger5]

I just wanted to bump this back up since the number of URL's has grown after the last update. I'm guessing this is because more URL's are being redirected since I turned off translations of new threads.

The response code that Google is returning is a 303

Priority URL Response Code Detected

1
de/alt-cellular-verizon/t350300-virgin-mobile-$25-plan-vs-all-others.html
303
7/16/13

2
es/alt-cellular-verizon/t350546-*********s-comet-entry-level-android-phone-wi-fi-quad-bandgsm-1700-2100-w-cdma-personal-hotspot-$140.html
303
7/14/13

3
de/alt-cellular-verizon/t350546-*********s-comet-entry-level-android-phone-wi-fi-quad-bandgsm-1700-2100-w-cdma-personal-hotspot-$140.html
303
7/14/13

4
fr/alt-cellular-verizon/t350300-virgin-mobile-$25-plan-vs-all-others.html
303
7/6/13

5
pt/new-member-introductions/t312961-*********~.html
303
7/14/13

6
es/sprint-pcs/t309992-owe-$-sprint-account-can-i-still-sell-phone.html
303
7/5/13

7
de/alt-cellular-attws/t351912-virgin-mobile-begin-offering-$40-unlimited-prepaid-**-broadbandservice-tomorrow.html
303
7/10/13

8
fr/alt-cellular-verizon/t350290-wi-fi-phones.html
301
7/7/13

9
de/virgin-mobile/t361401-konto-vor%C3%BCbergehend-gesperrt-my-balance-nicht-wegen-amt-%C3%9Cbertrifft-400-$.html
303
7/9/13

10
fr/alt-cellular-verizon/t351058-new-verizon-data-plan-details.html
301
7/16/13

11
es/sale-wanted/t361652-f-s-nuevo-*******-yo9190-galaxia-s4-mini-unlocked-$350.html
303
7/9/13

12
de/alt-cellular-attws/t352133-pageplus-vs-tracfone.html
301
7/16/13

13
de/**/t324455-how-get-rid-****y-old-phones.html
303
7/12/13

14
fr/alt-cellular-verizon/t350871-obscenely-large-bill.html
301
7/16/13

15
it/alt-cellular-verizon/t350744-failure-ring-incoming-calls.html
303
7/13/13

16
pt/sale-wanted/t361652-f-s-new-*******-i9190-galaxy-s4-mini-unlocked-$350.html
303
7/13/13

17
pt/*********/t295085-jay-z-*brooklyn-we-go-hard-remix*-ringtone.html
303
7/14/13

18
pt/sale-wanted/t361652-f-s-novo-*******-i9190-galaxy-s4-mini-desbloqueado-$-350-a.html
303
7/13/13

19
es/alt-cellular-attws/t351880-virgin-mobile-$25-plan-vs-all-others.html
303
7/16/13

20
fr/sale-wanted/t361652-f-s-i9190-galaxy-*******-new-s4-mini-unlocked-350-$.html
303
7/13/13

21
de/alt-cellular-verizon/t350643-verizon-android-phones-flood-onto-craigslist.html
301
7/6/13

22
es/alt-cellular-verizon/t351005-verizon-charge-$30-upgrade-your-phone.html
303
7/12/13

23
fr/new-member-introductions/t312961-*********~.html
303
7/15/13

24
de/sale-wanted/t361652-f-s-i9190-galaxy-*******-new-s4-mini-unlocked-$-350-a.html
303
7/14/13

25
es/*********/t295085-jay-z-*brooklyn-we-go-hard-remix*-ringtone.html
303
7/16/13

[tavenger5]

In the first url listed above
de/alt-cellular-verizon/t350300-virgin-mobile-$25-plan-vs-all-others.html
turns into
(German) Virgin Mobile $25 plan vs all others

Note that the problem is with special characters being escaped. If you look at the header for this page you'll see:
HTTP/1.1 303 See Other