Crawl error

[Havouza]

Is here someone who has an idea about this. I get a crawl error from Google webmaster like this. http://www.beautyandpleasure.co.uk/index.php?route=product/category&path=62_82

I ofc use rewrite and this looks more like a path NOT rewritten. It send you back to homepage, not a 404 page

[MockoB]

I never seen such error, it is interesting what it could be related with. Maybe something with the URL rewrite system?

[Havouza]

Thisn is also very strange. I get 404 on 11 paths. All of them crazy like this

sex-toys/sex-toys-sex-toys-for-men/sex-toys-for-men-penis-sleeves/contact-us

[Havouza]

I attach 2 screenshots from Bing Webmaster tools. Shows something that has never existed on the site. Just a little worrying if this decide your place in search

[MockoB]

I never used bing webmaster tools but from your screenshots I don't see any 404 errors. What is bothering me are all those 301 redirects. I believe that the new URL structure of thirty bees should have to avoid those redirects at all!? Please @mdekker throw us some light about the URL structure, is it same as PS with clean URL module installed? I know you are changing it at the moment but what should we expect from it, will the redirects be avoided?

[MockoB]

@Havouza please try to Fetch as Google some of those broken links in your webmaster tools and check if it redirects.

[Havouza]

If you look at the first one, that is a redirect somehow also. Can this have to do with the fact that I use ssl on all pages?

[Havouza]

Fetch as google gives not found

[MockoB]

Yes! You should add the https version on GWT also. But I am not sure if it should be like that if you force ssl for all pages ... I am confused ... About that existing link is not found when you fetch it I think @mdekker would have an idea.

[Havouza]

Another strange thing is the huge difference between Goggle and Bing result

[Havouza]

Well, the problems are created by the sitemap generators. I have now tested 2 free ones. Google and Bing. But both give the same problem

Error https://www.beautyandpleasure.co.uk/games-and-media/games-and-media-hen-and-stag-nights/drunk--and--disorderly-labels--boys

On site https://www.beautyandpleasure.co.uk/games-and-media/games-and-media-hen-and-stag-nights/drunk-and-disorderly-labels-boys

See the last part where the sitemap module has a double hyphen between the words. It is the same in all 89 404:s

So now I have taken away the sitemap from the webmaster tools

[Havouza]

One from PrestaTools for Bing and one from Github Called Google sitemap. But I think they are forks of eachother

[Havouza]

The difference between them is that the Google one also map the images, the Bing one not. One more scary thing is that the Bing version is that it report 119 redirects that do not exist, Google none

Like this http://www.beautyandpleasure.co.uk/45_id-lubricants

[Havouza]

Probably. The interface is exactly the same https://www.prestatoolkit.com/free-prestashop-modules

[Havouza]

You are a star. I have said it before. Mostly I am pleased that the rewrite engine was not to blame. All urls look as they should. Only thing is that it can not translate a & to and but that is doable

[Havouza]

Nice. I have tested all 4500 url directly in the database and the problem with -- does not exist there, but perhaps it is when it put the category and product together it go wrong. Well we have to see.

[MockoB]

Please make the sitemap compatible with the blog module you plan. Because ps currently doesn't support external blog URLs (at least smart blog)...

[wakabayashi]

I agree with @MockoB. I would love to see a sitemap compatible with the internal blog system.

[Havouza]

These crawl errors puzzle me but I think somehow it is the crawl that not work properly.

But how the error on the attached screenshot can occur its a mystery. The domain is mine since many years but has no website installed. How is this possble.? The only thing they have in common is that they both reside on my VPS.

[MockoB]

Maybe you should contact your hosting support, I think they could help you.

[Havouza]

No I dont think so. Its a VPS and I have full control over it. But I will ofc have a chat with them. I have been customer for over ten years and they are very helpfull. One of the biggest premium providers in Europe. HostEurope