Jump to content

Welcome, Guest!

By registering with us, you'll be able to discuss, share and private message with other members of our community.

DRMasterChief

Crawler fills 100+ cart and leave them abandoned?

Recommended Posts

Hello, as we will go live with our TB shop in summer i think about the following, which seems to be a problem in a lot of Prestashops:

A lot of PS users gets visits from Seokicks, who put everything into the shopping cart, and then leave them abandoned. This needs technical resources, slow down the shop and should be avoided (also other crawlers, i think there are a lot of different out there). I know from PS users which have 4000+ filled carts in a about 1-2 weeks.

I am not sure if this could be solved by an .htaccess (maybe the most unfavorable solution) or by blocking IP addresses? But IP addresses can change very fast and i think it is not possible to be up-to-date with this and the crawlers.

Does anyone have experiences with this and TB? Is this the case also at TB shops?

Can we do this with an script in the .htaccess like the following ?? SetEnvIfNoCase user-agent SEOkicks spam_ref = 1 .....same for other crawerls

I think we should think about that and also if this appears with TB, too. Hopefully the developers can contribute some ideas and solutions. thank you!

Share this post


Link to post
Share on other sites

I think it's really waste of your resources to battle this. You just can't stop these bots in generic way - not without significant risk of impacting your regular customers. And to try to fix each and every one of them is another extreme. Your time is much more valuable than few thousands rows in database these bots generates, or the bandwidh they consume.

I would say that the best defense is to simply delete abandoned carts regularly. For annonymous visitors delete any cart that's older than few days. You will probably want to keep customer's carts a little big longer, say for few weeks, or even the months.

Share this post


Link to post
Share on other sites

@DRMasterChief I never said to handle this manually, that's even bigger waste of time. There are modules that can delete them automatically, you just need to setup cron task. With proper retention policy there will never be more than few hundred abandoned carts...

Share this post


Link to post
Share on other sites

I have the same bot problem and I use tidy, the module datakick talks about, and it does the cart cleaning as well as a host of other very useful tasks. Definitely worth it!

Share this post


Link to post
Share on other sites

But wouldnt it be much better to keep the bots out, and not let them search and fill anything first? That would be my preferred solution. I also found a lot of more here: https://www.askapache.com/htaccess/setenvif/

Share this post


Link to post
Share on other sites

I have found this solution, which is free, and works with most bots: https://perishablepress.com/blackhole-bad-bots/

It has considerably curbed the problem for us. It is really to implement in TB, not as much on Prestashop but it is feasible.

Good luck!

Share this post


Link to post
Share on other sites

The plugin does not work with TB, but the PHP script version can be implemented anywhere. The instructions are pretty straight forward.

Share this post


Link to post
Share on other sites

Looks like i'm a bit late, but for anyone interested:

I also had this problem on a regular basis on my old shop. Bots usually follow links. If you get abandoned carts, it means that somewhere in your theme the "Add to Cart" buttons are defined as a link. Most of the time it's the list view on the front page or category pages. To prevent them from following those links, you should change them to buttons and call them via javascript. Just like in the product view page in the default theme.

Alternatively you could remove those buttons from list view completely. I don't think people would add anything to cart from a list view. Well, i wouldn't.. don't know about anyone else.

Share this post


Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now

×
×
  • Create New...