Unable to batch upload products

[ssimard]

Good morning everyone, I am having an issue with the csv products upload batch and was wondering if anyone have seen it before and knows what is happening.

1. I am able to batch upload just fine all my producst and get all the images created on my local XAMPP setup using the same php version. I am running php 5.6.30 locally on an OSX Sierra computer. Online is Debian 3.16.39 with php 5.6.30 as well. Thirtybees 1.0.3.

2. I am running imagemagick on both servers using the TB extension as well. Mind you, I did test with or without it and it did not make a difference so it is not related to it.

3. All my products have 3 images to create, if I change all my products to use only one image in the csv (always the same) it will create them all without issues.

4. With imagemagick turned ON, it is creating only 5 products. With it turned OFF, I could create 10 once but it crashed as well. (when products have 3 images)

5. The error says nothing, I have nothing in the logs, nothing in the php logs either. If I turn debug mode ON I get nothing more usefull either.

6. After the error as been outputted, the script continue and creates the 5 first products (checking in the TB products table, it is taking from 1 to 2 minutes to get them all created, they keep going until the fifth is eventually created and does not go further).

So there is some kind of a loop that seems to be creating them 5 by 5 and does not move to the next iteration apparently.

This was a long post, sorry, trying to give as much infos as possible. Thanks for any help, screenshot of the error follows.

[Troy.Roberts]

What is your PHP execution time?

[ssimard]

Local setup has maxexecutiontime set to 30 while I had it set to 80 online..

[Troy.Roberts]

80 is relallllly low if you're doing product imports. Unless you have like 20 products to import. Try increasing it to at least 600 and see what happens.

[ssimard]

Thanks Troy will give it a try and report back.

[ssimard]

Raised it to 600 and got the error again after the same execution time which is about 1 minute really.

Does not seems to be a factor.

[zimmer-media]

Do you have possibly in the product name special characters in it or no name, which can not process the system. I already had that with me.

[ssimard]

It is not related to the products datas as I can import them all just fine when they don't have images or have only 1.

It really seems to be related to images creation.

[ssimard]

I did add the errorThrown in the code and it is an internal server error.

Happens in the importNow function of import.js after the ajax call, see below:

[lesley]

Can you look at your server logs and see what is throwing the 500 error.

[ssimard]

Will check this out, been trying to get my isp to look at the logs since yesterday and just noticed that they had the error logging off on the server facepalm

Managed server so I can't check myself.

[ssimard]

As per my isp: The errors in the logs just say the process aborted.

Still waiting for them to send me the actual log file.

The only difference from my test computer is that FPM/FastCGI is used on the external server while I am using Apache 2.0 Handler as a server API locally.

[lesley]

If you are using fcgi, ask your host if they can increase the max timeout in fcgi. I think the key is the maxwaittimeout

[ssimard]

Just asked them thanks, will report back.

[ssimard]

That was exactly it Lesley !

Raised fcgi idle timeout to 250 and it is now working :-)

Thanks a lot, have a great evening, I know I will, cheers !

[lesley]

Awesome, that one has caused me so many problems over the years.

[ssimard]

I hear you, lost over 2 days trying to find the answer.

Working 6 months on a store only to be unable to upload products, priceless ;-)