Well, all products have unique names, also in these problem cases. This must in my opinion mean that the URL also will be unique. This has at least worked in the other 1500+ products we have in each shop.
After I rolled back, we recreated the same products, and now there is no problem. So I still don't think that is the problem.