The internet is a complicated thing. I like to test with several different tests, that way you can rule out localized problems. It does not matter how optimized your site is, if there is an issue between you and the destination server, the loading time will be affected.
If you really want to monitor and test things, you can spin up a digital ocean droplet and use sitespeed.io, we have a post on our blog about it.