I had a similar problem that wouldn't go away, and it turned out there was actually a virus/malware on my router, not any of the computers. Sneaky. Formatted the router and the problem was fixed.
Tried a few things that didn't work, but the situation has resolved itself, pings are back to normal. I can only assume it was an issue on the provider's end that they fixed.