Latency issues

Hi, I'm experiencing annoying latency issues where the latency goes from 5-10ms latency to 100+ whenever i move around in the game. When i first bought the game it was running fine, until it eventually because so annoying that i reset my PC and router.

After resetting it ran smooth 30ms latency for 20 minutes, until it returned to the same latency spikes as before the reset.

Im located in North Europe, but it doesn't matter if im on London server or South Africa server, its the same amount of latency across all servers.

Im running cable, so no wifi.

Specs:
Intel i5 14600
RTX4060
32GB RAM


EDIT:

The issues seems to be very instance based. If i start a new instance i can play with low latency

I'm getting spikes that shoot up to 10k+ latency... Not sure what's causing it. The game worked fine before the last couple of updates.