I had that a couple of months ago. Phone was fine when not connected to car play, location bang on. Soon as I plugged it in it moved my location.

Did the same with two other phones. Car play takes the location from the car rather than the phone.