Hey Petey, have you considered just using something like LeanTween or iTween or DOTween from the asset store? Those packages all do this stuff and like 1000x more.
For tracking this down, simplify everything and then do the good old Debug.Log() everywhere trick.
I haven’t used smoothdamp much, I always just Lerp() towards my targets, which moves FAST at first, but then eases to a stop nicely.