How To Desync A Player's Camera?

Currently I’m creating a vaulting mechanic for the player when he collides right at the edge of an object, when doing so I cast raycasts to calculate the position the player should land in and I teleport him to that position. However, the camera teleports as well but I’d prefer the camera to smoothly go back to the player. I tried using Vector3.SmoothDamp and so on but it created its own list of issues. Does anyone know any solution? Thanks for any help.

Can you provide us with a GIF animation?
Its hard to tell what problem your facing by just reading a question!

But if it helps I always use Lerp! I personally don’t like having a extra variable for SmoothDamp.