How to keep the original color of a sprite?

Hi, I’m trying to use Sprite Swap transition when a button is pressed, however when I change the button color, the sprite’s color is also changed when pressing. Is there a way to keep the original color of a sprite?
I’m still new to Unity and I really appreciate your help. Thank you.

The only reason I can think of is that you use sharedMaterial.color instead of material.color or (Your SpriteRender).color.