Why does my pixel art get ruined?

I made some basic pixel art for a few projects and I’ve come to realize that it ruins the pixel art for some reason. I’m not talking about it being blurry, that can be fixed by changing the Filter mode to "Point (no filter) but that makes some of the colors blend together weirdly193356-help.png

(left) what unity gives me (right) what the image looks like.
It does fix when i scale the textures up but i really dont want to do that!
is there an easier fix?

Are the textures compressed in the import settings? That looks like it could easily be the result of DXT compression artifacts.