Does the scale of an object matter?

Hello, I was thinking of shrinking my scene and I was wondering if the scale of the objects matter. I started to wonder this when I imported a model from Blender into Unity, it turned out to be insanely small and I had to scale it up by 500 before it was on par with the other objects.

Yes. You should set the scale in Blender.