In the import menu for the texture, set the filter mode to point, rather than bilinear/trilinear. Unity likes to filter images at a per pixel level to get smooth results, but if you are using a low resolution texture on purpose filtering is not something you want.