Try some of the debug visualization modes Unity - Manual: Debug Draw Modes for lighting
In particular, check the UV overlap and texel validity views. Do you see a bunch of red in problematic areas?
Might also want to take a look at this Lightmapping Troubleshooting Guide