Is there a way to increase the specular only in certain places on an object?
Yes. Many specular shaders include a specular channel, often the alpha of an image. In your favorite image editing program, paint specularity into the alpha channel of your image, and then choose a shader in Unity that says something along the lines of “RGB (Color) A (Gloss)”