Import .hgt data as heightmap

I have a heightmap of an area I want to import into my terrain, however when I select the file and import it, it doesn’t look good at all; full of holes, tall fins, and 1-unit spires. The heightmap format is a .hgt, and I believe that is what is causing the problem.