The Unity docs never mention anything beyond stereo. Are surround audio files supported? Does Vorbis even support that?
I think that multiple Audio Listeners should be available, and mixed, as described here, but only for interactive effects. A single surround music/ambience file should probably do for multiple people in most cases, however.