360 Video and Spatial Audio

Unity Engine
1

Hi Guys,

I’m doing some research on spatial Audio and 360 videos. There are many tutorials that explain both separately but none of them combined. I was wondering if anybody had some more information about this topic and if it is possible after seeing this video:

If it is possible to make transparant game objects within the 360 sphere with audio from fmod moving with objects in the video? Or does anyone have a better solution for this? And most important, when building it to an Android or iOS app will the (spatial) audio be included in the app?

I also found this other tutorial where he does not work with a sphere, but with an 360 Panorama Asset:

and explains how to render this in Unity to a 360 mp4 ready to be uploaded in Youtube. Any thoughts on how to implement spatial audio in this case?

Hope you guys can help me on my way in Unity. Thank you!

2

I’m using the Facebook Audio Spatial Workstation to play spatial audio mixes with video files.

Goto Redirecting... and download the Rendering SDK. It contains a Unity plugin with some decent documentation.

It was very easy to get up and running with a premixed .tbe file. If you do not have a .tbe you may be able to create one with the encoder included in Spatial Audio Workstation main package.

I will say I’m having trouble syncing the audio to the video in a reliable way. However, if both your video and spatial audio play on awake they stay relatively synced.