Is it possible to do this with Unity3D? - YouTube
Any ideas?
Obviously, all characters are already inside the app, and when the user swings the iPhone the accelerometer triggers the “character capture”, selecting one of them according to the current movie scene.
The whole problem here is how to sync the application to the movie. I suspect the application monitors the mic input and recognizes the movie sound track, syncing to it. Unity 3.5 accepts mic input and allows spectrum analysis with GetSpectrumData, thus this in principle is possible - but not easy: complex music recognition is too heavy to be done by script, specially in mobile devices.
If you put some simple tones at key points of the movie sound track, it may be possible to detect them with GetSpectrumData and sync your program to the movie, at least in PCs - mobile devices may be too slow to do that. Obviously, swinging a PC isn’t a good idea, thus some different action should be used to trigger the character capture.
Well what exactly you want to do from that video?
You mean catching the characters from the movie with the Iphone when you “swing” it?
I dont think they are recognizing the chars with the camera or something… just reading the describtion of the video.
It says you have to turn the sound loud and clear.
So the recognition is through the microphone.
Shouldnt be that hard then, but I cant tell you if it is possible with Unity.