Have any of you heard of any kind of code that could be used with Unity, to track the user’s eyes through webcam and send the data realtime into unity as the player’s POV?
I guess something like this would be ideal, although that example isn’t commercially available.
Has anyone used face/eye tracking with success?
There is this too :
Facetracking Starter Kit $75
http://forum.unity3d.com/threads/159554-Facetracking-starter-kit-Released
But it only works with the Kinect camera.
Hi, I work at Tobii. We have been developing commercial eye tracking devices for a long time, but now we finally have something with a descent price for developers ($195/$95 with promo code), the Tobii EyeX Controller: http://www.tobii.com/en/eye-experience/buy/
We have developed a SDK package for Unity that you can take a look at: http://developer.tobii.com/eyex-sdk/unity/
There are webcam solutions as well, but they do not work so well when moving your head around or when the light conditions are bad. With a real eye tracker you get robust x/y/x coordinates for each eye as well as gaze point in screen coordinates with ½ cm precision. If you use the base classes included in the samples you can also easily detect when the user is looking at a specific game object.
I bought that, but there’s a facetracking example in the $10 “kinect extras” that is just about as good. Also the interaction demo is really good with open/closing your hand to grab/release an item. KinectExtras with MsSDK | Tools | Unity Asset Store
edit:: Face Api also works with Unity but is expensive…per app licensing.
Brekel face is non unity but good face tracking for $100
FaceShift can do realtime tracking and has Unity support (via blendshapes) and a plugin… but it’s pricey and I’m not sure if the realtime tracking would work with Unity:
I’ve tested faceShift and it reacts perfectly but as you said I guess you can just record an animation in Faceshift and use it in Unity .
also tried receiving it’s OSC messeges but failed , no response !