Face Tracking + 3D mask

Unity Engine
1

Hi everyone, I am trying to reproduce my instagram/snapchat face filter. It uses the face tracking system of these apps and attach a 3D mask that follow the user face positions and rotation. It does not animate mouth or eyes! it is just a static 3D mesh. I am getting crazy trying to understand which direction I should go, especially since I do not have iPhone X nor a device with the depth camera. I have an iPhone8, ipad 2 and a couple of android tablets.

here is the description + gif / photo of my face filter: http://www.martinamenegon.com/familiar-stranger

any suggestion?
thanks in advance!

best,
M

2

Are you using Arcore or foundation? Ive had success with Arcore, but No love with Foundation.

3

Hi martinamenegon .

If you still got this problem, you may want to take a look at Banuba’s Unity 3D animation software. This tool allows you to create animated face filters which support the face tracking functionality just like the ones in Snapchat and Instagram for your Unity app. The SDK can be easily integrated into Android and iOS apps.