ARKit Face Actor and visual scripting

Unity Engine
, ,
1

Hi,

I’m quite new to Unity, and coming from Cycling74’s Max I’m pretty used to visual scripting. I just set up a simple face capture project with Unity Face Capture app, Live Capture and ARKit. I would like to be able to send the ARKit Face Actor Blend Shapes via OSC to control other app. Is there a way to get these value in the Visual Scripting environnement? Or is it just possible to get them with C# script? How would you do it?

Thanks!

LR

2

I believe this video (especially the script information at 8:50) outlines how to access the blend shapes.

3

@Elby_b It’s currently not easy to get the blend shape values in visual scripting, which is mostly a product of the fact that ARKit’s blendshapes are platform-specific, while AR Foundation is designed to be platform-agnostic.

Here’s the information that you can get in Visual Scripting currently (which has some things, but not the blendshape values): On Face Updated | AR Foundation | 5.1.5

Here’s the code we use in our BlendShapes sample scene (which has the blendshape values but requires C# scripting): arfoundation-samples/Assets/Scripts/Runtime/ARKitBlendShapeVisualizer.cs at main · Unity-Technologies/arfoundation-samples · GitHub

4

Hi,

Thanks, I’ll check for the C# script way!