Mars Facemask weird behavior on ios

Unity Engine
,
1

Just updated to Mars 1.3. and I am placing objects on the facemask and deploying it to ios. All worked fine when using 1.2. - now with 1.3. I have some weird behavior.

It seems that when my face is captured by the camera on app start - the facemask or object gets stuck to one position and doesn’t react on face movements… and this stays like this…

If I don’t let the iphone capture my face right away by pointing the camera away from my face and then later after a few seconds look into the camera the object fits perfectly on the facemask and reacts on movement. So everything is working as expected…

As mentioned before - didn’t have this issue with 1.2.

Any advice how to get this fixed?

Appreciate your feedback!!

Thanks!!

2

hello @patpre ,

We are looking into this; does this happen also without URP?; what version of Unity are you using?

3

Yes - I don’t have URP in use… Version Unity 2020.3.0f1 but the same on 2019.4.18f1 - also tested with this version…

4

Hi there @patpre ! Sorry to hear that you’re having issues.

Could you also please provide what versions you are using of the following packages:

  • AR Foundation
  • ARKit Plugin
  • ARKit Face Tracking

It sounds like this is a simple thing to reproduce, but are you able to submit your project with a bug report? That will make it easier for us to investigate the issue and track the resolution. Simply go to Help > Report a Bug… and be sure to include and upload the Unity project.

Thanks!

5

Hello @patpre ,

We have successfully managed to reproduce this and can confirm that its indeed a bug, we are working on a workaround for this.

Thanks for letting us know about this! :slight_smile:

6

Thanks for fast response. Could you please post into this thread when you found a solution? That would be really great!! Thanks!!

1 Like
7

If still useful… here the infos:

AR Foundation: 4.1.5
ARKit Plugin: 4.0.12
AR Fave Tracking: 4.0.12

Looking forward hearing about the solution on this!

Thanks!!

2 Likes
8

I think I’ve got to the root of this, and a possible workaround: try downgrading the AR Foundation, ARKit and AR Subsystem packages to the latest 2.x versions and let us know if the problem persists.

(Obviously we’re going to fix it for the newer versions…)

9

Hi, tried to downgrade… but it keeps creating issues and compile errors with AR Foundation… Do you know when to expect a new fixed version - so I can then upgrade? thx

10

hello @patpre ,

Strange, Which version of ARFoundation are you running and which version of ARCore/ARKit - ARKitFaceTracking do you have?

11

Hi,

I am using:

2020.3.0f1
AR Foundation: 4.1.5
ARKit Plugin: 4.0.12
AR Face Tracking: 4.0.12

When downgrading I was trying to AR Foundation 2.1.18 (latest version)…same for AR Kit… and for facetracking I downgraded to the latest 1.x version as there is no 2.x version available… Also tried the 4.1.7 Version for AR foundation - no errors - but still the same runtime issue.

12

can you please try it out with ARFoundation 4.0.12 and let us know if it fixes your issue? it is necessary that the versions of ARFoundation coincide with ARKit and facetracking.

13

Hi, have tried with this version as well - unfortunately doesn’t solve the issue

14

maybe it helps for finding a solution… I have also found out that in the version i am using right now (1.3) it only captures „one face“… so lets say I put an object on my face and i pass my phone to someone else, then the object would not be placed on the face of the other person?? This was different with 1.2. - there the object was placed on the face that it captured at that time… Somehow it seems as if in the new version it doesn’t update or refresh during runtime? Don‘t know how to better explain this - maybe it helps…

15

mmm, @patpre , we are looking into this, could you share with us the compile errors so we can check the stack trace?

16

Ah yeah, unfortunately you can’t downgrade to 2.x with 2020.3; I think you’d need to go back to 2019.4

A fix for this is in the works, but unfortunately I can’t promise exactly when it will be released.

1 Like
17

o.k. Thanks - I will try to also downgrade my unity version. Would be great, if you could post here when a fix is released. THX!!

18

Just downgraded everything as recommended by you! Awesome - Problem is gone!! Thanks a lot for the great support!!

1 Like
19

Just a follow-up on this; you should be able to workaround it on later versions by setting the Requested Max Face Count on the MARS Session to 1 (rather than -1)