AR Foundation Remote | Test and debug your AR project in the Editor

[distastee]

@KyryloKuzyk

Please update to the latest version. I managed to make a transition away from PlayerConnection/EditorConnection to a custom TCP/IP solution. It will fix all previous connection limitations.

Wow! Impressively quick! Glad you were able to find a solution so quickly. I hope it ends up being more stable and capable than the editor connection.

I took a stab at the update. Updating over my old installation yielded some issues the new TCP lib coming in (said that ARFoundationRemote.Runtime namespace didn’t exist). Deleted the folder and reinstalled. Now these two errors are popping up:

Library\PackageCache\com.kyrylokuzyk.arfoundationremote@95bfad42ff\Editor\Subsystems\CameraSubsystem.cs(113,30): error CS0104: ‘Object’ is an ambiguous reference between ‘UnityEngine.Object’ and ‘object’

Library\PackageCache\com.kyrylokuzyk.arfoundationremote@95bfad42ff\Editor\Subsystems\CameraSubsystem.cs(113,54): error CS0246: The type or namespace name ‘ARCameraBackground’ could not be found (are you missing a using directive or an assembly reference?)

[KyryloKuzyk]

@distastee

Library\PackageCache\com.kyrylokuzyk.arfoundationremote@95bfad42ff\Editor\Subsystems\CameraSubsystem.cs(113,54): error CS0246: The type or namespace name ‘ARCameraBackground’ could not be found (are you missing a using directive or an assembly reference?)

I’m sorry about that. I already submitted a new version to the Asset Store, but it’s going through the validation process.
Could you please contact me via email so I can send the latest version with a fix?

[scrant]

I cannot get this to work. The package is installed, the app built and installed on my iPhone no problem. I’ve got a sample scene up but it just won’t connect. At first Remote had black screen listing IP address which I put in settings. When then didn’t work I switched methods to Unity built in connection and tried selecting that from the Editor menu. Still no luck. No the message on the Remote app always says Select your device in Editor message. I tried inputting directly the IP address in the editor menu and that didn’t work either. Nothing is working…

[KyryloKuzyk]

@scrant

I cannot get this to work. The package is installed, the app built and installed on my iPhone no problem. I’ve got a sample scene up but it just won’t connect. At first Remote had black screen listing IP address which I put in settings. When then didn’t work I switched methods to Unity built in connection and tried selecting that from the Editor menu. Still no luck. No the message on the Remote app always says Select your device in Editor message. I tried inputting directly the IP address in the editor menu and that didn’t work either. Nothing is working…

Are there any errors in Console? Does you iPhone is connected to the same network as your computer?
Could you please contact me via email describing your setup? Please tell me your Unity version, ARKit XR Plugin version and send me Packages/manifest.json file.
email: kuzykkirill@gmail.com

[hyperbaton]

For those who are having problems updating to a new Telepathy version.

I also had some issues when trying to upgrade, mainly issues in the console about some absent namespaces or redeclared ones.

My solution was to complete remove the plugin from the project (and associated package pulled from github) and reinstall them all.
Same goes for the companion app: remove the old one and compile the new one.
And don’t forget to specify the IP address in the settings tab (not the console).

Hope that helps.

[masonmc]

on the latest, I’m getting the error message “Can’t start sender. Please connect AR device to private network.” In the settings, I put in the IP address of the laptop running my Unity editor. Is this correct? Firewall is off and this is on Android 9 (Samsung Galaxy5, SM-G950U1). Thanks!

[zulaman]

@masonmc

on the latest, I’m getting the error message “Can’t start sender. Please connect AR device to private network.” In the settings, I put in the IP address of the laptop running my Unity editor. Is this correct? Firewall is off and this is on Android 9 (Samsung Galaxy5, SM-G950U1). Thanks!

I believe you need to put the ip address of the phone. At least that’s what I’m doing and it’s working well.

[KyryloKuzyk]

@masonmc

on the latest, I’m getting the error message “Can’t start sender. Please connect AR device to private network.” In the settings, I put in the IP address of the laptop running my Unity editor. Is this correct? Firewall is off and this is on Android 9 (Samsung Galaxy5, SM-G950U1). Thanks!

I receive this error message when my phone is not connected to Wi-Fi. Is there a chance this is your case?
Could you please try to set ConnectionType to UnityBuiltinConnection and re-build Companion app and then connect to your device via Unity Console? If this will not help, please contact me via email describing your Unity version and your OS.

[YacineFENINA]

Hello, and thanks for your work it seems to be awsome !

I have questions about your AR Foundation Editor Remote.I’m interested by buying it, but I need to understand the constraints :

AR Foundation Editor Remote Unity plugin

On this video, I see you specify an IP adress to connect your phone to the editor.Do we need to be on the same network or can we do this with an usb connection ?
I don’t have any wifi connection to connect my device and my computer on the same network.

Is there any evaluation version to check compatibility with my computer configuration ?

[KyryloKuzyk]

@YacineFENINA

On this video, I see you specify an IP adress to connect your phone to the editor.Do we need to be on the same network or can we do this with an usb connection ?
I don’t have any wifi connection to connect my device and my computer on the same network.

This video is recorded with Unity built-in connection. Currently, the main connection method is Telepathy TCP library. It works by connecting Editor to your AR device via private network.
But the old built-in connection is still there, you can switch to it in plugin settings. It will enable you to connect Editor to your iOS device by wire (unfortunately, there is no way to connect Android devices by wire using built-in connection).

@YacineFENINA

Is there any evaluation version to check compatibility with my computer configuration ?

I had an evaluation version for an old version of the plugin, but it is very outdated now and doesn’t reflect the current state of the project. I can make a refund if the connection between Editor and device will not work for your setup.

[YacineFENINA]

@KyryloKuzyk

This video is recorded with Unity built-in connection. Currently, the main connection method is Telepathy TCP library. It works by connecting Editor to your AR device via private network.
But the old built-in connection is still there, you can switch to it in plugin settings. It will enable you to connect Editor to your iOS device by wire (unfortunately, there is no way to connect Android devices by wire using built-in connection).

I had an evaluation version for an old version of the plugin, but it is very outdated now and doesn’t reflect the current state of the project. I can make a refund if the connection between Editor and device will not work for your setup.

Thanks for your fast answer !
So if I work on windows (which means android ), there is no way to use your plugin without wireless network ?

[jipsen]

Any idea why I’m getting this error after git pull?

Library\PackageCache\com.kyrylokuzyk.arfoundationremote@f6561ed6eb\Editor\Subsystems\PlaneSubsystem.cs(57,52): error CS0115: ‘PlaneSubsystem.ARemotePlaneSubsystemProvider.planeDetectionMode’: no suitable method found to override

[KyryloKuzyk]

@jipsen

Any idea why I’m getting this error after git pull?

Library\PackageCache\com.kyrylokuzyk.arfoundationremote@f6561ed6eb\Editor\Subsystems\PlaneSubsystem.cs(57,52): error CS0115: ‘PlaneSubsystem.ARemotePlaneSubsystemProvider.planeDetectionMode’: no suitable method found to override

It seems like you’re running the old version of the plugin. In the old versions, it was required to add the ARFOUNDATION_4_0_OR_NEWER define in Scripting symbols.
Please update the plugin to the latest 3.10.12 version, now the installation process is automatic.

Here how to update:
“Q: How to update to a newer version?
A: Delete the folder ‘Assets/Plugins/ARFoundationRemoteInstaller’, re-import the plugin, and make a new build of AR Companion app by pressing Installer-BuildAndRunCompanionApp button.”

[KyryloKuzyk]

@YacineFENINA

Thanks for your fast answer !
So if I work on windows (which means android ), there is no way to use your plugin without wireless network ?

Unfortunately, no. I was unable to connect an Android phone to a PC by wire with Unity’s built-in EditorConnection. The Telepathy TCP is also not able to solve this connection problem.

[YacineFENINA]

@KyryloKuzyk

Unfortunately, no. I was unable to connect an Android phone to a PC by wire with Unity’s built-in EditorConnection. The Telepathy TCP is also not able to solve this connection problem.

But if I manage to get a wireless connection, I can connect my android device with Unity editor on windows, right ?

[KyryloKuzyk]

@YacineFENINA

But if I manage to get a wireless connection, I can connect my android device with Unity editor on windows, right ?

Yes, that’s correct. Moreover, you’ll be able to connect an iOS device to Windows PC (providing that you have a macOS device to build the companion app once).

[Misnomer]

I’ve just tried your asset and have a few questions:

1. Do I understand correctly that the use case for it is to write some code to work with AR data and then use your device to streamline it to editor?
2. It doesn’t seem to work “out of the box” as you need to set up a code to send and receive data. Maybe it’s stupid but I was under assumption that it will connect automatically and send data using the one and same scene. Additionally, you don’t have any such information in documentation and / or on your website. The only way is to use examples which is not self-evident. It would be great to add a small paragraph of text detailing the data exchange process.
   Thanks!

[KyryloKuzyk]

@Misnomer

Do I understand correctly that the use case for it is to write some code to work with AR data and then use your device to streamline it to editor?

No, this would undermine the whole ‘fast iterations’ idea. The main idea of the plugin is to build AR Companion app once (please refer to Documentation for more details) and then connect Unity Editor to it. AR Companion will then send AR data back to the Editor.

Here is a quote from Asset Store description:

Plugin workflow:

1. Please read the Documentation located at Assets/Plugins/ARFoundationRemoteInstaller/DOCUMENTATION.txt.
2. Build and run ARCompanion app on your AR device.
3. Connect Unity Editor to ARCompanion app.
4. Test and debug your AR project in Editor without the need to make a new build after every change (you will not see your recent changes in ARCompanion app. ARCompanion is used only to send AR data and touches back to the Editor).
5. Always test your project on a real AR device before releasing it to production.

Please feel free to contact me via email if you have any other issues.

[masonmc]

@KyryloKuzyk

I receive this error message when my phone is not connected to Wi-Fi. Is there a chance this is your case?
Could you please try to set ConnectionType to UnityBuiltinConnection and re-build Companion app and then connect to your device via Unity Console? If this will not help, please contact me via email describing your Unity version and your OS.

Thanks Kirill! Phone was connected to WiFi, but it turns out the error message is benign. I still see “can’t start sender” on the phone but when I press play in the editor everything works great, I see the camera background and everything. This is on Unity 2020.1, Windows, talking to a Samsung Galaxy SM-GM950U1 (Galaxy S8).

One new question though - my unity scene has both face tracking and image tracking; in code, I toggle between them by enabling or disabling the AR Tracked Image Manager or the AR Face Manager. I have a flip camera button that enables or disables these as needed. This works on an actual build for the phone:

IEnumerator DoFlipAsync()
    {
        ARCameraManager.requestedLightEstimation = LightEstimation.None;
        ARSession.enabled = false;

        if (IsUsingRearCamera)
        {
            TrackedImageManager.enabled = false;
            FaceManager.enabled = true;
            ARCameraManager.requestedFacingDirection = CameraFacingDirection.User;
            ARSession.requestedTrackingMode = TrackingMode.RotationOnly;
        }
        else
        {
            TrackedImageManager.enabled = true;
            FaceManager.enabled = false;
            ARCameraManager.requestedFacingDirection = CameraFacingDirection.World;
            ARSession.requestedTrackingMode = TrackingMode.PositionAndRotation;
        }

        ARSession.enabled = true;
        yield break;
    }

But when using your plugin, it seems to only show the user-facing camera, and the flip camera button doesn’t work.

I guess my question is, how does your plugin determine which camera and does it “listen” for changes to requestedFacingDirection?

[takahiro_unity]

Does this asset support body tracking?