Unity Robotics: Closing the Sim2Real Gap with Simulation Pro

Hello everyone, we’re excited to start a new chapter on Unity’s support for Robotics use cases. Starting today, Simulation Pro is available in early access, providing a supported suite of features and capabilities for robotics simulation and training. This package has been built with feedback from Unity’s robotics developers along with lessons learnt from robotics projects using Unity in production. Register your interest here to learn more.

What’s new

Simulation Pro is a new package that consolidates and innovates on previously disparate features and workflows for robotics development across Unity. Specifically, the package includes 4 key capabilities:

  • URDF importer, which enables a drag-and-drop experience for URDF files to be imported directly into Unity

  • Sensor simulation, that helps you simulate Lidar, RGB-D and IMU sensors out of the box in Unity.

  • ROS-2 support, which enables you to communicate with ROS-based hardware directly from Unity.

  • Headless Linux Build Target, which enables you to achieve parallel simulation across any hardware stack that you currently have.

We’ve also developed an in-depth, hands-on 5 hour training program on Unity Academy to help you get started with Simulation Pro. Simulation Pro will be supported for production on Unity 6.3 and newer, and early access is now open to Unity Industry developers.

Unity Robotics Solutions

Beyond Simulation Pro, Unity supports numerous packages that accelerate specific use cases in your robotics and simulation workflows. These include:

  • ML Agents, a pytorch-based toolkit that helps you define agents that observe, act and learn from any Unity scene.

  • Sentis, which helps you bring inference into simulations directly, enabling use cases like object detection, and motion planning.

  • XR Solutions, which enables a range of robotics use cases including teleoperation and human-in-the-loop training.

  • Unity Runtime, which enables you to deploy robotics applications to over 20+ platforms, including web, mobile, desktop and XR.

To learn more about how developers have been leveraging these products and workflows for robotics, check out our blog here.

Get Started Today

You can get started by registering your interest for the early access program today. We look forward to seeing what you’re building with Simulation Pro. For any feedback, please leave your comments and thoughts in this thread.

Resources

2 Likes