(Case 1031299) Performance regression

When I was running a performance test of my actual game, I observed Unity 2018.2.0b1 seems to be slower than 2018.1, see this thread .

I was able to reproduce this performance regression in a mini-example, which is attached to the bug-report Case 1031299. The provided example project runs about 0.8 ms slower on my PC, when built with 2018.2.0b1.

  • 2018.2.0b1 - 6.0 ms by average
  • 2018.1.0b11 - 5.2 ms by average

I was using the Profiler first, but the performance is too unstable and it was too difficult to see the regression by just looking at the bars in the profiler for me. The average performance of the last second on the other hand makes it a lot easier to see that 2018.2 is slower.

Video

Reproduce

  • Open user attached project in 2018.1.0b11
  • Build a Windows 64 Bit Standalone Player
  • Run Player
  • Write down the average milliseconds in the top left corner

Repeat these steps with Unity 2018.2.0b1 and observe 2018.2.0b1 is slower.

Expected
Newer Unity versions should not run slower.

7 Likes

Unity Technologies was able to reproduce the regression, which can be found in the public issue tracker now:

Good job and thank you, QA!

I’ve been keeping an eye on the “known issue” listed in the release notes of 2018 b11. This performance drop issue is listed there. However, it suddenly changed to “Not Reproducible” - which I don’t understand. Just open any project, upgrade to 2018.2 (b10 in my case), and boom… the frame rate drops by a significant amount. See here:

3 Likes

I measured 2018.2.0f1 performance with my project and 2018.2.0f1 continues to run slower than 2018.1:
https://discussions.unity.com/t/699049/8

1 Like