Performance Overview

Today I ran the automated performance test of my game with Unity 2018.2.0b1 and present the results below, just like I did before, during older beta cycles:

2018.2.0b1 is slower than 2018.1.0b9, but faster than Unity 2017.x with my project. 2018.2.0b1 performs about 0.7ms slower than 2018.1 in some cases.

I haven’t looked into what exactly is causing this performance difference yet.

How does the performance test work?

The (first-person) game I’m working on features an automated performance test. It works like this:

  • Camera is placed at a defined position in the scene

  • Camera makes a 360 degree rotation around the Y-axis within 20 seconds (slowly rotating around y)

  • Every second the test captures the average CPU frame time of the last second

The game runs just like it would normally do, but the camera/player does not move and the AI in unable to see the player.

It measures the “base-line” of the game so to speak. If an actual gamer plays the game, more things are going to happen, which is missing in the test, such as visual and sound effects when firing weapons, additional AI to hunt the player and more navigation pathing.

I run this test in a Standalone Windows 64bit (Mono) Player. The following Physics settings are applied:

  • Physics.autoSyncTransforms=false

  • Physics.autoSimulate=true

  • Physics2D.autoSyncTransforms=false

  • Physics2D.autoSimulate=false

The y-axis represents the average CPU time in milliseconds, how long “one frame took”. The x-axis represents the sample points while the camera makes its 360° rotation. Each test runs for 20 seconds, one sample every second, thus 20 samples for each test. Fewer milliseconds (vertical axis) indicate better performance.
3469805--275585--all_4_3.png

3469805--275586--all_5_4.png

3469805--275587--all_6_8.png

3 Likes

The following images provide a 2018.x only comparison…

3469806--275588--2018_4_3.png

Raw Numbers 4_3

2018.2.0b1   2018.1.0b9
3.918648   4.012695
3.813885   3.900313
3.779804   3.795971
3.922287   3.709807
4.250995   4.006592
4.578473   4.225333
4.731088   4.351807
4.880133   4.479545
4.801043   4.462891
4.632173   4.358706
4.305729   4.357379
4.117989   4.013672
3.886851   3.73567
3.754462   3.630707
3.710033   3.566973
3.725187   3.571969
3.713424   3.722918
3.798514   3.839369
3.928271   3.988441
3.931622   4.010742

3469806--275589--2018_5_4.png

Raw Numbers 5_4

2018.2.0b1   2018.1.0b9
5.534304   5.130083
5.555885   5.197792
5.665580   5.214056
5.630322   5.230586
5.716378   5.259888
5.628264   5.233765
5.629636   5.204117
5.746373   5.378969
5.710255   5.306506
5.703319   5.285645
5.635808   5.206014
5.556560   5.133213
5.548467   5.163448
5.551839   5.131335
5.494505   5.069001
5.526029   5.093492
5.562337   5.17037
5.576579   5.221049
5.599549   5.157785
5.595458   5.192732

3469806--275590--2018_6_8.png

Raw Numbers 6_8

2018.2.0b1    2018.1.0b9
6.218762    5.59404
6.468152    5.880328
6.625750    6.152416
7.031421    6.363326
6.901989    6.367146
6.911705    6.321643
6.650002    6.180969
6.568659    5.970523
6.455642    5.881382
6.211180    5.717752
6.070224    5.560684
5.907485    5.481709
5.814922    5.362904
5.594776    5.221824
5.462646    5.107677
5.390782    5.097229
5.510602    5.064666
5.581326    5.181723
5.793048    5.321087
5.920771    5.457712
3 Likes

Can you add in the LTS version?

1 Like

I just profiled 2017.4.1f1. It’s pretty similar to the 2017.3.0b6 results. I will include 2017.4 in the overview graphs next time.

Not bad for a first beta.

I’m curious about what you’ll find.

1 Like

Here you go: https://discussions.unity.com/t/699767

Today I repeated the test with Unity 2018.2.0f1 (Release Candidate 1). Unfortunately, 2018.2 continues to be slower than 2018.1 with my project, about 0.5ms by average.

3555931--286200--2018_2_0f1_scene_4_3.png

3555931--286201--2018_2_0f1_scene_5_4.png

3555931--286202--2018_2_0f1_scene_6_8.png

4 Likes