We’re excited to announce the release of a number of improvements to the experimentation workflows in Remote Config & Game Overrides enabled by Unity Analytics. With these improvements, you can now:
Configure an experiment and estimate the sample size
Game Overrides can now be set up as experiments. Experiments provide more guidance to help you create more effective tests and make data-driven decisions to improve player experiences.
Check the progress of an experiment
Whilst an experiment is running and collecting data, we’ll let you know how far along it is. Once the required sample size has been reached for all variants and at least 7 days have passed you can load up the results.
View the results
Alongside the regular operational metrics, you can now see a number of new statistical significance indicators. These can be used to build confidence that your goal metric is seeing a measurable difference as a result of the test as opposed to just changing by random chance.
Experimentation requires a Unity Analytics subscription. If you aren’t a Unity Analytics customer, you can learn more about pricing here.
Learn more about experimentation by visiting the getting started page in the docs, the FAQ or setting up a new Game Override to check it out. If you have any questions or feature requests - let us know by posting below! We look forward to making further improvements in this area and your feedback - good or bad - is greatly appreciated.
Happy experimenting,
The Unity Player Engagement Team