An A/B test is a controlled experiment that exposes different groups of players to variations of some aspect of your game.
A/B Testing uses the Remote Settings system that is built into Unity so you can create new experiments and make changes based on the results of those experiments, all without creating a new build of your game.
You can find the documentation here: