Mike talks about forcing test mode on or off via dashboard, please scroll to 41min 16sec in the video.
Unfortunately,I cannot display my settings in the dashboard currently, so if it happens to be the same for you, then you can ask Unity Ads team to switch it to FORCE OFF for you.
Yes, please contact our support then, to make sure you are showing production and not ads, as this is unfortunately not possible in the new dashboard for Unity 5.2 yet.