How to restrict my game to Android 5.0 and above?

I set the “Minimum API Level” in the player settings to 21 (lollipop).

After uploading the APK to the google developer console and publishing the app, I can still find, download and play it on my Android 4.3 device.

How can I change this?

Android publishing options has an drop down menu for minimum API LEVEL