Is there a way to force a upgrade on play store?

.

Yes, you could use Remote Config https://unity.com/remote-config .

Correct you would need to release a new build for this to work. I’m not familiar with a way to force updates for an existing app. They should get notified via Google Play that there is a new version available however.