The scale of everything in the world is important. By default, it kind of works if you assume 1 unity unity = 1 meter. If you're much larger or smaller than that, you'll run into issues.
Depending on what effect you're trying to get, you might wanna use ForceMode.Impulse. It works nicely when you wanna get a projectile moving or just knocking rigidbodies around.
Check whether you have changed your "Drag" value for the rigidbody. If you turn this value to high, objects have a higher air resistance - they fall slower, they need more force to move etc.