ECS - Unity Physics - Pushing up objects at start

Hello
I have a problem using ECS Physics. When my scene boots i manually create some physics objects but they seem to suffer from some starting issues (they look like they fall slightly below height 0 and collide with the plane and then get pushed up again).

My imression is somehow the gravity code pushes it down a little and then the collision system pushes it up again.

Any ideas how this should be handled?