A table tennis game.

I’m doing a table tennis game, but there is some trouble about the physics. It puzzles a lot. It is about the control of the racket.
The racket is of course controlled by the player, and the player could move it very fast. So the ball sometimes will go through the racket easily. And the ray cast does not help at all since the racket is a moving object. I thought the ray cast can only help to detect collision when a moving object collides with a non-moving object.
And then I increase the extents of the colliders of both the ball and the racket, now they look very large, but the ball still go through the racket sometimes.
I also tried use Rigidbody.MovePosition() to move the racket, it still happens. And there comes a weird problem. When I use Rigidbody.MovePosition() to move the racket, with the limitation of a max speed that I also used when I use Transform.Translate() to move the racket. It looks normal in the engine, but when I build it to a .exe file, the racket moves extremely slow.

Now I’m depressed. I want to know is there any one ever uses unity to build a game like this: a player-controlled object hits a physics-controlled object. It’s so hard.
If you have tried about this, some advices please.

I have the same issue. I wanna make a pinball-like game and in pinball games ball moves very quickly. So in my tests ball moves through the obstacles when the speed is high. Actually not VERY high, just high enough… not extremely. Obstacles using Box Colliders and ball using Sphere Collider. Setting Collision Detection to Continuous doesn’t help. Does anybody know what to do with this?

And another question. If i make the ball about 0.1 units (1 unit = 1 meter ?) it doesn’t calculate collision good. Ball will sink a little in to the floor and other obstacles. Good collision starts if a Ball will be approx 0.5 units and above (tried with box - same stuff). Cause of this i’ve made a table about 100 units and a ball 1 unit wide. So is that situation okey? i mean not correct physics with small objects. So what is workaround?
Can you help me please?