World space canvas child of gameObject

I’m making a game for VR and I have a world space canvas to show the user’s hp on their controller. The problem is when I make the canvas a child of the controller object, the canvas doesn’t appear to stay in the same localposition when I move the controller. When I move the controller fast, it appears that in the acceleration the canvas position isn’t updated fast enough.

I also tried giving the canvas a rigidbody and connecting it to the controller with a fixed joint, but same problem.

Am I missing something a to why the world space canvas had this weird behaviour?

Awnser:
It is a bug in that will be fixed in Unity 5.5.
Issue tracker: Unity Issue Tracker - [VR] Canvas should not lag behind when attached to a spatially tracked object