Hi, please I need your help
I took some real world videos and of a person using some tools in an assembly task. and I am trying to recreate the scene in a virtual environment ( Unity)
for the human, it is all good because i used some body motion tracking tools but for the tools I am stuck, how can I create animations from my objects in unity using videos.
Thank you in advance!
What kind of objects you have?
Are the videos recorded from different directions?
(so in theory you could try to generate photogrammetry/points cloud from it, and then have those objects appear in scene)
Or do you want actual gameobjects, and just adjust position and rotation based on tracking from video?
1 Like
Thank you for answering
I used 3 RGB cameras to capture the scene from different viewpoints. The scene itself involves an assembly activity, and the objects in it are tools like screwdrivers, wrenches, etc. My goal is to animate these tool models in Unity as part of an animation sequence, based on the actions captured in the video.
I am lost, what do you suggest I do that can help me represent this in unity?
I am trying to track the objects in blender than export the fbx to unity ( to create animations for objects) but I am facing some dimension et orientation problems.
if that almost works, its probably just different units (mm vs m) or unity z-vs-y up axis issue?
other options that come to mind,
volumetric capture would allow just displaying those objects… not actual gameobjects:
(from RGB video, you could create depthmap, but maybe not accurate enough for small objects…)