Humanoid bone parsing

snacktime · March 1, 2020, 12:13pm

I don’t want to get too much into detail but with the new DOTS animation stuff a couple of utilities would really be helpful.

Utility method that takes an array of bones and returns a HumanDescription or error.
A Utility that extracts a generic animation from a humanoid model.

Alternatively, some way to automate converting a humanoid model to generic would suffice for both of the above.

The flow I want is to start with an animation on a humanoid model and be able to automate the processing and data creation that DOTS needs with a single click. But I can’t figure out a way. Like I need a bone mapping of source to destination bones, but the only reliable way I know of is map between their HumanDescription. But then DOTS wants generic animations. So it all gets way more complex then it really needs to be without these additional tools. Or it could be I’m just missing some existing tools or api’s.

anon49125583 · March 3, 2020, 5:53pm

@snacktime
Hi, we didn’t put any effort into converting a humanoid rig to DOTS, and this is not planned for short term.

The easiest way would be to convert your imported animation from humanoid rig to generic rig.

If you are looking for a way to retarget your animation in dots animation we do have the RigRemapper which allow you to retarget your animation from one rig to another one. In the image below the yellow skeleton is retargeted on Ellen.

This samples is part of the Dots animation sample project and is called Retarget

https://github.com/Unity-Technologies/Unity.Animation.Samples/tree/master/UnityAnimationHDRPExamples/Assets/Scenes/Examples/Retarget

snacktime · March 3, 2020, 8:48pm

Right I started with those samples. I’m using humanoid avatars and HumanDescription to auto generate the bone mappings that RigRemapQuery needs.

I think starting with humanoid makes more sense even in the context of a specific game. Leveraging HumanDescription is just one example. Like if you want to be able to use third party animations which is the whole point of retargeting, you also have to solve for things like converting relaxed to strict tpose. And again being in humanoid form the existing utilities can help you out there.

Radivarig · August 28, 2021, 8:24am

Any news on this?

CybeRock · September 3, 2021, 5:54pm

hi,

anyone care to elaborate more or share some experience retargeting animations in Unity DOTS Animation Package?

andreiagmu · September 26, 2021, 9:54am

That “Retarget Sample” Mecanim-Dev mentioned is now called “Animation Rig Remap Sample”.
It shows 3 possible ways to remap an animation from a source rig to another destination rig.

github.com

Unity-Technologies/Unity.Animation.Samples/blob/master/UnityAnimationHDRPExamples/Assets/Scenes/Advanced/AnimationRigRemap/README.md

# Animation Rig Remap Sample

This sample demonstrates different ways to remap a source animation from a character rig to another destination rig.

## What does it show?

This sample demonstrates 3 different ways to perform animation remapping:
1) `EllenRig_MocapRetarget` demonstrates how to retarget source animation to another character with different proportions using a **Unity.Animation.RigRemapQuery** and **Unity.Animation.RigRemapTable** with offsets. Offsets are needed to retarget the source animation on the destination character because rotation axes may differ.
2) `TerraformerLOD0_LOD1BindingRemap` demonstrate usage of **Unity.Animation.RigRemapUtils.CreateRemapTable** to automatically build a remapping table based on existing **Unity.Animation.RigDefinition** bindings. This is useful when skeleton hierarchies are similar (ie. LOD setups).
    This example showcases remapping animation from a lower to higher resolution skeleton definition.
3) `HandRigLOD0_SubRigPartRemap` demonstrate usage of **Unity.Animation.Hybrid.RigRemapUtils.CreateRemapTable** to automatically build a remapping table based on existing **Unity.Animation.Hybrid.RigComponent** properties. In this example we show how to remap a sub part of a hierarchy to a hand rig.
    Given that the hierarchies are very different in this case, we use a name based matching strategy. Finally as we are remapping to a specific sub part we override the hand transform offsets to perform operations in LocalToRoot space instead of LocalToParent space to displace to hand rig at the wanted reference frame.

----
## Converting from GameObject to Entity prefab

This samples contains a subscene with the 3 different setups each of which have different conversion components:
1) **RetargetComponent** which builds a very simple text based remapping table to create it's **RigRemapQuery**. For example, `Hips Ellen_Hips TR` means that the bone named `Hips` on the source rig is mapped to the `Ellen_Hips` bone on the destination rig in `Translation` and `Rotation`.
2) **MatchBindingsComponent** takes in a source rig prefab to generate it's remapping table from the **RigDefintion** bindings.
3) **RemapSubRigPartComponent** takes in a source rig prefab and a transform to remap in LocalToRoot space.

This file has been truncated. show original

andreiagmu · September 30, 2021, 8:15am

Hi! I managed to do retargeting animations in DOTS.
I’m just finishing a few more tests on that system, then I’ll share instructions on how to achieve that retargeting.

https://www.youtube.com/watch?v=mPR-8_7et8M

andreiagmu · October 6, 2021, 11:06am

@CybeRock Here’s the animation system that I use, with retargeting support and instructions.