Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

VRM1: Missing first thumb bone in the generated IK Rigs' Retarget Chains #437

Open
andreiagmu opened this issue Nov 6, 2024 · 3 comments

Comments

@andreiagmu
Copy link

andreiagmu commented Nov 6, 2024

Unreal Engine v5.4.4
VRM4U v20241007

Describe the bug
After importing a VRM1 avatar, I noticed that in all of the generated IK Rigs (Mannequin, MannequinBone, VrmHumanoid, UEFN), the first thumb bone (on both thumbs) isn't part of the thumbs' Retarget Chains.
In VRM0, the first thumb bone is included in the thumbs' Retarget Chains, in all of the generated IK Rigs.

Is there any reason for this change in VRM1?
Based on my animation retargeting experiments, the retargeted thumbs look unnatural when the first thumb bone is excluded from the retargeting.
After I add it again to the Retarget Chains (just like in VRM0), the thumbs look more natural in the retargeted animations.

VRM0 IK Retargeter

capture_20241105_214108_018_edit

VRM1 IK Retargeter

capture_20241105_214130_019_edit

VRM0 IK Rig (Mannequin)

capture_20241105_214245_020_edit

VRM1 IK Rig (Mannequin)

capture_20241105_214250_021_edit

@andreiagmu
Copy link
Author

andreiagmu commented Nov 6, 2024

Here are screenshots of some retargeted animations.

On each screenshot pair, the first image has the first thumb bone excluded from the Retarget Chain (the current behavior from VRM1 import), and the second image has the bone added again to the Retarget Chain (just like in VRM0 import).

In my opinion, the thumbs look more natural when the first thumb bone is added back to the retargeting process.
It's very noticeable in the last animation I display here (Anim_KA_Idle08_ComeUpWithAnIdea, from Kawaii Animations 100).


Reference pose - from the VRM4U IK Retargeter (generated on avatar import)

capture_20241105_235839_025

capture_20241105_235912_026


MF_Idle - from UE5 Third-Person Template
(ignore the thumb clipping into the clothes)

capture_20241106_000312_027

capture_20241106_000338_028


MM_Walk_InPlace - from UE5 Third-Person Template

capture_20241106_000433_029

capture_20241106_000500_031


Anim_KA_Idle08_ComeUpWithAnIdea - from Kawaii Animations 100
(when the first thumb bone is excluded from the Retarget Chain, the retargeted thumb goes to the avatar's mouth)

capture_20241106_001125_034

capture_20241106_001150_036

capture_20241106_001222_037

capture_20241106_001237_038

@ruyo
Copy link
Owner

ruyo commented Nov 7, 2024

Hi.
Thanks for the report. This will be fixed in the next release.

@andreiagmu
Copy link
Author

The thumb bone Retarget Chains have been fixed in the IK_avatarName_Mannequin and IK_UEFN_avatarName_Mannequin IK Rigs, thanks!

But the IK_avatarName_MannequinBone and IK_avatarName_VrmHumanoid IK Rigs are still inconsistent with their VRM0 equivalents.


In the following screenshot pairs, the first image shows the VRM0 IK Rig, and the second image shows the VRM1 IK Rig.


IK_avatarName_MannequinBone

capture_20241111_220603_001_edit

capture_20241111_220607_002_edit


IK_avatarName_VrmHumanoid

capture_20241111_220610_003_edit

capture_20241111_220613_004_edit

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants