sign/translate

[Feature] Add rule based 3D avatar control

オープン

#121 opened on 2023/11/26

 (0 件のコメント) (0 件のリアクション) (0 人の担当者)TypeScript (164 件のフォーク)auto 404
enhancementhelp wantedspoken-to-signed

Repository metrics

Stars
 (777 個のスター)
PR merge metrics
 (PR metrics pending)

説明

Problem

Our 3D avatar control can currently only control Mixamo avatars, and does so very poorly. Controlling more general avatars (especially with faces) is necessary.

Description

We should add a rule-based 3D avatar solver such as https://github.com/yeemachine/kalidokit to be solve the avatar positions from the mediapipe poses directly.

Alternatives

Neural-network only approach. This will require training a better avatar model.

コントリビューターガイド