sign/translate

[Feature] Add rule based 3D avatar control

开放

#121 创建于 2023年11月26日

 (0 条评论) (0 个反应) (0 位负责人)TypeScript (164 个派生)auto 404
enhancementhelp wantedspoken-to-signed

仓库指标

星标
 (777 个星标)
PR 合并指标
 (PR 指标待抓取)

描述

Problem

Our 3D avatar control can currently only control Mixamo avatars, and does so very poorly. Controlling more general avatars (especially with faces) is necessary.

Description

We should add a rule-based 3D avatar solver such as https://github.com/yeemachine/kalidokit to be solve the avatar positions from the mediapipe poses directly.

Alternatives

Neural-network only approach. This will require training a better avatar model.

贡献者指南