Audio Guided Lipsync - joyVASA Models
Nobody has claimed this yet.
Assessment
- Difficulty
- 5/5
- Estimated time
- Over a week
- Newbie friendliness
- 25/100
- Issue type
- Feature
- Clarity
- Mostly clear
- Activity status
- Stale
- Tech stack
- python
- Domain
- audio-video-rtc, machine-learning, tooling
Research direction
Start by reviewing the existing FasterLivePortrait integration in ComfyUI-FasterLivePortrait and its current standard workflow. Then determine how the requested joyVASA model and audio-plus-static-image inputs fit into new ComfyUI node(s). Done means a working workflow that produces lipsynced video without webcam input, matching the requested behavior.
Written by the indexing model from the issue text.
Description
Use existing FasterLivePortrait and add a new node(s) to ComfyUI-FasterLivePortrait and create a workflow which takes audio input and a static image, similar to current "standard" FasterLivePortrait without webcam input.
- Dominant language
- Python
- Stars
- 26
- Forks
- 7
- PR merge metrics
- No merged PRs in 30d
Getting set up
This project ships no dev container, Dockerfile or contributing guide, so setting up is up to you: start from its README, and see our first-contribution guide for the general steps.
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from livepeer/ComfyUI-Stream-Pack
-
Difficulty 5/5 Over a week Newbie friendliness 20/100
livepeer/ComfyUI-Stream-Pack#39 · 1 comment ·
-
POC Dynamic LorasOpen
Difficulty 5/5 Over a week Newbie friendliness 25/100
livepeer/ComfyUI-Stream-Pack#38 · 1 comment ·
-
Difficulty 3/5 1-2 days Newbie friendliness 30/100
livepeer/ComfyUI-Stream-Pack#36 · 1 comment ·
-
Difficulty 5/5 Over a week Newbie friendliness 15/100
livepeer/ComfyUI-Stream-Pack#33 · 1 comment ·
-
Difficulty 5/5 Over a week Newbie friendliness 20/100
livepeer/ComfyUI-Stream-Pack#32 · 1 comment ·
All issues in livepeer/ComfyUI-Stream-Pack
Similar issues
-
Difficulty 2/5 1-3 hours Newbie friendliness 65/100
NVIDIA/flare-local-inference#90 ·
Maintainers usually reply within 1 day
-
area/streaming comp/gateway P2 platform/telegram type/bug
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
NousResearch/hermes-agent#144897 ·
Maintainers usually reply within 1 day
-
request-theme
Difficulty 1/5 Under an hour Newbie friendliness 66/100
LizardByte/ThemerrDB#9575 ·
Maintainers usually reply within 1 day
-
author-page correction
Difficulty 2/5 1-3 hours Newbie friendliness 62/100
acl-org/acl-anthology#10599 · 1 comment ·
Maintainers usually reply within 1 day
-
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
zilliztech/memsearch#818 ·
Maintainers usually reply within 1 day