[BUG] FluidMeet: one speaker's segment runs over the other speaker's replies
Maintainers usually reply within 1 day
Nobody has claimed this yet.
Assessment
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Newbie friendliness
- 22/100
- Issue type
- Bug
- Clarity
- Mostly clear
- Activity status
- Active
- Tech stack
- macos, swift
- Domain
- audio-video-rtc
Research direction
Start with the session.json for this meeting and check the 1:57 to 2:15 segment against the other speaker's audio track to see where segment boundaries are set. Then find where the transcript is split and where attributionState is assigned, which is probably where the diarization output meets the two tracks. Done means a segment breaks when the other speaker starts and the short unassigned fragments get a speaker. This is speaker-diarization pipeline work, so it needs maintainer guidance before you start.
Written by the indexing model from the issue text.
Description
FluidMeet puts long stretches of one person's speech into a single segment, even while the other person answers in the middle, so the transcript reads out of order.
Here's the first minute of a 38-minute Google Meet call, with times from session.json. I've replaced my own answers with placeholders:
- 1:57 to 2:15, other person (one segment): "Oh, yeah. Thank you. Where are you based? Here in the US? Oh, I don't hear that every How long have you been Oh, wow. What made you move over"
- 2:04, me: [answer to "Where are you based?"]
- 2:10 to 2:21, me: [answer to "How long have you been there?"]
Read in order, the other person asks four questions in a row and then I give all my answers. In the actual call we went back and forth.
Across the whole call:
- 48 of 323 segments run right over a complete segment from the other person's audio track. Every segment is marked
"overlap": "none", including those 48. - 99 segments (about 100 words, mostly one word each, like "uh," and "Meet.") have no speaker assigned (
attributionState: unassigned).
I expected segments to split when the other person starts talking, so the transcript keeps the back-and-forth, and short fragments to go to the speaker on that audio track.
Setup: FluidVoice 1.6.12-beta.1, macOS 27.0.1, Apple Silicon. Meeting model parakeet-tdt-v2 (backend local-parakeet-tdt-v2-nemotron-3-v1, pipeline version 13), diarization FluidAudio-offline-v1. Two tracks: application audio (Chrome) and microphone (Insta360 Link). Sound out through the MacBook speakers.
- Dominant language
- Swift
- Stars
- 11.9k
- Forks
- 863
- Avg merge
- 1d 14h
- Merged PRs (30d)
- 28
Getting set up
This project ships no dev container, Dockerfile or contributing guide, so setting up is up to you: start from its README, and see our first-contribution guide for the general steps.
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from altic-dev/FluidVoice
-
[BUG] File transcription skips audio chunks shorter than one secondPossibly taken @sabbah13 claimed this today. Open
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
altic-dev/FluidVoice#1161 ·
Maintainers usually reply within 1 day
-
feat: add Nix flake support for one-command installationPossibly taken @levonk claimed this today. Open
Difficulty 4/5 3-5 days Newbie friendliness 35/100
altic-dev/FluidVoice#1159 ·
Maintainers usually reply within 1 day
-
Difficulty 3/5 1-2 days Newbie friendliness 62/100
altic-dev/FluidVoice#1156 ·
Maintainers usually reply within 1 day
-
Difficulty 4/5 3-5 days Newbie friendliness 50/100
altic-dev/FluidVoice#1155 ·
Maintainers usually reply within 1 day
-
Difficulty 4/5 3-5 days Newbie friendliness 18/100
altic-dev/FluidVoice#1153 · 2 comments · 1 reaction ·
Maintainers usually reply within 1 day
All issues in altic-dev/FluidVoice
Similar issues
-
Difficulty 2/5 1-3 hours Newbie friendliness 75/100
Maintainers usually reply within 1 day
-
swift.md: `Date(myString, strategy: .iso8601)` example omits `try` — the initializer is throwingOpen
Difficulty 1/5 Under an hour Newbie friendliness 88/100
-
core: RAC_LLM_OPTIONS_DEFAULT.min_p disagrees with the IDL's annotated defaultPossibly taken A pull request linked to this issue is open or already merged. Openbug core p3
Difficulty 2/5 1-3 hours Newbie friendliness 70/100
RunanywhereAI/runanywhere-sdks#1083 ·
Maintainers usually reply within 5 days
-
bug/fix needs: triage
Difficulty 2/5 1-3 hours Newbie friendliness 70/100
capawesome-team/capacitor-firebase#1054 ·
Maintainers usually reply within 1 day
-
area: docs eco: swift good first issue help wanted lane: free-agent roadmap size: XS type: docs
Difficulty 1/5 Under an hour Newbie friendliness 62/100
arminazimi/evergreen#441 ·
Maintainers usually reply within 1 day