GPT-Live: expose a delegate-only mode where the model speaks only appended commentary
Maintainers usually reply within 1 day
Nobody has claimed this yet.
Assessment
- Difficulty
- 5/5
- Estimated time
- Over a week
- Newbie friendliness
- 35/100
Research direction
Read the GPTLiveModel delegation implementation and session option handling, starting from the delegation events and append_commentary paths; the payload does not name source files or tests. First establish whether existing response or turn settings support commentary-only speech, then determine how a new OpenAI option could pass through the plugin. Done means documenting the supported setting or exposing the requested pass-through; the issue depends on an OpenAI capability that may not exist yet.
Written by the indexing model from the issue text.
Description
Use case. Phone workflows on GPTLiveModel with delegation="client", where the application decides every spoken sentence. We want the model to hear the caller and report turns, but speak only what we pass to append_commentary.
Measured behaviour (livekit-agents 1.8.8, livekit-plugins-openai 1.8.8, openai 3.35.1). With input unmuted, 16 instrumented probe runs: the model sometimes answered every caller clip unprompted, and otherwise produced short acknowledgements ("Hi there.", "Okay."). Client-side interruption keeps unasked audio at 0 s but cannot stop the model from trying.
What the SDK exposes today.
delegation="client", thedelegation_createdevent, andappend_commentary.mute_input, whose docstring says the model keeps generating and speaking.
Muting input is therefore not a way to silence the model. We have to mute the session and run a separate STT listener to hear the caller. That costs a second transcription vendor.
Ask.
- Is there any existing knob (session option, response config,
turn_detectionorcreate_responsesetting) that makes the model silent unless commentary is appended? We may have missed one. - OpenAI's delegation guide documents no such mode today. I am filing a matching request with OpenAI: a delegate-only option such as
delegation: {type: "client", speak: "commentary_only"}. If they add it, can the plugin pass it through (for example viaGPTLiveModel(...)session options, or a raw-session-update escape hatch) without waiting for a new SDK release?
Related: #7551 and #7552 touch the same delegation seam.
- Dominant language
- Python
- Stars
- 14.6k
- Forks
- 3.9k
- Avg merge
- 3d 20h
- Merged PRs (30d)
- 193
Getting set up
This project ships no dev container, Dockerfile or contributing guide, so setting up is up to you: start from its README, and see our first-contribution guide for the general steps.
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from livekit/agents
-
Assistant markup is stripped from chat history when expressive mode is offPossibly taken @ShivamSharma43 claimed this 14 days ago. Open
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
Maintainers usually reply within 1 day
-
docs: openai.LLM vs openai.responses.LLM for HTTP OpenAI-compat hostsMay be free again @AbarnaaSree claimed this 54 days ago, and no pull request is open. Open
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
livekit/agents#7022 · 1 comment ·
Maintainers usually reply within 1 day
-
Difficulty 3/5 1-2 days Newbie friendliness 55/100
Maintainers usually reply within 1 day
-
Soniox and simplismart STT detect a dead websocket and reconnect into it forever instead of failing overPossibly taken A pull request linked to this issue is open or already merged. Open
Difficulty 4/5 3-5 days Newbie friendliness 35/100
livekit/agents#8031 · 1 comment ·
Maintainers usually reply within 1 day
-
Agent stays "speaking" forever when the avatar participant leaves mid-replyPossibly taken @regalmoix claimed this 1 day ago. Open
Difficulty 4/5 3-5 days Newbie friendliness 54/100
Maintainers usually reply within 1 day
Similar issues
-
resource-submission validation-passed
Difficulty 1/5 Under an hour Newbie friendliness 88/100
hesreallyhim/awesome-claude-code#3214 · 1 comment ·
Maintainers usually reply within 1 day
-
room-commons replace accepts an empty old string and silently prepends the new text to the pageOpen
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
Maintainers usually reply within 1 day
-
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
doobidoo/mcp-memory-service#1650 ·
Maintainers usually reply within 1 day
-
Difficulty 1/5 1-3 hours Newbie friendliness 82/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 76/100
ml-explore/mlx-lm#2002 ·
Maintainers usually reply within 2 days