Add support for multiple audio streams

Open
#176 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Assessment

Difficulty
4/5
Estimated time
3-5 days
Newbie friendliness
35/100
Issue type
Feature
Clarity
Mostly clear
Activity status
Stale
Tech stack
cpp
Domain
audio-video-rtc, desktop

Research direction

Start by locating the WinRT media setup that creates the MSS and adds AudioStreamDescriptor instances. Trace how MediaPlayerElement exposes stream selection and where SwitchStreamsRequested can control decoding. Done means multiple named or language-tagged streams are selectable and only selected streams are decoded.

Written by the indexing model from the issue text.

Description

The WinRT side does support multiple audio streams (I think since creators update) and we could make use of that in this project as well. We just need to add more than one AudioStreamDescriptor to the MSS (and maybe give them some reasonable names and assign language tags), then the MediaPlayerElement should automatically show a UI to allow stream selection. Additionally, we'd need to listen to SwitchStreamsRequested, so we only decode those streams that are actually in use.

Has someone already investigated this?

Dominant language
C++
Stars
1.4k
Forks
319
No merged PRs in 30d

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from microsoft/FFmpegInterop

All issues in microsoft/FFmpegInterop

Similar issues

More C++ issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.