mozilla/DeepSpeech

CC PMF importer improvements

Open

#3,450 opened on Dec 2, 2020

View on GitHub
 (2 comments) (0 reactions) (0 assignees)C++ (26,755 stars) (4,093 forks)batch import
good first bughelp wanted

Description

The current code does not work well:

  • extraction fails because Python zip does not support multiarchive, we should rely on 7z for example
  • we should expose MIN_SECS / MAX_SECS to the command-line arguments
  • document ffmpeg dependency for audio conversion
  • we use multiprocess for performing one WAV split, but maybe we should also use multiprocess for converting multiple MP3 to WAV in paralell

Contributor guide

Tech stack
python
Domain
datamachine learningtooling
Issue type
feature
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
3
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
1-2 days
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
stale
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
clear
Prerequisites
Pythonbasic understanding of audio processing
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
40
Research direction
The issue involves improving the Common Voice dataset importer. First, review the current extraction logic and replace Python's zip with 7z to handle multi archive files. Then, add command line arguments for MIN SECS and MAX SECS to allow user configuration. Document the ffmpeg dependency needed for audio conversion. Finally, explore using multiprocessing to parallelize MP3 to WAV conversion. Check the repository's importer module for existing code.
CC PMF importer improvements · mozilla/DeepSpeech#3450 | Good First Issue