sign/translate

[Feature] Continuous Translation

Open

#131 opened on Jan 22, 2024

View on GitHubContributor guide
 (0 comments) (0 reactions) (0 assignees)TypeScript (164 forks)auto 404
enhancementhelp wantedspoken-to-signed

Repository metrics

Stars
 (777 stars)
PR merge metrics
 (PR metrics pending)

Description

Problem

Our interface currently only allows for single turn translation, where for example a user can input text, then we perform the translation of the entire text.

Description

For spoken-to-signed, we can allow a "continuous mode", perhaps looking like this https://codepen.io/abnersn/pen/ExVwoWB image

This would allow continuous speech, and using the browser's native sentence segmentation we could translate one sentence at a time and stitch the sentences together in the client

Alternatives

Wait until everything is spoken, then translate.

Additional context

No response

Contributor guide

Research direction
Implement a continuous translation mode using the browser's native Intl.Segmenter for sentence segmentation. Modify the existing single turn translation to process speech input continuously, segment sentences, and translate each sentence sequentially, stitching the results in the client.
Tech stack
typescript
Domain
frontend
Issue type
Feature
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
3
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
1-2 days
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
Fresh
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
Clear
Prerequisites
JavaScriptBrowser APIs
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
70