soundscape-community/soundscape

Soundscape in the browser

Open

#75 ouverte le 5 déc. 2023

Voir sur GitHub
 (3 commentaires) (0 réactions) (1 assigné)Swift (31 forks)auto 404
Student projecthelp wanted

Métriques du dépôt

Stars
 (43 stars)
Métriques de merge PR
 (Métriques PR en attente)

Description

One avenue to get Soundscape on more platforms is to turn it into a web app, rather than a native app. There have been a slew of Web APIs that have been added over the years that can do lots of things that weren't possible in a browser before.

This is an appealing approach, because we would have a single codebase for all platforms, in a language (JavaScript) that's familiar to more developers. However, there are a few major hurdles that need to be overcome:

  1. Spatial speech. You can generate text-to-speech audio, and also generate positional audio, but these are separate Web APIs. If the API works by just telling an underlying OS service to emit some speech, it might not be possible to apply the appropriate 3D effects on the resulting audio. Some discussion on the lack of integration of these two services: https://github.com/WebAudio/web-audio-api/issues/1764
  2. Location tracking. For privacy reasons, Apple blocks location services for web sites when the device is locked. This would interfere with a main usage mode for Soundscape, running with the device in your pocket.

I'm still inclined to have us start a minimal prototype, that can at least get a user's location while the app is active, fetch the appropriate map tiles, and announce nearby places (even if in non-spatial audio).

Guide contributeur