Hacktoberfest 2026: le issue che i maintainer hanno segnato per ottobre, aperte e adatte ai principianti. Sfoglia le issue Hacktoberfest

Alignment-based suggestions from a major-language model text

Aperta
  • Qualcosa non va?
#218 1 commento 0 reazioni 0 assegnatari Vedi su GitHub

I maintainer di solito rispondono entro 1 giorno

Nessuno ha ancora preso questa issue.

Valutazione

Difficoltà
5/5
Tempo stimato
Più di una settimana
Idoneità per principianti
25/100
Tipo di issue
Funzionalità
Chiarezza
Da chiarire
Stato di attività
Attiva
Stack tecnologico
typescript
Ambito
data

Direzione di ricerca

Inizia leggendo #148 e risolvendo la decisione di allineamento A/B/C, quindi esamina deriveTokenSuggestion e il flusso modelProjectId che introduce. Ispeziona manifest.json, projectStorage.updateAnalysis, AlignmentLink e l’impostazione interlinearizer.useModelSuggestions; il lavoro è completato quando le parole del modello allineate producono suggerimenti con badge del modello e sono state concordate una strategia di persistenza e una sequenza delle dipendenze.

Scritto dal modello di indicizzazione a partire dal testo della issue.

Descrizione

Split out of #148 (2026-08-12). #148 now covers the surface-form tier — a sibling interlinear project whose approved glosses match the source by surface form — which is ready to build. This issue covers the other kind of model source, which is not.

A major-language Scripture project (e.g. an English Bible) whose words are the gloss vocabulary. It is in a different language from the source, so surface-form matching does not apply: suggestions come from source↔model word alignment — source word → aligned model word(s) → suggested gloss.

Required for full PT9 interlinearization support (Options 1 & 3), which is a stated goal, so this is on the PT9 parity path even though #150's import pipeline does not depend on it.

The decision that gates this

#148 left the approach open, and it has not been answered. It should be settled before any code is written, because the three answers have completely different costs and completely different dependencies.

A. Seed from imported PT9 cluster→gloss data. PT9 already recorded which source word maps to which gloss; reuse that as the alignment. No aligner, no binaries, no licensing question.
Cost: low. But it inverts a dependency — the alignment data comes from #150's import, so this route makes this issue depend on #150, rather than the other way round. Note #150 originally listed #148 as one of its dependencies; that edge was removed on 2026-08-12 because #150's pipeline does not need it. Choosing A would mean adding #218 blocked by #150.
Also: only covers text PT9 already aligned. A project with no PT9 import gets nothing.

B. Compute alignment with fast_align. Apache-2.0, so no license conflict. Still needs per-platform binaries built and shipped, and the createProcess elevated privilege.

C. Compute alignment with eflomal. #102 investigated this in depth and its assessment applies only to this branch. Two blockers it identifies are organizational rather than code, and neither is resolved or separately tracked:

  • GPLv3 (eflomal) vs MIT (this extension) — redistribution "needs legal/licensing sign-off from SIL."
  • Per-platform binary build/ship infrastructure — win32/linux/darwin with OpenMP, and the stock Makefile's -march=native must be dropped for a portable baseline or the binary may fault on other CPUs.

Options B and C additionally require adding "createProcess" to the currently-empty elevatedPrivileges array in manifest.json — the extension spawns no subprocesses today, so this would be the first.

Scope once the approach is settled

  • Resolve modelProjectId (added by #148) pointing at a non-interlinear Scripture project to the alignment strategy rather than the pool.
  • The alignment step itself, per the chosen option.
  • Feed aligned model words into deriveTokenSuggestion as candidates, reusing the producer: "model:{id}" marker #148 introduces so SuggestionDropdown badges them "from model".
  • Respect the interlinearizer.useModelSuggestions setting from #148.

Persistence is a separate open question

#148 noted alignments "could be persisted via AlignmentLink". Two things to know before choosing that:

  • projectStorage.updateAnalysis writes only the analysis field, not links — there is no persistence path for alignment links at all today.
  • #129 (Burrito alignment specification) observes that AlignmentLink is currently dead weight, so the cost of adopting or mapping to the Burrito flavor "is near zero today and grows with every feature that touches alignment," and recommends doing that investigation before alignment work is scheduled. If this issue persists via AlignmentLink, #129 should be answered first.

Computing alignment on demand and not persisting it sidesteps both.

Open questions

  • Which approach — A, B, or C? Everything else follows.
  • Persist via AlignmentLink, or recompute? See above; if persisting, sequence #129 first.
  • Alignment granularity and quality. #102 notes an aligner "needs reasonable sentence counts to align well; single-verse alignment in isolation may be weak" — so whole-book or corpus-trained priors may be necessary, which affects whether this is a batch or on-demand operation.

Blocked by: #148 (introduces modelProjectId, the model tier in deriveTokenSuggestion, and the producer marker).
Related: #150, #102, #129, #94.

Size: L
Priority: P2 — prerequisite for full PT9 import parity; not blocking gloss-only use or #150's pipeline.

Lingua principale
TypeScript
Stelle
2
Fork
0
Merge medio
2g 5h
PR unite (30g)
47

Preparare l'ambiente

Questo progetto non fornisce container di sviluppo, Dockerfile né guida per i contributori, quindi l'ambiente è a tuo carico: parti dal suo README e consulta la nostra guida al primo contributo per i passaggi generali.

Come iniziare

  1. Leggi tutta la issue e poi la guida ai contributi del progetto.
  2. Commenta sulla issue per dire che te ne occupi tu — evita che due persone facciano lo stesso lavoro.
  3. Fai un fork del repository e lavora su un branch.
  4. Apri una pull request che faccia riferimento al numero della issue.

Altre issue di sillsdev/interlinearizer-extension

Tutte le issue di sillsdev/interlinearizer-extension

Issue simili

Altre issue su TypeScript

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.