Hacktoberfest 2026: los issues que los mantenedores marcaron para octubre, abiertos y aptos para principiantes. Explorar issues de Hacktoberfest

Treat low-evidence candidate speech as unassessed

Abierto
  • ¿Algo no está bien?
#553 0 comentarios 0 reacciones 0 asignados Ver en GitHub

Los mantenedores suelen responder en 1 día

Nadie ha tomado este issue todavía.

Evaluación

Dificultad
5/5
Tiempo estimado
Más de una semana
Aptitud para principiantes
35/100
Tipo de issue
Nueva funcionalidad
Claridad
Bastante claro
Estado de actividad
Activo
Stack tecnológico
rust
Área
backend

Línea de trabajo

Read PR #423 and follow-up issues #123 and #553 to understand the existing communication eligibility flow. Locate where candidate turns determine assessment eligibility and review how transcript data is recorded and used. Agree on a deterministic evidence threshold before implementation; done means the listed transcript cases leave communication unassessed when evidence is insufficient, with coverage for each case.

Escrito por el modelo de indexación a partir del texto del issue.

Descripción

Background

PR #423 fixed the zero-candidate-turn case by leaving communication
unassessed when no candidate speech was recorded.

(guys can check out pr#423 first before fixing this issue)

However, the current assessment eligibility is still mainly determined by
whether at least one candidate turn exists. A transcript segment containing
a cough, background noise, a filler word, or a stray ASR result may therefore
enable communication scoring even when there is not enough meaningful
evidence to evaluate the candidate.

This is a follow-up to #123 and #423.

Current behavior

A session may be treated as communication-assessable as soon as one
candidate turn is recorded.

For example, the following may potentially count as evidence:

  • A cough or background noise transcribed as text
  • Filler-only speech such as "uh" or "um"
  • A short acknowledgement such as "yes"
  • A stray or malformed ASR transcript
  • Interviewer audio captured again through microphone echo

This may cause the report to generate a communication score and strengths
that are not supported by meaningful candidate speech.

Expected behavior

Communication should only be assessed when the transcript contains enough
meaningful candidate speech to support a reliable evaluation.

Sessions should distinguish between at least these states:

  • No candidate speech captured
  • Candidate speech captured, but evidence is insufficient
  • Sufficient evidence for communication assessment

For the first two states:

  • communicationScore should remain null
  • Communication should be displayed as unassessed
  • Communication strengths should not be invented
  • Coding activity, test runs, and code comments should not be treated as
    spoken communication

Proposed direction

Introduce a deterministic communication-evidence classification instead of
using only candidate_turns > 0.

The exact threshold should be discussed before implementation. Possible
signals include:

  • The number of substantive candidate turns
  • The amount of meaningful transcript content
  • Filtering filler-only and noise-like transcripts
  • Speaker attribution and ASR confidence, when available

The implementation should avoid relying on a model alone to decide whether
the available evidence is sufficient.

Validation

Add coverage for:

  • Zero candidate turns
  • Noise-only or cough-like transcripts
  • Filler-only speech
  • A single short acknowledgement
  • One substantive explanation
  • Multiple meaningful candidate responses
  • Mixed noise and meaningful speech
  • Empty or malformed ASR results
  • Interviewer echo incorrectly captured as candidate speech

Out of scope

This issue does not require implementing general-purpose audio denoising or
speaker recognition. Its scope is deciding whether the recorded transcript
contains enough reliable candidate evidence for communication assessment.

Lenguaje dominante
Rust
Estrellas
215
Forks
141
Merge medio
1 d 12 h
PR fusionados (30 d)
228

Preparar el entorno

Primeros pasos

  1. Lee el issue completo y luego la guía de contribución del proyecto.
  2. Comenta en el issue que vas a ocuparte — evita que dos personas hagan lo mismo.
  3. Haz un fork del repositorio y trabaja en una rama.
  4. Abre un pull request que haga referencia al número del issue.

Más de sysprog21/codetrial

Todos los issues de sysprog21/codetrial

Issues similares

Más issues de Rust

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.