Evaluate Localization Accuracy and Timing Under Faults and Overload

Aberta
#765 0 comentários 0 reações 0 responsáveis Ver no GitHub

Mantenedores costumam responder em até 2 dias

Ninguém assumiu esta issue ainda.

Avaliação

Dificuldade
5/5
Tempo estimado
Mais de uma semana
Facilidade para iniciantes
12/100
Tipo de issue
Funcionalidade
Clareza
Precisa de esclarecimento
Status de atividade
Ativa
Stack de tecnologia
rust

Direção de pesquisa

The issue names no source files or tests. Start by locating the M2 instrumentation and the input and overload policy definitions it refers to, then the localization pipeline entry point. Done means fault-free baseline and fault scenario runs that report accuracy, latency, freshness, deadline misses and data loss, with machine-readable results and reproduction commands.

Escrita pelo modelo de indexação a partir do texto da issue.

Descrição

Evaluate the integrated Awkernel localization pipeline under controlled input faults and computational overload. Reuse the M2 instrumentation to quantify localization accuracy, end-to-end latency, input data age, deadline misses, and dropped-data rates, including recovery after abnormal conditions end.

Scope:

  • Establish a fault-free baseline with motion distortion correction enabled
  • Run documented scenarios involving delivery delays, timestamp offsets, message loss, and computational overload
  • Evaluate individual faults and selected combinations using the defined input and overload policies
  • Measure accuracy, latency, freshness, deadline behavior, and data loss throughout each run
  • Analyze recovery behavior and accuracy–timing trade-offs

Acceptance criteria:

  • Each experiment records its dataset, ground-truth source where available, configuration, fault schedule, workload, and policy settings.
  • Position and orientation errors are measured against aligned ground truth; reference-output differences are reported separately.
  • Timing summaries include median, tail percentiles, maximum observed values, and sample counts.
  • Input age is reported per relevant stream; timestamp-offset experiments distinguish apparent age from age derived from the preserved original timeline.
  • Deadline-miss ratios use documented job populations, with unfinished or cancelled jobs accounted for explicitly.
  • Dropped-data rates specify their denominator and distinguish injected loss, buffer overflow, stale-input rejection, and discarded late results without double counting.
  • Missing outputs and prediction-only intervals remain visible rather than being excluded from accuracy and latency summaries.
  • Recovery time and any persistent degradation after fault removal are reported using predefined criteria.
  • Repeated runs quantify variability, and machine-readable results and reproduction commands are retained.

Out of scope:

New instrumentation or fault-injection frameworks, changes to localization algorithms or scheduling policies, and formal safety or worst-case timing guarantees.

Linguagem predominante
Rust
Estrelas
282
Forks
12
Merge médio
2d 9h
PRs com merge (30d)
28

Preparar o ambiente

Este projeto não oferece contêiner de desenvolvimento, Dockerfile nem guia de contribuição, então a configuração fica por sua conta: comece pelo README e veja nosso guia da primeira contribuição para os passos gerais.

Primeiros passos

  1. Leia a issue inteira e depois o guia de contribuição do projeto.
  2. Comente na issue dizendo que vai assumir — evita que duas pessoas façam o mesmo trabalho.
  3. Faça um fork do repositório e trabalhe em uma branch.
  4. Abra um pull request que referencie o número da issue.

Mais de tier4/awkernel

Todas as issues de tier4/awkernel

Issues semelhantes

Mais issues de Rust

Receba novas issues na sua caixa de entrada

Um resumo curto de issues do GitHub para quem está começando.