Hacktoberfest 2026: le issue che i maintainer hanno segnato per ottobre, aperte e adatte ai principianti. Sfoglia le issue Hacktoberfest

SchemaTrackerBase: XRT_ERROR_INVALID_TENSOR_ID from xrGetTensorDataNV aborts the teleop session

Aperta
  • Qualcosa non va?
#1,104 0 commenti 0 reazioni 0 assegnatari Vedi su GitHub

I maintainer di solito rispondono entro 1 giorno

Nessuno ha ancora preso questa issue.

Valutazione

Difficoltà
4/5
Tempo stimato
3-5 giorni
Idoneità per principianti
45/100
Tipo di issue
Bug
Chiarezza
Abbastanza chiara
Stato di attività
Attiva
Stack tecnologico
cpp
Ambito
robotics

Direzione di ricerca

Iniziate in src/core/live_trackers/cpp/schema_tracker_base.cpp, in SchemaTrackerBase::read_next_sample(), quindi esaminate la gestione degli errori dell’estensione tensor e il percorso di chiamata di DeviceIOSession.update(). Riproducete il problema con la configurazione documentata di CloudXR, MANUS e IsaacTeleop, se disponibile. Il lavoro è completato quando i riferimenti tensor non validi transitori possono essere aggiornati o recuperati senza terminare la teleoperazione, mentre gli errori di runtime persistenti rimangono fatali.

Scritto dal modello di indicizzazione a partire dal testo della issue.

Descrizione

Summary

During a live IsaacTeleop session with MANUS sensor collections, CloudXR’s tensor service reported XRT_ERROR_INVALID_TENSOR_ID. The OpenXR API returned XR_ERROR_RUNTIME_FAILURE, which SchemaTrackerBase treated as fatal, terminating the teleoperation session.

The immediate failure is reproducible only intermittently. The stale tensor may result from a producer disappearing or recreating its collection, but that root cause is not yet confirmed.

Environment

  • IsaacTeleop version: 1.6.x
  • IsaacTeleop commit: 5b5bceb7257733b6a4a7880ac5e02d3319a0de28
  • CloudXR Runtime: 6.3.0
  • Integration: GR00T xr_server
  • Additional device: MANUS gloves
  • GR00T release: Dexter v1.2.1

Symptom

The MANUS plugin connected and registered both sensor collections:

[manus-plugin] Successfully connected to Manus host after 1 attempts
[manus-plugin] Initialized with wrist source: HandTracking
[manus-plugin] left sensors=on
[manus-plugin] right sensors=on

Shortly afterward, the next DeviceIO update failed:

ERROR [get_tensor_data] ipc_receive: Service side get_tensor_data failed:
XRT_ERROR_INVALID_TENSOR_ID
[/builds/cloudxr/cloudxr-openxr-runtime/deps/monado/src/xrt/ipc/client/ipc_client_tensor_overseer.c:111]

XR_ERROR_RUNTIME_FAILURE in xrGetTensorDataNV: Failed to get tensor data

The exception propagated through:

TeleopSession.step()
  -> TeleopSession._execute_step_request()
  -> DeviceIOSession.update()
  -> SchemaTrackerBase::read_next_sample()
  -> xrGetTensorDataNV()

xr_server then exited. The available log does not show that the OpenXR runtime process itself crashed.

Reproduction

  1. Start CloudXR Runtime 6.3.0.
  2. Start an IsaacTeleop session configured with the MANUS plugin and the human,sensors,haptic datasets.
  3. Connect the headset and wait for manus_sensors_left and manus_sensors_right to begin streaming.
  4. Continue teleoperation.
  5. Intermittently, DeviceIOSession.update() fails with XRT_ERROR_INVALID_TENSOR_ID.

The problem has occurred alongside MANUS USB/device instability. Restarting the stack or moving the MANUS dongle and license key to different USB ports can temporarily clear it, but this is not reliable.

Expected behavior

If a tensor producer or collection temporarily disappears, the tracker should invalidate its cached collection reference and rediscover it. A transient tensor-list change should not terminate the entire teleoperation session.

Code analysis

SchemaTrackerBase::read_next_sample() handles XR_ERROR_TENSOR_LOST_NV as recoverable, but throws for every other XrResult.

The tensor extension describes XR_ERROR_TENSOR_LOST_NV as the result expected when a cached tensor-list element is no longer valid. In this case, however, the runtime’s internal XRT_ERROR_INVALID_TENSOR_ID was surfaced as the generic XR_ERROR_RUNTIME_FAILURE.

Possible explanations:

  1. A MANUS producer exited or recreated its tensor collection between generation checking and data retrieval.
  2. The CloudXR runtime retained or resolved a stale internal tensor ID.
  3. A producer failure occurred between IsaacTeleop’s periodic plugin-health checks, so the tensor error surfaced first.

Mitigations tested

  • Restarting the complete teleoperation stack: temporarily recovers.
  • Moving the MANUS USB devices to other ports: sometimes recovers, but the issue returns.
  • Upgrading the GR00T deployment to Dexter v1.2.1: issue still observed.

Questions

  1. Why is XRT_ERROR_INVALID_TENSOR_ID mapped to XR_ERROR_RUNTIME_FAILURE rather than XR_ERROR_TENSOR_LOST_NV?
  2. Should SchemaTrackerBase invalidate and refresh its tensor list after this failure?
  3. Would one forced refresh and retry allow recovery while preserving fatal handling for persistent runtime failures?
  4. Can the runtime log the missing tensor ID, current generation, and owning producer when this occurs?

Additional context

The same investigation also observed separate MANUS plugin processes terminating with SIGABRT and SIGSEGV. Those failures may explain a disappearing tensor producer, but they are being tracked separately and should not be assumed to share this root cause.

Full station logs are available. Sensitive MANUS license information has been omitted.

Lingua principale
Python
Stelle
403
Fork
94
Merge medio
2g 17m
PR unite (30g)
121

Preparare l'ambiente

Come iniziare

  1. Leggi tutta la issue e poi la guida ai contributi del progetto.
  2. Commenta sulla issue per dire che te ne occupi tu — evita che due persone facciano lo stesso lavoro.
  3. Fai un fork del repository e lavora su un branch.
  4. Apri una pull request che faccia riferimento al numero della issue.

Altre issue di NVIDIA/IsaacCapture

Tutte le issue di NVIDIA/IsaacCapture

Issue simili

Altre issue su Python

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.