Dendrite could automatically clear power faults
Los mantenedores suelen responder en 1 día
@bnaecker ya está trabajando en esto.
Desde el 14/7/2025.
Evaluación
Este issue todavía no se ha evaluado.
Descripción
Originally reported by @bnaecker
While bringing up the next rack, we noticed that one transceiver was faulted, reporting power lost:
BRM27230053-switch # swadm sp xcvr ls
Port State Reset Interrupt Power Power control Vendor Part No. Serial No.
qsfp0 supported false true high Software FINISAR CORP. FTCC1112E2PCL X65A12X
qsfp1 supported false false low Hardware FINISAR CORP. FTCC1112E2PCL X5NBW41
qsfp2 supported false false low Hardware FINISAR CORP. FTCC1112E2PCL X5QA1LJ
qsfp3 supported false false low Hardware FINISAR CORP. FTCC1112E2PCL X57BJGF
qsfp4 supported false true high Software FINISAR CORP. FTCC1112E2PCL X5MBDQ4
qsfp5 supported false false low Hardware FINISAR CORP. FTCC1112E2PCL X5PB5JE
qsfp6 supported false false low Hardware FINISAR CORP. FTCC1112E2PCL X72B2BL
qsfp7 supported false false low Hardware FINISAR CORP. FTCC1112E2PCL X5KBMCX
qsfp8 supported false true high Software FINISAR CORP. FTCC1112E2PCL X69BVNJ
qsfp9 supported false false low Hardware FINISAR CORP. FTCC1112E2PCL X52AC5S
qsfp10 supported false true high Software FINISAR CORP. FTCC1112E2PCL X64A0GT
qsfp11 supported false true high Software FINISAR CORP. FTCC1112E2PCL X72AZ71
qsfp12 supported false true high Software FINISAR CORP. FTCC1112E2PCL X64A1HF
qsfp13 supported false true high Software FINISAR CORP. FTCC1112E2PCL X64BWFW
qsfp14 supported false true high Software FINISAR CORP. FTCC1112E2PCL X5EBGDU
qsfp15 supported false true high Software FINISAR CORP. FTCC1112E2PCL X5SB7J4
qsfp16 supported false true high Software FINISAR CORP. FTCC1112E2PCL X65BPU1
qsfp17 supported false true high Software FINISAR CORP. FTCC1112E2PCL X5DBJZT
qsfp18 supported false true high Software FINISAR CORP. FTCC1112E2PCL X65B603
qsfp19 supported false true high Software FINISAR CORP. FTCC1112E2PCL X5QAPG4
qsfp20 supported false true high Software FINISAR CORP. FTCC1112E2PCL X5RA07S
qsfp21 supported false true high Software FINISAR CORP. FTCC1112E2PCL X5PALLC
qsfp22 supported false true high Software FINISAR CORP. FTCC1112E2PCL X65AM09
qsfp23 supported false true high Software FINISAR CORP. FTCC1112E2PCL X65BLFZ
qsfp24 faulted (PowerLost)
qsfp25 supported false true high Software FINISAR CORP. FTCC1112E2PCL X72B3LF
qsfp26 supported false true high Software FINISAR CORP. FTCC1112E2PCL X61ABER
qsfp27 supported false false low Hardware FINISAR CORP. FTCC1112E2PCL X5QAAJV
qsfp28 supported false true high Software FINISAR CORP. FTCC1112E2PCL X5PABV4
qsfp29 supported false true high Software FINISAR CORP. FTCC1112E2PCL X5QB2MY
qsfp30 supported false true high Software FINISAR CORP. FTCC1112E2PCL X65A14C
qsfp31 supported false true high Software FINISAR CORP. FTCC1112E2PCL X5PAQHE
BRM27230053-switch # xcvradm -i sidecar0 -t 24 vendor-info
Port Identifier Vendor Part Rev Serial Mfg date
Some operations failed, errors below
Port Error
24 Hardware error accessing module 24: FPGA reported an I2C error
BRM27230053-switch # xcvradm -i sidecar0 -t 24 status
Port Status
24 PRESENT | ENABLED | LOW_POWER_MODE | INTERRUPT | FAULT_POWER_LOST
BRM27230053-switch #
@Aaron-Hartwig and I recalled that this fault is latched, so at some point we lost power and all downstream operations are destined to fail. We cleared the latch manually, and things started working fine:
BRM27230053-switch # xcvradm -i sidecar0 -t 24 clear-power-fault
BRM27230053-switch # xcvradm -i sidecar0 -t 24 status
Port Status
24 PRESENT | ENABLED | LOW_POWER_MODE | INTERRUPT | POWER_GOOD
BRM27230053-switch #
BRM27230053-switch # xcvradm -i sidecar0 -t 24 vendor-info
Port Identifier Vendor Part Rev Serial Mfg date
24 QsfpPlusCmis (0x1e) FINISAR CORP. FTCC1112E2PCL A X5DA0P3 210901
BRM27230053-switch # swadm sp xcvr ls
Port State Reset Interrupt Power Power control Vendor Part No. Serial No.
qsfp0 supported false true high Software FINISAR CORP. FTCC1112E2PCL X65A12X
qsfp1 supported false false low Hardware FINISAR CORP. FTCC1112E2PCL X5NBW41
qsfp2 supported false false low Hardware FINISAR CORP. FTCC1112E2PCL X5QA1LJ
qsfp3 supported false false low Hardware FINISAR CORP. FTCC1112E2PCL X57BJGF
qsfp4 supported false true high Software FINISAR CORP. FTCC1112E2PCL X5MBDQ4
qsfp5 supported false false low Hardware FINISAR CORP. FTCC1112E2PCL X5PB5JE
qsfp6 supported false false low Hardware FINISAR CORP. FTCC1112E2PCL X72B2BL
qsfp7 supported false false low Hardware FINISAR CORP. FTCC1112E2PCL X5KBMCX
qsfp8 supported false true high Software FINISAR CORP. FTCC1112E2PCL X69BVNJ
qsfp9 supported false false low Hardware FINISAR CORP. FTCC1112E2PCL X52AC5S
qsfp10 supported false true high Software FINISAR CORP. FTCC1112E2PCL X64A0GT
qsfp11 supported false true high Software FINISAR CORP. FTCC1112E2PCL X72AZ71
qsfp12 supported false true high Software FINISAR CORP. FTCC1112E2PCL X64A1HF
qsfp13 supported false true high Software FINISAR CORP. FTCC1112E2PCL X64BWFW
qsfp14 supported false true high Software FINISAR CORP. FTCC1112E2PCL X5EBGDU
qsfp15 supported false true high Software FINISAR CORP. FTCC1112E2PCL X5SB7J4
qsfp16 supported false true high Software FINISAR CORP. FTCC1112E2PCL X65BPU1
qsfp17 supported false true high Software FINISAR CORP. FTCC1112E2PCL X5DBJZT
qsfp18 supported false true high Software FINISAR CORP. FTCC1112E2PCL X65B603
qsfp19 supported false true high Software FINISAR CORP. FTCC1112E2PCL X5QAPG4
qsfp20 supported false true high Software FINISAR CORP. FTCC1112E2PCL X5RA07S
qsfp21 supported false true high Software FINISAR CORP. FTCC1112E2PCL X5PALLC
qsfp22 supported false true high Software FINISAR CORP. FTCC1112E2PCL X65AM09
qsfp23 supported false true high Software FINISAR CORP. FTCC1112E2PCL X65BLFZ
qsfp24 supported false true low Hardware FINISAR CORP. FTCC1112E2PCL X5DA0P3
qsfp25 supported false true high Software FINISAR CORP. FTCC1112E2PCL X72B3LF
qsfp26 supported false true high Software FINISAR CORP. FTCC1112E2PCL X61ABER
qsfp27 supported false false low Hardware FINISAR CORP. FTCC1112E2PCL X5QAAJV
qsfp28 supported false true high Software FINISAR CORP. FTCC1112E2PCL X5PABV4
qsfp29 supported false true high Software FINISAR CORP. FTCC1112E2PCL X5QB2MY
qsfp30 supported false true high Software FINISAR CORP. FTCC1112E2PCL X65A14C
qsfp31 supported false true high Software FINISAR CORP. FTCC1112E2PCL X5PAQHE
This is a pretty bad failure mode, because there is no way to automatically recover from this, requiring operator intervention. Even if the module's power is actually fine, it cannot work until the fault is cleared. Dendrite should consider doing this automatically. During its transceiver monitoring loop, it could note any modules with a power fault and clear that, up to some number of attempts. Should we decide to do this, it needs to be logged, and ideally we'd have a way to control this disposition through the API.
- Lenguaje dominante
- Rust
- Estrellas
- 20
- Forks
- 3
- Merge medio
- 8 h 29 min
- PR fusionados (30 d)
- 2
Preparar el entorno
Aún no hemos revisado los archivos de configuración de este proyecto. Empieza por su README y consulta nuestra guía para la primera contribución para los pasos generales.
Primeros pasos
- Lee el issue completo y luego la guía de contribución del proyecto.
- Comenta en el issue que vas a ocuparte — evita que dos personas hagan lo mismo.
- Haz un fork del repositorio y trabaja en una rama.
- Abre un pull request que haga referencia al número del issue.
Más de oxidecomputer/dendrite
-
Dificultad 2/5 1-3 horas Aptitud para principiantes 78/100
oxidecomputer/dendrite#380 ·
Los mantenedores suelen responder en 1 día
-
Dificultad 3/5 1-2 días Aptitud para principiantes 65/100
oxidecomputer/dendrite#375 ·
Los mantenedores suelen responder en 1 día
-
Dificultad 5/5 Más de una semana Aptitud para principiantes 35/100
oxidecomputer/dendrite#369 ·
Los mantenedores suelen responder en 1 día
-
Dificultad 3/5 1-2 días Aptitud para principiantes 58/100
oxidecomputer/dendrite#368 ·
Los mantenedores suelen responder en 1 día
-
Dificultad 4/5 3-5 días Aptitud para principiantes 52/100
oxidecomputer/dendrite#359 · 1 comentario ·
Los mantenedores suelen responder en 1 día
Todos los issues de oxidecomputer/dendrite
Issues similares
-
Dificultad 2/5 1-3 horas Aptitud para principiantes 84/100
linebender/parley#849 ·
Los mantenedores suelen responder en 1 día
-
Dificultad 2/5 1-3 horas Aptitud para principiantes 88/100
Los mantenedores suelen responder en 1 día
-
Dificultad 2/5 1-3 horas Aptitud para principiantes 86/100
boxlite-ai/boxlite#1729 ·
Los mantenedores suelen responder en 1 día
-
external
Dificultad 2/5 1-3 horas Aptitud para principiantes 68/100
langchain-ai/docs#6255 ·
Los mantenedores suelen responder en 1 día
-
P2 testing
Dificultad 1/5 Menos de una hora Aptitud para principiantes 90/100
Los mantenedores suelen responder en 1 día