Myelin "Inconsistent strides" (tactic.cpp:4034) building a strongly typed fp16 network on sm_120, TRT 11.4; the fp32 export of the same model builds

Abierto
#4,925 1 comentario 0 reacciones 0 asignados Ver en GitHub

Los mantenedores suelen responder en 6 días

Nadie ha tomado este issue todavía.

Evaluación

Dificultad
4/5
Tiempo estimado
3-5 días
Aptitud para principiantes
35/100
Tipo de issue
Error
Claridad
Bastante claro
Estado de actividad
Activo
Stack tecnológico
cpp, python

Línea de trabajo

Start by running the TensorRT Python reproduction script against the fp16 ONNX export, then compare with the fp32 build. The error points to tactic.cpp:4034 and Myelin codeGenerator.cpp:2011; the issue offers a random-weight export and input on request. Done means the strongly typed fp16 network builds successfully, or the failure is reduced to a reproducible case.

Escrito por el modelo de indexación a partir del texto del issue.

Descripción

Module:Engine Build

Description

Building a strongly typed engine from an fp16 ONNX export of BridgeDepth (stereo matching with a ViT-L encoder, 994x1482, fixed shapes) fails after 9 s with a Myelin internal check. The same model exported with fp32 weights builds (191 s) and runs. onnxruntime 1.32.0 (CPU) runs the fp16 file and matches PyTorch eager (max abs error 0.023 on disparities around 8).

[TRT] [E] Error Code: 9: Skipping tactic 0x0000000000000000 due to exception [myelin_graph.h:1295: attachExceptionMsgToGraph] MyelinCheckException: tactic.cpp:4034: CHECK(common_values(use_fc_src_strides) == common_values(ir::compute_strides_from_stride_order( use_fc_src_dims, collapse_stride_order, use_fc_use_opnd->paddings()))) failed. Inconsistent strides In compileGraph at /_src/optimizer/myelin/codeGenerator.cpp:2011
[TRT] [E] IBuilder::buildSerializedNetwork: Error Code 10: Internal Error (Could not find any implementation for node {ForeignNode[ONNXTRT_castHelper_8874_output[Constant]...node_slice_371]}. In computeCosts at /_src/optimizer/common/tactic/optimizer.cpp:4254)

The failing ForeignNode starts at a parser cast helper, so the fp16 graph has casts the fp32 graph does not have. The build fails the same way (20 s) with the weights replaced by random values (seed 0), so the graph structure alone triggers it.

Expected: an engine, as with the fp32 export. Actual: build fails inside Myelin for the fp16 graph only.

Environment

TensorRT 11.4.0.106 (tensorrt-cu13 wheel, current release), RTX 5060 Ti 16 GB (sm_120), driver 595.99.02, CUDA 13.0, Ubuntu 26.04, Python 3.12. ONNX: torch 2.14.1 dynamo exporter, opset 18, onnx 1.23.2.

Relevant Files

The ONNX file is 1.4 GB (the model weights are CC-BY-NC), far above the attachment limit. I can share the random-weight export plus the input npz on request, or reduce it with polygraphy first if that helps.

Steps To Reproduce

import tensorrt as trt
logger = trt.Logger(trt.Logger.WARNING)
builder = trt.Builder(logger)
network = builder.create_network(1 << int(trt.NetworkDefinitionCreationFlag.STRONGLY_TYPED))
parser = trt.OnnxParser(network, logger)
assert parser.parse_from_file("bridgedepth_994x1482_fp16.onnx")
plan = builder.build_serialized_network(network, builder.create_builder_config())
print(plan is None)  # True, with the errors above
Lenguaje dominante
C++
Estrellas
13.5k
Forks
2.4k
Merge medio
6 d 21 h
PR fusionados (30 d)
3

Preparar el entorno

Primeros pasos

  1. Lee el issue completo y luego la guía de contribución del proyecto.
  2. Comenta en el issue que vas a ocuparte — evita que dos personas hagan lo mismo.
  3. Haz un fork del repositorio y trabaja en una rama.
  4. Abre un pull request que haga referencia al número del issue.

Más de NVIDIA/TensorRT

Todos los issues de NVIDIA/TensorRT

Issues similares

Más issues de C++

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.