openvinotoolkit/openvino

[Good First Issue]: if operation is incorrectly reporting profiling data in GPU

Open

#24.244 aperta il 25 apr 2024

Vedi su GitHub
 (25 commenti) (0 reazioni) (1 assegnatario)C++ (3229 fork)auto 404
category: GPUgood first issueno_stale

Metriche repository

Star
 (10.286 star)
Metriche merge PR
 (Merge medio 14g 3h) (305 PR mergiate in 30 g)

Descrizione

Context

Performance counter numbers works incorrectly with if operation. Using models with if layer, the reported time is almost zero, and there is a big delta between the some of the latencies of the operations vs. the end-to-end latency reported by benchmark_app.

Counter statistics are critical for performance analysis and optimizations

Below "total time" is reported by -pc, whereas "Latency" is computed as end-to-end inference latency by benchmark_app. Counter

What needs to be done?

Fix performance counters in if operation to see adequate layer statistics

Example Pull Requests

No response

Resources

Contact points

sshlyapn, p-durandin

Ticket

No response

Guida contributor