openvinotoolkit/openvino

[Good First Issue]: if operation is incorrectly reporting profiling data in GPU

Open

#24.244 aberto em 25 de abr. de 2024

Ver no GitHub
 (25 comments) (0 reactions) (1 assignee)C++ (3.229 forks)auto 404
category: GPUgood first issueno_stale

Métricas do repositório

Stars
 (10.286 stars)
Métricas de merge de PR
 (Mesclagem média 14d 3h) (305 fundiu PRs em 30d)

Description

Context

Performance counter numbers works incorrectly with if operation. Using models with if layer, the reported time is almost zero, and there is a big delta between the some of the latencies of the operations vs. the end-to-end latency reported by benchmark_app.

Counter statistics are critical for performance analysis and optimizations

Below "total time" is reported by -pc, whereas "Latency" is computed as end-to-end inference latency by benchmark_app. Counter

What needs to be done?

Fix performance counters in if operation to see adequate layer statistics

Example Pull Requests

No response

Resources

Contact points

sshlyapn, p-durandin

Ticket

No response

Guia do colaborador