openvinotoolkit/openvino

[Good First Issue]: if operation is incorrectly reporting profiling data in GPU

Open

#24,244 opened on 2024年4月25日

GitHub で見る
 (25 comments) (0 reactions) (1 assignee)C++ (3,229 forks)auto 404
category: GPUgood first issueno_stale

Repository metrics

Stars
 (10,286 stars)
PR merge metrics
 (平均マージ 14d 3h) (30d で 305 merged PRs)

説明

Context

Performance counter numbers works incorrectly with if operation. Using models with if layer, the reported time is almost zero, and there is a big delta between the some of the latencies of the operations vs. the end-to-end latency reported by benchmark_app.

Counter statistics are critical for performance analysis and optimizations

Below "total time" is reported by -pc, whereas "Latency" is computed as end-to-end inference latency by benchmark_app. Counter

What needs to be done?

Fix performance counters in if operation to see adequate layer statistics

Example Pull Requests

No response

Resources

Contact points

sshlyapn, p-durandin

Ticket

No response

コントリビューターガイド