openvinotoolkit/openvino

[Good First Issue]: Include HW plugin properties in supported_properties in BATCH Plugin

Open

#23 074 ouverte le 26 févr. 2024

Voir sur GitHub
 (28 commentaires) (0 réactions) (1 assigné)C++ (3 229 forks)auto 404
good first issueno_stale

Métriques du dépôt

Stars
 (10 286 stars)
Métriques de merge PR
 (Merge moyen 14j 3h) (305 PRs mergées en 30 j)

Description

Context

BATCH Plugin should include HW Plugin compiled_model properties in supported_properties, and get property value from HW plugin compiled_model if user request

benchmark_app -d GPU  -hint throughput -m  <batchable model, mobilenet-v2 for example> {noformat} [ INFO ] Model: [ INFO ]   OPTIMAL_NUMBER_OF_INFER_REQUESTS: 64 [ INFO ]   SUPPORTED_METRICS: OPTIMAL_NUMBER_OF_INFER_REQUESTS SUPPORTED_METRICS NETWORK_NAME SUPPORTED_CONFIG_KEYS EXECUTION_DEVICES [ INFO ]   NETWORK_NAME: torch-jit-export [ INFO ]   SUPPORTED_CONFIG_KEYS: AUTO_BATCH_TIMEOUT [ INFO ]   EXECUTION_DEVICES: OCL_GPU.0 [ INFO ]   AUTO_BATCH_TIMEOUT: 1000{noformat} The expectation is that it includes GPU properties in SUPPORTED_METRICS.

What needs to be done?

Example Pull Requests

No response

Resources

Contact points

@zhaixuejun1993 @riverlijunjie @ilya-lavrenov @vurusovs @peterchen-intel

Ticket

CVS-133381

Guide contributeur