openvinotoolkit/openvino

[Good First Issue]: Include HW plugin properties in supported_properties in BATCH Plugin

Open

#23.074 geöffnet am 26. Feb. 2024

Auf GitHub ansehen
 (28 Kommentare) (0 Reaktionen) (1 zugewiesene Person)C++ (3.229 Forks)auto 404
good first issueno_stale

Repository-Metriken

Stars
 (10.286 Stars)
PR-Merge-Metriken
 (Durchschn. Merge 14T 3h) (305 gemergte PRs in 30 T)

Beschreibung

Context

BATCH Plugin should include HW Plugin compiled_model properties in supported_properties, and get property value from HW plugin compiled_model if user request

benchmark_app -d GPU  -hint throughput -m  <batchable model, mobilenet-v2 for example> {noformat} [ INFO ] Model: [ INFO ]   OPTIMAL_NUMBER_OF_INFER_REQUESTS: 64 [ INFO ]   SUPPORTED_METRICS: OPTIMAL_NUMBER_OF_INFER_REQUESTS SUPPORTED_METRICS NETWORK_NAME SUPPORTED_CONFIG_KEYS EXECUTION_DEVICES [ INFO ]   NETWORK_NAME: torch-jit-export [ INFO ]   SUPPORTED_CONFIG_KEYS: AUTO_BATCH_TIMEOUT [ INFO ]   EXECUTION_DEVICES: OCL_GPU.0 [ INFO ]   AUTO_BATCH_TIMEOUT: 1000{noformat} The expectation is that it includes GPU properties in SUPPORTED_METRICS.

What needs to be done?

Example Pull Requests

No response

Resources

Contact points

@zhaixuejun1993 @riverlijunjie @ilya-lavrenov @vurusovs @peterchen-intel

Ticket

CVS-133381

Contributor Guide