openvinotoolkit/openvino

[Good First Issue]: Include HW plugin properties in supported_properties in BATCH Plugin

Open

#23,074 opened on Feb 26, 2024

View on GitHub
 (28 comments) (0 reactions) (1 assignee)C++ (3,229 forks)auto 404
good first issueno_stale

Repository metrics

Stars
 (10,286 stars)
PR merge metrics
 (Avg merge 14d 3h) (305 merged PRs in 30d)

Description

Context

BATCH Plugin should include HW Plugin compiled_model properties in supported_properties, and get property value from HW plugin compiled_model if user request

benchmark_app -d GPU  -hint throughput -m  <batchable model, mobilenet-v2 for example> {noformat} [ INFO ] Model: [ INFO ]   OPTIMAL_NUMBER_OF_INFER_REQUESTS: 64 [ INFO ]   SUPPORTED_METRICS: OPTIMAL_NUMBER_OF_INFER_REQUESTS SUPPORTED_METRICS NETWORK_NAME SUPPORTED_CONFIG_KEYS EXECUTION_DEVICES [ INFO ]   NETWORK_NAME: torch-jit-export [ INFO ]   SUPPORTED_CONFIG_KEYS: AUTO_BATCH_TIMEOUT [ INFO ]   EXECUTION_DEVICES: OCL_GPU.0 [ INFO ]   AUTO_BATCH_TIMEOUT: 1000{noformat} The expectation is that it includes GPU properties in SUPPORTED_METRICS.

What needs to be done?

Example Pull Requests

No response

Resources

Contact points

@zhaixuejun1993 @riverlijunjie @ilya-lavrenov @vurusovs @peterchen-intel

Ticket

CVS-133381

Contributor guide