openvinotoolkit/openvino

[Good First Issue]: Include HW plugin properties in supported_properties in BATCH Plugin

Open

#23.074 aperta il 26 feb 2024

Vedi su GitHub
 (28 commenti) (0 reazioni) (1 assegnatario)C++ (3229 fork)auto 404
good first issueno_stale

Metriche repository

Star
 (10.286 star)
Metriche merge PR
 (Merge medio 14g 3h) (305 PR mergiate in 30 g)

Descrizione

Context

BATCH Plugin should include HW Plugin compiled_model properties in supported_properties, and get property value from HW plugin compiled_model if user request

benchmark_app -d GPU  -hint throughput -m  <batchable model, mobilenet-v2 for example> {noformat} [ INFO ] Model: [ INFO ]   OPTIMAL_NUMBER_OF_INFER_REQUESTS: 64 [ INFO ]   SUPPORTED_METRICS: OPTIMAL_NUMBER_OF_INFER_REQUESTS SUPPORTED_METRICS NETWORK_NAME SUPPORTED_CONFIG_KEYS EXECUTION_DEVICES [ INFO ]   NETWORK_NAME: torch-jit-export [ INFO ]   SUPPORTED_CONFIG_KEYS: AUTO_BATCH_TIMEOUT [ INFO ]   EXECUTION_DEVICES: OCL_GPU.0 [ INFO ]   AUTO_BATCH_TIMEOUT: 1000{noformat} The expectation is that it includes GPU properties in SUPPORTED_METRICS.

What needs to be done?

Example Pull Requests

No response

Resources

Contact points

@zhaixuejun1993 @riverlijunjie @ilya-lavrenov @vurusovs @peterchen-intel

Ticket

CVS-133381

Guida contributor