[Good First Issue]: Include HW plugin properties in supported_properties in BATCH Plugin
#23,074 opened on Feb 26, 2024
Repository metrics
- Stars
- (10,286 stars)
- PR merge metrics
- (Avg merge 14d 3h) (305 merged PRs in 30d)
Description
Context
BATCH Plugin should include HW Plugin compiled_model properties in supported_properties, and get property value from HW plugin compiled_model if user request
benchmark_app -d GPU -hint throughput -m <batchable model, mobilenet-v2 for example> {noformat} [ INFO ] Model: [ INFO ] OPTIMAL_NUMBER_OF_INFER_REQUESTS: 64 [ INFO ] SUPPORTED_METRICS: OPTIMAL_NUMBER_OF_INFER_REQUESTS SUPPORTED_METRICS NETWORK_NAME SUPPORTED_CONFIG_KEYS EXECUTION_DEVICES [ INFO ] NETWORK_NAME: torch-jit-export [ INFO ] SUPPORTED_CONFIG_KEYS: AUTO_BATCH_TIMEOUT [ INFO ] EXECUTION_DEVICES: OCL_GPU.0 [ INFO ] AUTO_BATCH_TIMEOUT: 1000{noformat} The expectation is that it includes GPU properties in SUPPORTED_METRICS.
What needs to be done?
- Get properties from HW plugin compiled_model & add to BATCH plugin supported_properties. u can get HW compiled model properties with m_compiled_model_without_batch & add to the return list. https://github.com/openvinotoolkit/openvino/blob/f9605cd8d4c488ad405397bc4294e35a403ae803/src/plugins/auto_batch/src/compiled_model.cpp#L205
- Add test.
Example Pull Requests
No response
Resources
- Contribution guide - start here!
- Intel DevHub Discord channel - engage in discussions, ask questions and talk to OpenVINO developers
Contact points
@zhaixuejun1993 @riverlijunjie @ilya-lavrenov @vurusovs @peterchen-intel
Ticket
CVS-133381