openvinotoolkit/openvino

[Good First Issue]: Possible Conditional Compilation Optimization for type_to_fuse_map

Open

#23,069 建立於 2024年2月25日

在 GitHub 查看
 (26 留言) (0 反應) (1 負責人)C++ (3,229 fork)auto 404
good first issueno_stale

倉庫指標

Star
 (10,286 star)
PR 合併指標
 (平均合併 14天 3小時) (30 天內合併 305 個 PR)

描述

Context

Conditional Compilation is very helpful to optimize openvino binaries size for specified platforms and models, seems it can be used for type_to_fuse_map to do some binaries optimization:

https://github.com/openvinotoolkit/openvino/blob/f9605cd8d4c488ad405397bc4294e35a403ae803/src/common/transformations/src/transformations/convert_precision.cpp#L430-L477

Need to consider usage of CC factory here, because in case of conditional compilation, this map will hold all the operations, which are not even used in the model. See https://github.com/openvinotoolkit/openvino/blob/master/src/common/conditional_compilation/include/openvino/cc/factory.h

What needs to be done?

  1. Apply Conditional Compilation for type_to_fuse_map to optimize binaries size.
  2. Measure how many binaries size benefit can be achieved from this optimization.

Example Pull Requests

No response

Resources

Contact points

@riverlijunjie

Ticket

No response

貢獻者指南