openvinotoolkit/openvino

[Good First Issue]: Possible Conditional Compilation Optimization for type_to_fuse_map

Open

#23,069 opened on Feb 25, 2024

View on GitHub
 (26 comments) (0 reactions) (1 assignee)C++ (3,229 forks)auto 404
good first issueno_stale

Repository metrics

Stars
 (10,286 stars)
PR merge metrics
 (Avg merge 14d 3h) (305 merged PRs in 30d)

Description

Context

Conditional Compilation is very helpful to optimize openvino binaries size for specified platforms and models, seems it can be used for type_to_fuse_map to do some binaries optimization:

https://github.com/openvinotoolkit/openvino/blob/f9605cd8d4c488ad405397bc4294e35a403ae803/src/common/transformations/src/transformations/convert_precision.cpp#L430-L477

Need to consider usage of CC factory here, because in case of conditional compilation, this map will hold all the operations, which are not even used in the model. See https://github.com/openvinotoolkit/openvino/blob/master/src/common/conditional_compilation/include/openvino/cc/factory.h

What needs to be done?

  1. Apply Conditional Compilation for type_to_fuse_map to optimize binaries size.
  2. Measure how many binaries size benefit can be achieved from this optimization.

Example Pull Requests

No response

Resources

Contact points

@riverlijunjie

Ticket

No response

Contributor guide

Research direction
Study the existing conditional compilation patterns in the codebase, particularly the cc/factory.h usage, and apply to type to fuse map to exclude unused operations, then measure binary size reduction.
Tech stack
cpp
Domain
backend
Issue type
Performance
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
2
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
Half day
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
Active
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
Clear
Prerequisites
GitC++
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
70