Create a simple "real world" regexp benchmark [LUCENE-9986] · apache/lucene#11025

(6 评论) (0 反应) (1 负责人)Java (2,179 star) (879 fork)batch import

good first issuelegacy-jira-priority:Majortype:enhancement

描述

For issues like #11022, where we are struggling to decide which low-level optimizations to make for our (complicated!) determinize method, it would really help to have a large, real-world corpus of regexps to evaluate performance metrics of our automata operations, like CPU and HEAP required to parse the regexp and determinize.

Does anyone know of such an existing, hopefully compatibly licensed, corpus?

Probably we would add these benchmarks to luceneutil.

Migrated from LUCENE-9986 by Michael McCandless (@mikemccand)

贡献者指南

技术栈: java
领域: performance
议题类型: feature
难度: 4
预计时间: over 1 week
活动状态: blocked
清晰度: clear
前置要求: JavaLucene internalsRegex
新手友好度: 20
研究方向: First, review the existing discussion in issue #11022 to understand the performance concerns. Then, search for a real world regex corpus with a compatible license (e.g., regex corpora from programming language tests or open source projects). The benchmarks should be added to the `luceneutil` project, likely as a new module, measuring CPU and heap usage of regex parsing and determinization. Consult with maintainers, especially Michael McCandless, to align on the corpus selection and benchmark design.