pytorch/ignite

Enhancements to EarlyStopping handler

已关闭

#3,411 创建于 2025年6月4日

 (19 条评论) (0 个反应) (0 位负责人)Python (602 个派生)batch import
enhancementhelp wantedmodule: handlers

仓库指标

星标
 (4,313 个星标)
PR 合并指标
 (平均合并 18天 23小时) (30 天内合并 19 个 PR)

描述

🚀 Feature

I would propose several enhancements to the EarlyStopping handler.

  1. Introduce a new parameter, min_delta_mode, mimicking the parameter threshold_mode of ReduceLROnPlateau. If min_delta_mode="abs" (default) everything works as of now, while if min_delta_mode="rel" the score comparison becomes score >= best_score (1 + min_delta).
  2. Introduce a new parameter mode that work's as in ReduceLROnPlateau, allowing to handle validation metrics to be minimized.

Other ideas I'd like to discuss are:

  • Natively implementing min_epochs/min_evals, preventing EarlyStopping from terminating until it has been evaluated at least X times. I know this could be addressed as in #3317 but this solution might be more compact?
  • It would be nice to have the same threshold and threshold_mode nomenclature as ReduceLROnPlateau, but I realize this would probably break older code.
  • I personally find the parameter name cumulative_delta quite counter-intuitive. When I first read about that parameter, I understood it was taking the cumulative sum of the improvements and comparing this cumulative sum to min_delta.

贡献者指南