enhancementhelp wantedmodule: handlers
Métriques du dépôt
- Stars
- (4 313 étoiles)
- Métriques de merge PR
- (Merge moyen 18j 23h) (19 PRs mergées en 30 j)
Description
🚀 Feature
I would propose several enhancements to the EarlyStopping handler.
- Introduce a new parameter,
min_delta_mode, mimicking the parameterthreshold_modeof ReduceLROnPlateau. Ifmin_delta_mode="abs"(default) everything works as of now, while ifmin_delta_mode="rel"the score comparison becomesscore >= best_score (1 + min_delta). - Introduce a new parameter
modethat work's as in ReduceLROnPlateau, allowing to handle validation metrics to be minimized.
Other ideas I'd like to discuss are:
- Natively implementing
min_epochs/min_evals, preventing EarlyStopping from terminating until it has been evaluated at least X times. I know this could be addressed as in #3317 but this solution might be more compact? - It would be nice to have the same
thresholdandthreshold_modenomenclature asReduceLROnPlateau, but I realize this would probably break older code. - I personally find the parameter name
cumulative_deltaquite counter-intuitive. When I first read about that parameter, I understood it was taking the cumulative sum of the improvements and comparing this cumulative sum tomin_delta.