autogluon/autogluon

Support for custom cross-validation strategies, e.g., forward chaining for temporally ordered tabular data

開放

#4,492 建立於 2024年9月25日

 (4 則留言) (3 個反應) (0 位負責人)Python (1,176 個分叉)batch import
enhancementhelp wantedmodule: tabular

倉庫指標

星標
 (10,606 顆星)
PR 合併指標
 (平均合併 4天 5小時) (30 天內合併 20 個 PR)

描述

Hi AutoGluon team,

I'm using TabularPredictor for temporally ordered tabular data and need more flexible cross-validation options. The current CV methods and "groups" parameter don't suffice for many time-based scenarios.

Standard k-fold CV can cause data leakage with ordered data. As far as I can tell, I'm unable to do the following using the "groups" parameter:

fold 1: training [month 1], test [month 2] fold 2: training [months 1-2], test [month 3] fold 3: training [months 1-3], test [month 4] ...and so on

Proposed solution: Add a custom_cv_strategy parameter to TabularPredictor, allowing custom splitting functions or pre-implemented strategies like forward chaining.

Let me know if I've overlooked something, and this is actually currently possible, or if there is a workaround.

Otherwise, thank you for considering!

貢獻者指南