sktime/sktime
[ENH] umbrella issue - foundation models and pre-trained models
Aberta
#6.177 aberto em 20 de mar. de 2024
API designenhancementgood first issuemodule:classificationmodule:forecastingmodule:regression
Métricas do repositório
- Stars
- (7.162 estrelas)
- Métricas de merge de PR
- (Mesclagem média 26d 10h) (86 fundiu PRs em 30d)
Description
Collecting links to some issues on foundation models, pre-trained models, and related interface discussions.
"Good first issue" for interfacing foundation models - there are now enough examples in the code base to use these as recipe examples.
Interfacing guide: https://www.sktime.net/en/latest/developer_guide/add_estimators.html
specific foundation models and marketplaces
- hugging face pretrained models https://github.com/sktime/sktime/issues/5790
- transformers https://github.com/sktime/sktime/issues/6561
- patchtst https://github.com/sktime/sktime/issues/6709
- chronos https://github.com/sktime/sktime/issues/6119
- chronos v2 https://github.com/sktime/sktime/issues/8988
- LagLlama https://github.com/sktime/sktime/issues/6142
- MOIRAI https://github.com/sktime/sktime/issues/6161
- TimesFM https://github.com/sktime/sktime/issues/6408
- momentfm https://github.com/sktime/sktime/issues/6542
- TinyTimeMixer https://github.com/sktime/sktime/issues/6698
- TimeMOE https://github.com/sktime/sktime/issues/7340
- TimeLLM https://github.com/sktime/sktime/issues/7390
- Toto https://github.com/sktime/sktime/issues/8662
- TiRex https://github.com/sktime/sktime/issues/8663
- TabPFN-TS - https://github.com/sktime/sktime/issues/8664
- TabICL-TS - https://github.com/sktime/sktime/issues/8665
Note: most of these are for forecasting, some are multi-purpose. Adapatation to other tasks like TSC, or TSC-specific models should also be investigated.
open questions
- how to design interface for already fitted models, and fine-tuning: https://github.com/sktime/sktime/issues/6580
- also see #2903
- relation to global modelling interface, #4651, as global models allow to train and pre-train, also see https://github.com/sktime/sktime/issues/6690
- weight import handling: https://github.com/sktime/sktime/issues/7249
- relation to the
updateinterface point - "pairing weights with network architectures" - constructor or other interface point?
- multi-task or polymorphic models, mapping on interfaces
- tagging of licenses for the user, e.g., licenses for weights, python code, packages https://github.com/sktime/sktime/issues/6681