Inference on training data impossible??
Nobody has claimed this yet.
Assessment
- Difficulty
- 5/5
- Estimated time
- Over a week
- Newbie friendliness
- 20/100
- Issue type
- Bug
- Clarity
- Needs clarification
- Activity status
- Stale
- Tech stack
- azure, machine-learning
- Domain
- machine-learning
Research direction
No file, notebook, test, or entry point is named. Start by reproducing the Azure AutoML forecasting workflow described in the issue and determine whether inference or backtesting on training data is supported; done means documenting the behavior or identifying a concrete notebook or SDK change.
Written by the indexing model from the issue text.
Description
Hi,
I want to detect potential model overfitting for Azure AutoML forecasting. Usually, I would tune a model on train and then evaluate separately on train and out-of-time test set. But it seems like I cannot do backtesting with forecasting models on train?? That doesn't seem right.
Am I missing something here?
- Dominant language
- Jupyter Notebook
- Stars
- 4.4k
- Forks
- 2.6k
- PR merge metrics
- No merged PRs in 30d
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from Azure/MachineLearningNotebooks
-
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
Azure/MachineLearningNotebooks#1975 · 1 comment ·
-
duplicates Open
Difficulty 1/5 Under an hour Newbie friendliness 68/100
Azure/MachineLearningNotebooks#1960 ·
-
machine Open
Difficulty 5/5 Over a week Newbie friendliness 10/100
Azure/MachineLearningNotebooks#1987 ·
-
Difficulty 5/5 Over a week Newbie friendliness 25/100
Azure/MachineLearningNotebooks#1985 · 1 comment ·
-
Difficulty 3/5 1-2 days Newbie friendliness 35/100
Azure/MachineLearningNotebooks#1981 · 1 reaction ·
All issues in Azure/MachineLearningNotebooks
Similar issues
-
bug configuration documentation examples policies processor tests training
Difficulty 2/5 1-3 hours Newbie friendliness 70/100
huggingface/lerobot#4727 ·
-
bug
Difficulty 2/5 1-3 hours Newbie friendliness 86/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 75/100
huggingface/sentence-transformers#4068 ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 76/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 88/100
vllm-project/speculators#1156 · 1 comment ·