register_pandas_dataframe crashes kernel when receiving dataframe with multiple columns with same name
Nobody has claimed this yet.
Assessment
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Newbie friendliness
- 30/100
- Issue type
- Bug
- Clarity
- Mostly clear
- Activity status
- Stale
- Tech stack
- azure, jupyter-notebook, pandas, python
- Domain
- data, machine-learning
Research direction
Start by running the pandas DataFrame example from the issue with duplicate column names and observe the kernel exit. The payload identifies the TabularDatasetFactory documentation source at AzureML-Docset/stable/docs-ref-autogen/azureml-core/azureml.data.dataset_factory.tabulardatasetfactory.yml, but no implementation file or test is named. Done means the failure returns useful feedback without crashing the IPython kernel.
Written by the indexing model from the issue text.
Description
My Synapse kernel crashed when I tried to register a dataset where the dataframe had multiple columns with the same name. I am not completely sure if this is the correct place to post this, but this is the best place I could find.
Minimum reproducible example:
dataset = Dataset.Tabular.register_pandas_dataframe(
dataframe = pd.DataFrame([[1,2],[1,2]], columns=['a', 'a']),
target = datastore,
name = "bad_dataframe",
show_progress=True,
)
What I would expect:
To get some feedback about why it fails, and the kernel should not crash.
What I get:
Validating arguments.
Arguments validated.
Successfully obtained datastore reference and path.
Uploading file to managed-dataset/13e4b3c6-8730-4951-bde5-2d2bc6456e2d/
InternalError: Ipython kernel exits with code -11. Please restart your session.
Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.
- ID: 9b1aee32-5a1f-2ef1-ee76-30b17999db87
- Version Independent ID: f4785272-a81d-e9cc-c6a5-9d41c8dcd90b
- Content: azureml.data.dataset_factory.TabularDatasetFactory class - Azure Machine Learning Python
- Content Source: AzureML-Docset/stable/docs-ref-autogen/azureml-core/azureml.data.dataset_factory.TabularDatasetFactory.yml
- Service: machine-learning
- Sub-service: core
- GitHub Login: @DebFro
- Microsoft Alias: debfro
- Dominant language
- Jupyter Notebook
- Stars
- 4.4k
- Forks
- 2.6k
- PR merge metrics
- No merged PRs in 30d
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from Azure/MachineLearningNotebooks
-
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
Azure/MachineLearningNotebooks#1975 · 1 comment ·
-
duplicates Open
Difficulty 1/5 Under an hour Newbie friendliness 68/100
Azure/MachineLearningNotebooks#1960 ·
-
machine Open
Difficulty 5/5 Over a week Newbie friendliness 10/100
Azure/MachineLearningNotebooks#1987 ·
-
Difficulty 5/5 Over a week Newbie friendliness 25/100
Azure/MachineLearningNotebooks#1985 · 1 comment ·
-
Difficulty 3/5 1-2 days Newbie friendliness 35/100
Azure/MachineLearningNotebooks#1981 · 1 reaction ·
All issues in Azure/MachineLearningNotebooks
Similar issues
-
bug triage
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
fivetran/great_expectations#12253 ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 75/100
-
correction metadata
Difficulty 1/5 Under an hour Newbie friendliness 78/100
acl-org/acl-anthology#10071 · 1 comment ·
-
data:css needs triage
Difficulty 2/5 1-3 hours Newbie friendliness 75/100
mdn/browser-compat-data#30618 ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 70/100
basedosdados/pipelines#2095 ·