Add MLPipeline as a primitive

Open
#226 0 comments 0 reactions 1 assignee View on GitHub

@csala is already working on this.

Since Dec 18, 2019.

Assessment

This issue has not been assessed yet.

Description

approved new primitives

Create the mlblocks.MLPipeline primitive to allow setting a whole pipeline as a single primitive.

The primitive arguments will be the mlblocks.MLPipeline arguments, which means that the pipeline will be specified as either:

  • A pipeline name
  • A json path
  • A pipeline dictionary
  • Individual arguments

Some usage examples:

Python pipeline specification - specify the sub-pipeline by its name

from mlblocks import MLPipeline

primitives = [
    'mlblocks.MLPipeline',
    'xgboost.XGBClassifier'
]
init_params = {
    'mlblocks.MLPipeline#1': {
        'pipeline': 'my-preprocessing-pipeline'
    },
}
pipeline = MLPipeline(primitives, init_params=init_params)

Pipeline dictionary - specify the subpipelines by name, dict and json path

pipeline_dict = {
    'primitives': [
        'mlblocks.MLPipeline',
        'mlblocks.MLPipeline',
        'mlblocks.MLPipeline',
    ],
    'init_params': {
        'mlblocks.MLPipeline#1': {
            'pipeline': 'a-preprocessing-pipeline',
        },
        'mlblocks.MLPipeline#2': {
            'primitives': [
                'mlprimitives.feature_extraction.CategoricalEncoder',
                'sklearn.preprocessing.StandardScaler',
            ],
        },
        'mlblocks.MLPipeline#3': {
            'primitives': [
                'path/to/my/postprocessing/pipeline.json',
            ],
        },
    },
}
Dominant language
Python
Stars
70
Forks
37
PR merge metrics
No merged PRs in 30d

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from MLBazaar/MLPrimitives

All issues in MLBazaar/MLPrimitives

Similar issues

More Python issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.