You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/machine-learning/how-to-create-component-pipeline-python.md
+8-11Lines changed: 8 additions & 11 deletions
Original file line number
Diff line number
Diff line change
@@ -20,7 +20,7 @@ In this article, you learn how to build an [Azure Machine Learning pipeline](con
20
20
21
21
The example trains a small [Keras](https://keras.io/) convolutional neural network to classify images in the [Fashion MNIST](https://github.com/zalandoresearch/fashion-mnist) dataset. The pipeline looks like following.
22
22
23
-
:::image type="content" source="./media/how-to-create-component-pipeline-python-v2/pipeline-graph.png" alt-text="Screenshot showing pipeline graph of the image classification Keras example." lightbox ="./media/how-to-create-component-pipeline-python-v2/pipeline-graph.png":::
23
+
:::image type="content" source="./media/how-to-create-component-pipeline-python/pipeline-graph.png" alt-text="Screenshot showing pipeline graph of the image classification Keras example." lightbox ="./media/how-to-create-component-pipeline-python/pipeline-graph.png":::
24
24
25
25
26
26
In this article, you complete the following tasks:
@@ -53,7 +53,7 @@ If you don't have an Azure subscription, create a free account before you begin.
53
53
54
54
This article uses the Python SDK forAzure ML to create and control an Azure Machine Learning pipeline. The article assumes that you'll be running the code snippets interactivelyin either a Python REPL environment or a Jupyter notebook.
55
55
56
-
This article is based on the `image_classification_keras_minist_convnet.ipynb` notebook found in the `sdk/jobs/pipelines/2e_image_classification_keras_minist_convnet` directory of the [AzureML Examples](https://github.com/azure/azureml-examples) repository.
56
+
This article is based on the [image_classification_keras_minist_convnet.ipynb](https://github.com/Azure/azureml-examples/blob/sdk-preview/sdk/jobs/pipelines/2e_image_classification_keras_minist_convnet/image_classification_keras_minist_convnet.ipynb) notebook found in the `sdk/jobs/pipelines/2e_image_classification_keras_minist_convnet` directory of the [AzureML Examples](https://github.com/azure/azureml-examples) repository.
57
57
58
58
## Import required libraries
59
59
@@ -103,8 +103,7 @@ If you're following along with the example in the [AzureML Examples repo](https:
103
103
104
104
By using command_component() function as a decorator, you can easily define the component's interface, metadata and code to execute from a python function. Each decorated Python functionwill be transformed into a single static specification (YAML) that the pipeline service can process.
The code above define a component with display name `Prep Data` using `@command_component` decorator:
110
109
@@ -122,14 +121,13 @@ Following is what a component looks like in the studio UI.
122
121
- A component is a block in a pipeline graph.
123
122
- The `input_data`, `training_data` and `test_data` are ports of the component, which connects to other components for data streaming.
124
123
125
-
:::image type="content" source="./media/how-to-create-component-pipeline-python-v2/prep-data-component.png" alt-text="Screenshot of the Prep Data component in the UI and code." lightbox ="./media/how-to-create-component-pipeline-python-v2/prep-data-component.png":::
124
+
:::image type="content" source="./media/how-to-create-component-pipeline-python/prep-data-component.png" alt-text="Screenshot of the Prep Data component in the UI and code." lightbox ="./media/how-to-create-component-pipeline-python/prep-data-component.png":::
126
125
127
126
#### Specify component run-time environment
128
127
129
128
You'll need to modify the runtime environment in which your component runs.
The above code creates an object of `Environment` class, which represents the runtime environment in which the component runs.
135
133
@@ -161,7 +159,7 @@ The `train.py` file contains a normal python function, which performs the traini
161
159
162
160
After defining the training functionsuccessfully, you can use @command_component in Azure Machine Learning SDK v2 to wrap your functionas a component, which can be used in AML pipelines.
The code above define a component with display name `Train Image Classification Keras` using `@command_component`:
167
165
@@ -175,7 +173,6 @@ The train-model component has a slightly more complex configuration than the pre
175
173
176
174
Now, you've prepared all source files for the `Train Image Classification Keras` component.
177
175
178
-
179
176
### Create the score-model component
180
177
181
178
In this section, other than the previous components, you'll create a component to score the trained model via Yaml specification and script.
@@ -303,9 +300,9 @@ You can monitor the pipeline run by opening the link or you can block until it c
303
300
304
301
You can open the `Link to Azure Machine Learning studio`, which is the job detail page of your pipeline. You'll see the pipeline graph like following.
305
302
306
-
:::image type="content" source="./media/how-to-create-component-pipeline-python-v2/pipeline-ui.png" alt-text="Screenshot of the pipeline job detail page." lightbox ="./media/how-to-create-component-pipeline-python-v2/pipeline-ui.png":::
303
+
:::image type="content" source="./media/how-to-create-component-pipeline-python/pipeline-ui.png" alt-text="Screenshot of the pipeline job detail page." lightbox ="./media/how-to-create-component-pipeline-python/pipeline-ui.png":::
307
304
308
-
You can check the logs and outputs of each component by right clicking the component, or select the component to open its detail pane. To learn more about how to debug your pipeline in UI, you can refer to [this article](how-to-use-pipeline-ui.md).
305
+
You can check the logs and outputs of each component by right clicking the component, or select the component to open its detail pane. To learn more about how to debug your pipeline in UI, see [How to use studio UI to build and debug Azure ML pipelines](how-to-use-pipeline-ui.md).
Copy file name to clipboardExpand all lines: articles/machine-learning/how-to-create-component-pipelines-ui.md
+8-4Lines changed: 8 additions & 4 deletions
Original file line number
Diff line number
Diff line change
@@ -38,7 +38,7 @@ In this article, you'll learn how to create and run [machine learning pipelines]
38
38
39
39
## Register component in your workspace
40
40
41
-
To build pipeline using components in UI, you need to register components to your workspace first. You can use CLI or SDK to register components to your workspace, so that you can share and resue the component within the workspace. Registered components support automatic versioning so you can update the component but assure that pipelines that require an older version will continue to work.
41
+
To build pipeline using components in UI, you need to register components to your workspace first. You can use CLI or SDK to register components to your workspace, so that you can share and reuse the component within the workspace. Registered components support automatic versioning so you can update the component but assure that pipelines that require an older version will continue to work.
42
42
43
43
In the example below take using CLI for example. If you want to learn more about how to build a component, see [Create and run pipelines using components with CLI](how-to-create-component-pipelines-cli.md).
44
44
@@ -58,16 +58,20 @@ In the example below take using CLI for example. If you want to learn more about
58
58
59
59
## Create pipeline using registered component
60
60
61
-
1. Create a new pipeline in the designer. You can change the pipeline name.
61
+
1. Create a new pipeline in the designer.
62
+
63
+
:::image type="content" source="./media/how-to-create-component-pipelines-ui/new-pipeline.png" alt-text="Screenshot showing creating new pipeline in designer homepage." lightbox ="./media/how-to-create-component-pipelines-ui/new-pipeline.png":::
62
64
63
65
1. Set the default compute target of the pipeline.
64
66
65
-
Next to the pipeline name, select the **Gear icon**  at the top of the canvas to open the **Settings** pane. Select the default compute target for your pipeline.
67
+
Select the **Gear icon**  at the top right of the canvas to open the **Settings** pane. Select the default compute target for your pipeline.
68
+
69
+
:::image type="content" source="./media/how-to-create-component-pipelines-ui/set-default-compute.png" alt-text="Screenshot showing setting default compute for the pipeline." lightbox ="./media/how-to-create-component-pipelines-ui/set-default-compute.png":::
66
70
67
71
> [!Important]
68
72
> Attached compute is not supported, use [compute instances or clusters](concept-compute-target.md#azure-machine-learning-compute-managed) instead.
69
73
70
-
1. In asset library, you can see the components registered from previous section.
74
+
1. In asset library, you can see **Data assets** and **Components** tabs. Switch to **Components** tab, you can see the components registered from previous section.
Copy file name to clipboardExpand all lines: articles/machine-learning/how-to-use-pipeline-ui.md
+2-2Lines changed: 2 additions & 2 deletions
Original file line number
Diff line number
Diff line change
@@ -23,7 +23,7 @@ This article will introduce how to use the studio UI to build and debug machine
23
23
24
24
### Drag and drop components to build pipeline
25
25
26
-
In the designer homepage, you can select "New" to open a blank pipeline draft.
26
+
In the designer homepage, you can select **New pipeline** to open a blank pipeline draft.
27
27
28
28
In the asset library left of the canvas, there are **Data assets** and **Components** tabs, which contain components and data registered to the workspace. For what is component and how to create custom component, you can refer to the [component concept article](concept-component.md).
29
29
@@ -73,7 +73,7 @@ You can filter failed or completed nodes, and filter by only components or datas
73
73
74
74
:::image type="content" source="./media/how-to-use-pipeline-ui/quick-filter.png" alt-text="Screenshot showing the quick filter by in outline > search." lightbox= "./media/how-to-use-pipeline-ui/quick-filter.png":::
75
75
76
-
You can also sort the filter nodes.
76
+
You can also sort the filtered nodes.
77
77
78
78
:::image type="content" source="./media/how-to-use-pipeline-ui/sort.png" alt-text="Screenshot of sorting search result in outline > search." lightbox= "./media/how-to-use-pipeline-ui/sort.png":::
0 commit comments