Skip to content
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.

Commit 363844f

Browse files
committedApr 19, 2021
rearrange articles, from Shane
1 parent f6449a9 commit 363844f

40 files changed

+211
-484
lines changed
 

‎.openpublishing.redirection.json

Lines changed: 15 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -26530,6 +26530,21 @@
2653026530
"redirect_url": "/azure/machine-learning/classic/export-delete-personal-data-dsr",
2653126531
"redirect_document_id": true
2653226532
},
26533+
{
26534+
"source_path_from_root": "/articles/machine-learning/how-to-monitor-view-training-logs.md",
26535+
"redirect_url": "/azure/machine-learning/how-to-log-and-view.metrics",
26536+
"redirect_document_id": false
26537+
},
26538+
{
26539+
"source_path_from_root": "/articles/machine-learning/how-to-manage-runs.md",
26540+
"redirect_url": "/azure/machine-learning/how-to-track-monitor-analyze-runs",
26541+
"redirect_document_id": true
26542+
},
26543+
{
26544+
"source_path_from_root": "/articles/machine-learning/how-to-track-experiments.md",
26545+
"redirect_url": "/azure/machine-learning/how-to-log-and-view-metrics",
26546+
"redirect_document_id": true
26547+
},
2653326548
{
2653426549
"source_path_from_root": "/articles/machine-learning/machine-learning-faq.md",
2653526550
"redirect_url": "/azure/machine-learning/classic/faq",

‎articles/machine-learning/concept-azure-machine-learning-architecture.md

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -113,9 +113,9 @@ When you submit a run, Azure Machine Learning compresses the directory that cont
113113

114114
### Logging
115115

116-
Azure Machine Learning automatically logs standard run metrics for you. However, you can also [use the Python SDK to log arbitrary metrics](how-to-track-experiments.md).
116+
Azure Machine Learning automatically logs standard run metrics for you. However, you can also [use the Python SDK to log arbitrary metrics](how-to-log-and-view-metrics.md).
117117

118-
There are multiple ways to view your logs: monitoring run status in real time, or viewing results after completion. For more information, see [Monitor and view ML run logs](how-to-monitor-view-training-logs.md).
118+
There are multiple ways to view your logs: monitoring run status in real time, or viewing results after completion. For more information, see [Monitor and view ML run logs](how-to-log-and-view-metrics.md).
119119

120120

121121
> [!NOTE]
@@ -253,8 +253,8 @@ Pipeline steps are reusable, and can be run without rerunning the previous steps
253253
Azure Machine Learning provides the following monitoring and logging capabilities:
254254

255255
* For __Data Scientists__, you can monitor your experiments and log information from your training runs. For more information, see the following articles:
256-
* [Start, monitor, and cancel training runs](how-to-manage-runs.md)
257-
* [Log metrics for training runs](how-to-track-experiments.md)
256+
* [Start, monitor, and cancel training runs](how-to-track-monitor-analyze-runs.md)
257+
* [Log metrics for training runs](how-to-log-and-view-metrics.md)
258258
* [Track experiments with MLflow](how-to-use-mlflow.md)
259259
* [Visualize runs with TensorBoard](how-to-monitor-tensorboard.md)
260260
* For __Administrators__, you can monitor information about the workspace, related Azure resources, and events such as resource creation and deletion by using Azure Monitor. For more information, see [How to monitor Azure Machine Learning](monitor-azure-machine-learning.md).

‎articles/machine-learning/concept-ml-pipelines.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -42,7 +42,7 @@ After the pipeline is designed, there is often more fine-tuning around the train
4242

4343
With pipelines, you may choose to use different hardware for different tasks. Azure coordinates the various [compute targets](concept-azure-machine-learning-architecture.md) you use, so your intermediate data seamlessly flows to downstream compute targets.
4444

45-
You can [track the metrics for your pipeline experiments](./how-to-track-experiments.md) directly in Azure portal or your [workspace landing page (preview)](https://ml.azure.com). After a pipeline has been published, you can configure a REST endpoint, which allows you to rerun the pipeline from any platform or stack.
45+
You can [track the metrics for your pipeline experiments](./how-to-log-and-view-metrics.md) directly in Azure portal or your [workspace landing page (preview)](https://ml.azure.com). After a pipeline has been published, you can configure a REST endpoint, which allows you to rerun the pipeline from any platform or stack.
4646

4747
In short, all of the complex tasks of the machine learning lifecycle can be helped with pipelines. Other Azure pipeline technologies have their own strengths. [Azure Data Factory pipelines](../data-factory/concepts-pipelines-activities.md) excels at working with data and [Azure Pipelines](https://azure.microsoft.com/services/devops/pipelines/) is the right tool for continuous integration and deployment. But if your focus is machine learning, Azure Machine Learning pipelines are likely to be the best choice for your workflow needs.
4848

‎articles/machine-learning/data-science-virtual-machine/how-to-track-experiments.md

Lines changed: 0 additions & 202 deletions
This file was deleted.

‎articles/machine-learning/how-to-configure-auto-train.md

Lines changed: 17 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -390,7 +390,7 @@ Configure `max_concurrent_iterations` in your `AutoMLConfig` object. If it is n
390390

391391
Automated ML offers options for you to monitor and evaluate your training results.
392392

393-
* You can view your training results in a widget or inline if you are in a notebook. See [how to monitor automated ML runs](how-to-monitor-view-training-logs.md#monitor-automated-machine-learning-runs) for more details.
393+
* You can view your training results in a widget or inline if you are in a notebook. See [Monitor automated machine learning runs](#monitor) for more details.
394394

395395
* For definitions and examples of the performance charts and metrics provided for each run, see [Evaluate automated machine learning experiment results](how-to-understand-automated-ml.md) .
396396

@@ -493,6 +493,22 @@ print_model(model_from_aml)
493493
> [!NOTE]
494494
> The algorithms automated ML employs have inherent randomness that can cause slight variation in a recommended model's final metrics score, like accuracy. Automated ML also performs operations on data such as train-test split, train-validation split or cross-validation when necessary. So if you run an experiment with the same configuration settings and primary metric multiple times, you'll likely see variation in each experiments final metrics score due to these factors.
495495

496+
## <a name="monitor"></a> Monitor automated machine learning runs
497+
498+
For automated machine learning runs, to access the charts from a previous run, replace `<<experiment_name>>` with the appropriate experiment name:
499+
500+
```python
501+
from azureml.widgets import RunDetails
502+
from azureml.core.run import Run
503+
504+
experiment = Experiment (workspace, <<experiment_name>>)
505+
run_id = 'autoML_my_runID' #replace with run_ID
506+
run = Run(experiment, run_id)
507+
RunDetails(run).show()
508+
```
509+
510+
![Jupyter notebook widget for Automated Machine Learning](./media/how-to-configure-auto-train/azure-machine-learning-auto-ml-widget.png)
511+
496512
## Register and deploy models
497513

498514
You can register a model, so you can come back to it for later use.

‎articles/machine-learning/how-to-debug-pipelines.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -189,8 +189,8 @@ The table below provides information for different debug options for pipelines.
189189

190190
| Library | Type | Example | Destination | Resources |
191191
|----------------------------|--------|------------------------------------------------------------------|----------------------------------------------|------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
192-
| Azure Machine Learning SDK | Metric | `run.log(name, val)` | Azure Machine Learning Portal UI | [How to track experiments](how-to-track-experiments.md)<br>[azureml.core.Run class](/python/api/azureml-core/azureml.core.run%28class%29) |
193-
| Python printing/logging | Log | `print(val)`<br>`logging.info(message)` | Driver logs, Azure Machine Learning designer | [How to track experiments](how-to-track-experiments.md)<br><br>[Python logging](https://docs.python.org/2/library/logging.html) |
192+
| Azure Machine Learning SDK | Metric | `run.log(name, val)` | Azure Machine Learning Portal UI | [How to track experiments](how-to-log-and-view-metrics.md)<br>[azureml.core.Run class](/python/api/azureml-core/azureml.core.run%28class%29) |
193+
| Python printing/logging | Log | `print(val)`<br>`logging.info(message)` | Driver logs, Azure Machine Learning designer | [How to track experiments](how-to-log-and-view-metrics.md)<br><br>[Python logging](https://docs.python.org/2/library/logging.html) |
194194
| OpenCensus Python | Log | `logger.addHandler(AzureLogHandler())`<br>`logging.log(message)` | Application Insights - traces | [Debug pipelines in Application Insights](./how-to-log-pipelines-application-insights.md)<br><br>[OpenCensus Azure Monitor Exporters](https://github.com/census-instrumentation/opencensus-python/tree/master/contrib/opencensus-ext-azure)<br>[Python logging cookbook](https://docs.python.org/3/howto/logging-cookbook.html) |
195195

196196
#### Logging options example

‎articles/machine-learning/how-to-debug-visual-studio-code.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -274,7 +274,7 @@ ip_address: 10.3.0.5
274274
Save the `ip_address` value. It is used in the next section.
275275

276276
> [!TIP]
277-
> You can also find the IP address from the run logs for the child run for this pipeline step. For more information on viewing this information, see [Monitor Azure ML experiment runs and metrics](how-to-track-experiments.md).
277+
> You can also find the IP address from the run logs for the child run for this pipeline step. For more information on viewing this information, see [Monitor Azure ML experiment runs and metrics](how-to-log-and-view-metrics.md).
278278

279279
### Configure development environment
280280

0 commit comments

Comments
 (0)