You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/stream-analytics/filter-ingest-data-lake-storage-gen2.md
+23-4Lines changed: 23 additions & 4 deletions
Original file line number
Diff line number
Diff line change
@@ -6,7 +6,7 @@ ms.author: sidram
6
6
ms.service: stream-analytics
7
7
ms.topic: how-to
8
8
ms.custom: mvc, event-tier1-build-2022
9
-
ms.date: 05/08/2022
9
+
ms.date: 05/24/2022
10
10
---
11
11
12
12
# Filter and ingest to Azure Data Lake Storage Gen2 using the Stream Analytics no code editor
@@ -32,9 +32,9 @@ This article describes how you can use the no code editor to easily create a Str
32
32
:::image type="content" source="./media/filter-ingest-data-lake-storage-gen2/add-field.png" alt-text="Screenshot showing where you can add a field or remove, rename, or change a field type." lightbox="./media/filter-ingest-data-lake-storage-gen2/add-field.png" :::
33
33
1. A live sample of incoming data in **Data preview** table under the diagram view. It automatically refreshes periodically. You can select **Pause streaming preview** to see a static view of sample input data.
34
34
:::image type="content" source="./media/filter-ingest-data-lake-storage-gen2/sample-input.png" alt-text="Screenshot showing sample data on the Data preview tab." lightbox="./media/filter-ingest-data-lake-storage-gen2/sample-input.png" :::
35
-
1. In the **Filter** area, select a field to filter the incoming data with a condition.
35
+
1.Select the **Filter** tile. In the **Filter** area, select a field to filter the incoming data with a condition.
36
36
:::image type="content" source="./media/filter-ingest-data-lake-storage-gen2/filter-data.png" alt-text="Screenshot showing the Filter area where you can add a conditional filter." lightbox="./media/filter-ingest-data-lake-storage-gen2/filter-data.png" :::
37
-
1. Select the Azure Data Lake Gen2 table to send your filtered data:
37
+
1. Select the **Azure Data Lake Storage Gen2** tile. Select the **Azure Data Lake Gen2** table to send your filtered data:
38
38
1. Select the **subscription**, **storage account name**, and **container** from the drop-down menu.
39
39
1. After the **subscription** is selected, the **authentication method** and **storage account key** should be automatically filled in. Select **Connect**.
40
40
For more information about the fields and to see examples of path pattern, see [Blob storage and Azure Data Lake Gen2 output from Azure Stream Analytics](blob-storage-azure-data-lake-gen2-output.md).
@@ -47,10 +47,29 @@ This article describes how you can use the no code editor to easily create a Str
47
47
1. After your select **Start**, the job starts running within two minutes.
You can see the job under the Process Data section in the **Stream Analytics jobs** tab. Select **Open metrics** to monitor it or stop and restart it, as needed.
50
+
You can see the job under the Process Data section in the **Stream Analytics jobs** tab. Select **Refresh** until you see the job status as **Running**. Select **Open metrics** to monitor it or stop and restart it, as needed.
51
51
52
52
:::image type="content" source="./media/filter-ingest-data-lake-storage-gen2/no-code-list-jobs.png" alt-text="Screenshot showing the Stream Analytics jobs tab." lightbox="./media/filter-ingest-data-lake-storage-gen2/no-code-list-jobs.png" :::
53
53
54
+
Here's a sample **Metrics** page:
55
+
56
+
:::image type="content" source="./media/filter-ingest-data-lake-storage-gen2/metrics-page.png" alt-text="Screenshot showing the Metrics page." lightbox="./media/filter-ingest-data-lake-storage-gen2/metrics-page.png" :::
57
+
58
+
59
+
## Verify data in Data Lake Storage
60
+
61
+
1. You should see files created in the container you specified.
62
+
63
+
:::image type="content" source="./media/filter-ingest-data-lake-storage-gen2/filtered-data-file.png" alt-text="Screenshot showing the the generated file with filtered data in the Azure Data Lake Storage." lightbox="./media/filter-ingest-data-lake-storage-gen2/filtered-data-file.png" :::
64
+
1. Download and open the file to confirm that you see only the filtered data. In the following example, you see data with **SwitchNum** set to **US**.
0 commit comments