Skip to content
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.

Commit 7173819

Browse files
committedMar 10, 2021
bulk of content done
1 parent 9c4f9b6 commit 7173819

11 files changed

+121
-22
lines changed
 

‎articles/hpc-cache/add-namespace-paths.md

Lines changed: 25 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -4,7 +4,7 @@ description: How to create client-facing paths for back-end storage with Azure H
44
author: ekpgh
55
ms.service: hpc-cache
66
ms.topic: how-to
7-
ms.date: 12/22/2020
7+
ms.date: 03/10/2021
88
ms.author: v-erkel
99
---
1010

@@ -128,6 +128,30 @@ The options used for the update command are similar to the "create" command, exc
128128

129129
---
130130

131+
### ADLS-NFS namespace paths (PREVIEW)
132+
133+
Like a regular blob storage target an ADLS-NFS storage target only has one export, so it can only have one one namespace path.
134+
135+
Follow the instructions below to set or change the path with the Azure portal.
136+
137+
From the Azure portal, load the **Namespace** settings page. You can add, change, or delete namespace paths from this page.
138+
139+
* **Add a new path:** Click the **+ Add** button at the top and fill in information in the edit panel.
140+
141+
![Screenshot of the add namespace edit fields with an ADLS-NFS storage target selected. The export and subdirectory paths are set to / and not editable.](media/namespace-add-adls.png)
142+
143+
* Enter the path clients will use to access this storage target.
144+
145+
* Select which access policy to use for this path. Learn more about customizing client access in [Use client access policies](access-policies.md).
146+
147+
* Select the storage target from the drop-down list. If an ADLS-NFS storage target already has a namespace path, it can't be selected.
148+
149+
* For an ADLS-NFS storage target, the export and subdirectory paths are automatically set to ``/``.
150+
151+
* **Change an existing path:** Click the namespace path. The edit panel opens. You can modify the path and the access policy, but you can't change to a different storage target.
152+
153+
* **Delete a namespace path:** Select the checkbox to the left of the path and click the **Delete** button.
154+
131155
## Next steps
132156

133157
After creating the aggregated namespace for your storage targets, you can mount clients on the cache. Read these articles to learn more.

‎articles/hpc-cache/cache-usage-models.md

Lines changed: 13 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -4,13 +4,13 @@ description: Describes the different cache usage models and how to choose among
44
author: ekpgh
55
ms.service: hpc-cache
66
ms.topic: how-to
7-
ms.date: 03/04/2021
7+
ms.date: 03/08/2021
88
ms.author: v-erkel
99
---
1010

1111
# Understand cache usage models
1212

13-
Cache usage models let you customize how your Azure HPC Cache stores files to speed up your workflow.
13+
Cache usage models let you customize how your Azure HPC Cache stores files to speed up your workflow.
1414

1515
## Basic file caching concepts
1616

@@ -26,7 +26,7 @@ File caching is how Azure HPC Cache expedites client requests. It uses these bas
2626

2727
* **Write-back delay** - For a cache with write caching turned on, write-back delay is the amount of time the cache waits for additional file changes before moving the file to the back-end storage system.
2828

29-
* **Back-end verification** - The back-end verification setting determines how frequently the cache compares its local copy of a file it fetched for a client with the remote version on the back-end storage system. If the back-end copy is newer than the cached copy, the cache fetches the remote copy and stores it for future requests.
29+
* **Back-end verification** - The back-end verification setting determines how frequently the cache compares its local copy of a file with the remote version on the back-end storage system. If the back-end copy is newer than the cached copy, the cache fetches the remote copy and stores it for future requests.
3030

3131
The back-end verification setting shows when the cache *automatically* compares its files with source files in remote storage. However, you can force Azure HPC Cache to compare files by performing a directory operation that includes a readdirplus request. Readdirplus is a standard NFS API (also called extended read) that returns directory metadata, which causes the cache to compare and update files.
3232

@@ -42,7 +42,7 @@ There are several options:
4242

4343
* **Read heavy, infrequent writes** - Use this option if you want to speed up read access to files that are static or rarely changed.
4444

45-
This option caches client reads but doesn't cache writes (it passes them through to the back-end storage immediately).
45+
This option caches client reads but doesn't cache writes. It passes writes through to the back-end storage immediately.
4646

4747
Files stored in the cache are not automatically compared to the files on the NFS storage volume. (Read the description of back-end verification above to learn how to compare them manually.)
4848

@@ -52,15 +52,17 @@ There are several options:
5252

5353
In this usage model, files in the cache are only checked against the files on back-end storage every eight hours. The cached version of the file is assumed to be more current. A modified file in the cache is written to the back-end storage system after it has been in the cache for an hour with no additional changes.
5454

55-
* **Clients write to the NFS target, bypassing the cache** - Choose this option if any clients in your workflow write data directly to the storage system without first writing to the cache, or if you want to optimize data consistency. Files that clients request are cached, but any changes to those files from the client are passed back to the back-end storage system immediately.
55+
* **Clients write to the NFS target, bypassing the cache** - Choose this option if any clients in your workflow write data directly to the storage system without first writing to the cache, or if you want to optimize data consistency. Files that clients request are cached (reads), but any changes to those files from the client (writes) are not cached. They are passed through directly to the back-end storage system.
5656

5757
With this usage model, the files in the cache are frequently checked against the back-end versions for updates. This verification allows files to be changed outside of the cache while maintaining data consistency.
5858

59-
* **Greater than 15% writes, checking the backing server for changes every 30 seconds** and **Greater than 15% writes, checking the backing server for changes every 60 seconds** -
59+
* **Greater than 15% writes, checking the backing server for changes every 30 seconds** and **Greater than 15% writes, checking the backing server for changes every 60 seconds** - These options are designed for workflows where you want to speed up both reads and writes, but there's a chance that another user will write directly to the back-end storage system. For example, if multiple sets of clients are working on the same files from different locations, these usage models might make sense to balance the need for quick file access with low tolerance for stale content from the source.
6060

61-
* **Greater than 15% writes, write back to the server every 30 seconds** (Collaborating cloud workstation) -
61+
* **Greater than 15% writes, write back to the server every 30 seconds** (Collaborating cloud workstation) - This option is designed for the scenario where multiple clients are actively modifying the same files, or if some clients access the back-end storage directly instead of mounting the cache.
6262

63-
* **Read heavy, checking the backing server every 3 hours** (Read-only high verification time) -
63+
The frequent back-end writes affect cache performance, so you should consider using the **Greater than 15% writes** usage model if there's a low risk of file conflict - for example, if you know that different clients are working in different areas of the same file set.
64+
65+
* **Read heavy, checking the backing server every 3 hours** (Read-only high verification time) - This option prioritizes fast reads on the client side, but also refreshes cached files from the back-end storage system more quickly than the **Read heavy, infrequent writes** usage model.
6466

6567
This table summarizes the usage model differences:
6668

@@ -74,7 +76,8 @@ This table summarizes the usage model differences:
7476
| Greater than 15% writes, frequent write-back (Collaborating cloud workstation) | Read/write | 30 seconds | 30 seconds |
7577
| Read heavy, checking the backing server every 3 hours (Read-only high verification time)| Read | 3 hours | None |
7678

79+
If you have questions about the best usage model for your Azure HPC Cache workflow, talk to your Azure representative or open a support request for help.
7780

78-
## Next steps:
81+
## Next steps
7982

80-
*
83+
* [Add storage targets](hpc-cache-add-storage.md) to your Azure HPC Cache

‎articles/hpc-cache/configuration.md

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -71,7 +71,9 @@ Your cache uses the Azure-based time server time.microsoft.com by default. If yo
7171
- (stuff about how to configure and why not to - from that email thread)
7272
- (something about a DNS forwarder?)
7373

74-
??? where to document refresh DNS? ???
74+
### Refresh storage target DNS
75+
76+
If your DNS configuration changes, storage targets will become unavailable. Read how to update your custom DNS system IP address in [Edit storage targets](hpc-cache-edit-storage.md#update-ip-address-custom-dns-configurations-only).
7577

7678

7779
## View snapshots for blob storage targets

‎articles/hpc-cache/hpc-cache-add-storage.md

Lines changed: 44 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -36,6 +36,9 @@ A new Blob storage target needs an empty Blob container or a container that is p
3636

3737
The Azure portal **Add storage target** page includes the option to create a new Blob container just before you add it.
3838

39+
> [!NOTE]
40+
> For NFS-mounted blob storage, use the [ADLS-NFS storage target](#) type.
41+
3942
### [Portal](#tab/azure-portal)
4043

4144
From the Azure portal, open your cache instance and click **Storage targets** on the left sidebar.
@@ -161,11 +164,11 @@ An NFS storage target has different settings from a Blob storage target. The usa
161164

162165
When you create a storage target that uses NFS to reach its storage system, you need to choose a usage model for that target. This model determines how your data is cached.
163166

164-
Read [Understand usage models](cach-usage-models.md) for more details about all of these settings.
167+
Read [Understand usage models](cache-usage-models.md) for more details about all of these settings.
165168

166169
The built-in usage models let you choose how to balance fast response with the risk of getting stale data. If you want to optimize speed for reading files, you might not care whether the files in the cache are checked against the back-end files. On the other hand, if you want to make sure your files are always up to date with the remote storage, choose a model that checks frequently.
167170

168-
These are the most frequently used options:
171+
These three options cover most situations:
169172

170173
* **Read heavy, infrequent writes** - Speeds up read access to files that are static or rarely changed.
171174

@@ -183,6 +186,8 @@ These are the most frequently used options:
183186

184187
Files that clients request are cached, but any changes to those files from the client are passed through to the back-end storage system immediately. Files in the cache are frequently checked against the back-end versions for updates. This verification maintains data consistency when files are changed directly on the storage system instead of through the cache.
185188

189+
For details about the other options, read [Understand usage models](cache-usage-models.md).
190+
186191
This table summarizes the differences among all of the usage models:
187192

188193
| Usage model | Caching mode | Back-end verification | Maximum write-back delay |
@@ -296,6 +301,43 @@ Output:
296301

297302
---
298303

304+
## Add a new ADLS-NFS storage target (PREVIEW)
305+
306+
ADLS-NFS storage targets use Azure Blob containers that support the Network File System (NFS) 3.0 protocol.
307+
308+
> [!NOTE]
309+
> NFS 3.0 protocol support for Azure Blob storage is in public preview. Availability is restricted, and features might change between now and when the feature becomes generally available. Do not use preview technology in production systems.
310+
>
311+
> Read [NFS 3.0 protocol support](../storage/blobs/network-file-system-protocol-support.md) for the latest information.
312+
313+
ADLS-NFS storage targets have some similarities with Blob storage targets and some with NFS storage targets. For example:
314+
315+
* Like a Blob storage target, you need to give Azure HPC Cache permission to [access your storage account](#add-the-access-control-roles-to-your-account).
316+
* Like an NFS storage target, you need to set a cache [usage model](#choose-a-usage-model).
317+
* Because NFS-enabled blob containers have an NFS-compatible hierarchical structure, you do not need to use the cache to ingest data, and the containers are readable by other NFS systems. You can pre-load data in an ADLS-NFS container, then add it to an HPC cache as storage target, and then access the data later from outside of an HPC cache. When you use a standard blob container as an HPC cache storage target, the data is written in a proprietary format and can only be accessed from other Azure HPC Cache-compatible products.
318+
319+
Before you can create an ADLS-NFS storage target, you must create an NFS-enabled storage account. Follow the tips in [Prerequisites for Azure HPC Cache](hpc-cache-prerequisites.md#nfs-mounted-blob-adls-nfs-storage-requirements-preview) and the instructions in [Mount Blob storage by using NFS](../storage/blobs/network-file-system-protocol-support-how-to). After your storage account is set up you can create a new container when you create the storage target.
320+
321+
To create an ADLS-NFS storage target, Open the **Add storage target** page in the Azure portal. (Additional methods are in development.)
322+
323+
![Screenshot of add storage target page with ADLS-NFS target defined](media/add-adls-target.png)
324+
325+
Enter this information.
326+
327+
* **Storage target name** - Set a name that identifies this storage target in the Azure HPC Cache.
328+
* **Target type** - Choose **ADLS-NFS**.
329+
* **Storage account** - Select the account that you want to use. If your NFS-enabled storage account does not appear in the list, check that it conforms to the prerequisites and that the cache can access it.
330+
331+
You will need to authorize the cache instance to access the storage account as described in [Add the access roles](#add-the-access-control-roles-to-your-account).
332+
333+
* **Storage container** - Select the NFS-enabled blob container for this target, or click **Create new**.
334+
335+
* **Usage model** - Choose one of the data caching profiles based on your workflow, described in [Choose a usage model](#choose-a-usage-model) above.
336+
337+
When finished, click **OK** to add the storage target.
338+
339+
<!-- **** -->
340+
299341
## View storage targets
300342

301343
You can use the Azure portal or the Azure CLI to show the storage targets already defined for your cache.

‎articles/hpc-cache/hpc-cache-edit-storage.md

Lines changed: 33 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -4,7 +4,7 @@ description: How to edit Azure HPC Cache storage targets
44
author: ekpgh
55
ms.service: hpc-cache
66
ms.topic: how-to
7-
ms.date: 09/30/2020
7+
ms.date: 03/10/2021
88
ms.author: v-erkel
99
---
1010

@@ -14,14 +14,17 @@ You can remove or modify storage targets with the Azure portal or by using the A
1414

1515
Depending on the type of storage, you can modify these storage target values:
1616

17-
* For Blob storage targets, you can change the namespace path.
17+
* For Blob storage targets, you can change the namespace path and access policy.
1818

1919
* For NFS storage targets, you can change these values:
2020

2121
* Namespace paths
22+
* Access policy
2223
* The storage export or export subdirectory associated with a namespace path
2324
* Usage model
2425

26+
* For ADLS-NFS storage targets, you can change the namespace path, access policy, and the usage model.
27+
2528
You can't edit a storage target's name, type, or back-end storage system (Blob container or NFS hostname/IP address). If you need to change these properties, delete the storage target and create a replacement with the new value.
2629

2730
> [!TIP]
@@ -93,7 +96,7 @@ Storage targets in caches with some types of custom DNS settings also have a con
9396

9497
Details are below:
9598

96-
* [Change aggregated namespace values](#change-aggregated-namespace-values) (virtual namespace path, export, and export subdirectory)
99+
* [Change aggregated namespace values](#change-aggregated-namespace-values) (virtual namespace path, access policy, export, and export subdirectory)
97100
* [Change the usage model](#change-the-usage-model)
98101
* [Refresh DNS](#update-ip-address-custom-dns-configurations-only)
99102

@@ -110,7 +113,7 @@ Use the **Namespace** page for your Azure HPC Cache to update namespace values.
110113
![screenshot of the portal namespace page with the NFS update page open at the right](media/update-namespace-nfs.png)
111114

112115
1. Click the name of the path that you want to change.
113-
1. Use the edit window to type in new virtual path, export, or subdirectory values.
116+
1. Use the edit window to type in new virtual path, export, or subdirectory values, or to select a different access policy.
114117
1. After making changes, click **OK** to update the storage target or **Cancel** to discard changes.
115118

116119
### [Azure CLI](#tab/azure-cli)
@@ -175,10 +178,33 @@ If the cache is stopped or not in a healthy state, the update will apply after t
175178

176179
### Update IP address (custom DNS configurations only)
177180

178-
If your cache uses a non-default DNS configuration, it's possible for your storage target's IP address to change because of back-end DNS changes. If your DNS server changes the back-end storage system's IP address, Azure HPC Cache can lose access to the storage system.
181+
If your cache uses a non-default DNS configuration, it's possible for your NFS storage target's IP address to change because of back-end DNS changes. If your DNS server changes the back-end storage system's IP address, Azure HPC Cache can lose access to the storage system.
182+
183+
Ideally, you should work with the manager of your cache's custom DNS system to plan for any updates, because these changes make storage unavailable.
184+
185+
If you need to update a storage target's DNS-provided IP address, there is a button on the Storage targets list. Click **Refresh DNS** to query the custom DNS server for a new IP address.
186+
187+
![Screenshot of storage target list. For one storage target, the "..." menu in the far right column is open and two options appear: Delete, and Refresh DNS.](media/refresh-dns.png)
188+
189+
If successful, the update should take less than two minutes. You can only refresh one storage target at a time; wait for the previous operation to complete before trying another.
190+
191+
## Update an ADLS-NFS storage target (PREVIEW)
192+
193+
Similar to NFS targets, you can change the namespace path and the usage model for ADLS-NFS storage targets.
194+
195+
### Change an ADLS-NFS namespace path
196+
197+
Use the **Namespace** page for your Azure HPC Cache to update namespace values. This page is described in more detail in the article [Set up the aggregated namespace](add-namespace-paths.md).
198+
199+
![screenshot of the portal namespace page with an ADS-NFS update page open at the right](media/update-namespace-adls.png)
200+
201+
1. Click the name of the path that you want to change.
202+
1. Use the edit window to type in new virtual path, or update the access policy.
203+
1. After making changes, click **OK** to update the storage target or **Cancel** to discard changes.
204+
205+
### Change ADLS-NFS usage models
179206

180-
+ description and screensots of DNS refresh
181-
+ why this is an interpersonal problem and maybe you should look into relationship counseling (clash scenarios things?)
207+
The configuration for ADLS-NFS usage models is identical to the NFS usage model selection. Read the portal instructions in [Change the usage model](#change-the-usage-model) in the NFS section above. Additional tools for updating ADLS-NFS storage targets are in development.
182208

183209

184210
## Next steps

‎articles/hpc-cache/hpc-cache-prerequisites.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -184,7 +184,7 @@ This is a general overview of the steps:
184184

185185
1. Make sure that the features you need are available in the regions where you plan to work.
186186

187-
1. Enable the NFS protocol feature for your subscription. Do this before you create the storage account.
187+
1. Enable the NFS protocol feature for your subscription. Do this *before* you create the storage account.
188188

189189
1. Create a secure virtual network (VNet) for the storage account. You should use the same virtual network for your NFS-enabled storage account and for your Azure HPC Cache.
190190

286 KB
Loading
Loading
81.8 KB
Loading
Loading

‎articles/hpc-cache/toc.yml

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -10,6 +10,8 @@
1010
items:
1111
- name: Plan the aggregated namespace
1212
href: hpc-cache-namespace.md
13+
- name: Understand cache usage models
14+
href: cache-usage-models.md
1315
- name: Security
1416
items:
1517
- name: Security baseline

0 commit comments

Comments
 (0)
Please sign in to comment.