You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/hdinsight/hadoop/apache-hadoop-on-premises-migration-best-practices-infrastructure.md
+2-2Lines changed: 2 additions & 2 deletions
Original file line number
Diff line number
Diff line change
@@ -31,7 +31,7 @@ For more information, see the article [Capacity planning for HDInsight clusters]
31
31
32
32
## Use recommended virtual machine type for cluster
33
33
34
-
See [Default node configuration and virtual machine sizes for clusters](../hdinsight-component-versioning.md#default-node-configuration-and-virtual-machine-sizes-for-clusters) for recommended virtual machine types for each type of HDInsight cluster.
34
+
See [Default node configuration and virtual machine sizes for clusters](../hdinsight-supported-node-configuration.md) for recommended virtual machine types for each type of HDInsight cluster.
35
35
36
36
## Check Hadoop components availability in HDInsight
37
37
@@ -68,7 +68,7 @@ Applications or components that were available in on-premises clusters but aren'
68
68
|Palantir|IaaS
69
69
|Sailpoint|Iaas
70
70
71
-
For more information, see the article [Apache Hadoop components available with different HDInsight versions](../hdinsight-component-versioning.md#apache-components-available-with-different-hdinsight-versions)
71
+
For more information, see the article [Apache Hadoop components available with different HDInsight versions](../hdinsight-component-versioning.md)
72
72
73
73
## Customize HDInsight clusters using script actions
Copy file name to clipboardExpand all lines: articles/hdinsight/hadoop/hdinsight-troubleshoot-cluster-creation-fails.md
+1-1Lines changed: 1 addition & 1 deletion
Original file line number
Diff line number
Diff line change
@@ -61,7 +61,7 @@ Ensure that there are no [locks on your virtual network and resource group](../.
61
61
62
62
## Unsupported component versions
63
63
64
-
Ensure that you are using a [supported version of Azure HDInsight](../hdinsight-component-versioning.md) and any [Apache Hadoop components](../hdinsight-component-versioning.md#apache-components-available-with-different-hdinsight-versions) in your solution.
64
+
Ensure that you are using a [supported version of Azure HDInsight and Apache Hadoop component](../hdinsight-component-versioning.md) in your solution.
Copy file name to clipboardExpand all lines: articles/hdinsight/hdinsight-faq.md
+1-1Lines changed: 1 addition & 1 deletion
Original file line number
Diff line number
Diff line change
@@ -56,7 +56,7 @@ Yes. To install additional components or customize cluster configuration, use:
56
56
57
57
-[HDInsight Application Platform](https://azure.microsoft.com/services/hdinsight/partner-ecosystem/) to install applications.
58
58
59
-
For a list of supported components see [What are the Apache Hadoop components and versions available with HDInsight?](./hdinsight-component-versioning.md#apache-components-available-with-different-hdinsight-versions)
59
+
For a list of supported components see [What are the Apache Hadoop components and versions available with HDInsight?](./hdinsight-component-versioning.md)
60
60
61
61
### Can I upgrade the individual components that are pre-installed on the cluster?
Copy file name to clipboardExpand all lines: articles/hdinsight/hdinsight-hadoop-create-linux-clusters-azure-cli.md
+1-1Lines changed: 1 addition & 1 deletion
Original file line number
Diff line number
Diff line change
@@ -37,7 +37,7 @@ The steps in this document walk-through creating a HDInsight 3.6 cluster using t
37
37
|`--workernode-count`| The number of worker nodes in the cluster. This article uses the variable `clusterSizeInNodes` as the value passed to `--workernode-count`. |
38
38
|`--version`| The HDInsight cluster version. This article uses the variable `clusterVersion` as the value passed to `--version`. See also: [Supported HDInsight versions](./hdinsight-component-versioning.md#supported-hdinsight-versions).|
39
39
|`--type`| Type of HDInsight cluster, like: hadoop, interactivehive, hbase, kafka, storm, spark, rserver, mlservices. This article uses the variable `clusterType` as the value passed to `--type`. See also: [Cluster types and configuration](./hdinsight-hadoop-provision-linux-clusters.md#cluster-type).|
40
-
|`--component-version`|The versions of various Hadoop components, in space-separated versions in 'component=version' format. This article uses the variable `componentVersion` as the value passed to `--component-version`. See also: [Hadoop components](./hdinsight-component-versioning.md#apache-components-available-with-different-hdinsight-versions).|
40
+
|`--component-version`|The versions of various Hadoop components, in space-separated versions in 'component=version' format. This article uses the variable `componentVersion` as the value passed to `--component-version`. See also: [Hadoop components](./hdinsight-component-versioning.md).|
41
41
42
42
Replace `RESOURCEGROUPNAME`, `LOCATION`, `CLUSTERNAME`, `STORAGEACCOUNTNAME`, and `PASSWORD` with the desired values. Change values for the other variables as desired. Then enter the CLI commands.
Copy file name to clipboardExpand all lines: articles/hdinsight/hdinsight-hadoop-provision-linux-clusters.md
+1-1Lines changed: 1 addition & 1 deletion
Original file line number
Diff line number
Diff line change
@@ -211,7 +211,7 @@ Each cluster type has its own number of nodes, terminology for nodes, and defaul
211
211
| Storm |Nimbus node (2), supervisor server (1+), ZooKeeper node (3) ||
212
212
| Spark |Head node (2), Worker node (1+), ZooKeeper node (3) (free for A1 ZooKeeper VM size) ||
213
213
214
-
For more information, see [Default node configuration and virtual machine sizes for clusters](hdinsight-component-versioning.md#default-node-configuration-and-virtual-machine-sizes-for-clusters) in "What are the Hadoop components and versions in HDInsight?"
214
+
For more information, see [Default node configuration and virtual machine sizes for clusters](hdinsight-supported-node-configuration.md) in "What are the Hadoop components and versions in HDInsight?"
215
215
216
216
The cost of HDInsight clusters is determined by the number of nodes and the virtual machines sizes for the nodes.
Copy file name to clipboardExpand all lines: articles/hdinsight/hdinsight-release-notes-archive.md
+3-3Lines changed: 3 additions & 3 deletions
Original file line number
Diff line number
Diff line change
@@ -30,7 +30,7 @@ HDInsight now uses Azure virtual machines to provision the cluster. Starting fro
30
30
31
31
### Deprecation
32
32
#### Deprecation of HDInsight 3.6 ML Services cluster
33
-
HDInsight 3.6 ML Services cluster type will be end of support by December 31 2020. Customers won't create new 3.6 ML Services clusters after December 31 2020. Existing clusters will run as is without the support from Microsoft. Check the support expiration for HDInsight versions and cluster types [here](./hdinsight-component-versioning.md#available-versions).
33
+
HDInsight 3.6 ML Services cluster type will be end of support by December 31 2020. Customers won't create new 3.6 ML Services clusters after December 31 2020. Existing clusters will run as is without the support from Microsoft. Check the support expiration for HDInsight versions and cluster types [here](./hdinsight-component-versioning.md#supported-HDInsight-versions).
34
34
35
35
#### Disabled VM sizes
36
36
Starting from November 16 2020, HDInsight will block new customers creating clusters using standand_A8, standand_A9, standand_A10 and standand_A11 VM sizes. Existing customers who have used these VM sizes in the past three months won't be affected. Starting form January 9 2021, HDInsight will block all customers creating clusters using standand_A8, standand_A9, standand_A10 and standand_A11 VM sizes. Existing clusters will run as is. Consider moving to HDInsight 4.0 to avoid potential system/support interruption.
@@ -45,7 +45,7 @@ The following changes will happen in upcoming releases.
45
45
HDInsight today doesn't support customizing Zookeeper node size for Spark, Hadoop, and ML Services cluster types. It defaults to A2_v2/A2 virtual machine sizes, which are provided free of charge. In the upcoming release, you can select a Zookeeper virtual machine size that is most appropriate for your scenario. Zookeeper nodes with virtual machine size other than A2_v2/A2 will be charged. A2_v2 and A2 virtual machines are still provided free of charge.
46
46
47
47
#### Default cluster version will be changed to 4.0
48
-
Starting February 2021, the default version of HDInsight cluster will be changed from 3.6 to 4.0. For more information about available versions, see [available versions](./hdinsight-component-versioning.md#available-versions). Learn more about what is new in [HDInsight 4.0](./hdinsight-version-release.md)
48
+
Starting February 2021, the default version of HDInsight cluster will be changed from 3.6 to 4.0. For more information about available versions, see [supported versions](./hdinsight-component-versioning.md#supported-HDInsight-versions). Learn more about what is new in [HDInsight 4.0](./hdinsight-version-release.md)
49
49
50
50
#### HDInsight 3.6 end of support on June 30 2021
51
51
HDInsight 3.6 will be end of support. Starting form June 30 2021, customers can't create new HDInsight 3.6 clusters. Existing clusters will run as is without the support from Microsoft. Consider moving to HDInsight 4.0 to avoid potential system/support interruption.
@@ -71,7 +71,7 @@ HDInsight now uses Azure virtual machines to provision the cluster. Starting fro
71
71
72
72
### Deprecation
73
73
#### Deprecation of HDInsight 3.6 ML Services cluster
74
-
HDInsight 3.6 ML Services cluster type will be end of support by Dec 31 2020. Customers won't create new 3.6 ML Services clusters after that. Existing clusters will run as is without the support from Microsoft. Check the support expiration for HDInsight versions and cluster types [here](./hdinsight-component-versioning.md#available-versions).
74
+
HDInsight 3.6 ML Services cluster type will be end of support by Dec 31 2020. Customers won't create new 3.6 ML Services clusters after that. Existing clusters will run as is without the support from Microsoft. Check the support expiration for HDInsight versions and cluster types [here](./hdinsight-component-versioning.md#supported-HDInsight-versions).
Copy file name to clipboardExpand all lines: articles/hdinsight/hdinsight-release-notes.md
+2-2Lines changed: 2 additions & 2 deletions
Original file line number
Diff line number
Diff line change
@@ -32,7 +32,7 @@ HDInsight now uses Azure virtual machines to provision the cluster. Starting fro
32
32
33
33
## Deprecation
34
34
### Deprecation of HDInsight 3.6 ML Services cluster
35
-
HDInsight 3.6 ML Services cluster type will be end of support by December 31 2020. Customers won't be able to create new 3.6 ML Services clusters after December 31 2020. Existing clusters will run as is without the support from Microsoft. Check the support expiration for HDInsight versions and cluster types [here](./hdinsight-component-versioning.md#available-versions).
35
+
HDInsight 3.6 ML Services cluster type will be end of support by December 31 2020. Customers won't be able to create new 3.6 ML Services clusters after December 31 2020. Existing clusters will run as is without the support from Microsoft. Check the support expiration for HDInsight versions and cluster types [here](./hdinsight-component-versioning.md).
36
36
37
37
### Disabled VM sizes
38
38
Starting from November 16 2020, HDInsight will block new customers creating clusters using standand_A8, standand_A9, standand_A10 and standand_A11 VM sizes. Existing customers who have used these VM sizes in the past three months won't be affected. Starting form January 9 2021, HDInsight will block all customers creating clusters using standand_A8, standand_A9, standand_A10 and standand_A11 VM sizes. Existing clusters will run as is. Consider moving to HDInsight 4.0 to avoid potential system/support interruption.
@@ -51,7 +51,7 @@ HDInsight will introduce the first major official release of .NET for Apache Spa
51
51
Starting from next release (around end of January), default cluster VM sizes will be changed from D family to Ev3 family. This change applies to head nodes and worker nodes. To avoid this change, specify the VM sizes that you want to use in the ARM template.
52
52
53
53
### Default cluster version will be changed to 4.0
54
-
Starting February 2021, the default version of HDInsight cluster will be changed from 3.6 to 4.0. For more information about available versions, see [available versions](./hdinsight-component-versioning.md#available-versions). Learn more about what is new in [HDInsight 4.0](./hdinsight-version-release.md)
54
+
Starting February 2021, the default version of HDInsight cluster will be changed from 3.6 to 4.0. For more information about available versions, see [supported versions](./hdinsight-component-versioning.md#supported-HDInsight-versions). Learn more about what is new in [HDInsight 4.0](./hdinsight-version-release.md)
55
55
56
56
### OS version upgrade
57
57
HDInsight is upgrading OS version from 16.04 to 18.04. The upgrade will complete before April 2021.
Copy file name to clipboardExpand all lines: articles/hdinsight/hdinsight-troubleshoot-failed-cluster.md
+1-1Lines changed: 1 addition & 1 deletion
Original file line number
Diff line number
Diff line change
@@ -9,7 +9,7 @@ ms.date: 08/15/2019
9
9
10
10
# Troubleshoot a slow or failing job on a HDInsight cluster
11
11
12
-
If an application processing data on a HDInsight cluster is either running slowly or failing with an error code, you have several troubleshooting options. If your jobs are taking longer to run than expected, or you are seeing slow response times in general, there may be failures upstream from your cluster, such as the services on which the cluster runs. However, the most common cause of these slowdowns is insufficient scaling. When you create a new HDInsight cluster, select the appropriate [virtual machine sizes](hdinsight-component-versioning.md#default-node-configuration-and-virtual-machine-sizes-for-clusters).
12
+
If an application processing data on a HDInsight cluster is either running slowly or failing with an error code, you have several troubleshooting options. If your jobs are taking longer to run than expected, or you are seeing slow response times in general, there may be failures upstream from your cluster, such as the services on which the cluster runs. However, the most common cause of these slowdowns is insufficient scaling. When you create a new HDInsight cluster, select the appropriate [virtual machine sizes](hdinsight-supported-node-configuration.md).
13
13
14
14
To diagnose a slow or failing cluster, gather information about all aspects of the environment, such as associated Azure Services, cluster configuration, and job execution information. A helpful diagnostic is to try to reproduce the error state on another cluster.
0 commit comments