[Bug] Azure Local 2610 deployment fails during Arc/Network configuration due to backend API registration mismatch

Start by tracing the reported DeployArb / Install-ArcHciMgmt path in ArcHci.psm1, especially Install-ArcHciHybridAKSExtension near line 4965, and check the deployment package's networkProfiles API version. Compare those values with the Azure Arc extension catalog and Microsoft.AzureStackHCI provider metadata for the affected region. Done means a deployment using the reported solution version completes the Arc infrastructure phase without either registration error.

[Bug] Azure Local 2610 Deployment Failure: API Version & Registration Mismatch in Backend (Microsoft.HybridAKSOperator & clusters/networkProfiles)

Title

[Bug] Azure Local 2610 deployment fails during Arc/Network configuration due to backend API registration mismatch

---

Description

Overview

During a clean deployment of Azure Local (Azure Stack HCI) 2610 using Solution Version 12.2610.1004.50, the orchestration consistently fails during the "Deploy Arc infrastructure components" phase.

The failure stems from a backend API registration and catalog synchronization issue:

1. The local deployment scripts execute hardcoded CLI calls requesting the Kubernetes extension Microsoft.HybridAKSOperator version 7.2.12 on the stable release train, which is rejected by the Azure API.
2. The deployment path for network profiles targets API version 2026-03-15-preview for child resource type Microsoft.AzureStackHCI/clusters/networkProfiles/default. However, the Azure Resource Provider backend currently registers and accepts only 2026-11-01-preview across regions, producing persistent NoRegisteredProviderFound errors.

Core cluster creation and deployment prerequisites succeed prior to this step, confirming that the issue is isolated to resource provider API compatibility and extension version registration in the Azure control plane.

---

Detailed Technical Analysis

1. Arc Extension Failure (Microsoft.HybridAKSOperator)

During the DeployArb role execution (Install-ArcHciMgmt), the orchestration engine runs the following command via Azure CLI:

az.cmd k8s-extension create \
  --cluster-type appliances \
  --cluster-name "contoso-cl-arcbridge" \
  --resource-group "rg-contoso-azure-local-gwc" \
  --name "hybridaksextension" \
  --extension-type Microsoft.HybridAKSOperator \
  --release-train stable \
  --version 7.2.12 \
  --auto-upgrade False \
  --config-file C:\ClusterStorage\Infrastructure_1\Shares\SU1_Infrastructure_1\MocArb\WorkingDirectory\Appliance\aks-extension-config.json \
  --only-show-errors

This returns an ExtensionOperationFailed exception:

ERROR: (ExtensionOperationFailed) The extension operation failed with the following error: 
Failed to resolve the extension version from the given values. 
InnerError: 'Extension type 'microsoft.hybridaksoperator' does not support release train 'stable' for version '7.2.12'. 
Please try again with release train "stable".

The error message contains a contradictory directive ("does not support release train 'stable' ... Please try again with release train 'stable'"), indicating that version 7.2.12 is not properly mapped to the stable release train in the global Azure Arc catalog for the target region.

---

2. Resource Provider API Mismatch (clusters/networkProfiles)

Correlating support portal activity logs and deployment telemetry reveals a corresponding mismatch on the cluster network profile child resource (Microsoft.AzureStackHCI/clusters/networkProfiles/default):

• The local deployment package requests API version: 2026-03-15-preview.
• Querying the Microsoft.AzureStackHCI provider capabilities for clusters/networkProfiles confirms that only 2026-11-01-preview is currently registered:

{
  "resourceType": "clusters/networkProfiles",
  "locations": [
    "South Central US",
    "East US",
    "UK South",
    "UK West",
    "Germany West Central",
    "Australia East",
    "West Europe",
    "Southeast Asia",
    "Canada Central",
    "Japan East",
    "Central India"
  ],
  "apiVersions": [
    "2026-11-01-preview"
  ],
  "capabilities": "None"
}

Because legacy versions (such as 2026-03-15-preview) are unlisted across all supported regions, calls targeting that version fail with NoRegisteredProviderFound.

---

Steps to Reproduce

1. Prepare a host system with Azure Local (Azure Stack HCI OS) build 2610.
2. Launch a new deployment targeting Solution Version 12.2610.1004.50 in germanywestcentral (or any region where only 2026-11-01-preview is registered).
3. Complete initial hardware and infrastructure validation checks.
4. Execute deployment until the "Deploy Arc infrastructure components" phase.
5. The task fails at DeployArb / Install-ArcHciMgmt.

---

Observed Error Stack Trace (Anonymized)

Type 'DeployArb' of Role 'MocArb' raised an exception: [DeployArb:Calling Install-ArcHciMgmt]
Correlation ID: 00000000-0000-0000-0000-000000000000

az.cmd k8s-extension create --cluster-type appliances --cluster-name "contoso-cl-arcbridge" \
  --resource-group "rg-contoso-azure-local-gwc" --name "hybridaksextension" \
  --extension-type Microsoft.HybridAKSOperator --release-train stable --version 7.2.12 \
  --auto-upgrade False --config-file <path>\aks-extension-config.json --only-show-errors

returned error stream:
[ERROR: (ExtensionOperationFailed) The extension operation failed with the following error: 
Failed to resolve the extension version from the given values. 
InnerError: 'Extension type 'microsoft.hybridaksoperator' does not support release train 'stable' for version '7.2.12'.]

at Invoke-ArcHciAzCommandLine, ArcHci.psm1: line 3579
at Invoke-ArcHciAzCommand, ArcHci.psm1: line 3451
at Install-ArcHciHybridAKSExtension, ArcHci.psm1: line 4965
at Install-ArcHciHybridAKS, ArcHci.psm1: line 6723
at Install-ArcHciMgmt, ArcHci.psm1: line 6507
at DeployArbInternal, MocArbHelper.psm1: line 2006
at DeployArb, MocArbLifeCycleManager.psm1: line 312

Associated ARM Activity Log:

Code: NoRegisteredProviderFound
Message: The resource type 'clusters/networkProfiles' was not found in the provider namespace 
'Microsoft.AzureStackHCI' for api version '2026-03-15-preview'.

---

Expected Behavior

• The Azure Arc Extension catalog must resolve Microsoft.HybridAKSOperator version 7.2.12 on the stable release train for appliance cluster types.
• The Azure Resource Provider Microsoft.AzureStackHCI should maintain backward-compatible registration for clusters/networkProfiles API versions (e.g., 2026-03-15-preview) that active production solution versions (12.2610.1004.50) actively depend on.

---

Suggested Remediation

1. Azure Backend Fix: Re-register/enable API version 2026-03-15-preview for clusters/networkProfiles and align the Microsoft.HybridAKSOperator version mapping for stable.
2. Deployment Package Update: Publish an updated ECE / Solution package aligning the deployment scripts to target the currently active 2026-11-01-preview API version and the corresponding extension release train.

---

Environment Details

• Product: Azure Local (Azure Stack HCI)
• OS Version: 2610
• Solution Version: 12.2610.1004.50
• Affected Regions: Confirmed in Germany West Central; provider metadata indicates global scope across all Azure Local locations.