NXDOMAIN results for the psg-prod-eastus.azureedge.net domain are breaking package downloads

Ouverte
#297 4 commentaires 6 réactions 0 personnes assignées Voir sur GitHub

Personne n'a encore pris cette issue.

Évaluation

Difficulté
4/5
Temps estimé
3-5 jours
Accessibilité débutants
25/100
Type d'issue
Bug
Clarté
Plutôt claire
Activité
À l'abandon
Stack technique
azure, powershell
Domaine
infrastructure

Piste de recherche

Start by reviewing the reported failures in PowerShellGet’s package download flow and the PowerShell Gallery endpoints named in the issue, especially psg-prod-eastus.azureedge.net. The report shows intermittent DNS resolution failures across GitHub hosted runners and two public resolvers, but does not identify a project file or test to change. Done means package downloads succeed reliably when the reported endpoint is queried.

Rédigé par le modèle d'indexation à partir du texte de l'issue.

Description

Prerequisites
  • Write a descriptive title.
  • Make sure you are able to repro it on the latest version
  • Search the existing issues.
Steps to reproduce

Install any module.
Install-Module AWS.Tools.ECR-Verbose
Occasionally you will get a failure to download the package.

Expected behavior
PS> $ErrorView = 'DetailedView'
PS> $requiredModules = @("AWS.Tools.Common", "AWS.Tools.ECR")
PS> $requiredModules | Foreach-Object {
    Write-Host "Installing PowerShell Module '$module'"
    Install-Module -Name $module -Force -Verbose
}

Both modules install successfully.
Actual behavior
PS> $ErrorView = 'DetailedView'
PS> $requiredModules = @("AWS.Tools.Common", "AWS.Tools.ECR")
PS> $requiredModules | Foreach-Object {
    Write-Host "Installing PowerShell Module '$module'"
    Install-Module -Name $module -Force -Verbose
}

One occasionally fails, sometimes the first, sometimes the second.
Error details
PS> $ErrorView = 'DetailedView'
PS> $requiredModules = @("AWS.Tools.Common", "AWS.Tools.ECR")
PS> $requiredModules | Foreach-Object {
    Write-Host "Installing PowerShell Module '$module'"
    Install-Module -Name $module -Force -Verbose
}

Installing PowerShell Module 'AWS.Tools.Common'
VERBOSE: Acquiring providers for assembly: /opt/microsoft/powershell/7/Modules/PackageManagement/coreclr/netstandard2.0/Microsoft.PackageManagement.MetaProvider.PowerShell.dll
VERBOSE: Acquiring providers for assembly: /opt/microsoft/powershell/7/Modules/PackageManagement/coreclr/netstandard2.0/Microsoft.PackageManagement.ArchiverProviders.dll
VERBOSE: Acquiring providers for assembly: /opt/microsoft/powershell/7/Modules/PackageManagement/coreclr/netstandard2.0/Microsoft.PackageManagement.NuGetProvider.dll
VERBOSE: Acquiring providers for assembly: /opt/microsoft/powershell/7/Modules/PackageManagement/coreclr/netstandard2.0/Microsoft.PackageManagement.CoreProviders.dll
VERBOSE: Using the provider 'PowerShellGet' for searching packages.
VERBOSE: The -Repository parameter was not specified.  PowerShellGet will use all of the registered repositories.
VERBOSE: Getting the provider object for the PackageManagement Provider 'NuGet'.
VERBOSE: The specified Location is 'https://www.powershellgallery.com/api/v2' and PackageManagementProvider is 'NuGet'.
VERBOSE: Searching repository 'https://www.powershellgallery.com/api/v2/FindPackagesById()?id='AWS.Tools.Common'' for ''.
VERBOSE: Total package yield:'1' for the specified package 'AWS.Tools.Common'.
VERBOSE: Performing the operation "Install-Module" on target "Version '4.1.734' of module 'AWS.Tools.Common'".
VERBOSE: The installation scope is specified to be 'CurrentUser'.
VERBOSE: The specified module will be installed in '/home/runner/.local/share/powershell/Modules'.
VERBOSE: The specified Location is 'NuGet' and PackageManagementProvider is 'NuGet'.
VERBOSE: Downloading module 'AWS.Tools.Common' with version '4.1.734' from the repository 'https://www.powershellgallery.com/api/v2'.
VERBOSE: Searching repository 'https://www.powershellgallery.com/api/v2/FindPackagesById()?id='AWS.Tools.Common'' for ''.
VERBOSE: InstallPackage' - name='AWS.Tools.Common', version='4.1.734',destination='/tmp/1065875406'
VERBOSE: DownloadPackage' - name='AWS.Tools.Common', version='4.1.734',destination='/tmp/1065875406/AWS.Tools.Common.4.1.734/AWS.Tools.Common.4.1.734.nupkg', uri='https://www.powershellgallery.com/api/v2/package/AWS.Tools.Common/4.1.734'
VERBOSE: Downloading 'https://www.powershellgallery.com/api/v2/package/AWS.Tools.Common/4.1.734'.
VERBOSE: Completed downloading 'https://www.powershellgallery.com/api/v2/package/AWS.Tools.Common/4.1.734'.
VERBOSE: Completed downloading 'AWS.Tools.Common'.
VERBOSE: InstallPackageLocal' - name='AWS.Tools.Common', version='4.1.734',destination='/tmp/1065875406'
VERBOSE: Validating the 'AWS.Tools.Common' module contents under '/tmp/1065875406/AWS.Tools.Common.4.1.734' path.
VERBOSE: Test-ModuleManifest successfully validated the module manifest file '/tmp/1065875406/AWS.Tools.Common.4.1.734'.
VERBOSE: Module 'AWS.Tools.Common' was installed successfully to path '/home/runner/.local/share/powershell/Modules/AWS.Tools.Common/4.1.734'.

Installing PowerShell Module 'AWS.Tools.ECR'
VERBOSE: Using the provider 'PowerShellGet' for searching packages.
VERBOSE: The -Repository parameter was not specified.  PowerShellGet will use all of the registered repositories.
VERBOSE: Getting the provider object for the PackageManagement Provider 'NuGet'.
VERBOSE: The specified Location is 'https://www.powershellgallery.com/api/v2' and PackageManagementProvider is 'NuGet'.
VERBOSE: Searching repository 'https://www.powershellgallery.com/api/v2/FindPackagesById()?id='AWS.Tools.ECR'' for ''.
VERBOSE: Total package yield:'1' for the specified package 'AWS.Tools.ECR'.
VERBOSE: Performing the operation "Install-Module" on target "Version '4.1.734' of module 'AWS.Tools.ECR'".
VERBOSE: The installation scope is specified to be 'CurrentUser'.
VERBOSE: The specified module will be installed in '/home/runner/.local/share/powershell/Modules'.
VERBOSE: The specified Location is 'NuGet' and PackageManagementProvider is 'NuGet'.
VERBOSE: Downloading module 'AWS.Tools.ECR' with version '4.1.734' from the repository 'https://www.powershellgallery.com/api/v2'.
VERBOSE: Searching repository 'https://www.powershellgallery.com/api/v2/FindPackagesById()?id='AWS.Tools.ECR'' for ''.
VERBOSE: Searching repository 'https://www.powershellgallery.com/api/v2/FindPackagesById()?id='AWS.Tools.Common'' for ''.
VERBOSE: InstallPackage' - name='AWS.Tools.Common', version='4.1.734',destination='/tmp/295771909'
VERBOSE: DownloadPackage' - name='AWS.Tools.Common', version='4.1.734',destination='/tmp/295771909/AWS.Tools.Common.4.1.734/AWS.Tools.Common.4.1.734.nupkg', uri='https://www.powershellgallery.com/api/v2/package/AWS.Tools.Common/4.1.734'
VERBOSE: Downloading 'https://www.powershellgallery.com/api/v2/package/AWS.Tools.Common/4.1.734'.
VERBOSE: Name or service not known (psg-prod-eastus.azureedge.net:443)
VERBOSE: Retry downloading 'https://www.powershellgallery.com/api/v2/package/AWS.Tools.Common/4.1.734' for '2' more times
VERBOSE: Name or service not known (psg-prod-eastus.azureedge.net:443)
VERBOSE: Retry downloading 'https://www.powershellgallery.com/api/v2/package/AWS.Tools.Common/4.1.734' for '1' more times
VERBOSE: Name or service not known (psg-prod-eastus.azureedge.net:443)
VERBOSE: Retry downloading 'https://www.powershellgallery.com/api/v2/package/AWS.Tools.Common/4.1.734' for '0' more times
VERBOSE: Downloading package 'AWS.Tools.Common' failed, please make sure 'https://www.powershellgallery.com/api/v2/package/AWS.Tools.Common/4.1.734' is accessable.
WARNING: Source Location 'https://www.powershellgallery.com/api/v2/package/AWS.Tools.Common/4.1.734' is not valid.

Install-Package: Package 'AWS.Tools.Common' failed to download.
Error: Process completed with exit code 1.
Environment data
I've had this occur in github actions on github hosted runners and can see the domain name failing to resolve
periodically from our office in New Zealand.
Version

Multiple versions (one is 7.4.6)

Visuals

With verbose output while installing the modules you can see the domain resolution failures:

image

I wrote a crappy script to check all the domains I could find listed that are required for psgallery package search and downloads and the eastus is the only one failing to resolve. It's failing to resolve from multiple DNS servers (I used google and cloudflare in this test):

# Crappy script to check all psgallery domains
$domains = @("psg-prod-eastus.azureedge.net", "psg-prod-centralus.azureedge.net", "onegetcdn.azureedge.net", "az818661.vo.msecnd.net", "powershellgallery.azureedge.net")
$resolvers = @("8.8.8.8", "1.1.1.1")

while ($true) {
  Start-Sleep -Seconds 1
  foreach ($resolver in $resolvers) {
    $results = [ordered]@{}
    foreach($domain in $domains) {
      $results[$domain] = $false
      try {
        Resolve-DnsName -Name $domain -Server $resolver -ErrorAction Stop | Out-Null
        $results[$domain] = $true
      } catch {
        if ($_.Exception.Message -notlike "*name does not exist*") {
          throw
        }
      }
    }
    Write-Host "$resolver > " -NoNewline
    $results.GetEnumerator() | ForEach-Object {
      $color = ($false -eq $_.Value) ? "Red" : "Green"
      Write-Host -ForegroundColor $color -Message $_.Name -NoNewline
      Write-Host ", " -NoNewline
    }
    Write-Host ""
  }
}

image

Langage dominant
PowerShell
Étoiles
289
Forks
83
Merge moyen
1 min
PR mergées (30 j)
1

Préparer son environnement

Par où commencer

  1. Lisez l'issue en entier, puis le guide de contribution du projet.
  2. Signalez en commentaire que vous la prenez — cela évite que deux personnes fassent le même travail.
  3. Forkez le dépôt et travaillez sur une branche.
  4. Ouvrez une pull request qui référence le numéro de l'issue.

Autres issues de PowerShell/PowerShellGallery

Toutes les issues de PowerShell/PowerShellGallery

Issues similaires

Plus d'issues DevOps

Recevez les nouvelles issues par e-mail

Un résumé court des issues GitHub adaptées aux débutants.