Cannot restore on Mac OS X

[manu-st]

I have an issue in Mac OS X where I'm getting some failure restoring the build tools:

-- Installing: /Users/Silicon/local/Microsoft/coreclr/bin/Product/OSX.x64.Debug/lib/libpalrt.a
Restoring BuildTools...
.NET CLI will be downloaded from https://dotnetcli.blob.core.windows.net/dotnet/beta/Binaries/1.0.0.001718/dotnet-osx-x64.1.0.0.001718.tar.gz
log  : Restoring packages for /Users/Silicon/local/Microsoft/coreclr/Tools/1.0.25-prerelease-00206/project.json...
info :   GET https://www.myget.org/F/dotnet-buildtools/FindPackagesById()?id='Microsoft.DotNet.BuildTools'
info :   OK https://www.myget.org/F/dotnet-buildtools/FindPackagesById()?id='Microsoft.DotNet.BuildTools' 3657ms
info :   GET https://dotnet.myget.org/F/dotnet-buildtools/FindPackagesById?id='Microsoft.DotNet.BuildTools'&$skiptoken='Microsoft.DotNet.BuildTools','1.0.25-prerelease-00145'
info :   OK https://dotnet.myget.org/F/dotnet-buildtools/FindPackagesById?id='Microsoft.DotNet.BuildTools'&$skiptoken='Microsoft.DotNet.BuildTools','1.0.25-prerelease-00145' 1527ms
info :   GET https://dotnet.myget.org/F/dotnet-buildtools/api/v2/package/Microsoft.DotNet.BuildTools/1.0.25-prerelease-00206
info :   OK https://dotnet.myget.org/F/dotnet-buildtools/api/v2/package/Microsoft.DotNet.BuildTools/1.0.25-prerelease-00206 1156ms
log  : Installing Microsoft.DotNet.BuildTools 1.0.25-prerelease-00206.
info : Committing restore...
log  : /Users/Silicon/local/Microsoft/coreclr/Tools/1.0.25-prerelease-00206/project.json
log  : Restore completed in 9120ms.

NuGet Config files used:
    /Users/Silicon/.nuget/NuGet/NuGet.Config

Feeds used:
    https://www.myget.org/F/dotnet-buildtools/

Installed:
    1 package(s) to /Users/Silicon/local/Microsoft/coreclr/Tools/1.0.25-prerelease-00206/project.json
log  : Restoring packages for /Users/Silicon/local/Microsoft/coreclr/packages/Microsoft.DotNet.BuildTools/1.0.25-prerelease-00206/lib/tool-runtime/project.json...
info :   GET https://dotnetmyget.blob.core.windows.net/artifacts/dotnet-core/nuget/v3/flatcontainer/nuproj/index.json
info :   GET https://dotnetmyget.blob.core.windows.net/artifacts/dotnet-buildtools/nuget/v3/flatcontainer/nuproj/index.json
info :   NotFound https://dotnetmyget.blob.core.windows.net/artifacts/dotnet-core/nuget/v3/flatcontainer/nuproj/index.json 756ms
info :   NotFound https://dotnetmyget.blob.core.windows.net/artifacts/dotnet-buildtools/nuget/v3/flatcontainer/nuproj/index.json 668ms
info :   GET https://api.nuget.org/v3-flatcontainer/nuproj/index.json
info :   GET https://dotnetmyget.blob.core.windows.net/artifacts/dotnet-core/nuget/v3/flatcontainer/microsoft.build.framework/index.json
info :   GET https://dotnetmyget.blob.core.windows.net/artifacts/dotnet-buildtools/nuget/v3/flatcontainer/microsoft.build.framework/index.json
...

And many more errors about not being able to find json files. Eventually, it hangs at:

...
log  :   Couldn't connect to server
info :   GET https://api.nuget.org/v3-flatcontainer/system.linq.parallel/index.json
info :   GET https://api.nuget.org/v3-flatcontainer/system.globalization.extensions/index.json
log  : Retrying 'FindPackagesByIdAsync' for source 'https://api.nuget.org/v3-flatcontainer/system.linq.parallel/index.json'.
log  : An error occurred while sending the request.
log  :   Couldn't connect to server
log  : Retrying 'FindPackagesByIdAsync' for source 'https://api.nuget.org/v3-flatcontainer/system.globalization.extensions/index.json'.
log  : An error occurred while sending the request.
log  :   Couldn't connect to server
info :   GET https://dotnetmyget.blob.core.windows.net/artifacts/dotnet-core/nuget/v3/flatcontainer/system.io.filesystem.primitives/4.0.1-rc2-23907/system.io.filesystem.primitives.4.0.1-rc2-23907.nupkg
log  : Failed to download package from 'https://dotnetmyget.blob.core.windows.net/artifacts/dotnet-core/nuget/v3/flatcontainer/system.io.filesystem.primitives/4.0.1-rc2-23907/system.io.filesystem.primitives.4.0.1-rc2-23907.nupkg'.
log  : An error occurred while sending the request.
log  :   Couldn't connect to server

Any idea?

[jkotas]

There are connectivity issues that are affecting number of things (e.g. they are contributing to CI failures as well). Could you please retry again after some time?

[lemmaa]

Is your first try on Mac OS X? Have you done mozroots --import --sync before?

[manu-st]

Definitely my first time. I remember seeing this for other platforms, but this is not part of the OS X build instructions. Unfortunately, I do not have mozroots available. From which package does it come ?

[lemmaa]

@manu-silicon You can find it from 'mono' package

sjlee@callisto:~$ ls -la `which mozroots`
lrwxr-xr-x  1 sjlee  admin  36 Feb 18 22:11 /usr/local/bin/mozroots -> ../Cellar/mono/4.2.2.30/bin/mozroots
sjlee@callisto:~$ brew list
boost       gdb         gmp         isl         libpng      nettle      pixman      readline    vim
cmake       gdbm        gnutls      jpeg        libtasn1    node        pkg-config  sqlite      wget
ctags       gettext     icu4c       libffi      mono        openssl     python      tomcat      xz
gcc         glib        irssi       libmpc      mpfr        pcre        qemu        tree
sjlee@callisto:~$ 

[ericstj]

This is the same as https://github.com/dotnet/cli/issues/809. Workaround is to bump up the file descriptor limit. Just looked at a similar issue with @shiftkey, we need to get a bug on NuGet here. Looks like file descriptor limit needs to be a design-point for cross-plat applications.

[manu-st]

@ericstj I'll give it a try tonight. Thanks.

[manu-st]

@ericstj It seems to have done the trick, I had to do ulimit -n 1024 in bash to go to completion. However there are still a lot of errors being displayed.

[manu-st]

Although not tested, I think this should be fixed by PR dotnet/coreclr#4052

[ericstj]

FYI: it looks like NuGet took a fix for this here: NuGet/NuGet.Client@f5f67f6

[shiftkey]

To make it doubly-clear, NuGet/NuGet.Client@d6e4237 was merged into dev recently...

[manu-st]

👍