Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Dependabot NuGet updates timing out #16473

Closed
Piedone opened this issue Jul 22, 2024 · 3 comments
Closed

Dependabot NuGet updates timing out #16473

Piedone opened this issue Jul 22, 2024 · 3 comments
Labels
bug 🐛 Ecosystem

Comments

@Piedone
Copy link
Member

Piedone commented Jul 22, 2024

Describe the bug

We haven't received Dependabot NuGet updates since the 8th of July, despite it having to run once a week.

If you're a maintainer, under https://github.com/OrchardCMS/OrchardCore/network/updates you'll see the output logs of the update attempts. Chrome chokes on these logs for me, but if you right click -> Save link as... then you can download them and when opened locally they'll be easier to work with. However, they don't really have any good details.

The more recent one failed with this at the end:

updater | running NuGet updater:
updater | /opt/nuget/NuGetUpdater/NuGetUpdater.Cli update --repo-root /home/dependabot/dependabot-updater/repo --solution-or-project /home/dependabot/dependabot-updater/repo/src/OrchardCore/OrchardCore.Queries.Core/OrchardCore.Queries.Core.csproj --dependency YesSql.Core --new-version 5.1.0 --previous-version 5.0.0 --result-output-path /tmp/update-result.json --verbose
updater |   No dotnet-tools.json file found.
updater |   No global.json file found.
updater | Running for project file [src/OrchardCore/OrchardCore.Queries.Core/OrchardCore.Queries.Core.csproj]
updater | Updating project [/home/dependabot/dependabot-updater/repo/src/OrchardCore/OrchardCore.Queries.Abstractions/OrchardCore.Queries.Abstractions.csproj]
updater |   Running for SDK-style project
updater |     Package [YesSql.Core] Does not exist as a dependency in [/home/dependabot/dependabot-updater/repo/src/OrchardCore/OrchardCore.Queries.Abstractions/OrchardCore.Queries.Abstractions.csproj].
updater | Updating project [/home/dependabot/dependabot-updater/repo/src/OrchardCore/OrchardCore.Queries.Core/OrchardCore.Queries.Core.csproj]
updater |   Running for SDK-style project
updater |     Package [YesSql.Core] already meets the requested dependency version in [/home/dependabot/dependabot-updater/repo/src/OrchardCore/OrchardCore.Queries.Core/OrchardCore.Queries.Core.csproj].
updater | Update complete.
updater |   Writing update result to [/tmp/update-result.json].
updater | 2024/07/22 08:48:51 INFO <job_858623793> update result: {
updater |   "ErrorType": null,
updater |   "ErrorDetails": null
updater | }
updater | The contents of file [Directory.Packages.props] were updated.
updater | 2024/07/22 08:48:51 INFO <job_858623793> Checking if YesSql.Filters.Abstractions 5.0.0 needs updating
  proxy | 2024/07/22 08:48:51 [752] GET https://api.nuget.org:443/v3/registration5-gz-semver2/yessql.filters.abstractions/index.json
  proxy | 2024/07/22 08:48:51 [752] 200 https://api.nuget.org:443/v3/registration5-gz-semver2/yessql.filters.abstractions/index.json
updater | 2024/07/22 08:48:51 INFO <job_858623793> Filtered out 5 pre-release versions
  proxy | 2024/07/22 08:48:51 [754] GET https://api.nuget.org:443/v3-flatcontainer/yessql.filters.abstractions/5.0.0/yessql.filters.abstractions.nuspec
  proxy | 2024/07/22 08:48:51 [754] 200 https://api.nuget.org:443/v3-flatcontainer/yessql.filters.abstractions/5.0.0/yessql.filters.abstractions.nuspec
updater | 2024/07/22 08:48:51 INFO <job_858623793> Latest version is 5.1.0
updater | 2024/07/22 08:48:51 INFO <job_858623793> Requirements to unlock all
updater | 2024/07/22 08:48:51 INFO <job_858623793> Requirements update strategy 
updater | Finding updated dependencies for YesSql.Filters.Abstractions.
  proxy | 2024/07/22 08:48:52 [756] GET https://api.nuget.org:443/v3-flatcontainer/yessql.filters.abstractions/5.1.0/yessql.filters.abstractions.nuspec
  proxy | 2024/07/22 08:48:52 [756] 200 https://api.nuget.org:443/v3-flatcontainer/yessql.filters.abstractions/5.1.0/yessql.filters.abstractions.nuspec
  proxy | 2024/07/22 08:48:52 [758] GET https://api.nuget.org:443/v3-flatcontainer/parlot/1.0.0/parlot.nuspec
  proxy | 2024/07/22 08:48:52 [758] 200 https://api.nuget.org:443/v3-flatcontainer/parlot/1.0.0/parlot.nuspec
  proxy | 2024/07/22 08:48:52 [760] GET https://api.nuget.org:443/v3-flatcontainer/system.collections.immutable/8.0.0/system.collections.immutable.nuspec
  proxy | 2024/07/22 08:48:52 [760] 200 https://api.nuget.org:443/v3-flatcontainer/system.collections.immutable/8.0.0/system.collections.immutable.nuspec
  proxy | 2024/07/22 08:48:52 [762] GET https://api.nuget.org:443/v3-flatcontainer/system.runtime.compilerservices.unsafe/6.0.0/system.runtime.compilerservices.unsafe.nuspec
  proxy | 2024/07/22 08:48:52 [762] 200 https://api.nuget.org:443/v3-flatcontainer/system.runtime.compilerservices.unsafe/6.0.0/system.runtime.compilerservices.unsafe.nuspec
updater | 2024/07/22 08:48:52 INFO <job_858623793> Updating YesSql.Filters.Abstractions from 5.0.0 to 5.1.0
updater | running NuGet updater:
updater | /opt/nuget/NuGetUpdater/NuGetUpdater.Cli update --repo-root /home/dependabot/dependabot-updater/repo --solution-or-project /home/dependabot/dependabot-updater/repo/src/OrchardCore/OrchardCore.Users.Core/OrchardCore.Users.Core.csproj --dependency YesSql.Filters.Abstractions --new-version 5.1.0 --previous-version 5.0.0 --result-output-path /tmp/update-result.json --verbose
  proxy | 2024/07/22 08:48:56 Posting metrics to remote API endpoint
  proxy | 2024/07/22 08:48:56 Successfully posted metrics data via api client
  proxy | 2024/07/22 08:49:23 [764] GET https://api.nuget.org:443/v3-flatcontainer/yessql.filters.abstractions/index.json
  proxy | 2024/07/22 08:49:23 [764] 200 https://api.nuget.org:443/v3-flatcontainer/yessql.filters.abstractions/index.json
  proxy | 2024/07/22 08:49:23 [766] GET https://api.nuget.org:443/v3-flatcontainer/yessql.filters.abstractions/5.1.0/yessql.filters.abstractions.5.1.0.nupkg
  proxy | 2024/07/22 08:49:23 [766] 200 https://api.nuget.org:443/v3-flatcontainer/yessql.filters.abstractions/5.1.0/yessql.filters.abstractions.5.1.0.nupkg
  proxy | 2024/07/22 08:49:23 [768] GET https://api.nuget.org:443/v3-flatcontainer/parlot/index.json
  proxy | 2024/07/22 08:49:23 [768] 200 https://api.nuget.org:443/v3-flatcontainer/parlot/index.json
  proxy | 2024/07/22 08:49:23 [770] GET https://api.nuget.org:443/v3-flatcontainer/parlot/1.0.0/parlot.1.0.0.nupkg
  proxy | 2024/07/22 08:49:23 [770] 200 https://api.nuget.org:443/v3-flatcontainer/parlot/1.0.0/parlot.1.0.0.nupkg
  proxy | 2024/07/22 08:49:56 Posting metrics to remote API endpoint
  proxy | 2024/07/22 08:49:56 Successfully posted metrics data via api client
updater |   No dotnet-tools.json file found.
updater |   No global.json file found.
updater | Running for project file [src/OrchardCore/OrchardCore.Users.Core/OrchardCore.Users.Core.csproj]
updater | Updating project [/home/dependabot/dependabot-updater/repo/src/OrchardCore/OrchardCore.ContentManagement.GraphQL/OrchardCore.ContentManagement.GraphQL.csproj]
updater |   Running for SDK-style project
updater |     Package [YesSql.Filters.Abstractions] Does not exist as a dependency in [/home/dependabot/dependabot-updater/repo/src/OrchardCore/OrchardCore.ContentManagement.GraphQL/OrchardCore.ContentManagement.GraphQL.csproj].
updater | Updating project [/home/dependabot/dependabot-updater/repo/src/OrchardCore/OrchardCore.Data.YesSql/OrchardCore.Data.YesSql.csproj]
updater |   Running for SDK-style project
updater |     Package [YesSql.Filters.Abstractions] Does not exist as a dependency in [/home/dependabot/dependabot-updater/repo/src/OrchardCore/OrchardCore.Data.YesSql/OrchardCore.Data.YesSql.csproj].
updater | Updating project [/home/dependabot/dependabot-updater/repo/src/OrchardCore/OrchardCore.DisplayManagement.Abstractions/OrchardCore.DisplayManagement.Abstractions.csproj]
updater |   Running for SDK-style project
updater |     Package [YesSql.Filters.Abstractions] Does not exist as a dependency in [/home/dependabot/dependabot-updater/repo/src/OrchardCore/OrchardCore.DisplayManagement.Abstractions/OrchardCore.DisplayManagement.Abstractions.csproj].
updater | Updating project [/home/dependabot/dependabot-updater/repo/src/OrchardCore/OrchardCore.Infrastructure.Abstractions/OrchardCore.Infrastructure.Abstractions.csproj]
updater |   Running for SDK-style project
updater |     Package [YesSql.Filters.Abstractions] Does not exist as a dependency in [/home/dependabot/dependabot-updater/repo/src/OrchardCore/OrchardCore.Infrastructure.Abstractions/OrchardCore.Infrastructure.Abstractions.csproj].
updater | Updating project [/home/dependabot/dependabot-updater/repo/src/OrchardCore/OrchardCore.Users.Abstractions/OrchardCore.Users.Abstractions.csproj]
updater |   Running for SDK-style project
updater |     Package [YesSql.Filters.Abstractions] Does not exist as a dependency in [/home/dependabot/dependabot-updater/repo/src/OrchardCore/OrchardCore.Users.Abstractions/OrchardCore.Users.Abstractions.csproj].
updater | Updating project [/home/dependabot/dependabot-updater/repo/src/OrchardCore/OrchardCore.Users.Core/OrchardCore.Users.Core.csproj]
updater |   Running for SDK-style project
updater |     Found incorrect [PackageVersion] version attribute in [Directory.Packages.props].
updater |     Unable resolve requested dependency for YesSql.Filters.Abstractions in /home/dependabot/dependabot-updater/repo/src/OrchardCore/OrchardCore.Users.Core/OrchardCore.Users.Core.csproj.
updater |     Unable resolve requested dependency for YesSql.Filters.Abstractions in /home/dependabot/dependabot-updater/repo/src/OrchardCore/Directory.Build.props.
updater |     Unable resolve requested dependency for YesSql.Filters.Abstractions in /home/dependabot/dependabot-updater/repo/Directory.Build.props.
updater |     Unable resolve requested dependency for YesSql.Filters.Abstractions in /home/dependabot/dependabot-updater/repo/src/OrchardCore.Build/TargetFrameworks.props.
updater |     Unable resolve requested dependency for YesSql.Filters.Abstractions in /home/dependabot/dependabot-updater/repo/src/OrchardCore.Build/OrchardCore.Commons.props.
updater |     Unable resolve requested dependency for YesSql.Filters.Abstractions in /home/dependabot/dependabot-updater/repo/Directory.Packages.props.
updater |     Unable resolve requested dependency for YesSql.Filters.Abstractions in /home/dependabot/dependabot-updater/repo/src/OrchardCore/Directory.Build.targets.
updater |     Unable resolve requested dependency for YesSql.Filters.Abstractions in /home/dependabot/dependabot-updater/repo/src/OrchardCore.Build/OrchardCore.Commons.targets.
updater |     Saved [Directory.Packages.props].
updater | Update complete.
updater |   Writing update result to [/tmp/update-result.json].
updater | 2024/07/22 08:49:59 INFO <job_858623793> update result: {
updater |   "ErrorType": null,
updater |   "ErrorDetails": null
updater | }
updater | running NuGet updater:
updater | /opt/nuget/NuGetUpdater/NuGetUpdater.Cli update --repo-root /home/dependabot/dependabot-updater/repo --solution-or-project /home/dependabot/dependabot-updater/repo/src/OrchardCore/OrchardCore.Contents.Core/OrchardCore.Contents.Core.csproj --dependency YesSql.Filters.Abstractions --new-version 5.1.0 --previous-version 5.0.0 --result-output-path /tmp/update-result.json --verbose
updater |   No dotnet-tools.json file found.
updater |   No global.json file found.
updater | Running for project file [src/OrchardCore/OrchardCore.Contents.Core/OrchardCore.Contents.Core.csproj]
updater | Updating project [/home/dependabot/dependabot-updater/repo/src/OrchardCore/OrchardCore.ContentManagement.Abstractions/OrchardCore.ContentManagement.Abstractions.csproj]
updater |   Running for SDK-style project
updater |     Package [YesSql.Filters.Abstractions] Does not exist as a dependency in [/home/dependabot/dependabot-updater/repo/src/OrchardCore/OrchardCore.ContentManagement.Abstractions/OrchardCore.ContentManagement.Abstractions.csproj].
updater | Updating project [/home/dependabot/dependabot-updater/repo/src/OrchardCore/OrchardCore.DisplayManagement.Abstractions/OrchardCore.DisplayManagement.Abstractions.csproj]
updater |   Running for SDK-style project
updater |     Package [YesSql.Filters.Abstractions] Does not exist as a dependency in [/home/dependabot/dependabot-updater/repo/src/OrchardCore/OrchardCore.DisplayManagement.Abstractions/OrchardCore.DisplayManagement.Abstractions.csproj].
updater | Updating project [/home/dependabot/dependabot-updater/repo/src/OrchardCore/OrchardCore.Infrastructure.Abstractions/OrchardCore.Infrastructure.Abstractions.csproj]
updater |   Running for SDK-style project
updater |     Package [YesSql.Filters.Abstractions] Does not exist as a dependency in [/home/dependabot/dependabot-updater/repo/src/OrchardCore/OrchardCore.Infrastructure.Abstractions/OrchardCore.Infrastructure.Abstractions.csproj].
updater | Updating project [/home/dependabot/dependabot-updater/repo/src/OrchardCore/OrchardCore.Contents.Core/OrchardCore.Contents.Core.csproj]
updater |   Running for SDK-style project
updater |     Found correct [PackageVersion] version attribute in [Directory.Packages.props].
updater |     Unable resolve requested dependency for YesSql.Filters.Abstractions in /home/dependabot/dependabot-updater/repo/src/OrchardCore/OrchardCore.Contents.Core/OrchardCore.Contents.Core.csproj.
updater |     Unable resolve requested dependency for YesSql.Filters.Abstractions in /home/dependabot/dependabot-updater/repo/src/OrchardCore/Directory.Build.props.
updater |     Unable resolve requested dependency for YesSql.Filters.Abstractions in /home/dependabot/dependabot-updater/repo/Directory.Build.props.
updater |     Unable resolve requested dependency for YesSql.Filters.Abstractions in /home/dependabot/dependabot-updater/repo/src/OrchardCore.Build/TargetFrameworks.props.
updater |     Unable resolve requested dependency for YesSql.Filters.Abstractions in /home/dependabot/dependabot-updater/repo/src/OrchardCore.Build/OrchardCore.Commons.props.
updater |     Unable resolve requested dependency for YesSql.Filters.Abstractions in /home/dependabot/dependabot-updater/repo/Directory.Packages.props.
updater |     Unable resolve requested dependency for YesSql.Filters.Abstractions in /home/dependabot/dependabot-updater/repo/src/OrchardCore/Directory.Build.targets.
updater |     Unable resolve requested dependency for YesSql.Filters.Abstractions in /home/dependabot/dependabot-updater/repo/src/OrchardCore.Build/OrchardCore.Commons.targets.
updater | Update complete.
updater |   Writing update result to [/tmp/update-result.json].
updater | 2024/07/22 08:50:58 INFO <job_858623793> update result: {
updater |   "ErrorType": null,
updater |   "ErrorDetails": null
updater | }
updater | running NuGet updater:
updater | /opt/nuget/NuGetUpdater/NuGetUpdater.Cli update --repo-root /home/dependabot/dependabot-updater/repo --solution-or-project /home/dependabot/dependabot-updater/repo/src/OrchardCore/OrchardCore.AuditTrail.Abstractions/OrchardCore.AuditTrail.Abstractions.csproj --dependency YesSql.Filters.Abstractions --new-version 5.1.0 --previous-version 5.0.0 --result-output-path /tmp/update-result.json --verbose
updater | time="2024-07-22T08:51:17Z" level=info msg="task complete" container_id=job-858623793-updater exit_code=137 job_id=858623793 step=updater
updater | time="2024-07-22T08:51:18Z" level=warning msg="timeout running job" error="waiting for updater: waiting for container: context deadline exceeded" job_id=858623793

From the logs, it ran for about 46 minutes.

The earlier one failed with this, nothing error-like, and has run also for about 46 minutes, so I guess the cutoff is that:

updater | Update complete.
updater | The contents of file [Directory.Packages.props] were updated.
updater | 2024/07/15 08:11:43 INFO <job_855579875> Checking if Jint 3.1.4 needs updating
  proxy | 2024/07/15 08:11:43 [775] GET https://api.nuget.org:443/v3/registration5-gz-semver2/jint/index.json
  proxy | 2024/07/15 08:11:43 [775] 200 https://api.nuget.org:443/v3/registration5-gz-semver2/jint/index.json
  proxy | 2024/07/15 08:11:43 [777] GET https://api.nuget.org:443/v3-flatcontainer/jint/3.1.4/jint.nuspec
  proxy | 2024/07/15 08:11:43 [777] 200 https://api.nuget.org:443/v3-flatcontainer/jint/3.1.4/jint.nuspec
updater | 2024/07/15 08:11:43 INFO <job_855579875> Latest version is 3.1.5
updater | 2024/07/15 08:11:43 INFO <job_855579875> Requirements to unlock all
updater | 2024/07/15 08:11:43 INFO <job_855579875> Requirements update strategy 
updater | Finding updated dependencies for Jint.
  proxy | 2024/07/15 08:11:43 [779] GET https://api.nuget.org:443/v3-flatcontainer/jint/3.1.5/jint.nuspec
  proxy | 2024/07/15 08:11:43 [779] 200 https://api.nuget.org:443/v3-flatcontainer/jint/3.1.5/jint.nuspec
  proxy | 2024/07/15 08:11:43 [781] GET https://api.nuget.org:443/v3-flatcontainer/esprima/3.0.5/esprima.nuspec
  proxy | 2024/07/15 08:11:43 [781] 200 https://api.nuget.org:443/v3-flatcontainer/esprima/3.0.5/esprima.nuspec
updater | 2024/07/15 08:11:43 INFO <job_855579875> Updating Jint from 3.1.4 to 3.1.5
updater | running NuGet updater:
updater | /opt/nuget/NuGetUpdater/NuGetUpdater.Cli update --repo-root /home/dependabot/dependabot-updater/repo --solution-or-project /home/dependabot/dependabot-updater/repo/src/OrchardCore/OrchardCore.Scripting.JavaScript/OrchardCore.Scripting.JavaScript.csproj --dependency Jint --new-version 3.1.5 --previous-version 3.1.4 --verbose
  proxy | 2024/07/15 08:12:01 [783] GET https://api.nuget.org:443/v3-flatcontainer/jint/index.json
  proxy | 2024/07/15 08:12:01 [783] 200 https://api.nuget.org:443/v3-flatcontainer/jint/index.json
  proxy | 2024/07/15 08:12:01 [785] GET https://api.nuget.org:443/v3-flatcontainer/jint/3.1.5/jint.3.1.5.nupkg
  proxy | 2024/07/15 08:12:01 [785] 200 https://api.nuget.org:443/v3-flatcontainer/jint/3.1.5/jint.3.1.5.nupkg
  proxy | 2024/07/15 08:12:22 Posting metrics to remote API endpoint
  proxy | 2024/07/15 08:12:22 Successfully posted metrics data via api client
updater | time="2024-07-15T08:12:52Z" level=info msg="task complete" container_id=job-855579875-updater exit_code=137 job_id=855579875 step=updater
updater | time="2024-07-15T08:12:53Z" level=warning msg="timeout running job" error="waiting for updater: waiting for container: context deadline exceeded" job_id=855579875

It seems to me that we just have too many packages.

Orchard Core version

This started to happen with the update starting at 2024/07/15 07:27:22 (UTC, I presume). Worked since June 13 before that.

To Reproduce

I guess re-run the update under https://github.com/OrchardCMS/OrchardCore/network/updates (what I just did, watching for results).

Expected behavior

We get a PR from Dependabot every week.

Logs and screenshots

The two failing outputs:

Dependabot outputs.zip
@Piedone
Copy link
Member Author

Piedone commented Jul 22, 2024

FYI @MikeAlhayek. Dependabot can now run as an action too: https://github.blog/2024-05-02-dependabot-on-github-actions-and-self-hosted-runners-is-now-generally-available/. I've enabled this and will re-run with actions once the current run finishes.

@Piedone
Copy link
Member Author

Piedone commented Jul 22, 2024

The manual re-run still failed but finished with this:

updater | 2024/07/22 19:31:54 INFO <job_859055117> Finished job processing
updater | 2024/07/22 19:31:54 INFO Results:
updater | +------------------------------------------------------------------------------------------------------------------------------------+
updater | |                                                Changes to Dependabot Pull Requests                                                 |
updater | +---------+--------------------------------------------------------------------------------------------------------------------------+
updater | | created | YesSql.Abstractions ( from 5.0.0 to 5.1.0 ), YesSql.Core ( from 5.0.0 to 5.1.0 ), YesSql.Abstractions ( from 5.0.0 to... |
updater | +---------+--------------------------------------------------------------------------------------------------------------------------+
updater | Dependabot encountered '3' error(s) during execution, please check the logs for more details.
updater | +-----------------------------------------------------------------+
updater | |                  Dependencies failed to update                  |
updater | +-------------------------------------------------+---------------+
updater | | Microsoft.IdentityModel.Protocols.OpenIdConnect | unknown_error |
updater | | xunit.analyzers                                 | unknown_error |
updater | | MessagePack                                     | unknown_error |
updater | +-------------------------------------------------+---------------+
updater | time="2024-07-22T19:31:54Z" level=info msg="task complete" container_id=job-859055117-updater exit_code=0 job_id=859055117 step=updater

No idea what this is supposed to mean.

Re-running after switching to GitHub Actions shows the same error: https://github.com/OrchardCMS/OrchardCore/actions/runs/10047370341. However, this did open a PR: #16474

@Piedone
Copy link
Member Author

Piedone commented Jul 23, 2024

The GHA version doesn't time out anymore, and opens PRs like this one: #16479 So we have this solved. However, simply updating dependencies now will fail the build and needs manual intervention: #16470.

@Piedone Piedone closed this as completed Jul 23, 2024
@Piedone Piedone mentioned this issue Jul 24, 2024
Closed
This was referenced Aug 1, 2024
Closed
Open
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug 🐛 Ecosystem
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@Piedone