Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CI: Write GHA failed builds summary as a GitHub comment #26930

Open
datapythonista opened this issue Jun 18, 2019 · 0 comments
Open

CI: Write GHA failed builds summary as a GitHub comment #26930

datapythonista opened this issue Jun 18, 2019 · 0 comments
Labels
CI Continuous Integration Enhancement Needs Discussion Requires discussion from core team before further action

Comments

@datapythonista
Copy link
Member

I think it'd safe us a significant amount of time, if when a build fails, we get a nice github comment with the problems. The same idea as what pep8speaks does for linting, but for most things.

I think in some cases it'll save us from having to navigate to the logs (which in azure is even more complex than needed, see #26895).

In the cases when we still need to go to the logs for full tracebacks or whatever, we should be able to have direct links to the log in the comment.

For first-time contributors, the comment will generate an email with the exact problem, and they should be able to follow up and leave the CI green without our intervention. This can be very useful for changes to the docstrings. So, when we go and review PRs, there are no formatting mistakes...

Ideally, azure-pipelines should provide it, for them would be quite trivial to implement, since they can get the permissions to add comments as a GitHub app. I created microsoft/azure-pipelines-tasks#10665 and ask PMs couple of times, but doesn't seem this will happen.

The alternative is a bit trickier, which is having a small web app (like 100 lines long flask script) in a server, and add a webhook that calls it after the build finishes (this can be done from either github or azure). The app can do a REST call to azure to get the log content, and the rest should be a simple regex to get the errors.

Let me know if anyone thinks this is not a good idea, or you know of a better solution. For Travis there seems to be an app that does this (or something similar), https://www.travisbuddy.com/, but I'm not sure if there is something for azure.

@datapythonista datapythonista added CI Continuous Integration Needs Discussion Requires discussion from core team before further action labels Jun 18, 2019
@mroeschke mroeschke changed the title CI: Write azure failed builds summary as a GitHub comment CI: Write GHA failed builds summary as a GitHub comment Mar 29, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CI Continuous Integration Enhancement Needs Discussion Requires discussion from core team before further action
Projects
None yet
Development

No branches or pull requests

2 participants