Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Value worker migrate to task #2497

Merged
merged 13 commits into from
Aug 25, 2023

Conversation

IsaacMilarky
Copy link
Contributor

@IsaacMilarky IsaacMilarky commented Aug 25, 2023

Description
Migrate the old value worker into the new version of augur as a task called process_scc_value_metrics. This task does the same thing the old value worker did by using https://github.com/boyter/scc to gather data about files in a repo by language.

Also, alter the unique constraint on the repo_labor table to no longer be initially deferrable. This was done in order to have postgres ON CONFLICT logic work with the constraint which it didn't before altering it.

This new task is run as part of the facade tasks because it depends on the repository being cloned for it to work.

This new task also automatically clones and builds https://github.com/boyter/scc in the user's home directory in order to make it able to be used by augur in the same way that we do with ossf scorecard.

Signed commits

  • Yes, I signed my commits.

Signed-off-by: Isaac Milarsky <[email protected]>
Signed-off-by: Isaac Milarsky <[email protected]>
…the exact same thing in two places

Signed-off-by: Isaac Milarsky <[email protected]>
Signed-off-by: Isaac Milarsky <[email protected]>
…eferred so that it can be used in postgres ON CONFLICT logic

Signed-off-by: Isaac Milarsky <[email protected]>
Signed-off-by: Isaac Milarsky <[email protected]>
@IsaacMilarky IsaacMilarky requested a review from sgoggins as a code owner August 25, 2023 18:54
Signed-off-by: Isaac Milarsky <[email protected]>
@sgoggins sgoggins changed the base branch from dev to dev-index-matview-patch-spg-1 August 25, 2023 19:40
Copy link
Member

@sgoggins sgoggins left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

testing on a small db

@sgoggins sgoggins merged commit fb47594 into dev-index-matview-patch-spg-1 Aug 25, 2023
@IsaacMilarky IsaacMilarky deleted the value-worker-migrate-to-task branch February 20, 2024 00:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants