Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: use 🛻 pickup from cron pins job #2339

Open
wants to merge 3 commits into
base: main
Choose a base branch
from
Open

Conversation

olizilla
Copy link
Contributor

@olizilla olizilla commented Mar 7, 2023

cron jobs to handle ElasticIPFS as cluster service.

  • Update pins and pins-failed cron jobs to check pin status in pickup instead of cluster

Fixes #2309
Extracted from #2310 so we can deploy the api change first, but leave the old cron running for a few hours.

TODO

  • add PICKUP_BASIC_AUTH_TOKEN as a secret to the repo for cron jobs.
  • update CLUSTER-* api env vars.

License: MIT

pickup pulls dags into E-IPFS, so this PR updates the api and cron jobs to reflect that in our db.

- Update pins and pins-failed cron jobs to check pin status in pickup instead of cluster

Fixes #2309

TODO

- [x] add `PICKUP_BASIC_AUTH_TOKEN` as a secret to the repo for cron jobs.
- [ ] update `CLUSTER-*` api env vars.

License: MIT
Signed-off-by: Oli Evans <[email protected]>
@olizilla olizilla changed the title feat: use pickup from cron pins job feat: use 🛻 pickup from cron pins job Mar 7, 2023
@cloudflare-workers-and-pages
Copy link

cloudflare-workers-and-pages bot commented Mar 7, 2023

Deploying with  Cloudflare Pages  Cloudflare Pages

Latest commit: f1826fd
Status: ✅  Deploy successful!
Preview URL: https://62dce27d.nft-storage-1at.pages.dev
Branch Preview URL: https://cron-use-pickup.nft-storage-1at.pages.dev

View logs

olizilla added a commit that referenced this pull request Mar 7, 2023
cron changes now in #2339

License: MIT
Signed-off-by: Oli Evans <[email protected]>
olizilla added a commit that referenced this pull request Mar 7, 2023
cron changes now in #2339

License: MIT
Signed-off-by: Oli Evans <[email protected]>
@olizilla olizilla mentioned this pull request Mar 7, 2023
4 tasks
Copy link
Contributor

@vasco-santos vasco-santos left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. So #2310 will land first right?

olizilla added a commit that referenced this pull request Mar 22, 2023
pickup pulls dags into E-IPFS, so this PR updates the api to reflect
that.

- Update the pinning service add and update api routes to record
`ElasticIpfs` as the service that the pin is queued on.
- Update `GET /pins/:req-id` to check for a status change from pickup
and update out DB, so we can inform users early when a pin request is
pinned or failed.

Cron changes are in #2339 

Fixes #2309 

License: MIT
Signed-off-by: Oli Evans <[email protected]>
@alanshaw
Copy link
Contributor

@olizilla can it merge now?

.github/workflows/cron-pins-failed.yml Outdated Show resolved Hide resolved
Copy link
Contributor

@alanshaw alanshaw left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM apart from the URLs that need fixing.

.github/workflows/cron-pins.yml Outdated Show resolved Hide resolved
.github/workflows/cron-pins.yml Outdated Show resolved Hide resolved
olizilla and others added 2 commits May 10, 2023 11:27
License: MIT
Signed-off-by: Oli Evans <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Use 🛻 pickup to handle pinning service requests
3 participants