[feature] persist worker queues to db#3042

Merged

tsmethurst merged 22 commits intosuperseriousbusiness:mainfrom NyaaaWhatsUpDoc:feature/persist-worker-queues-to-db.2

Jul 30, 2024

+1,190-92

Commits on Jul 30, 2024

persist queued worker tasks to database on shutdown, fill worker queues from database on startup
NyaaaWhatsUpDoc
committed
ensure the tasks are sorted by creation time before pushing them
NyaaaWhatsUpDoc
committed
add migration to insert WorkerTask{} into database, add test for worker task persistence
NyaaaWhatsUpDoc
committed
add test for recovering worker queues from database
NyaaaWhatsUpDoc
committed
quick tweak
NyaaaWhatsUpDoc
committed
whoops we ended up with double cleaner job scheduling
NyaaaWhatsUpDoc
committed
insert each task separately, because bun is throwing some reflection error??
NyaaaWhatsUpDoc
committed
add specific checking of cancelled worker contexts
NyaaaWhatsUpDoc
committed
add http request signing to deliveries recovered from database
NyaaaWhatsUpDoc
committed
add test for outgoing public key ID being correctly set on delivery
NyaaaWhatsUpDoc
committed
replace select with Queue.PopCtx()
NyaaaWhatsUpDoc
committed
get rid of loop now we don't use it
NyaaaWhatsUpDoc
committed
remove field now we don't use it
NyaaaWhatsUpDoc
committed
ensure that signing func is set
NyaaaWhatsUpDoc
committed
header values weren't being copied over 🤦
NyaaaWhatsUpDoc
committed
use ptr for httpclient.Request in delivery
NyaaaWhatsUpDoc
committed
move worker queue filling to later in server init process
NyaaaWhatsUpDoc
committed
fix rebase issues
NyaaaWhatsUpDoc
committed
make logging less shouty
NyaaaWhatsUpDoc
committed
use slices.Delete() instead of copying / reslicing
NyaaaWhatsUpDoc
committed
have database return tasks in ascending order instead of sorting them
NyaaaWhatsUpDoc
committed
add a 1 minute timeout to persisting worker queues
NyaaaWhatsUpDoc
committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[feature] persist worker queues to db#3042

Commits on Jul 30, 2024

persist queued worker tasks to database on shutdown, fill worker queues from database on startup

ensure the tasks are sorted by creation time before pushing them

add migration to insert WorkerTask{} into database, add test for worker task persistence

add test for recovering worker queues from database

quick tweak

whoops we ended up with double cleaner job scheduling

insert each task separately, because bun is throwing some reflection error??

add specific checking of cancelled worker contexts

add http request signing to deliveries recovered from database

add test for outgoing public key ID being correctly set on delivery

replace select with Queue.PopCtx()

get rid of loop now we don't use it

remove field now we don't use it

ensure that signing func is set

header values weren't being copied over 🤦

use ptr for httpclient.Request in delivery

move worker queue filling to later in server init process

fix rebase issues

make logging less shouty

use slices.Delete() instead of copying / reslicing

have database return tasks in ascending order instead of sorting them

add a 1 minute timeout to persisting worker queues