Code

feat(plugin): new jobs plugin #726

Code

Merged

rustatian merged 122 commits intomasterroadrunner-server/roadrunner:masterfrom feature/jobs_pluginroadrunner-server/roadrunner:feature/jobs_pluginCopy head branch name to clipboardAug 12, 2021

+10,302-897

Commits

Commits on Jun 15, 2021

• - Jobs plugin initial commit

  Show description for d4c92e4
  rustatian

  committed
  d4c92e4

Commits on Jun 16, 2021

• - Update jobs sources

  Show description for cee4bc4
  rustatian

  committed
  cee4bc4

Commits on Jun 21, 2021

• Merge remote-tracking branch 'origin/master' into feature/jobs_plugin

  Show description for bdcfdd2
  rustatian

  committed
  bdcfdd2

• - Rework dispatcher, pipeline, job (not completely)

  Show description for 41bb9fa
  rustatian

  committed
  41bb9fa

Commits on Jun 22, 2021

• - Temporary turn off CI

  Show description for 260d69c
  rustatian

  committed
  260d69c

• - Remove all old code, reformat, fix linters, return GA

  Show description for 1a2a1f4
  rustatian

  committed
  1a2a1f4

• - Move common interfaces and structures to the 'common' folder

  Show description for 5627146
  rustatian

  committed
  5627146

• - Folders struct

  Show description for 035e432
  rustatian

  committed
  035e432

• Merge branch 'master' into feature/jobs_plugin

  rustatian

  authored
  effa24b

Commits on Jun 23, 2021

• - Update arch, pluign

  Show description for b0e7ac1
  rustatian

  committed
  b0e7ac1

• - Swithc from value to pointer to the pool configuration. Interface

  Show description for 7fc0995
  rustatian

  committed
  7fc0995

• - Add PQ (priority_queue) mock

  Show description for 521aeb8
  rustatian

  committed
  521aeb8

• - Fix broadcast tests panic

  Show description for 28f8182
  rustatian

  committed
  28f8182

Commits on Jun 24, 2021

• - Update logger for the broadcast tests

  Show description for 64d41f6
  rustatian

  committed
  64d41f6

Commits on Jun 25, 2021

• Merge remote-tracking branch 'origin/master' into feature/jobs_plugin

  rustatian

  committed
  09041fe

• - Update jobs interface

  Show description for ad1ca84
  rustatian

  committed
  ad1ca84

Commits on Jun 26, 2021

• Merge remote-tracking branch 'origin/master' into feature/jobs_plugin

  rustatian

  committed
  53e50a0

• - Merge master branch

  Show description for d26749a
  rustatian

  committed
  d26749a

Commits on Jun 28, 2021

• Merge remote-tracking branch 'origin/master' into feature/jobs_plugin

  rustatian

  committed
  c0f808b

Commits on Jun 30, 2021

• - Update arch diagrams

  Show description for 2ac3b24
  rustatian

  committed
  2ac3b24

• - Remove unused methods from the QueueImpl

  Show description for a233ef3
  rustatian

  committed
  a233ef3

• Merge remote-tracking branch 'origin/master' into feature/jobs_plugin

  rustatian

  committed
  cd64c6c

Commits on Jul 1, 2021

• - Remove Dispatcher

  Show description for a4b9d0c
  rustatian

  committed
  a4b9d0c

Commits on Jul 2, 2021

• - joinTopics/Server as constants, do not allocate strings on every

  Show description for e4834e0
  rustatian

  committed
  e4834e0

Commits on Jul 3, 2021

• - Initial binary_heap

  Show description for 677db79
  rustatian

  committed
  677db79

Commits on Jul 5, 2021

• - Finish binary_heap

  Show description for 1dd43e3
  rustatian

  committed
  1dd43e3

• - Include PQ tests into the CI

  Show description for 01ba1da
  rustatian

  committed
  01ba1da

• - Update PQ tests

  Show description for 300166e
  rustatian

  committed
  300166e

• - Update PQ

  Show description for 207739f
  rustatian

  committed
  207739f

Commits on Jul 6, 2021

• Rework ephemeral and binary heaps

  Show description for 2c78e93
  rustatian

  committed
  2c78e93

• Update Jobs interface...

  Show description for 36bf922
  rustatian

  committed
  36bf922

Commits on Jul 7, 2021

• Rework test env...

  Show description for 127186a
  rustatian

  committed
  127186a

• Updated ephemeral plugin, PQ and protobuf...

  Show description for 60c229c
  rustatian

  committed
  60c229c

• New Methods in the binary heap interface...

  Show description for b84a7cb
  rustatian

  committed
  b84a7cb

Commits on Jul 8, 2021

• Add length limiter for the binary heaps data structure. After max length

  Show description for bb7b6a4
  rustatian

  committed
  bb7b6a4

• Unlock binary heaps max length in the consume-rate test

  Show description for c7becb2
  rustatian

  committed
  c7becb2

• Add pipeline and job plugin options...

  Show description for 0595648
  rustatian

  committed
  0595648

• maxLen for the binary heaps should be more than 0

  Show description for eab69b1
  rustatian

  committed
  eab69b1

• Remove duplicated test-helpers

  Show description for 5f84c5d
  rustatian

  committed
  5f84c5d

• AMQP update...

  Show description for 4566f88
  rustatian

  committed
  4566f88

Commits on Jul 9, 2021

• AMQP job driver...

  Show description for 4fcb597
  rustatian

  committed
  4fcb597

• Merge branch 'master' into feature/jobs_plugin

  rustatian

  authored
  242022e

• Properly parse amqp items (jobs).

  Show description for fa57fa6
  rustatian

  committed
  fa57fa6

Commits on Jul 10, 2021

• Update Consumer interface, List method returns []string of the

  Show description for 96d437f
  rustatian

  committed
  96d437f

• DeliveryMode -> amqp.Persistent

  Show description for a90c34e
  rustatian

  committed
  a90c34e

• DeliveryMode -> amqp.Persistent for all Publish operations

  Show description for 3de13b2
  rustatian

  committed
  3de13b2

• SQS skeleton

  Show description for 435cfae
  rustatian

  committed
  435cfae

• Return structure instead of interface in places where that possible

  Show description for 453eb10
  rustatian

  committed
  453eb10

• Move interfaces to its consumers

  Show description for cb2665d
  rustatian

  committed
  cb2665d

Commits on Jul 11, 2021

• Update informer interface to return slice of pointers (do not over-copy

  Show description for 589f759
  rustatian

  committed
  589f759

• unpack: use fast string convert

  Show description for 510e193
  rustatian

  committed
  510e193

• Dead letter exchange optimization. Cache for the DLX queues. If the

  Show description for 240b114
  rustatian

  committed
  240b114

• Update JOBS interface, Renamed Consume -> Run.

  Show description for 0f70f1e
  rustatian

  committed
  0f70f1e

Commits on Jul 12, 2021

• Finish dynamic declaration of the pipelines. Fix issue with

  Show description for e82e924
  rustatian

  committed
  e82e924

• Implement Reset operation.

  Show description for b924032
  rustatian

  committed
  b924032

• Typo in the pool configuration.

  Show description for 87971c4
  rustatian

  committed
  87971c4

• Update JOBS interface, remove List() method, implemented on the root RPC

  Show description for aa1437d
  rustatian

  committed
  aa1437d

• Return proper error type in the redial

  Show description for 0be3e79
  rustatian

  committed
  0be3e79

• Add JOBS tests to the Makefile and GitHub CI.

  Show description for ec7c049
  rustatian

  committed
  ec7c049

Commits on Jul 14, 2021

• SQS driver.

  Show description for d099e47
  rustatian

  committed
  d099e47

• Implement Pause/Resume/Stop

  Show description for cd07985
  rustatian

  committed
  cd07985

• Merge remote-tracking branch 'origin/master' into feature/jobs_plugin

  Show description for 3ce3b5a
  rustatian

  committed
  3ce3b5a

• Merge master

  Show description for 04fde6d
  rustatian

  committed
  04fde6d

• Fix incorrect path in the CI. Implement FromPipeline for the sqs.

  Show description for 7ea2277
  rustatian

  committed
  7ea2277

• NPE when stopping RMQ channels.

  Show description for b38a0ff
  rustatian

  committed
  b38a0ff

• Fix early return

  Show description for 3483f96
  rustatian

  committed
  3483f96

• Update SQS item.

  Show description for 0505556
  rustatian

  committed
  0505556

• Remove duplicated logging

  Show description for f4feb30
  rustatian

  committed
  f4feb30

Commits on Jul 18, 2021

• Started beanstalk driver. Add new Queue impl (not finished yet).

  Show description for 9c51360
  rustatian

  committed
  9c51360

• Remove channel from the Queue

  Show description for 9784511
  rustatian

  committed
  9784511

Commits on Jul 19, 2021

• Worker watcher interface update.

  Show description for 02fc366
  rustatian

  committed
  02fc366

• Beanstalk initial commit

  Show description for 9750751
  rustatian

  committed
  9750751

• Make beanstalk import not indirect

  Show description for a149f83
  rustatian

  committed
  a149f83

Commits on Jul 20, 2021

• Beanstalk driver alpha version ready.

  Show description for 50cf036
  rustatian

  committed
  50cf036

Commits on Jul 21, 2021

• Fix AMQP context, add ID, job, other fields.

  Show description for b2da831
  rustatian

  committed
  b2da831

• Update beanstalk redial algo.

  Show description for e4b9551
  rustatian

  committed
  e4b9551

• Reduce tests timeout

  Show description for 182199a
  rustatian

  committed
  182199a

Commits on Jul 22, 2021

• Update consumers, tests stabilization

  Show description for 05660fc
  rustatian

  committed
  05660fc

• Add headers parsing

  Show description for 609e614
  rustatian

  committed
  609e614

• BC for the Pool, worker interfaces, pass/return payload by pointer

  Show description for fedf012
  rustatian

  committed
  fedf012

• Passing by ptr is slightly faster:

  Show description for b28dbda
  rustatian

  committed
  b28dbda

• Format-ed

  Show description for 92aa2e4
  rustatian

  committed
  92aa2e4

• Update static_pool_batched test

  Show description for ae2bdd7
  rustatian

  committed
  ae2bdd7

• Update Echo bench

  Show description for 6561c6a
  rustatian

  committed
  6561c6a

• Benchmark tests comments

  Show description for 83b246c
  rustatian

  committed
  83b246c

• Fix AMQP bugs, add more amqp tests

  Show description for e9713a1
  rustatian

  committed
  e9713a1

• Linters

  Show description for 2ceebd6
  rustatian

  committed
  2ceebd6

• Initial tests for all drivers

  Show description for 584e9ad
  rustatian

  committed
  584e9ad

• Update GA, codeconv bump to v2

  Show description for 71e3b0f
  rustatian

  committed
  71e3b0f

• Remove completed TODOs from the beanstalk driver.

  Show description for ed36f3e
  rustatian

  committed
  ed36f3e

• Update beanstalk options. Fix tube priority (correctly pass to the Put

  Show description for 3f45d2c
  rustatian

  committed
  3f45d2c

Commits on Jul 23, 2021

• Remove time.Now() from beanstalk tube declaration

  Show description for 6764d0f
  rustatian

  committed
  6764d0f

• EventPipeRun -> EvenPipeActive

  Show description for 54a5c4f
  rustatian

  committed
  54a5c4f

• SQS configuration and tests update

  Show description for c851b56
  rustatian

  committed
  c851b56

• Use zap logger in AMQP tests instead of mocked (temporarly)

  Show description for f585c65
  rustatian

  committed
  f585c65

• Tests refactoring

  Show description for 9079cc5
  rustatian

  committed
  9079cc5

• Add AMQP initial durability test

  Show description for e88dfd5
  rustatian

  committed
  e88dfd5

• SQS initial durability test

  Show description for c617566
  rustatian

  committed
  c617566

• Fix AMQP toxic

  Show description for 34c561a
  rustatian

  committed
  34c561a

Commits on Jul 24, 2021

• Beanstalk initial durability test

  Show description for d73344d
  rustatian

  committed
  d73344d

• Uniform push to pipelines in the durability tests

  Show description for 6f65b5a
  rustatian

  committed
  6f65b5a

• Remove unused code

  Show description for c25616b
  rustatian

  committed
  c25616b

• Remove unused toPtr conversions

  Show description for 685d7b4
  rustatian

  committed
  685d7b4

• Mooore constants :)

  Show description for d721811
  rustatian

  committed
  d721811

Commits on Jul 27, 2021

• Initial support for the cancellation via context

  Show description for 1e59ec2
  rustatian

  committed
  1e59ec2

Commits on Aug 1, 2021

• Rework vec based on the channel. Use select statement with the default

  Show description for c90c11b
  rustatian

  committed
  c90c11b

Commits on Aug 2, 2021

• Update CI, move all tests to the single source of truth - makefile

  Show description for 31752d8
  rustatian

  committed
  31752d8

Commits on Aug 3, 2021

• In a rare cases, when user set small timeout to allocate a worker,

  Show description for 606e217
  rustatian

  committed
  606e217

Commits on Aug 9, 2021

• Update goridge to v3.2.0, update all frames operations.

  Show description for fba3d92
  rustatian

  committed
  fba3d92

• Update response_protocol.md

  rustatian

  authored
  0f16b25

• Add initial support for the php worker protocol.

  Show description for d379c28
  rustatian

  committed
  d379c28

Commits on Aug 10, 2021

• Add jobs protocol support for the AMQP driver

  Show description for a8a7f41
  rustatian

  committed
  a8a7f41

• Add support for the jobs-worker protocol for the beanstalk,ephemeral and

  Show description for d449d9d
  rustatian

  committed
  d449d9d

Commits on Aug 11, 2021

• Replace all 'localhost' with '127.0.0.1'. Fix default configuration and

  Show description for 3e2e9fb
  rustatian

  committed
  3e2e9fb

• Increase timeout to 60s.

  Show description for aeb7d30
  rustatian

  committed
  aeb7d30

• Add headers to the protocol

  Show description for 2924f4b
  rustatian

  committed
  2924f4b

• Add headers support to the jobs protocol

  Show description for de37ed3
  rustatian

  committed
  de37ed3

• Remove attempts from the proto, and general jobs options

  Show description for e855ae9
  rustatian

  committed
  e855ae9

• Durable requeue algo. Update AMQP and Beanstalk tests to use mock

  Show description for 2d46006
  rustatian

  committed
  2d46006

Commits on Aug 12, 2021

• Made QoS production like

  Show description for bf2f716
  rustatian

  committed
  bf2f716

• Fix various bugs in the SQS. Implement SQS tests for the

  Show description for 4169e83
  rustatian

  committed
  4169e83

• Remove unneeded options, complete tests for the ephemeral, update proto

  Show description for ecbfc5c
  rustatian

  committed
  ecbfc5c