Code

New log collector module#54

Code

Merged

jefftlin merged 61 commits intoWeBankFinTech:dev-0.2.3WeBankFinTech/Streamis:dev-0.2.3from WeDataSphere:dev-0.2.3-log-collectorWeDataSphere/Streamis:dev-0.2.3-log-collectorCopy head branch name to clipboardDec 15, 2022

+5,660-147

Commits

Commits on Oct 17, 2022

• Support the method to get engine conn resource information.

  Davidhua1996

  committed
  c5ab969

  Copy full SHA for c5ab969

• Init the structure of log module.

  Davidhua1996

  committed
  9f6b0be

  Copy full SHA for 9f6b0be

Commits on Oct 18, 2022

• Add the new feature for adding task and stop task for existed jobs.

  wushengyeyouya

  committed
  a04b58d

  Copy full SHA for a04b58d

• Merge remote-tracking branch 'origin/dev-0.2.3-log-collector' into dev-0.2.3-log-collector

  wushengyeyouya

  committed
  0576382

  Copy full SHA for 0576382

• Use the "\u0001" instead of "\0x001" to act as blank placeholder.

  Davidhua1996

  committed
  3afd19c

  Copy full SHA for 3afd19c

• SendBuffer and BucketConfig.

  Davidhua1996

  committed
  9288a1c

  Copy full SHA for 9288a1c

Commits on Oct 19, 2022

• Merge branch 'dev-0.2.3-log-collector' of github.com:WeDataSphere/Streamis into dev-0.2.3-log-collector

  Davidhua1996

  committed
  8a753d3

  Copy full SHA for 8a753d3

• Add the new feature for adding task and stop task for existed jobs.

  wushengyeyouya

  committed
  a7183e9

  Copy full SHA for a7183e9

• Merge remote-tracking branch 'origin/dev-0.2.3-log-collector' into dev-0.2.3-log-collector

  wushengyeyouya

  committed
  1efbf47

  Copy full SHA for 1efbf47

• Complete the log collector (80%).

  Davidhua1996

  committed
  ba4189d

  Copy full SHA for ba4189d

• Merge branch 'dev-0.2.3-log-collector' of github.com:WeDataSphere/Streamis into dev-0.2.3-log-collector

  Davidhua1996

  committed
  25e4646

  Copy full SHA for 25e4646

Commits on Oct 20, 2022

• fix the bug for adding task for existed jobs.

  wushengyeyouya

  committed
  b1cf642

  Copy full SHA for b1cf642

• Merge branch 'dev-0.2.3-log-collector' of github.com:WeDataSphere/Streamis into dev-0.2.3-log-collector

  Davidhua1996

  committed
  e704f63

  Copy full SHA for e704f63

• 1. Add the ability for updating task for existed jobs.

  Show description for 247d93b
  wushengyeyouya

  committed
  247d93b

  Copy full SHA for 247d93b

• RPC(Http) module classes in collector

  Davidhua1996

  committed
  f001612

  Copy full SHA for f001612

• Merge branch 'dev-0.2.3-log-collector' of github.com:WeDataSphere/Streamis into dev-0.2.3-log-collector

  Davidhua1996

  committed
  d4bd7c8

  Copy full SHA for d4bd7c8

• 1. Add the ability for updating task for existed jobs.

  Show description for 06a4f63
  wushengyeyouya

  committed
  06a4f63

  Copy full SHA for 06a4f63

• 1. Add the ability for updating task for existed jobs.

  Show description for f5dc4ec
  wushengyeyouya

  committed
  f5dc4ec

  Copy full SHA for f5dc4ec

• Merge remote-tracking branch 'origin/dev-0.2.3-log-collector' into dev-0.2.3-log-collector

  wushengyeyouya

  committed
  321bf48

  Copy full SHA for 321bf48

• The strategy to retry the request and compact the buffer in log collector.

  Davidhua1996

  committed
  f4e3cf5

  Copy full SHA for f4e3cf5

• Merge branch 'dev-0.2.3-log-collector' of github.com:WeDataSphere/Streamis into dev-0.2.3-log-collector

  Davidhua1996

  committed
  aef0b89

  Copy full SHA for aef0b89

• Complete the log collector (95%)

  Davidhua1996

  committed
  6153eb9

  Copy full SHA for 6153eb9

Commits on Oct 21, 2022

• Fix the problem in send buffer and consumer.

  Davidhua1996

  committed
  7ac4336

  Copy full SHA for 7ac4336

• Optimize the architecture of fetch Job details.

  wushengyeyouya

  committed
  9588e90

  Copy full SHA for 9588e90

• Merge remote-tracking branch 'origin/dev-0.2.3-log-collector' into dev-0.2.3-log-collector

  wushengyeyouya

  committed
  467d06f

  Copy full SHA for 467d06f

• Add config autowired interface to set the log appender params.

  Davidhua1996

  committed
  f3bee02

  Copy full SHA for f3bee02

• Merge branch 'dev-0.2.3-log-collector' of github.com:WeDataSphere/Streamis into dev-0.2.3-log-collector

  Davidhua1996

  committed
  58fe439

  Copy full SHA for 58fe439

• fix the compilation bug.

  wushengyeyouya

  committed
  b31a319

  Copy full SHA for b31a319

• fix the long to int parse bug.

  wushengyeyouya

  committed
  6ac3092

  Copy full SHA for 6ac3092

Commits on Oct 22, 2022

• Complete the log collector (100%)

  Davidhua1996

  committed
  58d8410

  Copy full SHA for 58d8410

• Merge branch 'dev-0.2.3-log-collector' of github.com:WeDataSphere/Streamis into dev-0.2.3-log-collector

  Davidhua1996

  committed
  f52cc8d

  Copy full SHA for f52cc8d

• Add Flink log collector and the transform in streamis which resolves the internal configuration

  Davidhua1996

  committed
  80b5003

  Copy full SHA for 80b5003

• Complete stream log server to store the log events.

  Davidhua1996

  committed
  1c115d5

  Copy full SHA for 1c115d5

Commits on Oct 23, 2022

• Fix the problem in job builder.

  Davidhua1996

  committed
  0da93b0

  Copy full SHA for 0da93b0

• Move the internal group config into JobConfKeyConstants.

  Davidhua1996

  committed
  7b40828

  Copy full SHA for 7b40828

• Move the internal group config into JobConfKeyConstants.

  Davidhua1996

  committed
  7ddb908

  Copy full SHA for 7ddb908

• Make the constraints in transforms be configurable.

  Davidhua1996

  committed
  503ed3f

  Copy full SHA for 503ed3f

• Fix serialization and configuration problem.

  Davidhua1996

  committed
  e0d9804

  Copy full SHA for e0d9804

Commits on Oct 24, 2022

• Optimize the update task and stop task logic.

  wushengyeyouya

  committed
  b2052e1

  Copy full SHA for b2052e1

• Merge remote-tracking branch 'origin/dev-0.2.3-log-collector' into dev-0.2.3-log-collector

  wushengyeyouya

  committed
  d49ebc4

  Copy full SHA for d49ebc4

• Fix the problem in fetching user info when the flink application doesn't have hadoop dependencies.

  Davidhua1996

  committed
  be6ef36

  Copy full SHA for be6ef36

• Merge branch 'dev-0.2.3-log-collector' of github.com:WeDataSphere/Streamis into dev-0.2.3-log-collector

  Davidhua1996

  committed
  3359556

  Copy full SHA for 3359556

Commits on Oct 25, 2022

• Add new strategy named ThresholdFilter

  Davidhua1996

  committed
  7f449ee

  Copy full SHA for 7f449ee

• Fix the problem when closing bucket.

  Davidhua1996

  committed
  8b7903e

  Copy full SHA for 8b7903e

• Split the log collector into log4j1 and log4j2; Avoid the jackson module in log collector.

  Davidhua1996

  committed
  cc67dbb

  Copy full SHA for cc67dbb

Commits on Oct 26, 2022

• Add module to collect spark container log.

  Davidhua1996

  committed
  f8dbed0

  Copy full SHA for f8dbed0

• Add the new requestBody parameter projectName for adding task and stop task for existed jobs.

  wushengyeyouya

  committed
  8d006e1

  Copy full SHA for 8d006e1

• Add the new requestBody parameter projectName for adding task and stop task for existed jobs.

  wushengyeyouya

  committed
  c518e10

  Copy full SHA for c518e10

• Merge remote-tracking branch 'origin/dev-0.2.3-log-collector' into dev-0.2.3-log-collector

  wushengyeyouya

  committed
  f40985c

  Copy full SHA for f40985c

• Complete the strategy in JsonTool.escapeStrValue().

  Davidhua1996

  committed
  49c1f95

  Copy full SHA for 49c1f95

Commits on Oct 29, 2022

• resolve 413 response status for update task.

  wushengyeyouya

  committed
  d882cf4

  Copy full SHA for d882cf4

• Merge remote-tracking branch 'origin/dev-0.2.3-log-collector' into dev-0.2.3-log-collector

  wushengyeyouya

  committed
  86d8ad6

  Copy full SHA for 86d8ad6

• resolve 413 response status for update task.

  wushengyeyouya

  committed
  d33b0f3

  Copy full SHA for d33b0f3

• Fix the in method restoreInvariants of AbstractRpcLogSender.

  Davidhua1996

  committed
  11cf7c7

  Copy full SHA for 11cf7c7

• Merge branch 'dev-0.2.3-log-collector' of github.com:WeDataSphere/Streamis into dev-0.2.3-log-collector

  Davidhua1996

  committed
  4e330a2

  Copy full SHA for 4e330a2

Commits on Oct 31, 2022

• resolve 413 response status for update task.

  wushengyeyouya

  committed
  e9c8792

  Copy full SHA for e9c8792

• Merge remote-tracking branch 'origin/dev-0.2.3-log-collector' into dev-0.2.3-log-collector

  wushengyeyouya

  committed
  2004b57

  Copy full SHA for 2004b57

Commits on Nov 7, 2022

• adjust the relation path in pom.xml.

  Davidhua1996

  committed
  b3d60fe

  Copy full SHA for b3d60fe

• Fix the problem in pom.xml of stream job log modules.

  Davidhua1996

  committed
  67defce

  Copy full SHA for 67defce

Commits on Nov 15, 2022

• resolve the LinkisJobInfo is null for adding task.

  wushengyeyouya

  committed
  02dcdc6

  Copy full SHA for 02dcdc6

• Merge remote-tracking branch 'origin/dev-0.2.3-log-collector' into dev-0.2.3-log-collector

  wushengyeyouya

  committed
  a4fc531

  Copy full SHA for a4fc531