Code

feat: Built-in Pulsar source#2237

Code

Merged

yhl25 merged 21 commits intomainnumaproj/numaflow:mainfrom pulsarnumaproj/numaflow:pulsarCopy head branch name to clipboardDec 3, 2024

+3,143-720

Commits

Commits on Nov 22, 2024

• feat: pulsar integration

  Show description for 2586b28
  vigith

  committed
  2586b28

  Copy full SHA for 2586b28

• feat: Pulsar source implementation

  Show description for d934976
  BulkBeing

  committed
  d934976

  Copy full SHA for d934976

Commits on Nov 24, 2024

• Avoid serializing/deserializing pulsar offset

  Show description for 0c7062a
  BulkBeing

  committed
  0c7062a

  Copy full SHA for 0c7062a

• Conversion from Pulsar message to numaflow message

  Show description for 2d21a59
  BulkBeing

  committed
  2d21a59

  Copy full SHA for 2d21a59

Commits on Nov 25, 2024

• Error handling

  Show description for 1e13ea8
  BulkBeing

  committed
  1e13ea8

  Copy full SHA for 1e13ea8

• Code generation for Pulsar config object

  Show description for 17d4871
  BulkBeing

  committed
  17d4871

  Copy full SHA for 17d4871

• TTested built-in Pulsar source with Pipeline and Monovertex

  Show description for 6dd6a1e
  BulkBeing

  committed
  6dd6a1e

  Copy full SHA for 6dd6a1e

• Formatting, Upgrade Rust version to 1.82

  Show description for c428d90
  BulkBeing

  committed
  c428d90

  Copy full SHA for c428d90

• Unit test for Pulsar config parsing

  Show description for 1d5ee07
  BulkBeing

  committed
  1d5ee07

  Copy full SHA for 1d5ee07

Commits on Nov 27, 2024

• Use rustls instead of native tls

  Show description for adfc09b
  BulkBeing

  committed
  adfc09b

  Copy full SHA for adfc09b

Commits on Nov 28, 2024

• Code re-arrangement

  Show description for 230ad2b
  BulkBeing

  committed
  230ad2b

  Copy full SHA for 230ad2b

• Option to allow self-signed certs

  Show description for a14cd73
  BulkBeing

  committed
  a14cd73

  Copy full SHA for a14cd73

• Tests for Pulsar source

  Show description for 0db2f48
  BulkBeing

  committed
  0db2f48

  Copy full SHA for 0db2f48

• Use docker to run Pulsar test container

  Show description for 5d210ab
  BulkBeing

  committed
  5d210ab

  Copy full SHA for 5d210ab

Commits on Nov 29, 2024

• Revert to rustls instead of native_tls (Pulsar dependency)

  Show description for cd0a8a7
  BulkBeing

  committed
  cd0a8a7

  Copy full SHA for cd0a8a7

• Ability to authenticate with Pulsar using JWT Token

  Show description for 68057be
  BulkBeing

  committed
  68057be

  Copy full SHA for 68057be

• Code generation

  Show description for 9b9c30b
  BulkBeing

  committed
  9b9c30b

  Copy full SHA for 9b9c30b

Commits on Dec 2, 2024

• Minor refactoring based on PR review

  Show description for 4ddecbb
  BulkBeing

  committed
  4ddecbb

  Copy full SHA for 4ddecbb

• User Documentation for Pulsar Source

  Show description for 3d6c5e8
  BulkBeing

  committed
  3d6c5e8

  Copy full SHA for 3d6c5e8

• User doc updates

  Show description for 5555524
  BulkBeing

  committed
  5555524

  Copy full SHA for 5555524

• chore: add version

  Show description for 8d4d4e1
  vigith

  authored
  8d4d4e1

  Copy full SHA for 8d4d4e1