[FEATURE] Add transaction support

[jiazhai]

RFC: streamnative/community#2

Tasks

• Transaction Coordinator
  • producer id manager Complete the ProducerIdManager component #372
  • producer fence
  • transaction metadata [Transaction] KoP transaction stage0 #295
  • add partitions to transaction [Transaction] KoP transaction stage0 #295
  • end transaction [Transaction] KoP transaction stage0 #295
  • transcation marker channel handler [Transaction] KoP transaction stage0 #295
  • transaction log
• Consumer Coordinator
  • transaction offset commit [Transaction] Txn offset commit patch #365
  • write transaction marker [Transaction] Txn offset commit patch #365
• Topic Partition Leader Broker
  • find transaction coordinator [Transaction] KoP transaction stage0 #295
  • send transaction message [Transaction] KoP transaction stage0 #295
  • write transaction marker [Transaction] KoP transaction stage0 #295
  • read isolation [Transaction] KoP transaction stage0 #295
  • aborted index log
• Metrics
• Test
  • basic produce transaction messages and consume test (read_committed, read_uncommitted) [Transaction] KoP transaction stage0 #295
  • Kafka client test migrate

[zhaohaidao]

Hi @gaoran10 Is there any unassigned issue which I would like to pick up.

[gaoran10]

Hi @gaoran10 Is there any unassigned issue which I would like to pick up.

I'm working on processing the producer state snapshot and recovery. Could you help check that is there any more transaction tests in Kafka? Migrate them to KoP first if exists.

I think there are many codes that need to refine, if you find anything about the transaction need to do, you could open an issue to track the task, and this will help us to sync status. Thanks.