kafkaPractice

Topic

Partition

Broker

- connect to each other

Producer:

- round robin without key
- level of ack: none, borker, broker+replica

Consumer:

- read in order within each partitions
- # of partitions -> # of consumers
- commit: at most once, a least once

CLI:

topic:

list:

kafka-topics.sh --bootstrap-server localhost:9092 --list

create:

kafka-topics.sh --bootstrap-server localhost:9092 --topic second-topic --create --partitions 3 --replication-factor 1

describe:

kafka-topics.sh --bootstrap-server localhost:9092  --topic second-topic --describe

delete:

kafka-topics.sh --bootstrap-server localhost:9092  --topic second_topic --delete

producer:

produce:

kafka-console-producer.sh --broker-list localhost:9092 --topic second-topic

consumer:

consume without group:

kafka-console-consumer.sh --bootstrap-server localhost:9092 --topic second-topic

consume with group:

kafka-console-consumer.sh --bootstrap-server localhost:9092 --topic second-topic --group 1

consumer group:

list

kafka-consumer-groups.sh --bootstrap-server localhost:9092 --list

describe

kafka-consumer-groups.sh --bootstrap-server localhost:9092 --describe --group 1