Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Upgrade Kafka (to 2.6.0) #1137

Closed
toszo opened this issue Apr 7, 2020 · 6 comments
Closed

Upgrade Kafka (to 2.6.0) #1137

toszo opened this issue Apr 7, 2020 · 6 comments
Assignees
@toszo
Labels
area/ansible area/kafka
Milestone
S20201217

Comments

@toszo
Copy link
Contributor

toszo commented Apr 7, 2020 •
edited by atsikham
Loading

Is your feature request related to a problem? Please describe.
Need to perform Kafka upgrade to the latest possible version with all fixes included.

Describe the solution you'd like
Upgrade Kafka the same way as other components, using Ansible's 'upgrade' role.

Describe alternatives you've considered
No

Additional context
No
@toszo toszo added this to the Upgrades Q2'20 milestone Apr 7, 2020
@mkyc mkyc removed this from the Upgrades Q2'20 milestone Aug 11, 2020
@gj25
Copy link

gj25 commented Sep 17, 2020

@toszo Is the Kafka upgrade, preferably to to the latest version (2.6.0), scheduled for 0.8?

@usshmah
Copy link
Contributor

usshmah commented Sep 17, 2020 •
edited by mkyc
Loading

Our Kafka version used by epiphany 0.6.0 is 2.3.1 with zookeeper 3.4.12

There are these issues have been logged and resolved with latest version 2.6.0

https://issues.apache.org/jira/browse/KAFKA-7925 - CPU consumption

https://issues.apache.org/jira/browse/KAFKA-10254 - CPU consumption when broker lost connection

https://issues.apache.org/jira/browse/KAFKA-9603 - Leak file handles

To review file descriptor limit currently set for a running Kafka broker, run cat /proc/KAFKA_BROKER_PID/limits and look for Max open files.

To see open file descriptors, run: lsof -p KAFKA_BROKER_PID

@mkyc
Copy link
Contributor

mkyc commented Sep 18, 2020

@gj25 It's not.

@sunshine69
Copy link
Contributor

I made a PR #1790 to address the issues.

To add one more BUG of the current version and we are spending huge time to fix/work around - please see
https://issues.apache.org/jira/browse/KAFKA-9133

@sunshine69 sunshine69 mentioned this issue Oct 23, 2020
Closed
@mkyc mkyc added this to the S20201119 milestone Oct 23, 2020
@toszo toszo self-assigned this Nov 12, 2020
@mkyc mkyc modified the milestones: S20201119, S20201203 Nov 19, 2020
@plirglo plirglo mentioned this issue Nov 24, 2020
Closed
@mkyc
Copy link
Contributor

mkyc commented Nov 26, 2020

While releasing please make sure that it was tested together with #1853

@mkyc mkyc modified the milestones: S20201203, S20201217 Dec 4, 2020
toszo added a commit to toszo/epiphany that referenced this issue Dec 5, 2020
@toszo
Item: hitachienergy#1137
f5cf679 
Requirements.txt with correct download link (archive.apache.org)
toszo added a commit to toszo/epiphany that referenced this issue Dec 5, 2020
@toszo
Item: hitachienergy#1137
6664c6f 
Changelog and components file updated
toszo added a commit to toszo/epiphany that referenced this issue Dec 7, 2020
@toszo
Item: hitachienergy#1137, Upgrade.md file updated.
3c7332c
toszo added a commit to toszo/epiphany that referenced this issue Dec 7, 2020
@toszo
Item: hitachienergy#1137, Changes requested in code review.
a45fcf5 
Single place for version and filename.
toszo added a commit that referenced this issue Dec 8, 2020
@toszo
Kafka update to 2.6.0 (#1890)
63f2927 
* Upgrade kafka version to 2.6.0

* Update jmx exporter tar ball to 0.14.0

* Item: #1137

Requirements.txt with correct download link (archive.apache.org)

* Kafka server.properties tak take more settings from yaml

* Item: #1137

Changelog and components file updated

* Item: #1137, Upgrade.md file updated.

* Item: #1137, Changes requested in code review.

Single place for version and filename.

Co-authored-by: Steve Kieu <[email protected]>
@rpudlowski93
Copy link
Contributor

Tested, upgrade from 0.7.2 to develop finished with success. Kafka works properly after the changes.
Tested with #1853 (upgrade zookeeper to 3.5.8)

@mkyc mkyc changed the title Upgrade Kafka Upgrade Kafka (to 2.6.0) Dec 10, 2020
@mkyc mkyc closed this as completed Dec 10, 2020
@rafzei rafzei mentioned this issue Dec 17, 2020
Closed
This was referenced Dec 17, 2020
Closed
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@toszo toszo

Labels
area/ansible area/kafka
Projects
None yet
Milestone
S20201217
Development

No branches or pull requests
7 participants
@sunshine69 @gj25 @atsikham @toszo @mkyc @rpudlowski93 @usshmah