[Feature]: Kafka support

[arbfay]

Is there an existing issue for this?

• I have searched the existing issues

Summary

Read messages from Kafka topics and create messages, using a predefined schema (retrieved from the Schema Registry, or added manually, or none).

Why should this be worked on?

Event-based architectures are becoming more and more important as they are adopted by industries where events drive the business (finance, logistics, etc).
Kafka (and alternatives that implement its API, such as Redpanda) is a major event streaming platform that is used as a data source/sink by a growing number of applications.
It would benefit Appsmith to include Kafka to expand its use cases.

Front conversations

[Nikhil-Nandagopal]

@arbfay thank you for the feature request! I believe this would require us to implement #1950

[gonchik]

Any plans for the implementation?
it will be very useful for our landscape :)

[UMinky]

Is there something new here? Is this being worked on?

[huckpdx]

this would be a great addition to appsmith. I'm building systems using both kafka and appsmith. bouncing data through a DB is awkward.

does anyone have any good workarounds?

[Nikhil-Nandagopal]

@huckpdx have you tried using the rest API for Kafka along with either a polling mechanism or websockets?