Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
runtime: add materialize-kafka to ser_policy
Kafka has a default maximum message size of 1MiB. This adds `materialize-kafka` to the list of connectors that use `ser_policy`, which should generally ensure that documents with individual extremely large string, array, or object fields don't exceed the message size limit for Kafka. This simple heuristic may not always be 100% what users desire, but in general it seems better to have the connector at least sort-of-work rather than crash in a way that would require a more complicated fix (possibly a derivation) to best support data exploration / PoC use cases.
- Loading branch information