http server sink: accept batch log events

[happysalada]

A note for the community

• Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request
• If you are interested in working on this issue or have submitted a pull request, please leave a comment

Use Cases

logging on the browser side can be expensive if every single logs generates an http request to the http_server sink. Having a batching strategy would reduce the need to make individual requests for every single log event.

Attempted Solutions

No response

Proposal

No response

References

No response

Version

master

[jszwedko]

Hi @happysalada ,

The http_server allows for batches of events to be sent by configuring framing.method to indicate how the events are split up. The most common split would be newline_delimited. That is the config would look like:

[sources.source0]
address = "0.0.0.0:8080"
type = "http"
framing.method = "newline_delimited"

You can see all available options here: https://vector.dev/docs/reference/configuration/sources/http_server/#framing

I believe that should work for you so I'll close this issue but let me know if it does not.