How to send gzip payload for Cloudwatch's PutMetricData

[cswilliams]

The comments here indicate that Cloudwatch's PutMetricData endpoint supports sending a gzip payload. Is this possible to do with the ruby sdk? Searching for the word "gzip" in both the latest versions of aws-sdk-cloudwatch and aws-sdk-core doesn't yield much, so I'm assuming this isn't supported natively, but was curious if there was any "unofficial" way to do it.

Thanks!

[mullermp]

Unfortunately the gzip story in Ruby V3 is not great. We intentionally squash Accept-Encoding here for responses:

aws-sdk-ruby/gems/aws-sdk-core/lib/seahorse/client/net_http/handler.rb

Lines 181 to 184 in 378dfa6

	# Removing this is necessary for most services to not break request
	# signatures as well as dynamodb crc32 checks (these fail if the
	# response is gzipped).
	headers = { 'accept-encoding' => '' }

. I think you should be able to do this if you write a plugin that gzips the request body and insert it into the plugin stack immediately before signing. I also don't know if, you send a gzip request to cloud watch, if they will attempt to send you one back, in which case that plugin will also have to unzip the response. You can author a plugin just like that net_http handler example (

aws-sdk-ruby/gems/aws-sdk-core/lib/seahorse/client/plugins/net_http.rb

Line 43 in 378dfa6

handler(Client::NetHttp::Handler, step: :send)

) - you'd want to insert it at step: :sign, priority: 51.

[cswilliams]

Thanks for the response Matt, appreciate it! I did some more research and I'm thinking an easier route may be to just install the cloudwatch agent on our underlying system and then use one of ruby's statsd clients to send metrics to the agent (in place of using aws-sdk-ruby to send the metrics directly to cloudwatch). It looks like the agent supports gzip and I don't have to deal with the various limitations myself (e.g. no more than 20 metrics and payloads less than 40kb).

[mullermp]

That should work. We can take gzip cloudwatch as a feature request and perhaps we can handle that automatically in the SDK.

[mullermp]

This feature is actively being worked on across all SDKs, targeting sometime soon (TM)

[mullermp]

#2870

[github-actions[bot]]

Hello! Reopening this discussion to make it searchable.