auth0.from flag potentially not working

[jacobwoffenden]

What happened?

I am trying to obtain the metrics from our Auth0 tenant, but receive

ts=2023-08-01T09:59:48.393Z caller=log.go:168 level=error msg="error collecting event logs metrics from the selected Auth0 tenant" error="error fetching the log events from Auth0: 400 Bad Request: Requesting page 11 exceeds the allowed maximum of 1000 records: please consider searching by checkpoint https://auth0.com/docs/logs/retrieve-log-events-using-mgmt-api#retrieve-logs-by-checkpoint"

I have tried with passing --auth0.from "2023-08-01" but get the same response

What should have happened?

Metrics returned

Reproduction

auth0-exporter \
  export \
  --tls.disabled \
  --log.level "debug" \
  --web.listen-address "9301" \
  --auth0.domain "${TENANT_ID}.eu.auth0.com" \
  --auth0.client-id "${CLIENT_ID}" \
  --auth0.client-secret "${CLIENT_SECRET}" \
  --auth0.from "${FROM_DATE}" # e.g. 2023-08-01

results in

ts=2023-08-01T11:03:19.471Z caller=log.go:168 level=info build="dev, commit unknown, built at unknown" msg="initialising exporter"
ts=2023-08-01T11:03:20.160Z caller=log.go:168 level=info port=9301 metrics-address=/metrics msg="starting exporter"
ts=2023-08-01T11:03:20.160Z caller=log.go:168 level=info msg="running exporter with insecure connection!"
ts=2023-08-01T11:03:20.160Z caller=log.go:168 level=info port=9302 endpoint=probe msg="starting metrics server"
ts=2023-08-01T11:03:34.716Z caller=log.go:168 level=info requestID= remote_ip=172.18.0.1 host=localhost:9301 uri=/ method=GET path=/ route=/ user_agent="Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/115.0.0.0 Safari/537.36" status=200 msg="incoming request"
ts=2023-08-01T11:03:37.922Z caller=log.go:168 level=info msg="handling request for the auth0 tenant metrics"
ts=2023-08-01T11:03:37.923Z caller=log.go:168 level=info msg="handling request for the auth0 tenant metrics"
ts=2023-08-01T11:03:39.334Z caller=log.go:168 level=error msg="error collecting event logs metrics from the selected Auth0 tenant" error="error fetching the log events from Auth0: 400 Bad Request: Requesting page 11 exceeds the allowed maximum of 1000 records: please consider searching by checkpoint https://auth0.com/docs/logs/retrieve-log-events-using-mgmt-api#retrieve-logs-by-checkpoint"
ts=2023-08-01T11:03:39.335Z caller=log.go:168 level=info requestID= remote_ip=172.18.0.1 host=localhost:9301 uri=/metrics method=GET path=/metrics route=/metrics user_agent="Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/115.0.0.0 Safari/537.36" status=500 msg="incoming request"

[tfadeyi]

Hi! Thank you for reporting the issue! I'll take a look and keep the issue up to date! 👍

[tfadeyi]

The new release should have the fix for the issue https://github.com/tfadeyi/auth0-simple-exporter/releases/tag/v0.1.0. Please give it a try whenever you can