[SPIKE][OBSERVABILITY][ON-CHAIN] Monitor on-chain events and expose Prometheus metrics

[philipandersson]

Overview

What?
Monitor on-chain events and expose Prometheus metrics

How?

• Black box service that monitors on-chain events or events we anticipate to happen
  • Push (default) → We might get a notification/webhook
  • Pull (fallback) → We might need to index and/or query data

Why?
We need to have a unified way to monitor what happens on-chain, i.e. when the balance of multisig wallets, Sentinels etc. drops below certain thresholds. Adding monitoring and alerting is currently ad-hoc where we keep reinventing the wheel (Centralizing knowledge of what we have set up)

Deadline: Cycle 1 2024

Technical Design Document (TDD):

Acceptance criteria

• Full acceptance criteria can be found in https://www.notion.so/superfluidhq/Needs-to-track-all-events-and-be-configurable-for-networks-on-chain-monitoring-0c592077d6bc40f886e02eec39cf3f61?pvs=4
• Satisfies entire acceptance criteria
• Is the appetite for the spike exhausted?
• Documentation updated
• Presentation to stakeholders
• Output is a TDD
• Recommendation on next steps

Links/Resources

• Maintenance task

Readiness criteria

• Descriptive title
• What?
• Why?
• How?
• Deadline: If not a part of an epic
• Priority: Reflected as order on the board, walking the board from the top and right
• Assignee
• Labels
• Link to epic: If belonging to an epic

[mmd-afegbua]

RFC (WIP): https://www.notion.so/superfluidhq/edc1845ec0ef4b83a2d27fb767f992d2?v=5a9ee2b933ec4bc0988ee80fa7adaffa&p=7759aeb4e1d340ea957de46cd6b6fb03&pm=s