Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Threshold-based alerting #14331

Open
annikaschmid opened this issue Feb 21, 2023 · 22 comments
Open

Threshold-based alerting #14331

annikaschmid opened this issue Feb 21, 2023 · 22 comments
Assignees

Comments

@annikaschmid
Copy link

Users have asked for a functionality to create threshold-based alerts, e.g. when the conversion rate drops below a certain threshold.

Open questions:

  • In what format do people want these alerts? Email? Slack?

We'd love to hear user feedback, as well as ideas for stretch goals or implementation.

If you like this idea, please leave a 👍 or ❤️ reaction on this post to vote for it -- your votes and feedback help us prioritize what to work on next!

@annikaschmid annikaschmid added the enhancement New feature or request label Feb 21, 2023
@voarsh2
Copy link

voarsh2 commented Mar 5, 2023

Notification UI as well possibly?

@pimterry
Copy link

I'd find this useful! Both for conversion rates and overall totals (if errors today > X, if visitors/hour < Y).

As a stretch goal, it'd be useful to be able to alert on major changes in breakdowns. For example, I have a graph showing traffic to my site by day broken down by referrer - if there's a major change in who's referring traffic (a bunch of new traffic from a new source, or a previous major source of traffic disappearing) I'd love to be able to get alerts about that, even if the overall traffic total doesn't shift. Harder to define I imagine, but I think there's value in there.

In what format do people want these alerts? Email? Slack?

Personally: primarily email, and then webhooks. Email is quick & easy to get started, and medium-term webhooks would be the best way to integrate this into the rest of my stack (slack, pagerduty, internal dashboarding, "reboot the server automatically if load time gets too high", whatever).

@nik-418
Copy link

nik-418 commented Jul 6, 2023

Slack alert based on insight threshold triggers 👍

@mindofmar
Copy link

I need this. Other product analytics platforms like Mixpanel and Amplitude offer this. There's no reason Posthog also shouldn't. Please prioritize this.

@marandaneto
Copy link
Member

Consider a mobile companion app that sends push notifications as well, see request.

@GalDayan
Copy link
Contributor

Same as the alert per action - alerts per insight by threshold.

@williamlmao
Copy link

williamlmao commented May 24, 2024

+1, but offer email + slack please. We use discord instead of slack, so email notifications would be great.

@Slawikus
Copy link

Basically this would give observability capabilities to PostHog. One can use the platform not only for product analytics, but also as alerting tool if some of the metrics go down or up too rapidly. Highly anticipated feature!

The way how notifications/alerts are delivered is of less importance, it can be a simple email.

@blackbird-chrisf
Copy link

This would be useful as a simple canary to catch misconfigured deployments - one could (hypothetically) introduce a regression where you stop sending events to Posthog (I, however, would never do such a thing 😅). An alert on a sudden decrease in any metrics would catch this.

@anirudhpillai
Copy link
Contributor

We've started work on this feature. Will have updates soon on how users can sign up for early access to this feature!

@stuartbrameld
Copy link

awesome! email alerts for me, same as google analytics insights stuff

@Bogdanovist
Copy link

Big +1 to this, having this feature would save us a bunch of work we otherwise have committed to do soon on KPI alerts 🙏

@anirudhpillai anirudhpillai self-assigned this Oct 2, 2024
@anirudhpillai
Copy link
Contributor

anirudhpillai commented Oct 3, 2024

We have a very rough version of alerting available for trends without breakdowns (breakdown support coming soon) on which we wanted some user feedback. Have enabled a few people for this feature, if anyone's very keen try it out (or submit feedback) just reach out to me at [email protected]

The current version, lets you set alerts on trends without breakdowns from the dropdown on the page for the insight, and you can view all the alerts you've setup on the 'Product Analytics' page under the 'Alerts' tab

image image

@abigailbramble
Copy link

@anirudhpillai
Copy link
Contributor

Just an update, we now support setting alerts for monitoring day over day/week over week change in an insight value (just as requested by a lot of users)! You can also set these 'relative' alerts to trigger for percentage based thresholds (eg. signups decreasing by over 5% week over week)

image image

Alerts which are firing also support a 'snooze button' now. So you can choose not to get notified about the alert until a preset duration.

image

Feel free to send any feedback/requests to me directly at [email protected] :)

@stuartbrameld
Copy link

You can also set these 'relative' alerts to trigger for percentage based thresholds (eg. signups decreasing by over 5% week over week)

nice 👍

@anirudhpillai
Copy link
Contributor

Also for alerts comparing absolute value of the insight (not 'relative', day over day/week over week), you can choose to display the threshold lines on the insight.
To make this persist, you'll have to 'Edit' the insight > 'Options' > 'Show alert threshold lines'

image

@angrybacon
Copy link

Would it be the right feature for Web vitals thresholds or is something else in the works? I don't exactly need alerts or to be notified when something crosses a given threshold but I would be interested in seeing the "good", "needs improvement" and "poor" thresholds as colored backgrounds in my charts.

@robbie-c
Copy link
Member

robbie-c commented Nov 6, 2024

Hey @angrybacon, I made a separate issue for this here #26031

@angrybacon
Copy link

@robbie-c I'm confused, how would that help seeing hardcoded threshold areas in charts? I mentioned Web vitals because that's what my use case is but there could be more so I'm assuming we want "hardcoded threshold areas" to be metric-agnostic, if that makes sense.

@willzoltan
Copy link

We need alerting for funnels, so that we can be alerted to changes in conversion rates. Please like this 👍 if alerting for conversation rates in funnels would be valuable to you. Thanks!

@anirudhpillai
Copy link
Contributor

Thanks Will, agreed that's very useful so we'll be adding support for alerts on funnels soon!

In other news, now we also support setting alerts on trends with breakdowns! These alert when any breakdown value breaches the thresholds set.

image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests