feat(backend): move failed messages into a dead letter queue

[ntindle]

When we fail to process something, we don't want to keep retrying forever. We should store those and process them later

Changes 🏗️

• Fix the type of the failed exchange from Direct to Topic to allow filtering based on name (allows us later to do more advanced handling of queue types)
• abstract processing the messages in a queue a bit to reduce repeated code
• abstract how we check if a user wants a notification so that its a bit easier to process
• Handle errors better
• Abstract model parsing

Checklist 📋

For code changes:

• I have clearly listed my changes in the PR description
• I have made a test plan
• I have tested my changes according to the test plan:
  • ...

Example test plan

• Create from scratch and execute an agent with at least 3 blocks
• Import an agent from file upload, and confirm it executes correctly
• Upload agent to marketplace
• Import an agent from marketplace and confirm it executes correctly
• Edit an agent from monitor, and confirm it executes correctly

[qodo-merge-pro]

PR Reviewer Guide 🔍

Here are some key observations to aid the review process:

⏱️ Estimated effort to review: 2 🔵🔵⚪⚪⚪

🧪 No relevant tests

🔒 No security concerns identified

⚡ Recommended focus areas for review Error Handling The _run_queue method accesses the 'message' variable in the except block after it may have been unbound if QueueEmpty is raised. This could cause a NameError. except Exception as e: logger.error(f"Error in notification service loop: {e}") self.run_and_wait(message.reject(requeue=False)) Missing Return The _should_email_user_based_on_preference function appears to have a syntax error - missing closing parenthesis which could affect the return value. async def _should_email_user_based_on_preference( self, user_id: str, event_type: NotificationType ) -> bool: return ( get_db_client() .get_user_notification_preference(user_id) .preferences[event_type] )

[netlify]

✅ Deploy Preview for auto-gpt-docs-dev canceled.

Name	Link
🔨 Latest commit	6d3f8cb
🔍 Latest deploy log	https://app.netlify.com/sites/auto-gpt-docs-dev/deploys/67b6fded9bc9f10008daf685

[deepsource-io]

Here's the code health analysis summary for commits 6300563..6d3f8cb. View details on DeepSource ↗.

Analysis Summary

Analyzer	Status	Summary	Link
JavaScript	✅ Success		View Check ↗
Python	✅ Success	❗ 19 occurences introduced	View Check ↗

---

💡 If you’re a repository administrator, you can configure the quality gates from the settings.

[netlify]

✅ Deploy Preview for auto-gpt-docs canceled.

Name	Link
🔨 Latest commit	6d3f8cb
🔍 Latest deploy log	https://app.netlify.com/sites/auto-gpt-docs/deploys/67b6fdedc2034a0008ccc891

[Bentlybro]

Tested and works :)