Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

added ingest failure logging and retry logic #25

Merged
merged 1 commit into from
Jan 13, 2023
Merged

added ingest failure logging and retry logic #25

merged 1 commit into from
Jan 13, 2023

Conversation

irshadaj
Copy link
Contributor

@irshadaj irshadaj commented Jan 13, 2023

We've been losing data on clients due to ingest timeouts. Further introspection revealed that the timeouts weren't being logged on the AZHound side at all.

When BHE's ingest endpoint responds with a failure, this is not being reflected in AZHound because we don't not process the response after sending the request. This means that whenever ingest fails, the task is cleared out anyway and we lose that data. This MR adds logic to process the response and prevent removing the task so it may be retried.

@irshadaj irshadaj requested a review from ddlees January 13, 2023 16:39
@github-actions
Copy link

github-actions bot commented Jan 13, 2023

CLA Assistant Lite bot All contributors have signed the CLA ✍️ ✅

Copy link
Collaborator

@zinic zinic left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Some minor formatting nits.

cmd/start.go Outdated Show resolved Hide resolved
cmd/start.go Outdated Show resolved Hide resolved
Copy link
Collaborator

@zinic zinic left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍

@irshadaj
Copy link
Contributor Author

I have read the CLA Document and I hereby sign the CLA

@irshadaj irshadaj merged commit 7116173 into main Jan 13, 2023
@irshadaj irshadaj deleted the bed-2941 branch January 13, 2023 17:52
@github-actions github-actions bot locked and limited conversation to collaborators Jan 13, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants