Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[k8s] fix hints stream missing ids #6485

Merged

Conversation

pkoutsovasilis
Copy link
Contributor

What does this PR do?

After this PR got merged our k8s CI test started failing. After investigating I realised that all the hint-based inputs are lacking streams IDs in the respective filestream inputs resulting in all of them registering with an empty ID and thus colliding. Also, during this investigation, I realised that by default when hints are enabled are capturing the logs of containers that do not feature a hints-related annotation. Thus I updated the Helm chart to explicitly disable the former when both the contailer logs of kubernetes integration and hints are enabled.

A fix should also happen in the actual job that fabricates and introduces these templates

Why is it important?

Because it fixes an actual bug and it brings the CI back to green

Checklist

  • I have read and understood the pull request guidelines of this project.
  • My code follows the style guidelines of this project
  • I have commented my code, particularly in hard-to-understand areas
  • I have added an integration test or an E2E test

Disruptive User Impact

None

How to test this PR locally

mage integration:auth
PLATFORMS=linux/arm64 EXTERNAL=true SNAPSHOT=true PACKAGES=docker mage -v package 
INSTANCE_PROVISIONER=kind STACK_PROVISIONER=stateful K8S_VERSION=v1.31.1 SNAPSHOT=true mage integration:kubernetes

Related issues

N/A

@pkoutsovasilis pkoutsovasilis added bug Something isn't working Team:Elastic-Agent-Control-Plane Label for the Agent Control Plane team skip-changelog backport-8.x Automated backport to the 8.x branch with mergify labels Jan 7, 2025
@pkoutsovasilis pkoutsovasilis self-assigned this Jan 7, 2025
@pkoutsovasilis pkoutsovasilis force-pushed the k8s/fix_hints_stream_ids branch from aa09b42 to 8265572 Compare January 7, 2025 13:44
@pkoutsovasilis
Copy link
Contributor Author

buildkite test extended

Copy link

Quality Gate passed Quality Gate passed

Issues
0 New issues
0 Fixed issues
0 Accepted issues

Measures
0 Security Hotspots
No data about Coverage
No data about Duplication

See analysis details on SonarQube

@pkoutsovasilis pkoutsovasilis marked this pull request as ready for review January 7, 2025 16:10
@pkoutsovasilis pkoutsovasilis requested a review from a team as a code owner January 7, 2025 16:10
@elasticmachine
Copy link
Contributor

Pinging @elastic/elastic-agent-control-plane (Team:Elastic-Agent-Control-Plane)

@swiatekm
Copy link
Contributor

swiatekm commented Jan 7, 2025

Looks like we need to add the ID here. I'll take care of it.

@pkoutsovasilis pkoutsovasilis merged commit 7ad0456 into elastic:main Jan 7, 2025
9 checks passed
mergify bot pushed a commit that referenced this pull request Jan 7, 2025
* fix: add required ids in hints input streams of type filestream

* feat: disable hints default_container_logs when kubernetes integration container logs is enabled

(cherry picked from commit 7ad0456)
pkoutsovasilis added a commit that referenced this pull request Jan 9, 2025
* fix: add required ids in hints input streams of type filestream

* feat: disable hints default_container_logs when kubernetes integration container logs is enabled

(cherry picked from commit 7ad0456)

Co-authored-by: Panos Koutsovasilis <[email protected]>
@pkoutsovasilis pkoutsovasilis deleted the k8s/fix_hints_stream_ids branch January 9, 2025 16:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport-8.x Automated backport to the 8.x branch with mergify bug Something isn't working skip-changelog Team:Elastic-Agent-Control-Plane Label for the Agent Control Plane team
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants