Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

kubearmor/kubearmor-relay stopping abruptly #622

Closed
nyrahul opened this issue Feb 15, 2022 · 1 comment · Fixed by #624
Closed

kubearmor/kubearmor-relay stopping abruptly #622

nyrahul opened this issue Feb 15, 2022 · 1 comment · Fixed by #624
Labels
bug Something isn't working important

Comments

@nyrahul
Copy link
Contributor

nyrahul commented Feb 15, 2022

Bug Report

It is found that the logs/telemetry from kubearmor-relay are abruptly stopped once in while.
The root-cause of the problem is not known yet.

Following are the observations (attached below is a screenshot):

  1. Observed failure to send a log in kubearmor GRPC server
  2. Observed in one case that the NodeIP (of kubearmor node/pod) is empty on kubearmor-relay
  3. WatchLogs() no more working but WatchAlerts() keeps working fine.

General Information

  • Environment description (GKE, VM-Kubeadm, vagrant-dev-env, minikube, microk8s, ...)
    GKE-COS

  • Kernel version (run uname -a)
    NA

  • Orchestration system version in use (e.g. kubectl version, ...)
    k8s 1.22

To Reproduce
We do not have exact steps to reproduce the issue. However, the issue springs up when karmor log is started-stopped while connecting to kubearmor-relay.

Expected behavior
It is expected that log/telemetry keeps working regardless of failures on karmor, kubearmor-relay or kubearmor itself.

Screenshots
image

@nyrahul nyrahul added bug Something isn't working important labels Feb 15, 2022
@nyrahul
Copy link
Contributor Author

nyrahul commented Feb 16, 2022

Another instantiation of the same problem (reproduced in the same env):

image

CC: @nam-jaehyun

nyrahul added a commit to nyrahul/KubeArmor that referenced this issue Feb 16, 2022
nyrahul added a commit to nyrahul/KubeArmor that referenced this issue Feb 16, 2022
nyrahul added a commit to nyrahul/KubeArmor that referenced this issue Mar 14, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working important
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant