📚 7-Day Observability Tutorial Series

Welcome to the 7-Day Observability Tutorial Series! This repository contains the code and detailed explanations for setting up and understanding observability in Kubernetes using Prometheus, Grafana, Elasticsearch Fluentbit, Kibana, Jaeger, groundcover(eBPF), opentelemetry e.t.c.,.

📅 Overview of Each Day

Day 1: Introduction to Observability

• Concepts Covered:
  • Introduction to Observability, Monitoring, Logging, and Tracing.
  • The difference between Monitoring and Observability.
  • Tools available for Monitoring and Observability.
  • Comparison between monitoring and observing in Bare-Metal Servers vs. Kubernetes.
• Key Learning:
  • Understand the fundamental concepts of observability.
  • Learn why monitoring and observability are crucial in modern IT environments.

Day 2: Prometheus - Setting Up Monitoring

• Concepts Covered:
  • Introduction to Prometheus and its architecture.
  • Setup and configuration of Prometheus in an EKS cluster.
  • Installation of kube-prometheus-stack with Helm and integrating it with Grafana.
  • Basic queries and setup for monitoring with Prometheus and Grafana.
• Key Learning:
  • Get hands-on experience with Prometheus and Grafana.
  • Learn to install and configure Prometheus on Kubernetes.

Day 3: Metrics and PromQL in Prometheus

• Concepts Covered:
  • Introduction to PromQL and basic querying techniques.
  • Aggregation and functions in PromQL to analyze metrics data.
• Key Learning:
  • Master the Prometheus Query Language (PromQL) for querying and analyzing metrics.

Day 4: Instrumentation and Custom Metrics

• Concepts Covered:
  • Instrumentation for adding monitoring capabilities to applications.
  • Understanding different types of metrics in Prometheus: Counter, Gauge, Histogram, and Summary.
  • Writing custom metrics in a Node.js application using the prom-client library.
  • Dockerizing the application and deploying it on Kubernetes.
  • Setting up Alertmanager for alerting based on custom metrics.
• Key Learning:
  • Learn how to instrument applications to expose custom metrics.
  • Configure alerts in Alertmanager to monitor application performance.
  • Understand how to work with different types of metrics in Prometheus.

Day 5: Logging with EFK Stack

• Concepts Covered:
  • Introduction to logging in distributed systems and Kubernetes.
  • Setting up the EFK stack (Elasticsearch, Fluentbit, Kibana) on Kubernetes.
  • Detailed setup and configuration for collecting and visualizing logs.
  • Cleaning up the Kubernetes cluster and resources.
• Key Learning:
  • Understand the importance of logging and how to set up

Day 6: Distributed Tracing with Jaeger

• Concepts Covered:
  • Introduction to Jaeger and its architecture for distributed tracing.
  • Setting up Jaeger in a Kubernetes cluster using Helm.
  • Instrumenting services using OpenTelemetry to enable tracing.
  • Viewing and analyzing traces in the Jaeger UI.
  • Cleaning up the environment after setting up Jaeger.
• Key Learning:
  • Gain insights into distributed tracing and how it helps in debugging and performance optimization.
  • Learn how to set up and configure Jaeger for tracing in a microservices architecture.

Day 7: OpenTelemetry – Setting Up Unified Observability

• Concepts Covered:
  • Introduction to OpenTelemetry, a unified framework for observability.
  • Understanding how OpenTelemetry integrates tracing, metrics, and logging.
  • Comparison of OpenTelemetry with prior observability tools like Jaeger, Prometheus
  • Supported programming languages and multi-language support in OpenTelemetry.
  • Step-by-step setup of OpenTelemetry in Kubernetes.
• Key Learning:
  • Learn how OpenTelemetry simplifies the process of collecting and exporting telemetry data.
  • Understand the benefits of a unified observability approach using OpenTelemetry.
  • Gain hands-on experience with setting up OpenTelemetry Collector, Prometheus, Jaeger, and Elasticsearch to monitor a Golang microservice application.