Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fargate New cluster #93

Merged
merged 35 commits into from
Oct 18, 2023
Merged
Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
35 commits
Select commit Hold shift + click to select a range
171444a
Adding fargate compatibility and new patterns
Howlla Aug 15, 2023
c45b41a
create new type to limit parameter into builder
Howlla Aug 15, 2023
309475d
Merge branch 'aws-observability:main' into main
Howlla Aug 15, 2023
da3e785
Prepare for pr
Howlla Aug 22, 2023
ecbae71
remove parameter computeType for existing clusters
Howlla Aug 22, 2023
076b498
lint fix
Howlla Aug 22, 2023
cdce95a
remove existing aws fargate code
Howlla Aug 22, 2023
a96a1aa
lint fix
Howlla Aug 22, 2023
b4ab8dd
Merge branch 'aws-observability:main' into main
Howlla Aug 24, 2023
244b64d
Added documentation and reset observability builder code
Howlla Aug 25, 2023
65a89e4
Correct addons for fargate and add namespace for opentelemetry
Howlla Aug 28, 2023
aa6f252
Merge branch 'aws-observability:main' into main
Howlla Aug 28, 2023
e86be21
Merge remote-tracking branch 'upstream/main'
Howlla Aug 29, 2023
e11a7e9
Merge branch 'aws-observability:main' into main
Howlla Sep 11, 2023
37f068d
Explicitly define addons for fargate pattern
Howlla Sep 11, 2023
ba4451c
pass coredns props
Howlla Sep 11, 2023
f7d30fc
Tested with updated observability builder props PR
Howlla Sep 15, 2023
5258401
Tested with updated observability builder props PR
Howlla Sep 15, 2023
dfff787
Merge branch 'aws-observability:main' into main
Howlla Sep 22, 2023
2fcb561
Merge branch 'aws-observability:main' into main
Howlla Sep 29, 2023
144186e
Merge branch 'aws-observability:main' into main
Howlla Oct 7, 2023
c368a73
update version and minor props fix for addons
Howlla Oct 7, 2023
1fd56ca
kubeproxy auto instead of explicit
Howlla Oct 7, 2023
633850b
Merge branch 'main' into main
Howlla Oct 8, 2023
8290fc2
updated docs
Howlla Oct 8, 2023
edc2f92
Merge branch 'main' of https://github.com/Howlla/cdk-aws-observabilit…
Howlla Oct 8, 2023
545fa3b
Merge branch 'aws-observability:main' into main
Howlla Oct 9, 2023
dcbddd7
update image location
Howlla Oct 9, 2023
701ca57
auto coredns version
Howlla Oct 9, 2023
cad2ca6
Merge branch 'aws-observability:main' into main
Howlla Oct 12, 2023
460b6f7
fargate holly monitoring
Howlla Oct 16, 2023
502acce
updated docs
Howlla Oct 16, 2023
9af21ca
added deployment steps in docs
Howlla Oct 16, 2023
b778c8c
clean delete except coredns
Howlla Oct 17, 2023
46b3cd0
Cat command for manifest
Howlla Oct 17, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
# Single New EKS Fargate Cluster AWS Native Observability Accelerator
# Single Cluster AWS Native Observability - Fargate

## Architecture

Howlla marked this conversation as resolved.
Show resolved Hide resolved
Expand Down Expand Up @@ -158,9 +158,168 @@ Example with "EKS_Cluster" metrics

Although the default metrics exposed by cloudWatchAdotAddon are useful for getting some standardized metrics from our application we often instrument our own application with OLTP to expose metrics. Fortunately, the otel-collector-cloudwatch-collector can be specified as the endpoint for collecting these metrics and getting metrics and logs to cloudwatch.

We will be fetching metrics from `ho11y` a synthetic signal generator allowing you to test observability solutions for microservices. It emits logs, metrics, and traces in a configurable manner. The application can be deployed using `team-geordie` ArgoCD configuration found [here](https://github.com/aws-observability/aws-observability-accelerator/tree/main/artifacts/argocd-apps/teams/team-geordie).

We will have to edit the `OTEL_EXPORTER_OTLP_ENDPOINT` value in `ho11y.yaml` and set the value as 'otel-collector-cloudwatch-collector.default.svc.cluster.local:4317'
We will be fetching metrics from `ho11y` a synthetic signal generator allowing you to test observability solutions for microservices. It emits logs, metrics, and traces in a configurable manner.

## Deploying Workload

elamaran11 marked this conversation as resolved.
Show resolved Hide resolved

``` yaml title="holly.yaml" linenums="1"
apiVersion: v1
kind: Namespace
metadata:
name: ho11y
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: frontend
namespace: default
spec:
selector:
matchLabels:
app: frontend
replicas: 1
template:
metadata:
labels:
app: frontend
spec:
containers:
- name: ho11y
image: public.ecr.aws/z0a4o2j5/ho11y:latest
ports:
- containerPort: 8765
env:
- name: DISABLE_OM
value: "on"
- name: HO11Y_LOG_DEST
value: "stdout"
- name: OTEL_RESOURCE_ATTRIB
value: "frontend"
- name: OTEL_EXPORTER_OTLP_ENDPOINT
value: "otel-collector-cloudwatch-collector.default.svc.cluster.local:4317"
- name: HO11Y_INJECT_FAILURE
value: "enabled"
- name: DOWNSTREAM0
value: "http://downstream0"
- name: DOWNSTREAM1
value: "http://downstream1"
imagePullPolicy: Always
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: downstream0
namespace: default
spec:
selector:
matchLabels:
app: downstream0
replicas: 1
template:
metadata:
labels:
app: downstream0
spec:
containers:
- name: ho11y
image: public.ecr.aws/mhausenblas/ho11y:stable
ports:
- containerPort: 8765
env:
- name: DISABLE_OM
value: "on"
- name: HO11Y_LOG_DEST
value: "stdout"
- name: OTEL_RESOURCE_ATTRIB
value: "downstream0"
- name: OTEL_EXPORTER_OTLP_ENDPOINT
value: "otel-collector-cloudwatch-collector.default.svc.cluster.local:4317"
- name: DOWNSTREAM0
value: "https://mhausenblas.info/"
imagePullPolicy: Always
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: downstream1
namespace: default
spec:
selector:
matchLabels:
app: downstream1
replicas: 1
template:
metadata:
labels:
app: downstream1
spec:
containers:
- name: ho11y
image: public.ecr.aws/mhausenblas/ho11y:stable
ports:
- containerPort: 8765
env:
- name: DISABLE_OM
value: "on"
- name: HO11Y_LOG_DEST
value: "stdout"
- name: OTEL_RESOURCE_ATTRIB
value: "downstream1"
- name: OTEL_EXPORTER_OTLP_ENDPOINT
value: "otel-collector-cloudwatch-collector.default.svc.cluster.local:4317"
- name: DOWNSTREAM0
value: "https://o11y.news/2021-03-01/"
- name: DOWNSTREAM1
value: "DUMMY:187kB:42ms"
- name: DOWNSTREAM2
value: "DUMMY:13kB:2ms"
imagePullPolicy: Always
---
apiVersion: v1
kind: Service
metadata:
name: frontend
namespace: default
annotations:
scrape: "true"
spec:
type: LoadBalancer
ports:
- port: 80
targetPort: 8765
selector:
app: frontend
---
apiVersion: v1
kind: Service
metadata:
name: downstream0
namespace: default
annotations:
scrape: "true"
spec:
ports:
- port: 80
targetPort: 8765
selector:
app: downstream0
---
apiVersion: v1
kind: Service
metadata:
name: downstream1
namespace: default
annotations:
scrape: "true"
spec:
ports:
- port: 80
targetPort: 8765
selector:
app: downstream1
---
```

Once deployed you will be able to monitor the Ho11y metrics in cloudwatch as shown:

Expand Down
2 changes: 1 addition & 1 deletion mkdocs.yml
Original file line number Diff line number Diff line change
Expand Up @@ -34,7 +34,7 @@ nav:
- New Cluster:
- AWS Native : patterns/single-new-eks-observability-accelerators/single-new-eks-awsnative-observability.md
- Graviton OSS : patterns/single-new-eks-observability-accelerators/single-new-eks-graviton-opensource-observability.md
- Fargate : patterns/single-new-eks-observability-accelerators/single-new-eks-awsnative-fargate-observability.md
- Fargate AWS Native : patterns/single-new-eks-observability-accelerators/single-new-eks-awsnative-fargate-observability.md
- Mixed : patterns/single-new-eks-observability-accelerators/single-new-eks-mixed-observability.md
- Multi-Cluster Multi-Region Mon : patterns/multi-new-eks-observability-accelerators/multi-acc-new-eks-mixed-observability.md
- OSS : patterns/single-new-eks-observability-accelerators/single-new-eks-opensource-observability.md
Expand Down
Loading