Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

docs: Manually create Equinix cluster #2

Merged
merged 3 commits into from
Nov 16, 2023

Conversation

rossf7
Copy link
Contributor

@rossf7 rossf7 commented Oct 18, 2023

Adds docs for manually creating a cluster with CAPI / CAPEM to try things out while we work on the pipeline design.

I've added comments for decisions I'm not sure on or that are worth highlighting.

One thing to note is the Kubernetes API will be public. As we've discussed as a later step we could make it private and use a GitOps tool like Flux to manage the components running in the cluster.

export PROJECT_ID="<PROJECT_ID>"

# Use Paris metro (Equinix region)
export METRO="pa"
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we want to consider carbon intensity when deciding which metro to use?

I chose Paris since France has a low average carbon intensity and this metro has a good selection of node types.

Full list is here and we can easily change if I'm over thinking this :)
https://deploy.equinix.com/developers/docs/metal/locations/metros/

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is a very important callout! We can hardcode Paris for now and make the testing carbon-aware in the future. Would you like to create a new issue for this to add it to our backlog? 🌟

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes sure I'll create an issue for it. 👍


# Use node type with Intel CPUs for RAPL support
export CONTROLPLANE_NODE_TYPE="m3.small.x86"
export WORKER_NODE_TYPE="m3.small.x86"
Copy link
Contributor Author

@rossf7 rossf7 Oct 18, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think its safest to use a node type with an Intel CPU. I tested with an AMD CPU and Kepler couldn't access RAPL.

Screenshot 2023-10-18 at 11 15 34

I think this node type has good enough resources for now. WDYT?

See https://deploy.equinix.com/product/bare-metal/servers/

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1 for using an Intel CPU and starting with small! 👍

docs/create_equinix_cluster.md Show resolved Hide resolved
apt install linux-headers-$(uname -r)
apt install linux-modules-extra-$(uname -r)
modprobe intel_rapl_common
```
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I didn't actually need to run these steps but I think its safest to include them since they are requirements for Kepler. WDYT?

Copy link
Contributor

@nikimanoledaki nikimanoledaki Oct 24, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good to validate that the kernel headers are there, I always double-check this as well 👍

Copy link
Contributor

@nikimanoledaki nikimanoledaki left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Wonderful, thank you @rossf7! 🌟 🎉

Signed-off-by: Ross Fairbanks <[email protected]>
@leonardpahlke leonardpahlke merged commit 86e9631 into cncf-tags:main Nov 16, 2023
1 check passed
@rossf7 rossf7 deleted the add-equinix-metal-docs branch November 16, 2023 18:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants