Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Only use default EDA excludes if also using default Includes #263

Merged
merged 1 commit into from
Oct 16, 2024

Conversation

cartalla
Copy link
Contributor

@cartalla cartalla commented Oct 16, 2024

Default Exclude only works correctly with default includes because it excludes instance types to keep the total instance types down. If user specifies any includes, then the default EDA excludes may exclude instance types that they are trying to include.
Only use the default EDA includes and excludes if no includes or excludes are configured.

Clean up the defaults to be less opinionated.
For example, don't exclude the a1 instance family even though you probably shouldn't use it.
Don't exclude old instance families even though you probably shouldn't use them.
The defaults should allow anything that is legal.
The defaults will fail because they select too many instance types, but the errors will allow the user
to narrow down the configuration.

The EDA default configuration is opinionated and meant to be a starting point and an example of what is possible.

Resolves #262

Restore memory based partitions.

Related to #235.

Create partitions that include the purchase option (sp|od) and the amoutn of instance memory. This maintains backward compatibility for those using partitions to select the purchase option and amount of total memory.

Resolves #261

Add UseOnDemand configuration option that defaults to true so that you could create a cluster with only spot instances.
Currently you always have to configure on-demand instances and only spot was optional.
Make both purchase options optional, but require at least one.

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

@cartalla cartalla linked an issue Oct 16, 2024 that may be closed by this pull request
@cartalla cartalla force-pushed the 261-feature-restore-memory-based-partitions branch 4 times, most recently from 240d284 to 27385ba Compare October 16, 2024 21:47
Default Exclude only works correctly with default includes because it excludes
instance types to keep the total instance types down.
If user specifies any includes, then the default EDA excludes may exclude
instance types that they are trying to include.
Only use the default EDA includes and excludes if no includes or excludes
are configured.

Clean up the defaults to be less opinionated.
The EDA configuration is opinionated and meant to be a starting point.
But the defaults are wide open and will fail because they select too many instance types.
So, the errors will give guidance on winnowing down the instance types.

Resolves #262

Restore memory based partitions.

Related to #235.

Create partitions that include the purchase option (sp|od) and the amount of instance memory.
This maintains backward compantibility for those using partitions to select
the purchase option and amount of total memory.

Resolves #261

Add UseOnDemand configuration option that defaults to true so that you could
create a cluster with only spot instances.
Currently you always had to configure on-demand instances and only spot was optional.
Make both purchase options optional, but require at least one.
@cartalla cartalla force-pushed the 261-feature-restore-memory-based-partitions branch from 27385ba to 171cc7c Compare October 16, 2024 22:17
@cartalla cartalla merged commit 5da1512 into main Oct 16, 2024
@cartalla cartalla deleted the 261-feature-restore-memory-based-partitions branch October 16, 2024 22:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[BUG] Default excludes incorrect if not using default includes [FEATURE] Restore memory based partitions
1 participant