Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Instance types not supported by EMR #135

Closed
chrismld opened this issue Jul 1, 2022 · 4 comments
Closed

Instance types not supported by EMR #135

chrismld opened this issue Jul 1, 2022 · 4 comments

Comments

@chrismld
Copy link
Contributor

chrismld commented Jul 1, 2022

When running a command like the following, it's returning m5n.2xlarge and m5ad.2xlarge which are not supported by EMR.

ec2-instance-selector --vcpus-min 8 --vcpus-max 8 --vcpus-to-memory-ratio 1:4 --cpu-architecture x86_64 --current-generation --gpus 0 --service emr-5.32.0 --max-results 50 -o table-wide --price-per-hour-max 0.428 -u spot --region eu-west-1

Do we need to specify another parameter or is there an issue with the API call?

@bwagner5
Copy link
Contributor

bwagner5 commented Jul 1, 2022

The EMR service integration is not the best tbh. To my knowledge there is no API to determine which instance types are supported for EMR, just the docs page which is pretty difficult to read. It may be worth deprecating the EMR service integration.

Here's the current logic: https://github.com/aws/amazon-ec2-instance-selector/blob/main/pkg/selector/emr.go

@chrismld
Copy link
Contributor Author

chrismld commented Jul 7, 2022

@bwagner5 thanks for the feedback, I thought it was a parameter being forwarded to the API but I see the list is hard coded. So, in the meantime, should we exclude types that are not supported as we get feedback?

@bwagner5
Copy link
Contributor

bwagner5 commented Jul 8, 2022

We can do that. Are you able to submit a PR with more accurate instance types list per version?

@chrismld
Copy link
Contributor Author

chrismld commented Jul 8, 2022

@bwagner5 sure, I'll work on updating the instance types for EMR

chrismld pushed a commit to chrismld/amazon-ec2-instance-selector that referenced this issue Jul 15, 2022
bwagner5 pushed a commit that referenced this issue Jul 15, 2022
* Updated EMR instance types list

* Updated EMR instance types list #135

Co-authored-by: EC2 Default User <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants