Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to pass the parameter processingInstanceType to the dataprocessing command? #103

Closed
AWS-Bassem opened this issue Mar 31, 2021 · 2 comments
Assignees

Comments

@AWS-Bassem
Copy link

How do you pass the parameter processingInstanceType when using the %neptune-ml magic dataprocessing command to start a processing job?

The Notebooks only have the below code which does not have this parameter.

processing_params = f"""
--config-file-name training-job-configuration.json
--job-id {training_job_name} 
--s3-input-uri {export_results['outputS3Uri']} 
--s3-processed-uri {str(s3_bucket_uri)}/preloading """
%neptune_ml dataprocessing start --wait --store-to processing_results {processing_params}
@austinkline
Copy link
Contributor

Thanks for creating this @AWS-Bassem, we should just be able to add this parameter to the dataprocessing variant of neptune_ml.

linking the sub parser that we use for those parameters for future reference when we pick this up:
https://github.com/aws/graph-notebook/blob/main/src/graph_notebook/magics/ml.py#L64

@michaelnchin
Copy link
Member

michaelnchin commented Oct 1, 2021

Hi @AWS-Bassem,

Support for processingInstanceType has been added in #202; you can now pass in this parameter by specifying the --instance-type option; this will be included in the next release.

Closing out this issue as the requested feature has been completed; please feel free to re-open if there are any further questions or concerns.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: Resolved
Development

No branches or pull requests

3 participants