-
Notifications
You must be signed in to change notification settings - Fork 5.1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Inference Endpoint and Deployment resources #10193
Inference Endpoint and Deployment resources #10193
Conversation
[Staging] Swagger Validation Report
️✔️ |
Rule | Message |
---|---|
An error occurred while executing JSON.parse() on the linter output for specification/machinelearningservices/resource-manager/readme.md: |
"role":"Lint Diff", "new":"https://github.com/Azure/azure-rest-api-specs/blob/1fb4fe90f3bd6e8629a8ada524ec543fa376c335/specification/machinelearningservices/resource-manager/readme.md", "old":"https://github.com/Azure/azure-rest-api-specs/blob/master/specification/machinelearningservices/resource-manager/readme.md" |
️️✔️
Avocado [Detail]
️✔️
Validation passes for Avocado.
Azure Pipelines successfully started running 1 pipeline(s). |
azure-sdk-for-go
|
Azure CLI Extension Generation
|
azure-sdk-for-java
No readme.md specification configuration files were found that are associated with the files modified in this pull request, or swagger_to_sdk section in readme.md is not configured
|
Trenton Generation
No readme.md specification configuration files were found that are associated with the files modified in this pull request, or swagger_to_sdk section in readme.md is not configured
|
azure-sdk-for-js
|
azure-sdk-for-python
- Breaking Change detected in SDK
|
} | ||
} | ||
}, | ||
"/subscriptions/{subscriptionId}/resourceGroups/{resourceGroupName}/providers/Microsoft.MachineLearningServices/workspaces/{workspaceName}/endpoints/{endpointName}/deployments/{deploymentName}/skus": { |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Reminder comment: Can you add a comment as to why this is required - based on the autoscale email thread? - Rakesh
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
yes it is required for azmon autoscale integration
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
yes this is from the previous PR. I will add the "why" in the description.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
or in summary.
azure-sdk-for-net
|
Can one of the admins verify this patch? |
…ghts (weight distribution across deployments) to Endpoint, added PATCH for Endpoint and Deployment
Azure Pipelines successfully started running 1 pipeline(s). |
azure-sdk-for-python-track2
No readme.md specification configuration files were found that are associated with the files modified in this pull request, or swagger_to_sdk section in readme.md is not configured
|
…esponse for resource since these are resources, added validate call to validate endpoint name, added deployment properties code assets and environments
Azure Pipelines successfully started running 1 pipeline(s). |
…r vnet ref, deleted POST for endpoint and deployment as convention uses PUT for creation
Azure Pipelines successfully started running 1 pipeline(s). |
Azure Pipelines successfully started running 1 pipeline(s). |
"description": "The payload that is used to update the Inference Deployment.", | ||
"required": true, | ||
"schema": { | ||
"$ref": "#/definitions/InferenceDeploymentUpdateParameter" |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
is this a standard naming scheme "xxxUpdateParameter".. seems odd to be called a parameter?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
If you look through the file, I followed the convention of "type" + UpdateParameters, i.e. ClusterUpdateParameters, QuotaUpdateParameters, WorkspacePropertiesUpdateParameters, and WorkspaceUpdateParameters.
@@ -2537,6 +3196,7 @@ | |||
"type": "string" | |||
} | |||
}, | |||
// RANDOM QUESTION: WHY IS THIS HERE??? |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
what is plan for this?
@@ -3629,6 +4289,15 @@ | |||
} | |||
}, | |||
"Sku": { | |||
// CORRECTION???: Docs show sku def as |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
also this?
}, | ||
"discriminator": "computeType" | ||
}, | ||
"PaginatedServiceList": { |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
do we need to define this?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I did not define this. I dont know why this was an addition here.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Down below, it assumes that I changed the PaginatedServiceList line for PaginatedInferenceDeploymentsList
...er/Microsoft.MachineLearningServices/preview/2020-05-01-preview/machineLearningServices.json
Outdated
Show resolved
Hide resolved
"readOnly": true | ||
} | ||
}, | ||
"x-ms-discriminator-value": "InferenceEndpoint" |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
required?
"readOnly": true, | ||
"description": "The current provisioning state of the Inference Deployment resource." | ||
}, | ||
"error": { |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Is this the errorMessage when state is Failed? Should we call it statusMessage or failureMessage? is there a comparable we can reference to decide?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
this was a property left over from copying service. Compute has ProvisioningError that holds the error and AmlCompute keeps an array of error encountered for compute nodes during node setup. We can keep this property for failed endpoints.
}, | ||
"InferenceEndpointUpdateParameter": { | ||
"description": "The parameters for updating an inference endpoint.", | ||
"properties": { } |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
is this TODO? can add a TODO comment if so?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I left it for conversation and any changes but there is nothing mutable in Endpoint, so we can get rid of PATCH for Endpoint and this object then.
Azure Pipelines successfully started running 1 pipeline(s). |
Azure Pipelines successfully started running 1 pipeline(s). |
Azure Pipelines successfully started running 1 pipeline(s). |
Azure Pipelines successfully started running 1 pipeline(s). |
Azure Pipelines successfully started running 1 pipeline(s). |
Azure Pipelines successfully started running 1 pipeline(s). |
Azure Pipelines successfully started running 1 pipeline(s). |
Azure Pipelines successfully started running 1 pipeline(s). |
Azure Pipelines successfully started running 1 pipeline(s). |
Azure Pipelines successfully started running 1 pipeline(s). |
While adding new version the recommendation is to copy the existing version into new directory structure for first commit and then push new changes for easy review. Please create new branch with this recommendation for faster review. |
Azure Pipelines successfully started running 1 pipeline(s). |
Thanks for the recommendation. Which existing version should I copy? Latest stable or latest preview? |
Also it seems that the errors in the automated tests are not changes I made, but in machineLearningServices.json that was already checked in. |
moved changes to new PR as instructed. #10420 |
MSFT employees can try out our new experience at OpenAPI Hub - one location for using our validation tools and finding your workflow.
Contribution checklist:
If any further question about AME onboarding or validation tools, please view the FAQ.
ARM API Review Checklist
Ensure to check this box if one of the following scenarios meet updates in the PR, so that label “WaitForARMFeedback” will be added automatically to involve ARM API Review. Failure to comply may result in delays for manifest application. Note this does not apply to data plane APIs, all “removals” and “adding a new property” no more require ARM API review.
If you are blocked on ARM review and want to get the PR merged with urgency, please get the ARM oncall for reviews (RP Manifest Approvers team under Azure Resource Manager service) from IcM and reach out to them.
Breaking Change Review Checklist
If there are following updates in the PR, ensure to request an approval from API Review Board as defined in the Breaking Change Policy.
Please follow the link to find more details on PR review process.