Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Correct swagger spec for error responses. #12317

Merged
merged 8 commits into from
Jan 15, 2021

Conversation

rkrishna12
Copy link
Member

@rkrishna12 rkrishna12 commented Jan 7, 2021

MSFT employees can try out our new experience at OpenAPI Hub - one location for using our validation tools and finding your workflow.

Changelog

Please ensure to add changelog with this PR by answering the following questions.

  1. What's the purpose of the update?
    • new service onboarding
    • new API version
    • update existing version for new feature
    • update existing version to fix swagger quality issue in s360
    • Other, please clarify
  2. When you are targeting to deploy new service/feature to public regions? Please provide date, or month to public if date is not available yet.
    N/A, no new features.
  3. When you expect to publish swagger? Please provide date, or month to public if date is not available yet.
    Service is already in public preview.
  4. If it's an update to existing version, please select SDKs of specific language and CLIs that require refresh after swagger is published.
    • SDK of .NET (need service team to ensure code readiness)
    • SDK of Python
    • SDK of Java
    • SDK of Js
    • SDK of Go
    • PowerShell
    • CLI
    • Terraform
    • No, no need to refresh for updates in this PR

Contribution checklist:

If any further question about AME onboarding or validation tools, please view the FAQ.

ARM API Review Checklist

  • Ensure to check this box if one of the following scenarios meet updates in the PR, so that label “WaitForARMFeedback” will be added automatically to involve ARM API Review. Failure to comply may result in delays for manifest application. Note this does not apply to data plane APIs, all “removals” and “adding a new property” no more require ARM API review.

    • Adding new API(s)
    • Adding a new API version
    • Adding a new service
  • Please ensure you've reviewed following guidelines including ARM resource provider contract and REST guidelines. Estimated time (4 hours). This is required before you can request review from ARM API Review board.

  • If you are blocked on ARM review and want to get the PR merged with urgency, please get the ARM oncall for reviews (RP Manifest Approvers team under Azure Resource Manager service) from IcM and reach out to them.

Breaking Change Review Checklist

If there are following updates in the PR, ensure to request an approval from API Review Board as defined in the Breaking Change Policy.

  • Removing API(s) in stable version
  • Removing properties in stable version
  • Removing API version(s) in stable version
  • Updating API in stable version with Breaking Change Validation errors
  • Updating API(s) in preview over 1 year

Action: to initiate an evaluation of the breaking change, create a new intake using the template for breaking changes. Addition details on the process and office hours are on the Breaking change Wiki.

Please follow the link to find more details on PR review process.

@openapi-workflow-bot
Copy link

Hi, @rkrishna12 Thanks for your PR. I am workflow bot for review process. Here are some small tips.

  • Please ensure to do self-check against checklists in first PR comment.
  • PR assignee is the person auto-assigned and responsible for your current PR reviewing and merging.
  • For specs comparison cross API versions, Use API Specs Comparison Report Generator
  • If there is CI failure(s), to fix CI error(s) is mandatory for PR merging; or you need to provide justification in PR comment for explanation. How to fix?

  • Any feedback about review process or workflow bot, pls contact swagger and tools team. [email protected]

    @openapi-pipeline-app
    Copy link

    openapi-pipeline-app bot commented Jan 7, 2021

    Swagger Validation Report

    ️❌BreakingChange: 23 Errors, 0 Warnings failed [Detail] Only 10 items are listed, please refer to log for more details.

    Rule Message
    1029 - ReadonlyPropertyChanged The read only property has changed from 'true' to 'false'.
    New: Microsoft.HanaOnAzure/preview/2017-11-03-preview/hanaonazure.json#L854:9
    Old: Microsoft.HanaOnAzure/preview/2017-11-03-preview/hanaonazure.json#L860:9
    1029 - ReadonlyPropertyChanged The read only property has changed from 'true' to 'false'.
    New: Microsoft.HanaOnAzure/preview/2017-11-03-preview/hanaonazure.json#L866:9
    Old: Microsoft.HanaOnAzure/preview/2017-11-03-preview/hanaonazure.json#L873:9
    1029 - ReadonlyPropertyChanged The read only property has changed from 'true' to 'false'.
    New: Microsoft.HanaOnAzure/preview/2017-11-03-preview/hanaonazure.json#L944:9
    Old: Microsoft.HanaOnAzure/preview/2017-11-03-preview/hanaonazure.json#L952:9
    1029 - ReadonlyPropertyChanged The read only property has changed from 'true' to 'false'.
    New: Microsoft.HanaOnAzure/preview/2017-11-03-preview/hanaonazure.json#L964:9
    Old: Microsoft.HanaOnAzure/preview/2017-11-03-preview/hanaonazure.json#L973:9
    1029 - ReadonlyPropertyChanged The read only property has changed from 'true' to 'false'.
    New: Microsoft.HanaOnAzure/preview/2017-11-03-preview/hanaonazure.json#L968:9
    Old: Microsoft.HanaOnAzure/preview/2017-11-03-preview/hanaonazure.json#L978:9
    1029 - ReadonlyPropertyChanged The read only property has changed from 'true' to 'false'.
    New: Microsoft.HanaOnAzure/preview/2017-11-03-preview/hanaonazure.json#L988:9
    Old: Microsoft.HanaOnAzure/preview/2017-11-03-preview/hanaonazure.json#L999:9
    1029 - ReadonlyPropertyChanged The read only property has changed from 'true' to 'false'.
    New: Microsoft.HanaOnAzure/preview/2017-11-03-preview/hanaonazure.json#L800:9
    Old: Microsoft.HanaOnAzure/preview/2017-11-03-preview/hanaonazure.json#L801:9
    1029 - ReadonlyPropertyChanged The read only property has changed from 'true' to 'false'.
    New: Microsoft.HanaOnAzure/preview/2017-11-03-preview/hanaonazure.json#L804:9
    Old: Microsoft.HanaOnAzure/preview/2017-11-03-preview/hanaonazure.json#L806:9
    1029 - ReadonlyPropertyChanged The read only property has changed from 'true' to 'false'.
    New: Microsoft.HanaOnAzure/preview/2017-11-03-preview/hanaonazure.json#L820:9
    Old: Microsoft.HanaOnAzure/preview/2017-11-03-preview/hanaonazure.json#L823:9
    1029 - ReadonlyPropertyChanged The read only property has changed from 'true' to 'false'.
    New: Microsoft.HanaOnAzure/preview/2017-11-03-preview/hanaonazure.json#L824:9
    Old: Microsoft.HanaOnAzure/preview/2017-11-03-preview/hanaonazure.json#L828:9
    ️️✔️LintDiff succeeded [Detail] [Expand]
    Validation passes for LintDiff.

    ️️✔️Avocado succeeded [Detail] [Expand]
    Validation passes for Avocado.
    ️️✔️ModelValidation succeeded [Detail] [Expand]
    Validation passes for ModelValidation.
    ️️✔️SemanticValidation succeeded [Detail] [Expand]
    Validation passes for SemanticValidation.
    ️️✔️[Staging] Cross Version BreakingChange (Base on preview version) succeeded [Detail] [Expand]
    There are no breaking changes.
    ️️✔️[Staging] Cross Version BreakingChange (Base on stable version) succeeded [Detail] [Expand]
    There are no breaking changes.
    ️️✔️CredScan succeeded [Detail] [Expand]
    There is no credential detected.
    Posted by Swagger Pipeline | How to fix these errors?

    @openapi-pipeline-app
    Copy link

    openapi-pipeline-app bot commented Jan 7, 2021

    Swagger Generation Artifacts

    ️⚠️ azure-sdk-for-java warning [Detail]
    • ⚠️Warning [Logs]Release - Generate from 14313ea. SDK Automation 14.0.0
      command	./eng/mgmt/automation/init.sh ../azure-sdk-for-java_tmp/initInput.json ../azure-sdk-for-java_tmp/initOutput.json
      command	./eng/mgmt/automation/generate.py ../azure-sdk-for-java_tmp/generateInput.json ../azure-sdk-for-java_tmp/generateOutput.json
      cmderr	[generate.py] 2021-01-15 08:37:55 INFO [VERSION][Not Found] cannot find version for "com.azure.resourcemanager:azure-resourcemanager-hanaonazure"
      cmderr	[generate.py] 2021-01-15 08:37:55 INFO [VERSION][Not Found] cannot find stable version, current version "1.0.0-beta.1"
      cmderr	[generate.py] 2021-01-15 08:37:55 INFO autorest --version=3.0.6350 --use=@autorest/[email protected] --java.azure-libraries-for-java-folder=/home/vsts/work/1/s/azure-sdk-for-java --java.output-folder=/home/vsts/work/1/s/azure-sdk-for-java/sdk/hanaonazure/azure-resourcemanager-hanaonazure --java.namespace=com.azure.resourcemanager.hanaonazure  --package-version=1.0.0-beta.1 --java --pipeline.modelerfour.additional-checks=false --pipeline.modelerfour.lenient-model-deduplication=true --azure-arm --verbose --sdk-integration --fluent=lite --java.fluent=lite --java.license-header=MICROSOFT_MIT_SMALL ../azure-rest-api-specs/specification/hanaonazure/resource-manager/readme.md
      cmderr	[generate.py] 2021-01-15 08:38:34 INFO [CI][Success] Write to ci.yml
      cmderr	[generate.py] 2021-01-15 08:38:34 INFO [POM][Process] dealing with pom.xml
      cmderr	[generate.py] 2021-01-15 08:38:34 INFO [POM][Skip] pom already has module azure-resourcemanager-hanaonazure
      cmderr	[generate.py] 2021-01-15 08:38:34 INFO [POM][Success] Write to pom.xml
      cmderr	[generate.py] 2021-01-15 08:38:34 INFO [POM][Process] dealing with root pom
      cmderr	[generate.py] 2021-01-15 08:38:34 INFO [POM][Success] Write to root pom
      cmderr	[generate.py] WARNING: An illegal reflective access operation has occurred
      cmderr	[generate.py] WARNING: Illegal reflective access by org.codehaus.groovy.reflection.ReflectionUtils (file:/home/vsts/.m2/repository/org/codehaus/groovy/groovy/3.0.0-beta-2/groovy-3.0.0-beta-2-indy.jar) to method java.util.Collections$UnmodifiableCollection.toString()
      cmderr	[generate.py] WARNING: Please consider reporting this to the maintainers of org.codehaus.groovy.reflection.ReflectionUtils
      cmderr	[generate.py] WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
      cmderr	[generate.py] WARNING: All illegal access operations will be denied in a future release
    • ️✔️azure-resourcemanager-hanaonazure [View full logs]  [Release SDK Changes]
      cmderr	[Inst] 2021-01-15 08:40:52 DEBUG Got artifact_id: azure-resourcemanager-hanaonazure
      cmderr	[Inst] 2021-01-15 08:40:52 DEBUG Got artifact: pom.xml
      cmderr	[Inst] 2021-01-15 08:40:52 DEBUG Got artifact: azure-resourcemanager-hanaonazure-1.0.0-beta.1.jar
      cmderr	[Inst] 2021-01-15 08:40:52 DEBUG Match jar package: azure-resourcemanager-hanaonazure-1.0.0-beta.1.jar
      cmderr	[Inst] 2021-01-15 08:40:52 DEBUG output: {"full": "```sh\ncurl -L \"https://portal.azure-devex-tools.com/api/sdk-dl-pub?p=Azure/12317/azure-sdk-for-java/azure-resourcemanager-hanaonazure/azure-resourcemanager-hanaonazure-1.0.0-beta.1.jar\" -o azure-resourcemanager-hanaonazure-1.0.0-beta.1.jar\nmvn install:install-file -DgroupId=com.azure.resourcemanager -DartifactId=azure-resourcemanager-hanaonazure -Dversion=1.0.0-beta.0 -Dfile=azure-resourcemanager-hanaonazure-1.0.0-beta.1.jar -Dpackaging=jar -DgeneratePom=true
      ```"}
    ️️✔️ azure-sdk-for-python succeeded [Detail] [Expand]
    • ️✔️Succeeded [Logs]Release - Generate from 14313ea. SDK Automation 14.0.0
      warn	Skip initScript due to not configured
      command	npx n 12
      command	python3 -m venv venv
      command	pip install --upgrade setuptools wheel pip
      command	pip install pathlib jinja2 msrestazure
      command	autorest --version=V2 [email protected]/autorest.python@~4.0.71 --python --python-mode=update --multiapi --keep-version-file --no-async --python-sdks-folder=/home/vsts/work/1/s/azure-sdk-for-python/sdk ../azure-rest-api-specs/specification/hanaonazure/resource-manager/readme.md
    • ️✔️azure-mgmt-hanaonazure [View full logs]  [Release SDK Changes] Breaking Change Detected
      cmderr	[buildConf] INFO:packaging_tools:Building template azure-mgmt-hanaonazure
      cmderr	[buildConf] INFO:packaging_tools.conf:Skipping default conf since the file exists
      cmderr	[buildConf] INFO:packaging_tools:Skipping CHANGELOG.md template, since a previous one was found
      cmderr	[buildConf] INFO:packaging_tools:Template done azure-mgmt-hanaonazure
      cmderr	[changelogSetup] WARNING: Skipping azure-nspkg as it is not installed.
      cmderr	[changelogReport] INFO:__main__:Looking for Autorest generated package in azure.mgmt.hanaonazure
      cmderr	[changelogReport] INFO:__main__:Found azure.mgmt.hanaonazure
      cmderr	[changelogReport] INFO:__main__:Working on azure.mgmt.hanaonazure
      cmderr	[changelogReport] INFO:__main__:Report written to sdk/hanaonazure/azure-mgmt-hanaonazure/code_reports/latest/report.json
      cmderr	[changelogReportLatest] INFO:__main__:Download versions of azure-mgmt-hanaonazure on PyPI
      cmderr	[changelogReportLatest] INFO:__main__:Got ['0.1.0', '0.1.1', '0.2.0', '0.2.1', '0.3.0', '0.3.1', '0.3.2', '0.4.0', '0.5.0', '0.5.1', '0.6.0', '0.7.0', '0.7.1', '0.8.0', '0.9.0', '0.10.0', '0.11.0', '0.12.0', '0.12.1', '0.13.0', '0.14.0', '1.0.0b1']
      cmderr	[changelogReportLatest] INFO:__main__:Only keep last PyPI version
      cmderr	[changelogReportLatest] INFO:__main__:Installing version 0.14.0 of azure-mgmt-hanaonazure in a venv
      cmderr	[changelogReportLatest] Cache entry deserialization failed, entry ignored
      cmderr	[changelogReportLatest] INFO:__main__:Looking for Autorest generated package in azure.mgmt.hanaonazure
      cmderr	[changelogReportLatest] INFO:__main__:Found azure.mgmt.hanaonazure
      cmderr	[changelogReportLatest] INFO:__main__:Working on azure.mgmt.hanaonazure
      cmderr	[changelogReportLatest] INFO:__main__:Report written to sdk/hanaonazure/azure-mgmt-hanaonazure/code_reports/0.14.0/report.json
      cmdout	[Changelog] Size of delta 11.599% size of original (original: 9061 chars, delta: 1051 chars)
      cmdout	[Changelog] **Breaking changes**
      cmdout	[Changelog]   - Parameter location of model TrackedResource is now required
      cmdout	[Changelog]   - Parameter location of model SapMonitor is now required
      cmdout	[Changelog]   - Model ErrorResponse has a new signature
      warn	Breaking change found in changelog
    ️️✔️ azure-sdk-for-go succeeded [Detail] [Expand]
    • ️✔️Succeeded [Logs]Release - Generate from 14313ea. SDK Automation 14.0.0
      command	sh ./initScript.sh ../../../../../azure-sdk-for-go_tmp/initInput.json ../../../../../azure-sdk-for-go_tmp/initOutput.json
      command	go run ./tools/generator/main.go ../../../../../azure-sdk-for-go_tmp/generateInput.json ../../../../../azure-sdk-for-go_tmp/generateOutput.json
    • ️✔️preview/hanaonazure/mgmt/2017-11-03-preview/hanaonazure [View full logs]  [Release SDK Changes] Breaking Change Detected
      info	[Changelog] ## Breaking Changes
      info	[Changelog]
      info	[Changelog] - Function `StorageProfile.MarshalJSON` has been removed
      info	[Changelog] - Function `NetworkProfile.MarshalJSON` has been removed
      info	[Changelog] - Function `HanaInstanceProperties.MarshalJSON` has been removed
      info	[Changelog] - Function `OSProfile.MarshalJSON` has been removed
      info	[Changelog] - Field `Code` of struct `ErrorResponse` has been removed
      info	[Changelog] - Field `Message` of struct `ErrorResponse` has been removed
      info	[Changelog]
      info	[Changelog] ## New Content
      info	[Changelog]
      info	[Changelog] - New struct `ErrorResponseError`
      info	[Changelog] - New field `Error` in struct `ErrorResponse`
      info	[Changelog]
      info	[Changelog] Total 5 breaking change(s), 3 additive change(s).
      info	[Changelog]
    ️️✔️ azure-resource-manager-schemas succeeded [Detail] [Expand]
    • ️✔️Succeeded [Logs]Release - Generate from 14313ea. Schema Automation 14.0.0
      warn	Skip initScript due to not configured
      command	npx n 12
      command	autorest --use=@autorest/[email protected] --version=3.0.6351 --azureresourceschema --multiapi --title=none --pass-thru:subset-reducer --azureresourceschema-folder=/home/vsts/work/1/s/azure-resource-manager-schemas/azure-resource-manager-schemas ../../azure-rest-api-specs/specification/hanaonazure/resource-manager/readme.md
    • ️✔️hanaonazure [View full logs]  [Release Schema Changes]
      cmderr	[resource-manager] node-pre-gyp
      cmderr	[resource-manager] WARN Using request for node-pre-gyp https download
      cmderr	[resource-manager] WARN [email protected] No repository field.
      cmderr	[resource-manager] WARN optional SKIPPING OPTIONAL DEPENDENCY: [email protected] (node_modules/fsevents):
      cmderr	[resource-manager] npm WARN notsup SKIPPING OPTIONAL DEPENDENCY: Unsupported platform for [email protected]: wanted {"os":"darwin","arch":"any"} (current: {"os":"linux","arch":"x64"})
    ️️✔️ azure-sdk-for-js succeeded [Detail] [Expand]
    • ️✔️Succeeded [Logs]Release - Generate from 14313ea. SDK Automation 14.0.0
      warn	Skip initScript due to not configured
      command	autorest --version=V2 --typescript --license-header=MICROSOFT_MIT_NO_VERSION [email protected]/[email protected] --typescript-sdks-folder=/home/vsts/work/1/s/azure-sdk-for-js/azure-sdk-for-js ../../azure-rest-api-specs/specification/hanaonazure/resource-manager/readme.md
    • ️✔️@azure/arm-hanaonazure [View full logs]  [Release SDK Changes]
      cmderr	[npmPack] loaded rollup.config.js with warnings
      cmderr	[npmPack] (!) Unused external imports
      cmderr	[npmPack] default imported from external module 'rollup' but never used
      cmderr	[npmPack] ./esm/hanaManagementClient.js → ./dist/arm-hanaonazure.js...
      cmderr	[npmPack] created ./dist/arm-hanaonazure.js in 232ms
    ️️✔️[Staging] ApiDocPreview succeeded [Detail] [Expand]
     Please click here to preview with your @microsoft account. 
    Posted by Swagger Pipeline | How to fix these errors?

    @openapi-workflow-bot
    Copy link

    Hi @rkrishna12, one or multiple breaking change(s) is detected in your PR. Please check out the breaking change(s), and provide business justification in the PR comment and @ PR assignee why you must have these change(s), and how external customer impact can be mitigated. Please ensure to follow breaking change policy to request breaking change review and approval before proceeding swagger PR review.
    Action: To initiate an evaluation of the breaking change, create a new intake using the template for breaking changes. Addition details on the process and office hours are on the Breaking change Wiki.
    If you want to know the production traffic statistic, please see ARM Traffic statistic.
    If you think it is false positive breaking change, please provide the reasons in the PR comment, report to Swagger Tooling Team via https://aka.ms/swaggerfeedback.

    @openapi-workflow-bot
    Copy link

    Hi @rkrishna12, Your PR has some issues. Please fix the CI sequentially by following the order of Avocado, semantic validation, model validation, breaking change, lintDiff.

    TaskHow to fixPrioritySupport (Microsoft alias)
    AvocadoFix-AvocadoHighruowan
    Semantic validationFix-SemanticValidation-ErrorHighraychen, jianyxi
    Model validationFix-ModelValidation-ErrorHighraychen,jianyxi
    LintDiffFix-LintDiffhighjianyxi, ruoxuan
    If you need further help, please feedback via swagger feedback."

    @rkrishna12
    Copy link
    Member Author

    rkrishna12 commented Jan 7, 2021

    @ChenTanyi, One thing to note - the service is returning the error response in the correct OpenAPI format but the swagger spec did not match this. This PR corrects the swagger spec to match the actual behavior, hence no API version change was done.

    @lagalbra
    Copy link
    Contributor

    lagalbra commented Jan 7, 2021

    This API version has always been in Preview. Our RP in general is in Public Preview, and is not expected to become GA for at least 6 months to a year.

    @ChenTanyi
    Copy link
    Contributor

    @rkrishna12 You need to fix the CI error although it may not be caused by this PR.
    And fix S360 issue also need Breaking Change Review. You can see https://dev.azure.com/azure-sdk/internal/_wiki/wikis/internal.wiki/405/Window-to-Fix-Broken

    @rkrishna12
    Copy link
    Member Author

    @ChenTanyi, to clarify - the "Swagger ModelValidation" errors need to be fixed in this same PR before presenting to the "Breaking change" review board and merging?

    @ChenTanyi
    Copy link
    Contributor

    Yes, you could also create a new PR only fix for the validation error, if there are no breaking changes.

    most of HanaInstance properties.
    properties. Must fix the example code.
    @JeffreyRichter JeffreyRichter added the Approved-BreakingChange DO NOT USE! OBSOLETE label. See https://github.com/Azure/azure-sdk-tools/issues/6374 label Jan 14, 2021
    @ChenTanyi
    Copy link
    Contributor

    @ArcturusZhang Could you take a look at GO failure?

    @ArcturusZhang
    Copy link
    Member

    /azp run

    @azure-pipelines
    Copy link

    Azure Pipelines successfully started running 2 pipeline(s).

    @ArcturusZhang
    Copy link
    Member

    @ChenTanyi rerun and it should pass - there was a bug fixed a few hours ago

    @ChenTanyi ChenTanyi merged commit 14313ea into Azure:master Jan 15, 2021
    mkarmark pushed a commit to mkarmark/azure-rest-api-specs that referenced this pull request Jul 21, 2021
    * Correct swagger spec for error responses.
    
    * Fix example file for SAP monitor create to use
    the correct casing.
    
    * Remove read-only setting from
    most of HanaInstance properties.
    
    * Fix remaining model validation failures.
    
    * One more property to fix
    
    * Resource object should have read-only
    properties. Must fix the example code.
    
    * Remove read-only properties from example file
    
    * Fix error from prettier
    Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
    Labels
    Approved-BreakingChange DO NOT USE! OBSOLETE label. See https://github.com/Azure/azure-sdk-tools/issues/6374 CI-BreakingChange-Go CI-BreakingChange-Python
    Projects
    None yet
    Development

    Successfully merging this pull request may close these issues.

    6 participants