[Storage] Add data plane Datalake Storage swagger (Azure#15789)

* Storage Dataplane Preview (#7027)

* Adding Azure Storage Dataplane REST API Specs

These are all Preview swagger specs and we do expect to make changes.

- Add readme.md files to suppress --azure-validator rules
- Fix trivial error about an x-ms-client-name mathing a name that won't change the
code generation
- We'll need to fix the semantic/avocado pipeline issues and get this properly reviewed before merging from the `storage-dataplane-preview` fork into `master`.

* Fixed blob swagger for CPK (#7045)

* Fixed blob swagger for CPK

* Add share permission body to storage files (#7081)

* Add share permission body to storage files

* Add produces to getPermission

* Move response body from create to get

* Adding SAS Error Codes (#7322)

* [Fix]Addressing the Things Below (#7304)

1.	create of Page Blob is missing tier parameter.
2.	For upload_pages_from_url of Page Blob, the generated code doesn’t extract header encryption-key-sha256 from raw response, which resulted in the response to client doesn’t have encryption-key-sha256 info.
3.	For append_block_from_url of Append Blob, currently the generated code is not extracting the response header request-server-encrypted from raw response(server returned response) which resulted in client doesn’t have request-server-encrypted info.
4.	get_permission of Storage File has file_permission_key parameter which should be required instead of optional

* Remove delimiter from list blob flat segment response (#7376)

Resolves #7350

* Updated DataLake swagger (#7408)

* Additional DataLake swagger updates (#7445)

* Additional DataLake swagger updates

* refactored fileSystemResource param and added md5 to pathHttpHeaders (#7525)

* Updated ContentMD5 parameter in DataLake swagger (#7534)

* Updated ContentMD5 parameter in DataLake swagger

* separated contentMD5 from transactionalContentMD5

* Add transactional md5 support for blockBlobUpload (#7553)

* Added File Storage 2019-07-07 service version (#7825)

* Added premium share properties to File Shares (#7826)

* Added x-ms-number-of-handles-failed to File and Directory ForceCloseHandles (#7833)

* Added new FileCopy() headers (#7837)

* Added File Lease (#7845)

* [Blob] Added missing headers for copy blob from URL (#7820)

* Added 2019-07-07 Blobs Swagger (#7849)

* Added additional FileLease parameters (#7892)

* Added additional File Lease request and response headers (#7910)

* Added encryption scopes to Blob Storage (#7929)

* Storage/features/more cpk n (#7940)

* Added previous snapshot url header to PageBlob.GetPageRangeDiff (#7951)

* Made LeaseId optional on File Break Lease (#7952)

* Added EncryptionScope and DenyDefaultEncryptionScopeOverride to ContainerProperties (#8001)

* Added rest parity attributes to start copy response (#8009)

* Modified swagger to fix some descriptions (#8014)

* undid rest parity start copy response (#8016)

* Added new ErrorCode (#8071)

* Added FileSystem Get/SetAccessControl and SetPermissions (#8081)

* Revert "Added FileSystem Get/SetAccessControl and SetPermissions (#8081)" (#8134)

This reverts commit 855877c2917e43c1ba9af635d6324791555c32f9.

* Renamed DenyEncryptionScopeOverride -> PreventEncryptionScopeOverride (#8245)

* Renamed denyEncryptionScopeOverride to preventEncryptionScopeOverride (#8247)

* Added 2019-12-12 storage service version (#8396)

* make AccessPolicy's fields optional in blob and queue (#7992)

* Updated swagger to include Quick Query (#8407)

* Removed '&' from comment in 2019-12-12 blobs swagger (#8510)

* Minor Quick Query update (#8523)

* Another quick query update (#8549)

* Added DataLake 2019-12-12 swagger file (#8594)

* Changed name of hasHeaders to headersPresent (#8612)

* [Storage][Blob]Blob Versioning (#8515)

* Storage/feature/recursive acl (#8666)

* added set acl recursive operation

* added set acl recursive operation

* added set acl recursive operation

* remove invalid parameters

* rename mode enum and strip list entry per review feedback (#8698)

* [Storage][Blob]Blob Versioning: listBlobs add include {versions} and undo set metadata (#8735)

* [Blob Versioning] listBlobs add include {versions} and undo set metadata

* add response headers to syncCopyFromURL and abortCopyFromURL

* undo abortCopyFromURL

* Revert "undo abortCopyFromURL"

This reverts commit 886c9a39c631799f25deccde2a982981d48f1c14.

* add versionId to setMetaData and incrementalCopy's response headers

* [Storage][Blob]Blob Versioning Update (#8762)

 Undo abortCopyFromURL and pageBlob incrementalCopy

* [Storage] add version headers for get blob properties (#8775)

* [Storage] add version headers for get blob properties

* dot

* add versionId to getBlob response headers (#8786)

Co-authored-by: Lin Jian <[email protected]>

* [Storage][Recursive ACL] Tweak mode enum to allow hiding it in transforms (#8789)

* added x-ms-client-name tot DataLakeStorageError's inner error (#8739)

* block can be now up to 4000MB (#8912)

* Undid breaking change (#8939)

* Fixed typo (#8941)

* Feature/storage/blob tags (#8936)

* Fixing Tags swagger (#8948)

* minor tags update (#8950)

* Added container soft delete (#9013)

* Added Share Soft Delete (#9015)

* Added Append Blob Seal (#9016)

* Minor addition to Append Seal (#9039)

* More Append Seal stuff (#9059)

* Removed contentLength from setTags (#9061)

* Feature/storage/set expiry (#9079)

* Added Snapshot and Version to Blob Set Tier (#9086)

* Object Replication update to swagger (update from James OR branch) (#9024)

* Object Replication update to swagger (update from James OR branch)

* Adding object replication to code 206

* Adding in x-ms-or-policy-id header

* Blob tags serialization fix (#9087)

* Blob tags serialization fix (#9142)

* Removed contentLength from setTags (#9061)

* Fixed BlobTags serialization

* Added tag count to properties returned on listing

* Renaming BlobProperties to BlobPropertiesInternal (#9183)

* Rename ObjectReplicationRuleStatus to ObjectReplicationRules (#9186)

* Remove snapshot from set tags (#9184)

* Removed contentLength from setTags (#9061)

* Fixed BlobTags serialization

* Added tag count to properties returned on listing

* Removed snapshot from setTags

* Renamed quick query to query (#9504)

* x-ms-client-name to DataLakeStorageError's inner error (#9506)

* Added Set Expiry to Data Lake (#9620)

* Update CODEOWNERS

* Feature/storage/blob conditional headers (#9695)

* list blobs ors (#9698)

* Added x-ms-source-if-tags to Blob Async Copy (#9744)

* fix typo in comments (#9758)

Co-authored-by: Lin Jian <[email protected]>

* fix typo in comments (#9783)

Co-authored-by: Lin Jian <[email protected]>

* remove TagValue (#9830)

* Revert "remove TagValue (#9830)"

This reverts commit 6af58bf7a09774c77da07cf2ae574c2270ca14a0.

* Adding STG74 2020-02-02 swagger for DataLake (#9915)

* Adding STG74 2020-02-02 swagger

* Adding forceflag for recursive acl in datalake (#9916)

* Added support for Get/SetBlobServiceProperties StaticWebsite.DefaultIndexDocumentPath (#9940)

* Added RehydratePriority response header to GetBlobProperties and ListBlobs (Azure#9951)

* Fixed bug where AccountKind was missing BlockBlobStorage and FileStorage (Azure#9961)

* Fixed Enum values (Azure#9970)

* Added new swagger files for STG 74 (Azure#10074)

* Storage/add if tags to set tier (Azure#10092)

* removed source if tags from start copy from url (Azure#10093)

Co-authored-by: Gauri Prasad <[email protected]>

* Storage/sealblob (Azure#10201)

* Added back source ifTags (Azure#10206)

* Added tag to storage readme (Azure#10218)

* add iftags for clearPage, incrementalcopy, resize, UpdateSequenceNumber and query (Azure#10238)

Co-authored-by: Lin Jian <[email protected]>

* Concurrent Append (Azure#10279)

* Inital commit for Concurrent Append swagger

* another update

* PR comments

* make queue message body optional (Azure#10477)

* Added Get File Range Diff (Azure#10399)

* [Storage] Make message required for enqueue. (Azure#10480)

* make queue message body optional

* require queue message for post

* colons

* SMB Multichannel (Azure#10329)

* Changed setAclRecursiveMode to be a method param (Azure#10509)

* Feature/storage/share lease (Azure#10351)

* Removed Concurrent Append (Azure#10544)

* Feature/storage/new quick query features (Azure#10571)

* Added Last Access Time (Azure#10339)

* [Storage][DataLake]Update API Version (Azure#10663)

* Added missing error code (Azure#10744)

* [storage-blob] fix typo "laster" -> "later" (Azure#10751)

* fix typo laster

* fix 4tb file documentation

Co-authored-by: Lin Jian <[email protected]>

* Renamed SmbSettings and ProtocolSettings, Removed lease duration headers.  (Azure#10835)

* Removed lease duration from response headers for all lease APIs except break lease

* Modified names according to arch board review

Co-authored-by: Gauri Prasad <[email protected]>

* Fixed FileClient.GetRangeListDiff (Azure#10896)

* Set File Tier (Azure#10368)

* Added swagger files for new Storage service version (Azure#11031)

* Added include leased to DeleteSnapshots (Azure#11108)

* Added 2020-06-12 blob swagger (Azure#11445)

* Added DataLake 2020-06-12 file (Azure#11446)

* fix description of enqueue message's visibilityTimeout (Azure#11459)

* don't rename (Azure#11461)

* Feature/storage/blob tags75 (Azure#11305)

* Permanent Delete (Azure#11359)

* Feature/storage/put blob from url (Azure#11197)

* Feature/storage/share enable protocol share squash root (Azure#11304)

* added source content MD5 (Azure#11715)

* Applied 2020-04-08 blob changes to 2020-06-12 (Azure#11786)

* minor fix (Azure#11804)

* Add "x-ms-is-hns-enabled" to ServiceGetAccountInfoResponse (Azure#11871)

* Renamed IsHnsEnabled (Azure#11904)

* added enum for api version (Azure#12164)

* added enum for api version

* added version for all api versions

* Added version id for DownloadBlob 206 response (Azure#12193)

* added version id for download blob 206 response

* removed from versions prior to 2019-12-12

* added current version

* Feature/storage/container rename (Azure#11791)

* Added container scoped batch (Azure#11927)

* Remove/move XML name mapping when ref is provided (Azure#12341)

* testing

* removed more fileshare ignored xml names

* fixed silly indents

* fixed silly indents

* Update DataLakeStorage.json (Azure#13145)

* GetBlockList returns long block sizes (Azure#13188)

* Added 2020-08-04 swagger file for Blob (Azure#13526)

* Fixed date (Azure#13529)

* Feature/storage/hns soft delete (Azure#11741)

* Added Quick Query Parquet (Azure#13589)

* added resource type header to list deleted paths (Azure#13719)

* added resource type header

* added resource type header

* [Storage] Version Level Worm (Azure#13527)

* Switched back to using BlobImmutabilityPolicy enum (Azure#13753)

Co-authored-by: Sean McCullough <=>

* Added BlobErrorCode.BlobUsesCustomerSpecifiedEncryption (Azure#13930)

* Fix typo (Azure#14081)

* Fix typo

* Update blob.json

* Update queue.json

* wip

* Added 2020-10-02 blob swagger (Azure#14193)

* Added 2020-10-02 file swagger (Azure#14207)

* Updated swagger to reflect VLW changes (Azure#14357)

* Added Files 2020-06-12 service version (Azure#14383)

* [Storage] Oauth support for copy source (Azure#14404)

* List Delete Root Blob With Versions (Azure#14195)

* Added support for List File V2 (Azure#14385)

* Align with service and documentation where Blob Quick Query XML elements are optional instead of required (Azure#14688)

* Changed order of BlobImmutabilityPolicyMode (Azure#14764)

* Cleaned up Storage Swagger to get validation tools and CI green (Azure#15015)

* removed tags as a requirement (Azure#15106)

* Added 2020-12-06 service version for Data Lake (Azure#15234)

* Revert "Added 2020-12-06 service version for Data Lake (Azure#15234)" (Azure#15235)

* Added new Data Lake swagger version (Azure#15508)

Co-authored-by: Sean McCullough <=>

* Added Blob 2020-12-06 service version (Azure#15519)

* Added encryption scope to blob sync copy (Azure#15521)

* FileSystem.GetPaths() (Azure#15534)

* storage swaggers

* sort

* Added Datalake Spec

* revert custom words

* readme path

* moved datalake swagger and supressed warning

* moved datalake swagger and supressed warning

* fixing existing error

* reverted

Co-authored-by: tg-msft <[email protected]>
Co-authored-by: Sean McCullough <[email protected]>
Co-authored-by: Jianghao Lu <[email protected]>
Co-authored-by: Amanda Nguyen <[email protected]>
Co-authored-by: Xiaoxi Fu <[email protected]>
Co-authored-by: Jeremy Meng <[email protected]>
Co-authored-by: Gauri Prasad <[email protected]>
Co-authored-by: Rick Ley <[email protected]>
Co-authored-by: Ze Qian Zhang <[email protected]>
Co-authored-by: Lin Jian <[email protected]>
Co-authored-by: Kamil Sobol <[email protected]>
Co-authored-by: Lin Jian <[email protected]>
Co-authored-by: iscai-msft <[email protected]>
Co-authored-by: Gauri Prasad <[email protected]>
Co-authored-by: Lin Jian <[email protected]>
Co-authored-by: bharathsreenivas <[email protected]>
Co-authored-by: James <[email protected]>