Kan Tang
d12db7f413
Added ChangeLog/Readme for file service. ( #573 )
2020-09-04 04:31:07 +08:00
Kan Tang
d9b58fd935
Resolved breaking change introduced by URL. ( #584 )
2020-09-04 04:18:48 +08:00
Victor Vazquez
38d90d62f3
URL encode and URL Unification ( #561 )
...
* Update URL from CORE with uri builder from storage and make Request to take URL to be created
2020-09-02 23:57:03 -07:00
Daniel Jurek
919610f429
Use version.hpp for package versions ( #572 )
...
* Add version.txt
* Add doc generation for template
* Add version.hpp parsing and update capabilities to cmake and engsys
* Get-SdkVersion -> Get-PkgVersion
* Move Update-PkgVersion.ps1 under eng/scripts
* Get-PackageVersion -> Get-PkgVersion
* Update paths, params, verbosity
* Couple fixes to output and make use of new SemVer version
* Add fallback support for verison.txt in cases where we still use it to unblock release artifact generation
* Use version information in release pipeline
* Add workaround to generate storage pipeline artifacts
* eng/scripts/
* Write warning
* Haven't released storage-file-shares yet according to releases on GitHub
* Set release date on changelog.md
* Update CHANGELOG.md to indicate this is a test release
* Remove fallback exception for storage
* Re-add Rick's suggestions
* Revert "Remove fallback exception for storage"
2020-09-02 18:53:46 -07:00
Daniel Jurek
67b21fed12
Template ci.yml ( #569 )
...
* Add ci.yml to template project
* triggers on sdk/template
2020-09-01 21:44:02 -07:00
Victor Vazquez
b46a544a7b
fix for unit tests for cleanner ( #558 )
...
* fix for unit tests for cleanner
2020-08-28 16:17:16 -07:00
Kan Tang
97bfdf91d2
Rewritten the user agent. ( #555 )
2020-08-28 21:23:31 +08:00
Kan Tang
f9fee4f56a
Added file/datalake changelog ( #554 )
2020-08-28 18:26:29 +08:00
JinmingHu
9a1f84fbfb
Update changelog ( #551 )
2020-08-28 17:09:05 +08:00
Victor Vazquez
6e33262be5
Fix for connection re-use on response error ( #548 )
...
* Fix for connection re-use on response error
2020-08-27 22:45:33 -07:00
Victor Vazquez
e782efbb47
perf stress basic struct folder and no op herarchy structure ( #390 )
...
* perf stress basic struct folder and no op herarchy structure
2020-08-27 15:27:31 -07:00
JinmingHu
66c331e52b
Resolve review comments ( #545 )
...
* Rename UndeleteContainer->Undelete
* Remove concurrent upload page blob
* move offset to the first parameter
* Rename: TransactionalMd5 TransactionalCrc64
* add batch protocol layer
fix x-ms-server-encrypted
transactional-md5
* transcational md5
* Remove Transactional headers from ClearPagesResult
* parse x-ms-blob-content-md5
* Remove redundant space
2020-08-27 22:44:29 +08:00
Kan Tang
62dd39c1be
Resolved review comments. ( #544 )
...
* Fixed review comments.
* Resolved some review comments
2020-08-27 16:54:35 +08:00
JinmingHu
3a4e1f3b49
Restructure storage directory ( #536 )
...
* Restructure azure storage directory
* Add tests and sample
* reformat with clang-format
* Reorder files in CMake
* load versions from version.txt
* fix crash
* Update README.md
* Use relative links
* fix CI
* Fix CI
* Try to fix CI
* Move option to the top of the file
2020-08-27 16:16:08 +08:00
Kan Tang
53bd00034b
Added samples and more test cases to file service and resolved some issues. ( #539 )
2020-08-26 19:56:15 -07:00
Victor Vazquez
1f0da6fcc4
Clean routine ( #530 )
...
* adding cleaner routine
2020-08-26 16:51:24 -07:00
Kan Tang
2c84e3f094
Resolve some casing issue ( #534 )
2020-08-26 12:09:06 +08:00
Rick Winter
c5438d623b
Restructure the azure inc folder ( #514 )
...
* Restructure the azure inc folder
2020-08-25 20:08:34 -07:00
Kan Tang
ae6ada5cfb
Added lease support for DataLake's Path ( #521 )
2020-08-26 07:43:29 +08:00
Kan Tang
b87bd0816c
Added GetSubDirectory. ( #524 )
2020-08-26 07:43:08 +08:00
Kan Tang
9c9e631c0d
Fixed datalake/file service protocol layer remaining issues. ( #523 )
...
* Fixed datalake build warnings on linux
* Pass context by reference instead.
* Added metadata key case check
* Fixed acronym casing.
* Fixes more acronym casing.
2020-08-26 07:42:46 +08:00
Victor Vazquez
760c645af0
remove double checking mutex ( #528 )
2020-08-25 15:52:02 -07:00
Victor Vazquez
80f2c2f407
Reuse connection when calling ReadToCount() ( #518 )
...
* change EOF for IsEOF function to avoid setting EOF after checking read everytime
* fix setting size to read
* move IsEOF to be private
* Update comment about not moving a connection back to the pool
2020-08-25 10:06:47 -07:00
JinmingHu
cf08d39d14
Remove context from StorageError::CreateFromResponse ( #511 )
...
* Remove context from StorageError::CreateFromResponse
* Resolved issues in datalake/file protocol layer
Co-authored-by: Tank Tang <kat@microsoft.com>
2020-08-25 14:38:18 +08:00
Kan Tang
38241bb152
Added support for directory/file client for file service. ( #510 )
...
* Added support for directory/file client for file service.
* Resolve multiple comments
* Resolved some further comments
* Removed ShareSnapshot
* Fixed protocol layer and integrated refined concurrent download test from blob service.
* Fixed CI issue on Linux/Mac
* Adapted to change of Storage per-retry policy.
* Removed inconsistency comparing towards other SDKs.
2020-08-25 12:17:21 +08:00
JinmingHu
f0ece5fd7a
[Storage Blobs] Optimize blob ut ( #513 )
2020-08-25 10:14:20 +08:00
JinmingHu
b2dfbabd04
StoragePerRetryPolicy ( #512 )
2020-08-25 09:52:11 +08:00
Victor Vazquez
70eeec5984
Connection pool for keep alive ( #500 )
...
* keep-alive. reuse same connection based on host
2020-08-21 15:41:45 -07:00
JinmingHu
755085f25d
GetBlobServiceStatistics ( #496 )
2020-08-21 09:29:26 +08:00
Victor Vazquez
67abbb3728
fix clang warnings on e2e tests ( #495 )
2020-08-20 00:07:44 -07:00
JinmingHu
b9299478ee
[Storage Blob Service] Concurrent upload for Page Blob ( #486 )
2020-08-20 10:54:28 +08:00
JinmingHu
070772e7c5
Remove Content-MD5 and ContentCRC64 from Create{PageBlob|AppendBlob}Result ( #487 )
2020-08-20 10:52:21 +08:00
Mitch Denny
420a72a9d5
Adjust CI YAML headers ( #448 )
2020-08-19 13:49:45 +10:00
JinmingHu
4c5286803b
[Storage Blob Service] ORS ( #467 )
2020-08-19 09:13:13 +08:00
Victor Vazquez
5cb3a644a4
Thow runtime error if reading fails at FileStream ( #481 )
...
* Handle non eof errors on Windows
* trhow on pread error for linux
* adding errno.h to fix macOS
2020-08-18 15:16:47 -07:00
Kan Tang
e0bb037cdd
Fixed test failure due to network latency too low. ( #466 )
2020-08-18 11:13:39 +08:00
JinmingHu
42ffbc853e
[Storage Blobs Service] Seal Append Blob ( #465 )
...
* seal append blob
* copy seal append blob
2020-08-18 09:55:12 +08:00
Kan Tang
3042f69d5b
Rename return types for Datalake and file services. ( #464 )
2020-08-18 09:28:31 +08:00
JinmingHu
1dce74c642
[Storage Blobs Service] Undelete Container ( #462 )
...
* Undelete Container
2020-08-18 09:11:59 +08:00
JinmingHu
24959f30da
[Storage Blobs Service] Rename Results and Options ( #460 )
...
* rename UploadFrom
* Rename CommitBlockListResult/Options GetBlockListResult/Options
* Rename DownloadBlobTo{Options/Result} UploadBlockBlobFrom{Options/Result}
2020-08-17 10:06:58 +08:00
JinmingHu
86a22901e9
[Storage Blobs Service] Transactional MD5 and CRC64 ( #456 )
...
* MD5
* Crc64
* crc64 concatenate
2020-08-16 00:30:49 +08:00
Rick Winter
0b2b688e72
Context improvements ( #457 )
...
* Expose the ContextValueType so callers can use it to get at key values.
* Add a const char * overload for construction
* Remove explicit conversion which adds an extra move construction.
const char* implicitly converts to std::string
2020-08-14 13:02:16 -07:00
Victor Vazquez
e031696bce
handle size 0 chunked response ( #451 )
2020-08-14 09:57:42 -07:00
Victor Vazquez
311902fe25
Fix waitforsocket usage when receiving from socket ( #453 )
2020-08-14 09:03:54 -07:00
JinmingHu
069e359562
Rename return types and option types ( #449 )
...
* rename return types and option types
* define ConcurrentUploadBlockBlobFromBufferOptions and ConcurrentUploadBlockBlobFromFileOptions
* use std::move
* Rename DownloadTo
* update doc
* Resolved datalake build issues.
* Resolved some cmake issue when linking
Co-authored-by: Tank Tang <kat@microsoft.com>
2020-08-14 13:02:10 +08:00
Kan Tang
d77ecf7917
Added support for share service ( #450 )
2020-08-14 13:01:51 +08:00
Anton Kolesnyk
cc78776bcb
EnvironmentCredential with ClientSecretCredential support ( #442 )
2020-08-13 14:28:08 -07:00
Rick Winter
e3394ec3f5
Null out the union for the Undefined type ( #444 )
2020-08-13 13:11:17 -07:00
JinmingHu
698c4f5848
Replace old RFC1123 impl which cannot be built until GCC 5 ( #440 )
2020-08-13 08:17:27 +08:00
JinmingHu
a848c65933
x-ms-client-request-id header ( #439 )
2020-08-13 08:16:52 +08:00
JinmingHu
4c549b1a29
Fix build error ( #438 )
2020-08-13 08:16:21 +08:00
Rick Winter
1a32179fec
Create template project ( #443 )
...
* Create template project
Support retrieving version from code
2020-08-12 15:08:46 -07:00
JinmingHu
2027d5102f
add test cases for base64 encode/decode, hash wrapper ( #431 )
2020-08-12 10:13:16 +08:00
JinmingHu
65bd5c6bf4
use #include "" instead of #include <> ( #418 )
2020-08-12 10:12:48 +08:00
Anton Kolesnyk
83174eeec3
Context tweaks ( #378 )
2020-08-11 17:11:27 -07:00
JinmingHu
ee0b8d07b8
pass Context by const ref ( #432 )
2020-08-12 07:02:28 +08:00
Rick Winter
8821aadb80
Rename UUID -> Uuid ( #436 )
...
* Rename UUID -> Uuid
Update header references
2020-08-11 13:23:14 -07:00
Anton Kolesnyk
302bbf251e
Add authority URL support for ClientSecretCredential ( #424 )
2020-08-11 11:22:09 -07:00
JinmingHu
68643e3ee2
[Storage Blobs Service] Add test cases for LastModifiedTime and ETag and lease id ( #425 )
...
* add test cases for LastModifiedTime and ETag and lease id
2020-08-11 10:40:59 +08:00
JinmingHu
8372d39cc1
[Storage Blobs Service] Customer-Provided Key (CPK-V) and Encryption Scope (CPK-N) ( #427 )
...
* cpk-v and cpk-n
2020-08-11 09:45:35 +08:00
JinmingHu
a47789c311
Fix bug: CopyBlob always sends empty access-tier header ( #426 )
2020-08-11 07:25:09 +08:00
JinmingHu
329a30f0e3
[Storage Blob Service] integrate reliable stream ( #421 )
...
* integrate reliable stream
* define c_reliableStreamRetryCount
2020-08-10 16:07:38 +08:00
JinmingHu
cc0ff27eec
[Storage Blobs Service] Only make one HTTP request if the blob size is small for Concurrent Upload API ( #419 )
...
* Only make one HTTP request if the blob size is small for Concurrent Upload API
2020-08-08 08:44:03 +08:00
KarishmaGhiya
3060f7341c
clean up links and add link verification ( #410 )
2020-08-07 11:55:11 -07:00
JinmingHu
c700b7811c
[Storage Blobs Service] Blob Versioning ( #409 )
...
* blob versioning
2020-08-07 12:14:26 +08:00
Rick Winter
75590c6d96
Add requestId policy implementation ( #239 )
...
* Add requestId policy implementation
Includes uuid class
2020-08-06 15:38:53 -07:00
Victor Vazquez
a5c3f10b7d
204 http client support ( #408 )
...
* 204 http client support
* adding test for 204 response
2020-08-06 09:00:09 -07:00
JinmingHu
355184ef4f
[Storage Blob Service] Container Lease and Blob Lease ( #402 )
...
* container lease
* blob lease
2020-08-06 13:50:15 +08:00
Kan Tang
46c0af9a70
Added service prefix to file names. ( #399 )
2020-08-06 13:09:02 +08:00
JinmingHu
1081ed6979
Fix compiler warning ( #404 )
2020-08-06 07:47:36 +08:00
JinmingHu
5e596b723e
Fix compiler warning ( #403 )
2020-08-06 07:47:20 +08:00
JinmingHu
52dbc6b2f2
Pascal case for acronyms ( #391 )
2020-08-05 10:32:03 +08:00
Kan Tang
626a8856f0
Added support for get/set file service properties. ( #384 )
2020-08-05 10:31:48 +08:00
Victor Vazquez
eeffd6248f
update context to const ref ( #389 )
2020-08-04 09:45:13 -07:00
Kan Tang
3de57667d4
Added support for create/delete file shares. ( #382 )
...
* Added support for create/delete file shares.
* Removed nullable for metadata.
2020-08-04 09:54:04 +08:00
JinmingHu
8867c7abcb
[Storage Blob Service] Get/SetBlobContainerAccessPolicy ( #381 )
...
* Get/SetBlobContainerAccessPolicy
* Remove ResetPermissions()
2020-08-04 09:53:34 +08:00
JinmingHu
18b02094ed
Parse error message only from bodyBuffer ( #380 )
2020-08-04 09:53:22 +08:00
Victor Vazquez
5426cf7a07
Retriable stream ( #369 )
...
* Adding retriable_stream
2020-08-03 10:09:12 -07:00
JinmingHu
22f4ba12fc
GetAccountInfo ( #371 )
2020-08-03 10:32:43 +08:00
Kan Tang
1b4ea7ac70
Added file protocol layer. ( #367 )
...
* Added file protocol layer.
* Resolved some comments.
2020-08-01 20:23:50 -07:00
Victor Vazquez
fb729fcf10
Http/download on error ( #376 )
...
* Download body on error response codes from request
* Adding test case for downloading body
2020-07-31 22:11:31 -07:00
Anton Kolesnyk
4bf1f62ba8
Core logging infrastructure + logging policy + retry logging ( #330 )
2020-07-31 16:43:47 -07:00
JinmingHu
b9212922e7
GetBlobServiceProperties and SetBlobServiceProperties ( #366 )
2020-07-30 16:39:06 +08:00
JinmingHu
cbec5c6af6
Add unit test cases that require SAS token ( #359 )
2020-07-29 17:42:14 +08:00
JinmingHu
b0b5a18d18
User Delegation SAS ( #358 )
2020-07-29 16:11:21 +08:00
Victor Vazquez
6e3c3d9acf
avoid making a copy from vectorBody ( #364 )
2020-07-29 00:50:55 -07:00
Victor Vazquez
9563d9dd3c
Http/making upload chunk size overridle with Request option ( #342 )
...
* adding http request option to customize the upload chunk size for bodyStream
2020-07-29 00:16:36 -07:00
JinmingHu
b0facd3dd5
adapt to breaking change in Azure Core ( #356 )
...
* adapt to breaking change in Azure Core
* Adapt breaking change for Datalake service.
* Adapt to the breaking change
* Adapt breaking change for Datalake service.
* fix ut
* Fixed UT.
Co-authored-by: Tank Tang <kat@microsoft.com>
2020-07-29 14:55:53 +08:00
Victor Vazquez
d9e39a0e6e
Http/moving DownloadViaStream option to request ( #362 )
...
* move DownloadViaStream option to Request
* Fix credentials request
* Fix unit tests
* use constructor instead of set method
* fix tests
2020-07-28 14:10:26 -07:00
JinmingHu
9d1566c5ea
Add Account SAS and Blob SAS ( #353 )
...
* Add Account SAS and Blob SAS
* add doc for sas
* remove Nones
* remove Nones
2020-07-28 13:43:04 +08:00
JinmingHu
b380dfb76a
Fix inconsistent RFC1123 date format in different system locales ( #352 )
2020-07-27 18:49:42 -07:00
Victor Vazquez
ef0c530ee0
Pipeline/download content on pipeline to let Retry policy to handle read/get issues ( #323 )
...
make upload chunk size custumizable
2020-07-27 11:40:40 -07:00
Kan Tang
573ffdf1f7
Added Readme/Changelog and 3rd party notice. ( #340 )
2020-07-24 11:14:10 +08:00
JinmingHu
ef03d3b3ec
Rename XxxRespone->XxxInfo ( #337 )
...
* Rename XxxRespone->XxxInfo
* fix doc, remove unused include headers, remove fab4
* Rename SetAccessTierInfo->SetBlobAccessTierInfo
2020-07-24 09:40:15 +08:00
Kan Tang
8568327a56
Refined DataLake sample ( #336 )
...
* Refined DataLake sample
* Added DirectoryClient::GetFileClient, resolved some comment and test failures.
* Resolved an issue introduced by lowercasing response headers resulting in error code/message not being passed, and refined sample.
* Refined the structure according to comments.
* Changed buffer initialziation to stack allocated.
* Resolved some further comments.
2020-07-23 15:40:16 +08:00
JinmingHu
29f5e30ad3
integrate TelemetryPolicy into Blob Service ( #328 )
...
* integrate TelemetryPolicy into Blob Service
* Also add telemetry support to ADLS Gen 2.
Co-authored-by: Tank Tang <kat@microsoft.com>
2020-07-23 15:39:51 +08:00
Kan Tang
b0b348e9cb
Resolved API review comments and added FileClient and DirectoryClient… ( #308 )
...
* Added API to extract raw response.
* Resolved API review comments and added FileClient and DirectoryClient for DataLake.
* Added some blob/adls Gen2 interop functionality.
* Resolved some issues/comments
* Adds more interop, support retry and concurrent upload/download.
* Added support for Azure Core's token credential to support bearer token credential.
* Added integration on RawResponse/Response<T> and resolved some test issues.
* Added validation for Client secret authentication.
* Resolved some review comments and resolved CI issue.
* Resolved a UT failure in Azure Core.
* Resolved some further comments.
2020-07-22 16:03:44 +08:00
JinmingHu
cd023c49f0
Remove MD5 and CRC64 function interface ( #324 ) ( #329 )
2020-07-22 11:27:27 +08:00
JinmingHu
4d19f3b078
Integrate Response<T> into Storage Blobs Service ( #327 )
...
* Revert changes to storage code
* adapt to breaking changes in Azure::Core, Response->RawResponse, pipeline clone returns unique_ptr
* just to make build pass, remove this commit after https://github.com/Azure/azure-sdk-for-cpp/pull/326 is merged
* adapt to Response<T>
* concurrent upload/download also return Response<T>
* add BlobInfo and BlobContainerInfo
2020-07-21 10:31:00 +08:00
Daniel Jurek
1a9918c4db
add CMakeLists.txt and eng to CI and PR triggers ( #314 )
2020-07-20 10:09:50 -07:00
