Commit Graph

174 Commits

Author SHA1 Message Date
JinmingHu
c949400dba
fix bug in file sas (#597) 2020-09-04 17:30:07 +08:00
JinmingHu
bcdeeb1434
[Storage Blobs Service] Blob Tags (#416)
* blob tags

* add TagConditions for CreateSnapshot and GetBlockList

* update tags ut

* remove unsupported conditional headers from PutBlockFromUriOptions

* sas permission ut for tags

* add comment
2020-09-04 14:47:34 +08:00
JinmingHu
911a879a00
[Storage Blobs Service] Blob Batch (#582)
* blob batch

* fix build error

* Update sdk/storage/azure-storage-blobs/test/blob_batch_client_test.cpp
2020-09-04 14:47:11 +08:00
JinmingHu
07208d1720
[Storage Files Service] File sas (#568)
* File sas

* rebase on lastest master
2020-09-04 14:46:24 +08:00
Victor Vazquez
caf705c863
reuse code from tolower char (#583)
* reuse code from tolower char

* c_LocaleInvariant table to do tolower instead of toUpper
2020-09-03 22:46:28 -07:00
Kan Tang
d12db7f413
Added ChangeLog/Readme for file service. (#573) 2020-09-04 04:31:07 +08:00
Kan Tang
d9b58fd935
Resolved breaking change introduced by URL. (#584) 2020-09-04 04:18:48 +08:00
Victor Vazquez
38d90d62f3
URL encode and URL Unification (#561)
* Update URL from CORE with uri builder from storage and make Request to take URL to be created
2020-09-02 23:57:03 -07:00
Daniel Jurek
919610f429
Use version.hpp for package versions (#572)
* Add version.txt
* Add doc generation for template
* Add version.hpp parsing and update capabilities to cmake and engsys
* Get-SdkVersion -> Get-PkgVersion
* Move Update-PkgVersion.ps1 under eng/scripts
* Get-PackageVersion -> Get-PkgVersion
* Update paths, params, verbosity
* Couple fixes to output and make use of new SemVer version
* Add fallback support for verison.txt in cases where we still use it to unblock release artifact generation
* Use version information in release pipeline
* Add workaround to generate storage pipeline artifacts
* eng/scripts/
* Write warning
* Haven't released storage-file-shares yet according to releases on GitHub
* Set release date on changelog.md
* Update CHANGELOG.md to indicate this is a test release
* Remove fallback exception for storage
* Re-add Rick's suggestions
* Revert "Remove fallback exception for storage"
2020-09-02 18:53:46 -07:00
Daniel Jurek
67b21fed12
Template ci.yml (#569)
* Add ci.yml to template project
* triggers on sdk/template
2020-09-01 21:44:02 -07:00
Victor Vazquez
b46a544a7b
fix for unit tests for cleanner (#558)
* fix for unit tests for cleanner
2020-08-28 16:17:16 -07:00
Kan Tang
97bfdf91d2
Rewritten the user agent. (#555) 2020-08-28 21:23:31 +08:00
Kan Tang
f9fee4f56a
Added file/datalake changelog (#554) 2020-08-28 18:26:29 +08:00
JinmingHu
9a1f84fbfb
Update changelog (#551) 2020-08-28 17:09:05 +08:00
Victor Vazquez
6e33262be5
Fix for connection re-use on response error (#548)
* Fix for connection re-use on response error
2020-08-27 22:45:33 -07:00
Victor Vazquez
e782efbb47
perf stress basic struct folder and no op herarchy structure (#390)
* perf stress basic struct folder and no op herarchy structure
2020-08-27 15:27:31 -07:00
JinmingHu
66c331e52b
Resolve review comments (#545)
* Rename UndeleteContainer->Undelete

* Remove concurrent upload page blob

* move offset to the first parameter

* Rename: TransactionalMd5 TransactionalCrc64

* add batch protocol layer
fix x-ms-server-encrypted
transactional-md5

* transcational md5

* Remove Transactional headers from ClearPagesResult

* parse x-ms-blob-content-md5

* Remove redundant space
2020-08-27 22:44:29 +08:00
Kan Tang
62dd39c1be
Resolved review comments. (#544)
* Fixed review comments.

* Resolved some review comments
2020-08-27 16:54:35 +08:00
JinmingHu
3a4e1f3b49
Restructure storage directory (#536)
* Restructure azure storage directory

* Add tests and sample

* reformat with clang-format

* Reorder files in CMake

* load versions from version.txt

* fix crash

* Update README.md

* Use relative links

* fix CI

* Fix CI

* Try to fix CI

* Move option to the top of the file
2020-08-27 16:16:08 +08:00
Kan Tang
53bd00034b
Added samples and more test cases to file service and resolved some issues. (#539) 2020-08-26 19:56:15 -07:00
Victor Vazquez
1f0da6fcc4
Clean routine (#530)
* adding cleaner routine
2020-08-26 16:51:24 -07:00
Kan Tang
2c84e3f094
Resolve some casing issue (#534) 2020-08-26 12:09:06 +08:00
Rick Winter
c5438d623b
Restructure the azure inc folder (#514)
* Restructure the azure inc folder
2020-08-25 20:08:34 -07:00
Kan Tang
ae6ada5cfb
Added lease support for DataLake's Path (#521) 2020-08-26 07:43:29 +08:00
Kan Tang
b87bd0816c
Added GetSubDirectory. (#524) 2020-08-26 07:43:08 +08:00
Kan Tang
9c9e631c0d
Fixed datalake/file service protocol layer remaining issues. (#523)
* Fixed datalake build warnings on linux

* Pass context by reference instead.

* Added metadata key case check

* Fixed acronym casing.

* Fixes more acronym casing.
2020-08-26 07:42:46 +08:00
Victor Vazquez
760c645af0
remove double checking mutex (#528) 2020-08-25 15:52:02 -07:00
Victor Vazquez
80f2c2f407
Reuse connection when calling ReadToCount() (#518)
* change EOF for IsEOF function to avoid setting EOF after checking read everytime

* fix setting size to read

* move IsEOF to be private

* Update comment about not moving a connection back to the pool
2020-08-25 10:06:47 -07:00
JinmingHu
cf08d39d14
Remove context from StorageError::CreateFromResponse (#511)
* Remove context from StorageError::CreateFromResponse

* Resolved issues in datalake/file protocol layer

Co-authored-by: Tank Tang <kat@microsoft.com>
2020-08-25 14:38:18 +08:00
Kan Tang
38241bb152
Added support for directory/file client for file service. (#510)
* Added support for directory/file client for file service.

* Resolve multiple comments

* Resolved some further comments

* Removed ShareSnapshot

* Fixed protocol layer and integrated refined concurrent download test from blob service.

* Fixed CI issue on Linux/Mac

* Adapted to change of Storage per-retry policy.

* Removed inconsistency comparing towards other SDKs.
2020-08-25 12:17:21 +08:00
JinmingHu
f0ece5fd7a
[Storage Blobs] Optimize blob ut (#513) 2020-08-25 10:14:20 +08:00
JinmingHu
b2dfbabd04
StoragePerRetryPolicy (#512) 2020-08-25 09:52:11 +08:00
Victor Vazquez
70eeec5984
Connection pool for keep alive (#500)
* keep-alive. reuse same connection based on host
2020-08-21 15:41:45 -07:00
JinmingHu
755085f25d
GetBlobServiceStatistics (#496) 2020-08-21 09:29:26 +08:00
Victor Vazquez
67abbb3728
fix clang warnings on e2e tests (#495) 2020-08-20 00:07:44 -07:00
JinmingHu
b9299478ee
[Storage Blob Service] Concurrent upload for Page Blob (#486) 2020-08-20 10:54:28 +08:00
JinmingHu
070772e7c5
Remove Content-MD5 and ContentCRC64 from Create{PageBlob|AppendBlob}Result (#487) 2020-08-20 10:52:21 +08:00
Mitch Denny
420a72a9d5
Adjust CI YAML headers (#448) 2020-08-19 13:49:45 +10:00
JinmingHu
4c5286803b
[Storage Blob Service] ORS (#467) 2020-08-19 09:13:13 +08:00
Victor Vazquez
5cb3a644a4
Thow runtime error if reading fails at FileStream (#481)
* Handle non eof errors on Windows

* trhow on pread error for linux

* adding errno.h to fix macOS
2020-08-18 15:16:47 -07:00
Kan Tang
e0bb037cdd
Fixed test failure due to network latency too low. (#466) 2020-08-18 11:13:39 +08:00
JinmingHu
42ffbc853e
[Storage Blobs Service] Seal Append Blob (#465)
* seal append blob

* copy seal append blob
2020-08-18 09:55:12 +08:00
Kan Tang
3042f69d5b
Rename return types for Datalake and file services. (#464) 2020-08-18 09:28:31 +08:00
JinmingHu
1dce74c642
[Storage Blobs Service] Undelete Container (#462)
* Undelete Container
2020-08-18 09:11:59 +08:00
JinmingHu
24959f30da
[Storage Blobs Service] Rename Results and Options (#460)
* rename UploadFrom

* Rename CommitBlockListResult/Options GetBlockListResult/Options

* Rename DownloadBlobTo{Options/Result} UploadBlockBlobFrom{Options/Result}
2020-08-17 10:06:58 +08:00
JinmingHu
86a22901e9
[Storage Blobs Service] Transactional MD5 and CRC64 (#456)
* MD5

* Crc64

* crc64 concatenate
2020-08-16 00:30:49 +08:00
Rick Winter
0b2b688e72
Context improvements (#457)
* Expose the ContextValueType so callers can use it to get at key values.

* Add a const char * overload for construction

* Remove explicit conversion which adds an extra move construction.
const char* implicitly converts to std::string
2020-08-14 13:02:16 -07:00
Victor Vazquez
e031696bce
handle size 0 chunked response (#451) 2020-08-14 09:57:42 -07:00
Victor Vazquez
311902fe25
Fix waitforsocket usage when receiving from socket (#453) 2020-08-14 09:03:54 -07:00
JinmingHu
069e359562
Rename return types and option types (#449)
* rename return types and option types

* define ConcurrentUploadBlockBlobFromBufferOptions and ConcurrentUploadBlockBlobFromFileOptions

* use std::move

* Rename DownloadTo

* update doc

* Resolved datalake build issues.

* Resolved some cmake issue when linking

Co-authored-by: Tank Tang <kat@microsoft.com>
2020-08-14 13:02:10 +08:00