Commit Graph

3846 Commits

Author SHA1 Message Date
Victor Vazquez
fb729fcf10
Http/download on error (#376)
* Download body on error response codes from request

* Adding test case for downloading body
2020-07-31 22:11:31 -07:00
Anton Kolesnyk
4bf1f62ba8
Core logging infrastructure + logging policy + retry logging (#330) 2020-07-31 16:43:47 -07:00
Azure SDK Bot
fe7af14c84
Sync eng/common directory with azure-sdk-tools repository (#363) 2020-07-31 15:53:45 -07:00
Daniel Jurek
c7d994f08f
Use vcpkg caching (#361)
* Use vcpkg caching

* fetch tags

* Supply OSVmImage to doc generation so vcpkg.yml can include/exclude the correct set of steps
2020-07-31 15:10:09 -07:00
JinmingHu
b9212922e7
GetBlobServiceProperties and SetBlobServiceProperties (#366) 2020-07-30 16:39:06 +08:00
JinmingHu
cbec5c6af6
Add unit test cases that require SAS token (#359) 2020-07-29 17:42:14 +08:00
JinmingHu
b0b5a18d18
User Delegation SAS (#358) 2020-07-29 16:11:21 +08:00
Victor Vazquez
6e3c3d9acf
avoid making a copy from vectorBody (#364) 2020-07-29 00:50:55 -07:00
Victor Vazquez
9563d9dd3c
Http/making upload chunk size overridle with Request option (#342)
* adding http request option to customize the upload chunk size for bodyStream
2020-07-29 00:16:36 -07:00
JinmingHu
b0facd3dd5
adapt to breaking change in Azure Core (#356)
* adapt to breaking change in Azure Core

* Adapt breaking change for Datalake service.

* Adapt to the breaking change

* Adapt breaking change for Datalake service.

* fix ut

* Fixed UT.

Co-authored-by: Tank Tang <kat@microsoft.com>
2020-07-29 14:55:53 +08:00
Chidozie Ononiwu
61f36fd64d
Add Langauge Settings (#351) 2020-07-28 20:18:32 -07:00
Victor Vazquez
d9e39a0e6e
Http/moving DownloadViaStream option to request (#362)
* move DownloadViaStream option to Request

* Fix credentials request

* Fix unit tests

* use constructor instead of set method

* fix tests
2020-07-28 14:10:26 -07:00
Azure SDK Bot
2d507e7e4a
Sync eng/common directory with azure-sdk-tools repository (#251)
Co-authored-by: Daniel Jurek <djurek@microsoft.com>
2020-07-28 11:56:52 -07:00
Daniel Jurek
d96413b950
Engineering changes required to publish tags and docs (#260)
* update version to dev.1 for test release

* Update release date in CHANGELOG.md

* Add checkout step

* Faster matrix

* Add Skip.Test to improve inner loop

* Show more info for tagging

* Revert "Faster matrix"

This reverts commit 713afd3d64743cbc1841e1ee965e936c049f7cf7.

* Add correct folder

* Add fixes for tagging repo

* Use Invoke-WebRequest for GetExistingTags

* Use -Uri

* return empty list

* Add vcpkg caching

* Set contents to copy

* Add doc uploads for C++

* Revert "Update release date in CHANGELOG.md"

This reverts commit 6fb302701381758cbb3d3828c2ce8d29d6b77950.

* Revert "update version to dev.1 for test release"

This reverts commit 4e188e4da99cb1246f195a5362e47d6ff80c3219.

* Revert "Add vcpkg caching"

This reverts commit 1f5f4d95e21d07d5ade1df470f39ceb478849f06.
2020-07-28 10:27:42 -07:00
JinmingHu
9d1566c5ea
Add Account SAS and Blob SAS (#353)
* Add Account SAS and Blob SAS

* add doc for sas

* remove Nones

* remove Nones
2020-07-28 13:43:04 +08:00
JinmingHu
b380dfb76a
Fix inconsistent RFC1123 date format in different system locales (#352) 2020-07-27 18:49:42 -07:00
Victor Vazquez
ef0c530ee0
Pipeline/download content on pipeline to let Retry policy to handle read/get issues (#323)
make upload chunk size custumizable
2020-07-27 11:40:40 -07:00
Kan Tang
573ffdf1f7
Added Readme/Changelog and 3rd party notice. (#340) 2020-07-24 11:14:10 +08:00
JinmingHu
ef03d3b3ec
Rename XxxRespone->XxxInfo (#337)
* Rename XxxRespone->XxxInfo

* fix doc, remove unused include headers, remove fab4

* Rename SetAccessTierInfo->SetBlobAccessTierInfo
2020-07-24 09:40:15 +08:00
Kan Tang
8568327a56
Refined DataLake sample (#336)
* Refined DataLake sample

* Added DirectoryClient::GetFileClient, resolved some comment and test failures.

* Resolved an issue introduced by lowercasing response headers resulting in error code/message not being passed, and refined sample.

* Refined the structure according to comments.

* Changed buffer initialziation to stack allocated.

* Resolved some further comments.
2020-07-23 15:40:16 +08:00
JinmingHu
29f5e30ad3
integrate TelemetryPolicy into Blob Service (#328)
* integrate TelemetryPolicy into Blob Service

* Also add telemetry support to ADLS Gen 2.

Co-authored-by: Tank Tang <kat@microsoft.com>
2020-07-23 15:39:51 +08:00
Kan Tang
b0b348e9cb
Resolved API review comments and added FileClient and DirectoryClient… (#308)
* Added API to extract raw response.

* Resolved API review comments and added FileClient and DirectoryClient for DataLake.

* Added some blob/adls Gen2 interop functionality.

* Resolved some issues/comments

* Adds more interop, support retry and concurrent upload/download.

* Added support for Azure Core's token credential to support bearer token credential.

* Added integration on RawResponse/Response<T> and resolved some test issues.

* Added validation for Client secret authentication.

* Resolved some review comments and resolved CI issue.

* Resolved a UT failure in Azure Core.

* Resolved some further comments.
2020-07-22 16:03:44 +08:00
JinmingHu
cd023c49f0
Remove MD5 and CRC64 function interface (#324) (#329) 2020-07-22 11:27:27 +08:00
JinmingHu
4d19f3b078
Integrate Response<T> into Storage Blobs Service (#327)
* Revert changes to storage code

* adapt to breaking changes in Azure::Core, Response->RawResponse, pipeline clone returns unique_ptr

* just to make build pass, remove this commit after https://github.com/Azure/azure-sdk-for-cpp/pull/326 is merged

* adapt to Response<T>

* concurrent upload/download also return Response<T>

* add BlobInfo and BlobContainerInfo
2020-07-21 10:31:00 +08:00
Daniel Jurek
1a9918c4db
add CMakeLists.txt and eng to CI and PR triggers (#314) 2020-07-20 10:09:50 -07:00
JinmingHu
2c21d4b018
Remove MD5 and CRC64 function interface (#324) 2020-07-20 10:35:09 +08:00
Anton Kolesnyk
b259db5a3b
Telemetry policy (#264) 2020-07-17 17:03:47 -07:00
Victor Vazquez
6122529bac
Core/response t (#316)
* rename http response to RawResponse

* Adding Response T
2020-07-17 14:43:17 -07:00
JinmingHu
0f37994e44
add perf benchmark code (#319)
* Add multithread perf testcase

* add large scale upload testcase

* Fix compiler error on GCC 9

* Fix failed testcase
2020-07-17 11:16:18 +08:00
Rick Winter
bbbaa06b5c
Exception objects should be thrown and not the pointer to the exception object. (#322)
Exception objects should be thrown and not the pointer to the exception object. 
   https://azure.github.io/azure-sdk/cpp_design.html#c-exceptions
The pattern for the catch expects a reference to the exception and not the pointer.

Example:
try{
   throw Myxception();
}
catch (MyException const& e) {  //process  }
2020-07-16 15:44:34 -07:00
Rick Winter
b69080bc48
Codeowners updates (#315) 2020-07-16 08:48:34 -07:00
JinmingHu
204c025d09
suggested changes in API review (#312)
* suggested changes in API review

* Rename UrlBuilder->UriBuilder

* add perf test case

* Integrate retrypolicy into blob clients

* remove `Content-Length` header for GET/HEAD/DELETE http requests

* Remove temp files in ut
2020-07-16 00:49:55 -07:00
Victor Vazquez
12b389a579
Http/throw on read error (#274)
* throw exception on Read from wire Error instead of returning -1

* throw exception if read from socket is not CURLE_OK

* missing header for Win

* fix header on windows

* Add more description to transport errors
2020-07-15 10:27:38 -07:00
JinmingHu
3db59439c9
[Storage Blobs Service] ListBlobsByHierarchy (#265)
* add API ListBlobsByHierarchy

* fix compiler error on GCC 8

* Update Blob API version to 2019-12-12

* use lowercase header key
2020-07-15 10:45:22 +08:00
Victor Vazquez
0eacb230cb
Http/fix reading more than content (#311)
* Fix reading more data than content length

* fix for head request
2020-07-14 16:38:20 -07:00
Victor Vazquez
c0faea5f90
Http transport adapter - read all chunks from server until chunkSize is zero (#273)
* fix for getting all chunks from a chunked response until chuksize is zero

* fix for pulling from wire when inner buffer is empty
2020-07-13 23:00:23 -07:00
Victor Vazquez
05c91d6002
Http/missing change for to lower (#279)
* throw exception on Read from wire Error instead of returning -1

* missing change for tolower
2020-07-13 22:02:32 -07:00
Victor Vazquez
57bdc0f6d6
Adding toLower for header names and unit testd (#270) 2020-07-13 17:21:08 -07:00
Victor Vazquez
59d7ebabe1
Http/fix gcc 8 build (#275)
* throw exception on Read from wire Error instead of returning -1
2020-07-13 17:20:44 -07:00
Kan Tang
a1ec5119a6
Datalake full feature support PR. (#257)
* Added test cases.

* Adapt stream breaking change and adding usage for Nullable.

* Resolve CI issue.

* Resolved comments from review.

* Integrate access condition support and resolve more comments.

* Resolved some further comments.

* Resolved some further comments and removed GetMetadata.
2020-07-13 05:31:02 -07:00
Victor Vazquez
c699888daa
Make sure Read will always start on body start. (#256)
* make stream use int64_t instead of uint64_t
2020-07-10 23:02:18 -07:00
Anton Kolesnyk
43dcc6c495
Retry policy (#241) 2020-07-10 00:23:40 -07:00
JinmingHu
83406f23dd
Storage Blob Service Access Conditions, Bitwise enum class (#252)
* access conditions

* bitwise enum class

* Update x-ms-date on each retry

* add a header for all constant strings

* fix some ut

* rename ModifiedTimeAccessConditons->LastModifiedTimeAccessConditions
2020-07-09 21:03:32 -07:00
Billy O'Neal
f6defdf25a
Add tests and locale invariant string equal function in support of the 'extensible enum' guideline. (#197)
* Add locale invariant string equal function in support of the 'extensible enum' guideline.

* Resolve gcc narrowing warning.

* Fix case flipping table to go the correct direction 😳

* organize tests and add one test for invariant locale compare as exaple

* Add more test cases.

* Move to Details namespace.
2020-07-08 22:34:29 -07:00
JinmingHu
90d4ee3203
Add constructor for HttpPipeline which accepts rvalue (#165) 2020-07-08 09:18:33 -07:00
JinmingHu
95aa6361ef
Concurrent upload block blob from file, concurrent download blob to file (#247)
* concurrent download to file

* concurrent upload block blob from file

* update sample

* Change default download chunk size from 8MB to 4MB

* fix CI
2020-07-08 13:26:22 +08:00
Azure SDK Bot
ed9fd2d179
Sync eng/common directory with azure-sdk-tools repository (#245) 2020-07-07 09:44:18 -07:00
JinmingHu
66c7518dce
Suggested changes in API review (#244)
* Rename Properties->HttpHeaders

* Rename BlobXxxItems->Items

* Remove MaxResults in response of list operations

* specify time format in comments for GetUSerDelegationKey API

* per operation pipelines and per retry pipelines

* Define some response types and rename ListBlobsFlat

* Add different return types for some APIs

* Rename BlobDownloadInfo->BlobDownloadResponse

* Assign default value to BlobContentLength to supporess compiler warnings

* add concurrent download to buffer

* concurrent upload block blob from buffer
2020-07-07 10:54:05 +08:00
Victor Vazquez
9fb4119ccb
Memory Stream - File Stream (win/lin) - HTTP Request / Response - Updates (#236)
* make stream use int64_t instead of uint64_t
2020-07-03 22:22:16 -07:00
Chidozie Ononiwu
c22e4f8386
Clean up azure-sdk-tools and reduce dependency on external resources (#228) 2020-07-02 14:20:12 -07:00