Commit Graph

116 Commits

Author SHA1 Message Date
Rick Winter
b69080bc48
Codeowners updates (#315) 2020-07-16 08:48:34 -07:00
JinmingHu
204c025d09
suggested changes in API review (#312)
* suggested changes in API review

* Rename UrlBuilder->UriBuilder

* add perf test case

* Integrate retrypolicy into blob clients

* remove `Content-Length` header for GET/HEAD/DELETE http requests

* Remove temp files in ut
2020-07-16 00:49:55 -07:00
Victor Vazquez
12b389a579
Http/throw on read error (#274)
* throw exception on Read from wire Error instead of returning -1

* throw exception if read from socket is not CURLE_OK

* missing header for Win

* fix header on windows

* Add more description to transport errors
2020-07-15 10:27:38 -07:00
JinmingHu
3db59439c9
[Storage Blobs Service] ListBlobsByHierarchy (#265)
* add API ListBlobsByHierarchy

* fix compiler error on GCC 8

* Update Blob API version to 2019-12-12

* use lowercase header key
2020-07-15 10:45:22 +08:00
Victor Vazquez
0eacb230cb
Http/fix reading more than content (#311)
* Fix reading more data than content length

* fix for head request
2020-07-14 16:38:20 -07:00
Victor Vazquez
c0faea5f90
Http transport adapter - read all chunks from server until chunkSize is zero (#273)
* fix for getting all chunks from a chunked response until chuksize is zero

* fix for pulling from wire when inner buffer is empty
2020-07-13 23:00:23 -07:00
Victor Vazquez
05c91d6002
Http/missing change for to lower (#279)
* throw exception on Read from wire Error instead of returning -1

* missing change for tolower
2020-07-13 22:02:32 -07:00
Victor Vazquez
57bdc0f6d6
Adding toLower for header names and unit testd (#270) 2020-07-13 17:21:08 -07:00
Victor Vazquez
59d7ebabe1
Http/fix gcc 8 build (#275)
* throw exception on Read from wire Error instead of returning -1
2020-07-13 17:20:44 -07:00
Kan Tang
a1ec5119a6
Datalake full feature support PR. (#257)
* Added test cases.

* Adapt stream breaking change and adding usage for Nullable.

* Resolve CI issue.

* Resolved comments from review.

* Integrate access condition support and resolve more comments.

* Resolved some further comments.

* Resolved some further comments and removed GetMetadata.
2020-07-13 05:31:02 -07:00
Victor Vazquez
c699888daa
Make sure Read will always start on body start. (#256)
* make stream use int64_t instead of uint64_t
2020-07-10 23:02:18 -07:00
Anton Kolesnyk
43dcc6c495
Retry policy (#241) 2020-07-10 00:23:40 -07:00
JinmingHu
83406f23dd
Storage Blob Service Access Conditions, Bitwise enum class (#252)
* access conditions

* bitwise enum class

* Update x-ms-date on each retry

* add a header for all constant strings

* fix some ut

* rename ModifiedTimeAccessConditons->LastModifiedTimeAccessConditions
2020-07-09 21:03:32 -07:00
Billy O'Neal
f6defdf25a
Add tests and locale invariant string equal function in support of the 'extensible enum' guideline. (#197)
* Add locale invariant string equal function in support of the 'extensible enum' guideline.

* Resolve gcc narrowing warning.

* Fix case flipping table to go the correct direction 😳

* organize tests and add one test for invariant locale compare as exaple

* Add more test cases.

* Move to Details namespace.
2020-07-08 22:34:29 -07:00
JinmingHu
90d4ee3203
Add constructor for HttpPipeline which accepts rvalue (#165) 2020-07-08 09:18:33 -07:00
JinmingHu
95aa6361ef
Concurrent upload block blob from file, concurrent download blob to file (#247)
* concurrent download to file

* concurrent upload block blob from file

* update sample

* Change default download chunk size from 8MB to 4MB

* fix CI
2020-07-08 13:26:22 +08:00
Azure SDK Bot
ed9fd2d179
Sync eng/common directory with azure-sdk-tools repository (#245) 2020-07-07 09:44:18 -07:00
JinmingHu
66c7518dce
Suggested changes in API review (#244)
* Rename Properties->HttpHeaders

* Rename BlobXxxItems->Items

* Remove MaxResults in response of list operations

* specify time format in comments for GetUSerDelegationKey API

* per operation pipelines and per retry pipelines

* Define some response types and rename ListBlobsFlat

* Add different return types for some APIs

* Rename BlobDownloadInfo->BlobDownloadResponse

* Assign default value to BlobContentLength to supporess compiler warnings

* add concurrent download to buffer

* concurrent upload block blob from buffer
2020-07-07 10:54:05 +08:00
Victor Vazquez
9fb4119ccb
Memory Stream - File Stream (win/lin) - HTTP Request / Response - Updates (#236)
* make stream use int64_t instead of uint64_t
2020-07-03 22:22:16 -07:00
Chidozie Ononiwu
c22e4f8386
Clean up azure-sdk-tools and reduce dependency on external resources (#228) 2020-07-02 14:20:12 -07:00
Azure SDK Bot
34468b6e46
Sync eng/common directory with azure-sdk-tools repository (#240) 2020-07-02 12:44:58 -07:00
Azure SDK Bot
1c9b932b57
Sync eng/common directory with azure-sdk-tools repository (#234) 2020-07-01 22:53:51 -07:00
JinmingHu
e61c3ff51a
Documentation for BlockBlobClient and Blob options (#235)
* Documentation for blob options

* Rename struct UploadBlobOptions -> UploadBlockBlobOptions

* documentation for BlockBlobClient
2020-07-02 10:01:27 +08:00
JinmingHu
74ce80659b
Documentation for Storage Blob Service, Nullable, signed int, and others (#213)
* use Nullable

* use C++ style cast

* Add documentation

* use signed int instead of unsigned

* disable storage ut

* add timeout in protocol layer

* enable stroage ut

* undelete test case

* Support copy status in properties

* Remove default value for SequenceNumber in CreatePageBlobOptions
2020-06-30 03:03:42 -07:00
Victor Vazquez
2877c959e1
Enable storage unit tests (#227)
* enable core unit tests to be compiled
* Avoid running core unit tests in CI
2020-06-29 14:19:46 -07:00
Azure SDK Bot
cdb5d324ee
Sync eng/common directory with azure-sdk-tools repository (#216) 2020-06-29 12:24:00 -07:00
Victor Vazquez
d58cbad14d
Unique ptr for body stream (#214)
* change bodyStream to unique ptr
2020-06-29 10:33:31 -07:00
Anton Kolesnyk
ad2e63afe1
Remake ClientSecretCredential (#212) 2020-06-27 15:27:11 -07:00
Daniel Jurek
0cfcdca725
Unified Pipelines for storage (#184)
* Add ci.yml for storage

* OSVmImage

* Use correct name for storage

* Update ci.ymls

* Documentation generation

* Fix tabbing

* More tabbing

* Use correct service directory for storage ci.yml

* Add docs assets

* Use cpp for dropdown generation

* Use cmake to generate documentation

* Use CMake to generate doxygen docs

* BuildArgs -> GenerateArgs

* Correct template path

* More CURL options

* Install curl to satisfy minimum build requirements

* use dependency variable name

* Add VCPKG_DEFAULT_TRIPLET

* Always generate documentaion when -DBUILD_DOCUMENTATION=YES

* Build docs at top level

* Change variable names, simplify cmake-build.yml

* -DBUILD_DOCUMENTATION

* Try using MathJax for formula rendering instead of Latex

* Add version.txt for storage

* artifact.Name -> artifact.Path

* Build docs by target

* Remove Doxyfile

* Remove Doxyfile.template

* Remove generate_docs.py, we are using cmake

* Pass CtestRegex to archetype-sdk-client job template)
2020-06-26 10:42:48 -07:00
Rick Winter
078cbc2205
Fix for non-msvc std lib (#222) 2020-06-26 09:45:29 -07:00
Rick Winter
866f4029e8
Update codeowners (#221) 2020-06-25 21:19:14 -07:00
Rick Winter
692cab5651
Nullable type (#204)
* Nullable type
Add Nullable type and tests
2020-06-25 13:58:27 -07:00
Azure SDK Bot
6a4a092c61
Sync eng/common directory with azure-sdk-tools repository (#180) 2020-06-25 09:48:51 -07:00
Kan Tang
1564e5106e
Resolved comments and rewrote StorageError. (#199)
* Resolved comments and rewrote StorageError.

* Changed Upn name, removed ';', refined error output, moved local function to unamed namespace.
2020-06-24 08:54:06 -07:00
JinmingHu
f74011a2e0
Add Unittest for Blob Service, other fixes and enhancements found during validation (#181)
* Give AccessTier a default value to eliminate warning

* Add blob clients conversion functions

* Fix bug in shared key authentication

* Add GetUri().

* make lease-status and lease-state optional

* Check duplicates in metadata

* add tests for blob service

* AppendBlocb doesn't support AccessTier

* fix bug in "RangeFromXml"

* redefine PageRange in convenience layer

* suppress warnings from gtest

* add API AppendBlockFromUri

* connection string parsing

* Add memorystream

* Rename connection string constants

* Adapt to new bodystream, this will be rewritten when bosystream is changed to unique_ptr

* fix compiler errors

* Change MemoryStream interface

* samples framework

* Add newline at the end of file

* fix compiler error
2020-06-24 01:17:09 -07:00
Victor Vazquez
e1e88b3984
Support for requests with no body (#202)
* avoid fail if no body in request

* request with no body

* fix for win86

* Update sdk/samples/http_client/curl/src/azure_core_with_curl_bodyBuffer.cpp

Co-authored-by: Rick Winter <rick.winter@microsoft.com>

Co-authored-by: Rick Winter <rick.winter@microsoft.com>
2020-06-22 18:38:35 -07:00
Victor Vazquez
90345e090c
fix the number of bytes that are read by stream (#203) 2020-06-22 18:24:09 -07:00
Victor Vazquez
e5e063f88c
support no path request (#201) 2020-06-22 18:23:42 -07:00
Victor Vazquez
614fa143ba
adding host header automatically if missing for libcurl transport (#200) 2020-06-22 18:23:30 -07:00
Kan Tang
a8a200ef26
Added convenience layer for datalake service (#178) 2020-06-20 19:55:41 -07:00
Victor Vazquez
90e57362bf
Victor/http/add streams (#183)
* Adding body Stream for HTTP
* Adding libcurl session with custom send and receive
2020-06-18 21:43:00 -07:00
JinmingHu
5758bedc5c
Export symbols when building dll (#177) 2020-06-16 13:28:37 +08:00
Rick Winter
3a0cf11ef2
Adding the SDK team for notification (#179) 2020-06-15 15:01:37 -07:00
Azure SDK Bot
de6d6431d8
Sync eng/common directory with azure-sdk-tools repository (#170) 2020-06-15 11:37:39 -07:00
JinmingHu
4366159c50
Add more APIs in storage sdk (#169)
* Add xml serializer/deserializer

* Add blob service client, add undelete, set access tier, start copy, abort copy, create snapshot, stage block from uri

* add support for conditional headers

* support range download

* Change the helper functions order to alphabetical

so that we always get the same result in different environemnts.

* use c++ casting

* Add support for append blob and page blob

* remove redundant ; added by auto-generator

* Remove BlobType in BlockBlob::Upload

* Rename blob_client_options.hpp->blob_options.hpp

* Remove API version in request options
2020-06-15 17:31:36 +08:00
Daniel Jurek
f604a1dd00
Replace CMake steps with script steps (#156)
* Replace CMake steps with script steps
* Remove comment, use script tasks to invoke cmake going forward
2020-06-11 11:20:52 -07:00
Kan Tang
18408f848a
Adding ADLS gen2 protocol layer code. (#153)
* Adding test framework for azure storage.

* Adding ADLS gen2 protocol layer code.
2020-06-09 06:31:12 -07:00
JinmingHu
401298577e
Shared Key Authentication Policy (#160)
* Remove Date in request options, assign x-ms-version a default value

* reformat files with clang-format

* Add shared key policy and basic request policy

* Add openssl dependency for linux and macOS

* add some comments, some slight fixes

* Rename CommonRequestPolicy -> CommonHeaderRequestPolicy
2020-06-09 03:38:35 -07:00
Kan Tang
6e01498038
Adding test framework for azure storage. (#152) 2020-06-09 02:45:11 -07:00
JinmingHu
11f842bfbe
Add support for HTTP methods to unblock storage team (#158)
* Support all HTTP methods

* Add const qualifier

* fix compiler error on some platforms
2020-06-04 09:44:40 -07:00