github/azure-sdk-for-cpp
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
3,501 Commits 49 Branches 0 Tags 28 MiB
366e05ea1a
Commit Graph

2206 Commits

Author SHA1 Message Date
JinmingHu
09e174865a
replace * with - (#1110) 2020-12-09 16:15:25 +08:00
Anton Kolesnyk
035ba8509c
Move BearerTokenAuthenticationPolicy to Http namespace/policy.hpp (#1104) 2020-12-08 17:04:03 -08:00
Anton Kolesnyk
d20d5eb139
Check for BUILD_TESTING and BUILD_SAMPLES inside Storage's cmakefiles (#1071) 2020-12-08 12:34:14 -08:00
JinmingHu
24c0e72601
GetPageRangesDiff and GetManagedDiskRangesDiff (#1090) 
* GetPageRangesDiff GetManagedDiskRangesDiff
 2020-12-08 13:35:05 +08:00
Anton Kolesnyk
bbe4b54528
Do not use ${TARGET_NAME} unless necessary (#1094) 2020-12-07 20:20:06 -08:00
Anton Kolesnyk
d1f162f9e3
Fix typo (#1091) 
This change was extracted from #1013, in order to isolate some of the changes.
 2020-12-08 03:56:21 +00:00
Anton Kolesnyk
46419412c3
Use CONFIG QUIET when looking for packages (#1092) 
This change was extracted from #1013, in order to isolate some of the changes.
 2020-12-08 03:55:21 +00:00
Ahson Khan
dd65f20a1f
Try to remove the dependency on a curl header in client secret credential implementation (#1086) 
Ideally, there should be no direct dependency on a specific transport adapter, even in the implementation.
 2020-12-07 15:07:14 -08:00
Victor Vazquez
4cc1754b63
fix warning while building master (#1083) 2020-12-04 16:08:18 -08:00
Anton Kolesnyk
ce98087f7e
Don't use WINDOWS/POSIX/NOMINMAX macros defined in cmake, move them to source code instead (#1070) 2020-12-04 11:55:59 -08:00
Victor Vazquez
3ca1104e91
use INCLUDE_DISABLED_TESTS for disabling tests (#1077) 
* use INCLUDE_DISABLED_TESTS for disabling tests
 2020-12-04 10:58:52 -08:00
Anton Kolesnyk
9d3b488524
Remove last pieces of Storage libs dependency on Identity (#1079) 2020-12-03 22:21:47 -08:00
Anton Kolesnyk
7d6d3dbf8f
Make SDK buildable in VS 2017 (#1078) 2020-12-03 19:16:18 -08:00
Victor Vazquez
34146cc7af
disable problematic test until it gets fixed (#1065) 
Temporal patch for https://github.com/azure/azure-sdk-for-cpp/issues/1060.
 2020-12-03 20:05:11 +00:00
JinmingHu
222967cc89
new field IsHnsEnabled in AccountInfo (#1068) 2020-12-03 05:53:52 +00:00
Kan Tang
72a6ea98a9
Update Readme for nlohmann-json. (#1069) 2020-12-03 04:22:15 +00:00
JinmingHu
9febf43832
CreateIfNotExists and DeleteIfExists (#1059) 
* CreateIfNotExists DeleteIfExists for containers

* DeleteIfExists for blobs

* CreateIfNotExists for append blob

* CreateIfNotExists for page blob

* changelog
 2020-12-03 11:19:52 +08:00
Victor Vazquez
c3afb7798f
Remove CMake nlohmann module (#1042) 
fixes: https://github.com/Azure/azure-sdk-for-cpp/issues/1041

Make nlohmann a 3rd party required lib. Do not fetch it with CMake if it is not found
 2020-12-03 01:52:56 +00:00
JinmingHu
46ce66d150
case-insensitive metadata (#1050) 
* case-insensitive metadata

* Added support for case insensitive metadata for file/datalake service

Co-authored-by: Tank Tang <kat@microsoft.com>
 2020-12-03 09:49:33 +08:00
Victor Vazquez
3822ca8729
use private as suffix for private headers (#1040) 
fixes: https://github.com/Azure/azure-sdk-for-cpp/issues/1039

Adding `private` suffix for private headers.

Updating core test CMake script to include the /src folder from CORE to expose the private headers to the tests. Then tests don't need to do relative-path includes.
 2020-12-03 01:16:46 +00:00
Anton Kolesnyk
d61e106e89
Remove alternative token usage (#1053) 2020-12-02 16:14:17 -08:00
JinmingHu
31cd0d1e76
sas raw permissions (#1036) 2020-12-02 13:32:28 +08:00
JinmingHu
d0b128049d
Move StoragePerRetryPolicy and SharedKeyPolicy to Details namespace (#1046) 
* move some policies to Details namespace

* changelog

* move StorageRetryPolicy to Details namespace

* changelog
 2020-12-02 10:19:23 +08:00
Kan Tang
96892d9923
Resolved some API review comments from Arch board on File Share service. (#1033) 2020-12-02 10:18:41 +08:00
JinmingHu
4e38e8961e
fix typo (#1045) 2020-12-02 08:15:18 +08:00
JinmingHu
9b83bec0b4
rename variables for append blob access condition (#1035) 
* rename variables for append blob access condition

* changelog
 2020-12-01 10:14:18 +08:00
JinmingHu
f378a3a467
block id list now is a vector of strings (#1034) 
* block id list now is a vector of strings

* changelog
 2020-12-01 09:57:49 +08:00
Victor Vazquez
cc75233a54
Remove curl transport adapter models and private headers form public layer (#1023) 2020-11-30 15:54:21 -08:00
JinmingHu
85fb3e3530
Add "Blob" before every "Container" (#1028) 
* Add "Blob" before every "Container"

* rename more

* rename more

* more

* more

* changelog
 2020-11-26 18:46:21 +08:00
JinmingHu
4de5bcff96
rename SharedKeyCredential -> StorageSharedKeyCredential (#1025) 
* rename SharedKeyCredential -> StorageSharedKeyCredential

* fix

* rename
 2020-11-26 14:32:58 +08:00
JinmingHu
be601f2cdd
fix parameter name case (#1024) 
* fix parameter name case

* more
 2020-11-26 14:32:43 +08:00
Kan Tang
50170a062d
Removed client secret credential support for file service. (#1015) 
* Removed client secret credential support for file service.

* Removed #include "azure/identity/client_secret_credential.hpp"
 2020-11-26 14:06:48 +08:00
Victor Vazquez
c9c12e27aa
let azure core provide json interface (#1004) 
* let azure core provide json interface
 2020-11-24 15:55:46 -08:00
Kan Tang
847e769576
Add more test cases to increase datalake service test coverage. (#1014) 
* Add more test cases to increase datalake service test coverage.

* add coverage for download to file.

* Reformat the include files.
 2020-11-24 15:51:32 +08:00
Kan Tang
fdc06b978d
Removed Share Lease due to it not supported until STG 76 (#1016) 
* Removed Share Lease due to it not supported until STG 76

* Update breaking change.

* Added removed APIs list in change log.
 2020-11-24 13:39:02 +08:00
Kan Tang
7c8d40bddf
Resolve protocol layer latest comment proposed changes from review. (#1003) 
* Removed c_ in datalake/file's protocol layer

* Changed to use Azure::Core's ToLower
 2020-11-23 12:42:34 +08:00
Gabor Gyimesi
50806328d6
Fix linker error of missing pthread on Linux (#980) 2020-11-20 00:07:59 -08:00
JinmingHu
fadb43e664
remove c_ (#1000) 
* remove c_

* remove more c_

* remove more
 2020-11-20 12:24:23 +08:00
JinmingHu
2b56b8b026
clients accept TokenCredential as param (#998) 2020-11-20 12:24:04 +08:00
JinmingHu
9fae36a4f7
rename uri->url (#997) 2020-11-20 10:55:10 +08:00
JinmingHu
980f858676
AccessConditions as a member (#996) 2020-11-20 10:54:27 +08:00
JinmingHu
c6da8da8c7
Rename Get{Block/Append/Page}BlobClient -> As{Block/Append/Page}BlobClient (#995) 2020-11-20 10:46:13 +08:00
Victor Vazquez
ac09ee6f44
Fix coverage report for template and core pipelines (#1002) 
Root Cause:
Storage project generates coverage files in a different location (sdk/*/*cov_xml.xml) from where Core and Template (sdk/*/*/*cov_xml.xml). Basically one level up.

When I added the coverage for Storage, I didn’t know we were also running live tests for Core and Template pipelines. It failed on them because the xml files were not found.

In the PR, I add a new parameter to pipelines to change the default path, and also I am disabling LiveTests from Core and Template, since it only runs the same thing that we run on CI pipelines (We can enable it if we ever have some live tests)


fix: #1001
 2020-11-19 20:19:57 +00:00
JinmingHu
91c6116ead
fix (#994) 2020-11-19 09:34:44 +08:00
Victor Vazquez
b8d9d42e5a
Update Notice and add cgmanifest.json (#839) 
* Update Notice and add cgmanifest.json
 2020-11-18 11:44:22 -08:00
Victor Vazquez
84f690e968
Allow exclude for codecoverage (#939) 
* Add support for EXCLUDE path from code coverage

* code coverage for live tests
 2020-11-18 09:57:56 -08:00
Kan Tang
d906a89310
Updated Readme to reflect the change of default triplet. (#986) 2020-11-18 15:38:17 +08:00
JinmingHu
801e072e42
Blob test enhancements (#987) 2020-11-17 14:36:43 +08:00
JinmingHu
485b526a26
unify blob client options (#989) 
* unify blob client options

* Unified client options is datalake/files and adapt blob breaking change.

Co-authored-by: Tank Tang <kat@microsoft.com>
 2020-11-17 14:35:27 +08:00
Gabor Gyimesi
a716e094fe
Fix default EndpointSuffix when parsing connection string (#981) 2020-11-16 09:58:01 +08:00
Azure SDK Bot
e0ddcfec89
Increment version for storage releases (#979) 
* Increment package version after release of azure-storage-common

* Increment package version after release of azure-storage-blobs

* Increment package version after release of azure-storage-files-datalake

* Increment package version after release of azure-storage-files-shares
 2020-11-13 13:15:48 -08:00
Ahson Khan
498d8429df
Add a simplified identity header. (#971) 
* Add a simplified identity header.

* Update the CL.
 2020-11-13 13:14:57 -08:00
Kan Tang
a96f4c6f7d
Changelog update for file/datalake service for beta.5 (#978) 
* Changelog update for file/datalake service for beta.5

* Resolved review comments and refined the documentation.

* Add full stops.

* Moved bug fix below the features/breaking change section.
 2020-11-13 14:55:21 +08:00
Kan Tang
206c8fb2d8
Changed version string for beta.5 release. (#973) 2020-11-13 13:15:16 +08:00
JinmingHu
c32f9b0cb2
changelog for storage common and blob (#974) 2020-11-13 13:13:31 +08:00
Kan Tang
97af13d7e6
Moved model types in file share service into Models namespace. (#965) 2020-11-13 10:52:00 +08:00
Kan Tang
216c88483a
Moved model types in datalake service into Models namespace. (#966) 2020-11-13 10:51:43 +08:00
Anton Kolesnyk
bbfffc5e46
Remove DateTime::operator Duration() (#967) 
No need for it, other than the unit tests, which still can get it by subtracting epoch.
(https://github.com/Azure/azure-sdk-for-cpp/pull/938/files#r522344899)
 2020-11-12 20:09:00 +00:00
Anton Kolesnyk
78e34a2189
Update/correct DateTime exception documentation (#950) 2020-11-12 01:59:14 -08:00
JinmingHu
2eff3aa1b1
rename ToSasQueryParameters->GenerateSasToken (#958) 2020-11-12 08:30:04 +00:00
JinmingHu
43cc2e547c
customers cannot change sas version anymore (#957) 2020-11-12 08:29:24 +00:00
JinmingHu
3838944ab9
rename SetAccountKey->UpdateAccountKey (#955) 
* rename SetAccountKey->UpdateAccountKey

* add doc
 2020-11-12 14:05:56 +08:00
JinmingHu
b5005d910c
default concurrency from 1 to 5 (#952) 2020-11-12 14:04:38 +08:00
Azure SDK Bot
83e4efbf60
Increment version for identity releases (#956) 
Increment package version after release of azure-identity
 2020-11-12 05:02:21 +00:00
Azure SDK Bot
04439563bf
Increment version for core releases (#951) 
Increment package version after release of azure-core
 2020-11-12 04:34:51 +00:00
Ahson Khan
3390505745
Move the identity changelog to the directory expected by the pipeline. (#953) 
See release pipeline failing: https://dev.azure.com/azure-sdk/internal/_build/results?buildId=616379&view=logs&j=630dead4-e82d-55e1-e443-1204aff8eed9&t=a860a438-9be2-5317-d14b-bab172a8d9b6

This makes it consistent with all the other libraries, like core and storage:
https://github.com/Azure/azure-sdk-for-cpp/blob/master/sdk/core/azure-core/CHANGELOG.md
 2020-11-12 03:48:37 +00:00
JinmingHu
9462201d9a
move stuff to Models (#945) 
* move stuff to Models

* fix build errors

* fix build error

* Resolve datalake build issue

* fix build errors

* fix build errors

* reformat

Co-authored-by: Tank Tang <kat@microsoft.com>
 2020-11-12 11:40:32 +08:00
Victor Vazquez
1df5cfac9c
changelog updated for Releasing 1.0.0-beta.3 (#941) 2020-11-11 18:30:38 -08:00
Anton Kolesnyk
56475b003a
DateTime: API review feedback (#938) 2020-11-12 01:48:00 +00:00
JinmingHu
20a20d058b
customized http client (#864) 
* customized http client
 2020-11-11 08:25:19 -08:00
Kan Tang
927542cc6e
Resolve review comments from Core team. (#946) 2020-11-11 18:03:34 +08:00
JinmingHu
8e46bbaacd
API review change (#942) 
* make SharedKeyCredential a class

* move xml stuff to Details namespace

* Rename LastModifiedTimeAccessConditions -> ModifiedTimeConditions

* remove {Block/Append/Page}BlobClientOptions

* file -> fileName

* rename StorageError->StorageException

* rename storage_error.hpp -> storage_exception.hpp

* fix build error

* Adapted name/namespace change

* fix typo

* Removed Azure in Azure::Storage

Co-authored-by: Tank Tang <kat@microsoft.com>
 2020-11-11 17:05:46 +08:00
Kan Tang
8c45574292
Move protocol layer options and methods to details namespace. (#923) 
* Move protocol layer options and methods to details namespace.

* Moved FromJson, FromString, ToString to details namespace.
 2020-11-11 15:44:10 +08:00
JinmingHu
f99e4a57c7
move stuff to Details namespace (#921) 2020-11-11 09:41:19 +08:00
Victor Vazquez
eb509cebb8
maka transport adapter base class for any transport to add its own implementation (#928) 2020-11-10 15:42:09 -08:00
Victor Vazquez
4b4e8ba7ea
Adding datetime format decimal and no decimal (#936) 
* revert change to xmlsoft link

* remove link

* Add DateFormat::Iso8601WithDecimals and DateFormat::Iso8601WithNoDecimals

* changelog

* add ToISO8601String with TimeFractionFormat

* update the name and add extra test
 2020-11-09 17:50:05 -08:00
Victor Vazquez
c0ad020856
remove commented code (#933) 
fixes: https://github.com/Azure/azure-sdk-for-cpp/issues/930
 2020-11-10 00:12:12 +00:00
Victor Vazquez
06f37eafc7
revert change to xmlsoft link (#935) 
* revert change to xmlsoft link

* remove link
 2020-11-09 15:37:48 -08:00
Ahson Khan
35c78c3e30
Disabling BlobContainerClientTest.BlobSasTest since it is failing live test (#925) 2020-11-09 15:17:06 -08:00
Kan Tang
6bb5cd788c
Removed IPv6 not compatible SAS test cases. (#920) 2020-11-09 21:07:48 +08:00
JinmingHu
344e778177
Storage uses Core::Encode (#855) 
* use Core::Encode

* fix bug

* remove %
 2020-11-09 14:59:14 +08:00
Victor Vazquez
742e385350
Adding options for telemetry and transport policy (#889) 
Fixes: https://github.com/Azure/azure-sdk-for-cpp/issues/819
 2020-11-07 01:01:03 +00:00
Victor Vazquez
c48bb033af
Test that a connection won't be moved to the connection pool if uploading fails (#910) 
Fixes: https://github.com/Azure/azure-sdk-for-cpp/issues/905
 2020-11-06 20:36:27 +00:00
Victor Vazquez
7510c58c6a
remove space from header (#907) 2020-11-06 12:03:19 -08:00
Victor Vazquez
b1e08f713b
create error string only if there is an error and not before (#912) 2020-11-06 11:57:11 -08:00
Victor Vazquez
4b2e335d35
Add GetPort to URL (#904) 
* Add GetPort to URL
 2020-11-05 16:01:08 -08:00
Daniel Jurek
20349daf11
Live test framework (#608) 
- Add live test framework
- Enable storage live tests
 2020-11-05 14:59:05 -08:00
Victor Vazquez
7962546009
curl transport adapter options (#885) 2020-11-04 18:06:09 -08:00
Victor Vazquez
0676f788c3
remove throw from NextPolicy (#877) 
Update NextPolicy to that a reference instead of a pointer to the policies vector.
This way we don't need to check if the pointer is null.

Then, handle the case were no transport adapter was found

fixes: https://github.com/Azure/azure-sdk-for-cpp/issues/874
 2020-11-04 17:03:35 +00:00
Rick Winter
e099942e25
Create a more random approach to uuid generation (#868) 
* Create a more random approach to uuid generation
* Add two additional test cases for Uuid
 2020-11-02 08:49:41 -08:00
Victor Vazquez
75c3f85ca6
handle server chunked response without number (#881) 2020-10-30 01:11:41 -07:00
Victor Vazquez
1fa314f19e
Refactor curl connection for mocking (#869) 
* split curl headers

* curl transport refactoring for curl mocking support tests
 2020-10-29 23:44:06 -07:00
Victor Vazquez
36ea25db7f
Do not reuse a connection that fail while uploading (#863) 2020-10-28 01:27:23 -07:00
Victor Vazquez
c764052e7c
Add Code coverage (#830) 
* Add code coverage scripts
 2020-10-27 15:35:15 -07:00
JinmingHu
02f5869559
storage service starts using version.hpp (#845) 
* version.hpp

* 12

* fix
 2020-10-26 10:43:13 +08:00
Kan Tang
26ad18c6e3
Resolved File test issue. (#844) 2020-10-26 10:19:22 +08:00
Sima Zhu
ef15be36af
Fixed the http link (#850) 2020-10-24 00:33:59 +00:00
JinmingHu
e09a891383
move storage headers (#837) 
* move blob.hpp

* move headers

* add changelog
 2020-10-23 11:39:29 +08:00
JinmingHu
08e364e1cd
replace std::tolower with Azure::Core::ToLower (#834) 2020-10-23 09:43:30 +08:00
Victor Vazquez
5d0e7734c4
update exceptions to be a class instead of an struct (#833) 
Fixes: https://github.com/Azure/azure-sdk-for-cpp/issues/828
 2020-10-22 02:53:46 +00:00
Victor Vazquez
f699e25ab8
Add unit test for simplified core.hpp header (#824) 
* Add unit test for simplified core.hpp header
 2020-10-21 17:10:34 -07:00
Victor Vazquez
9c96688b6e
rename RequestCancelException to OperationCanceledException (#825) 2020-10-21 01:31:26 -07:00
Victor Vazquez
9d47db1d4a
Add RequestFailedException (#717) 
* Add RequestFailedException
 2020-10-20 22:22:02 -07:00
Rick Winter
e88274f33f
Remove reference to removed header (#821) 2020-10-20 23:42:42 +00:00
Victor Vazquez
eec298d16a
Prevent zero length pipeline (#813) 
fixes: https://github.com/azure/azure-sdk-for-cpp/issues/726
 2020-10-20 20:01:26 +00:00
Victor Vazquez
e1dddce239
remove azure hpp (#809) 
Remove Azure.hpp

Make Azure/Core/Strings.hpp public

Move ToLower and InvariantIsEqual to Strings.hpp

Also removing `AZURE_UNREFERENCED_PARAMETER`  

fixes: https://github.com/Azure/azure-sdk-for-cpp/issues/811
 2020-10-20 18:08:58 +00:00
Victor Vazquez
90387b3c5d
Add core.hpp general header (#807) 
General header for all public Core headers.
This header will be used for API review tool.

https://github.com/Azure/azure-sdk-for-cpp/issues/812
 2020-10-20 17:49:09 +00:00
Anton Kolesnyk
a1385518a2
DateTime: Allow dates from 1601 to 1900 (#799) 
Closes #769.
 2020-10-17 02:05:05 +00:00
Victor Vazquez
d79d95e5b7
Add prefix for Azure Core Tests - Fix CI test run (#801) 
* Add prefix for Azure Core Tests
 2020-10-16 17:39:02 -07:00
Kan Tang
8f1ab29a6d
Added breaking change documentation for behavior change in Core. (#798) 2020-10-16 15:25:13 -07:00
Kan Tang
b6ab1d0872
Added date value to changelog (#800) 2020-10-16 20:45:32 +08:00
Kan Tang
ef4b7c5268
Resolved the issue in datalake/file where file/path/directory/share/f… (#796) 
* Resolved the issue in datalake/file where file/path/directory/share/filesystem name are not encoded.

* Refined special char string

* Resolve comments.
 2020-10-16 14:26:50 +08:00
JinmingHu
95fea7af78
fix url encoding issue (#795) 
* fix more

* add ut

* add more ut
 2020-10-16 14:08:10 +08:00
JinmingHu
5bad554a06
fix path encoding issue (#794) 2020-10-16 12:43:12 +08:00
Victor Vazquez
fda43987e4
removing log member from curl session (#789) 
Remove the m_logger member from curl session and use logger directly from static logger in application
 2020-10-16 00:45:52 +00:00
Rick Winter
12b7a5e449
Use quotes for files relative to the package (#784) 2020-10-15 17:30:13 +00:00
Victor Vazquez
854bd834cc
Adding tests to verify that request can be canceled while waiting for socket (#782) 
* adding tests for cancel
 2020-10-15 10:13:29 -07:00
Victor Vazquez
f9e6acb358
Update Readme and Contribute to Oct07-2020 release instructions (#712) 
* Update Readme and Contribute to Oct07-2020 release instructions
 2020-10-14 22:00:34 -07:00
Victor Vazquez
d4ff61919f
Prevent transport adapter to keep pulling for data on a closed connection (#780) 
* thow if connection is closed when reading response

* improve comment

* format
 2020-10-14 19:18:43 -07:00
Victor Vazquez
724e6ca512
Make waiting for socket cancelable (#719) 
* Make waiting for socket cancelable
 2020-10-14 16:55:04 -07:00
Rick Winter
aa18492bb9
Fix version and changelog (#770) 2020-10-14 14:57:38 -07:00
Kan Tang
a7672f67f6
Renamed all continuation related object to ContinuationToken. (#779) 
* Renamed all continuation related object to ContinuationToken.

* Refined changelog.
 2020-10-14 15:18:38 +08:00
Kan Tang
e0079f0541
Update Changelog and remove breaking changes individual file. (#778) 
Update Changelog and remove breaking changes individual file
 2020-10-14 14:35:57 +08:00
JinmingHu
443369b057
[Storage] Rename NextMarker -> ContinuationToken (#777) 
* rename nextmarker->continuationtoken

* update changelog

* Update sdk/storage/azure-storage-blobs/CHANGELOG.md

Co-authored-by: Ahson Khan <ahkha@microsoft.com>

* fix

Co-authored-by: Ahson Khan <ahkha@microsoft.com>
 2020-10-14 14:19:38 +08:00
animeshdas2000
c806e4ee94
Updated changelog.md (#762) 
* Updated changelog.md

Updated changelog as per the right order of release

* updated changelog.md

removed duplicate version releases
 2020-10-13 22:40:55 -07:00
JinmingHu
e0d717a0d3
revert non-overwriting changes (#773) 2020-10-14 13:23:40 +08:00
JinmingHu
570c774ebd
fix typo in doc (#774) 2020-10-14 12:05:20 +08:00
JinmingHu
b0e5d3d356
update changelog for storage beta3 release (#772) 2020-10-14 10:46:30 +08:00
Anton Kolesnyk
a38de03e7b
Extract part of credentials to Identity module (#748) 2020-10-13 07:33:18 -07:00
Kan Tang
e9f37a5760
Change 4 spaces into 2. (#761) 2020-10-13 13:02:33 +08:00
Kan Tang
9633fbc6be
Modified version, Added changelog/breaking changes for beta.3 (#759) 2020-10-13 04:30:31 +00:00
JinmingHu
f3b324d4f5
changelog (#758) 2020-10-13 04:20:50 +00:00
JinmingHu
a07aa979ce
concurrent upload is overwriting (#760) 2020-10-13 04:02:23 +00:00
JinmingHu
320a22e664
Make sure CI pipelines legs get triggered with cmake modules are modi… (#756) 
…fied.
 2020-10-13 03:10:51 +00:00
Ahson Khan
c44d9b4f3b
Make sure CI pipelines legs get triggered when cmake modules are modified. (#755) 
Certain PRs, like this - https://github.com/Azure/azure-sdk-for-cpp/pull/753 weren't triggering any CI pipelines to run, when they should.

Following suggestion from Wes: https://github.com/Azure/azure-sdk-for-cpp/pull/728#issuecomment-707251860

@Jinming-Hu, @katmsft - I think we should make a similar change to the storage ci.yml file.
 2020-10-13 02:57:35 +00:00
Kan Tang
f43ef4b137
Enabled Get file range diff with snapshot. (#757) 2020-10-13 10:56:46 +08:00
Kan Tang
af71e0167d
Removed Nullable return value that never returns. (#747) 2020-10-13 10:41:23 +08:00
JinmingHu
5d1a8f4cbc
Upload/Create is non-overwriting by default (#745) 
* add overwrite option

* fix failed ut

* add ut
 2020-10-13 10:41:15 +08:00
JinmingHu
b6032bfe54
Enable tests for setting tiers for snapshots/versions (#743) 2020-10-13 09:42:10 +08:00
Azure SDK Bot
c4f09c6894
Increment package version after release of azure-core (#734) 2020-10-12 11:15:38 -07:00
Victor Vazquez
9eb132249b
Url use url encoded queries (#730) 
* keep url-encoded queries
 2020-10-12 09:39:46 -07:00
Kan Tang
966b7892b2
Avoid test case throw meaningless exception when sys env is not set. (#723) 
* Avoid test case throw meaningless exception when sys env is not set.

* Update sdk/storage/azure-storage-common/test/test_base.cpp

Co-authored-by: JinmingHu <jinmhu@microsoft.com>

* Update sdk/storage/azure-storage-common/test/test_base.cpp

Co-authored-by: JinmingHu <jinmhu@microsoft.com>

* Update sdk/storage/azure-storage-common/test/test_base.cpp

Co-authored-by: JinmingHu <jinmhu@microsoft.com>

* Apply clang format

Co-authored-by: JinmingHu <jinmhu@microsoft.com>
 2020-10-12 14:49:30 +08:00
Kan Tang
582377fc1d
Fixed multichannel bug. (#737) 
* Fixed multichannel bug.

* Resolved some comments.
 2020-10-12 11:48:48 +08:00
Anton Kolesnyk
6ae0c0daac
Add DateTime: supporting standardized string date and time representations. (#718) 2020-10-09 19:13:48 -07:00
Victor Vazquez
cd2a8a3812
cmake updates for building transport adapters (#706) 
Adding CMake module to enable/disable transport adapters

TRANSPORT ADAPTER BUILD  
Default: If no option is explicitly added, curl will be used for POSIX and WIN HTTP for WIndows 
 Windows: Both CURL and WIN_HTTP can be build to be used.                                        
POSIX: Only CURL is acceptable. If WIN_HTTP is set, generate step will fail for user            

Defines `BUILD_WIN_HTTP_TRANSPORT_ADAPTER` and `BUILD_CURL_HTTP_TRANSPORT_ADAPTER` for source code
 
Fixes #350
 2020-10-10 00:08:57 +00:00
Victor Vazquez
2cc4ecdea8
Validate invalid HTTP headers (#703) 
Creating new function to insert headers by validating characters on it are accepted chars for header name
fixes: https://github.com/Azure/azure-sdk-for-cpp/issues/191
 2020-10-09 23:35:58 +00:00
Victor Vazquez
dc9d3b0595
update CMake min version to 3.15 (#710) 
Storage is using CMake version 3.15 and it is currently required for generating without errors
 2020-10-09 23:26:01 +00:00
Rick Winter
82079de190
Added release notes for C++ (#714) 2020-10-09 17:06:52 +00:00
Kan Tang
f59ab214a6
Integrate storage retry policy. (#722) 
* Integrate storage retry policy.

* Removed the logic to make URL empty when '.blob.' is not found in URL.
 2020-10-09 14:30:35 +08:00
Kan Tang
1b351de2d8
Added 2020-02-10 features. (#692) 
* Added 2020-02-10 features.

* Resolved comments.
 2020-10-09 11:05:24 +08:00
Victor Vazquez
400ca5ae29
Adding retry policy to unit tests (#707) 2020-10-07 14:10:11 -07:00
Victor Vazquez
190a0e80b1
fixing typos from #686 (#704) 
Follow up from #686 to address PR comments about typos
 2020-10-06 23:10:42 +00:00
Kan Tang
a898fd819a
Added SetExpiry DataLake convenience layer. (#696) 2020-09-30 16:13:37 +08:00
JinmingHu
e238e28b0d
[Storage Common] Storage Retry Policy (#588) 
* storage retry policy

* revert changes to azure core

* refactor storage retry policy

* fix typo

* change the logic a little bit

* adapt storage retry policy in blob batch client

* fix build error

* Add StorageRetryWithSecondaryOptions
 2020-09-30 13:14:28 +08:00
JinmingHu
8c4c4e75a9
[Storage Blobs Service] STG 74 features (#652) 
* SetExpiry protocol layer

* add test

* last access time

* upgrade blob sas to 2020-02-10

* datalake sas

* fix build error

* tag count

* enable tag test

* fix build error

* enable container soft delete test
 2020-09-30 11:38:25 +08:00
Victor Vazquez
7c32578798
Perf fix windows (#686) 
* sample for repro

* adding repro app

* reset win socket for perf windows
 2020-09-29 11:37:31 -07:00
Casey Carter
21d4e4c5b4
Response<T> stores Nullable<T> (#654) 
* Response<T> stores Nullable<T>

Drive-by: Replace `Nullable(const T&)` with `Nullable(T)` to avoid extra copy when initialized with an rvalue.

* Update sdk/core/azure-core/inc/azure/core/response.hpp

Co-authored-by: Rick Winter <rick.winter@microsoft.com>

Co-authored-by: Rick Winter <rick.winter@microsoft.com>
 2020-09-29 10:01:00 -07:00
JinmingHu
fbe95f36c5
fix variable casing (#689) 2020-09-28 11:10:32 +08:00
Rick Winter
8b22d3f478
Add Notice and cgmanifest for Core (#687) 
* Add Notice and cgmanifest for Core
 2020-09-25 10:57:06 -07:00
Rick Winter
d867d7e8ad
Standardize header includes (#685) 
* Standardize header includes

Update sources to match guidelines

- `#include ""` when file is relative to the project
- `#include <>` when file is external to the project

Updated tests to mirror how a customer will include the header

- `#include <>`
 2020-09-25 10:56:06 -07:00
Rick Winter
f73f61119b
Add cgmanifest and NOTICE file to template project (#682) 2020-09-24 18:31:55 +00:00
Victor Vazquez
fdcb150621
Replace select for epoll (#676) 
* adding poll instead of select

* Windows support for polling

* fix for define check
 2020-09-22 16:24:26 -07:00
Sima Zhu
8fed524b96
Replaced relative link with absolute links and remove locale (#668) 2020-09-17 22:28:36 -07:00
Sima Zhu
caf9fbc7d6
Enable master link replacement feature for cpp (#632) 2020-09-17 17:51:27 -07:00
Daniel Jurek
39e8dfd6e7
Vcpkg publish framework (#645) 
* Add vcpkg artifact creation and port template copying
* Skip staging if vcpkg port directory doesn't exist
 2020-09-17 15:45:43 -07:00
Kan Tang
34944552ad
Resolved an issue where path is not encoded. (#657) 2020-09-16 11:13:12 +08:00
JinmingHu
7584c208ab
Fix bug: encode blob name (#655) 2020-09-16 11:08:59 +08:00
JinmingHu
95f4034490
fix bug in blob tags (#653) 2020-09-15 10:52:23 +08:00
Victor Vazquez
9c9b2c242a
throw transport exception when getting new connection fails (#640) 
* throw transport exception when getting new connection fails

* use function instead of macro

* Update function to PascalCase
 2020-09-14 13:44:04 -07:00
JinmingHu
73ba0029bc
Add date in Changelog (#637) 
* Add date in Changelog

* Update changelog

* Update changelog
 2020-09-10 13:51:31 +08:00
Daniel Jurek
01cb68f763
Fix release tagging (#636) 
* add ReleaseTag
* pkgId -> pkgName
* pkgId -> pkgName
* beta.2
 2020-09-09 22:27:49 -07:00
Azure SDK Bot
9fa18c4174
Increment package version after release of azure-core (#630) 2020-09-09 21:41:10 -07:00
Rick Winter
6b1043fc3f
Update the repo readmes and changelog (#627) 
* Update the repo readmes and changelog

* Lowercase beta

* Fix a couple instances of `preview`
 2020-09-09 16:55:57 -07:00
Victor Vazquez
db4f318ffa
throw transport error when write error (#623) 2020-09-09 09:26:34 -07:00
JinmingHu
29c58ca4bf
[Storage Blobs Service] update changelog (#615) 
* update changelog

* Add changelog

* Update changelog
 2020-09-09 10:32:35 +08:00
JinmingHu
a5d09b5f47
disable blob tags ut (#613) 
* disable blob tags ut

* fix ut

* disable tags in sas
 2020-09-09 09:04:44 +08:00
Anton Kolesnyk
949d143284
Add doxygen comments (#611) 2020-09-08 11:00:06 -07:00
Ahson Khan
40121dd78a
Fix typo in comment. (#610) 2020-09-04 17:55:15 -07:00
Victor Vazquez
864582b10e
fix the url init in credentials (#599) 
* fix the url init in credentials

* do not encode tenantId
 2020-09-04 16:13:17 -07:00
Victor Vazquez
0dce4de5a1
throw runtime error if response is shorter than expected or gets closed (#577) 
* throw runtime error if response is shorter than expected or gets closed

* trhow Azure::Core::Http::TransportException
 2020-09-04 14:51:12 -07:00
Victor Vazquez
9eb4d41bfc
fix format and remove inline (#601) 2020-09-04 14:21:44 -07:00
Victor Vazquez
68ee875fca
Legal/adding notice for libcurl sample (#372) 
* Adding libcurl sample usage to Notice
 2020-09-04 14:15:35 -07:00
JinmingHu
c949400dba
fix bug in file sas (#597) 2020-09-04 17:30:07 +08:00
JinmingHu
bcdeeb1434
[Storage Blobs Service] Blob Tags (#416) 
* blob tags

* add TagConditions for CreateSnapshot and GetBlockList

* update tags ut

* remove unsupported conditional headers from PutBlockFromUriOptions

* sas permission ut for tags

* add comment
 2020-09-04 14:47:34 +08:00
JinmingHu
911a879a00
[Storage Blobs Service] Blob Batch (#582) 
* blob batch

* fix build error

* Update sdk/storage/azure-storage-blobs/test/blob_batch_client_test.cpp
 2020-09-04 14:47:11 +08:00
JinmingHu
07208d1720
[Storage Files Service] File sas (#568) 
* File sas

* rebase on lastest master
 2020-09-04 14:46:24 +08:00
Victor Vazquez
caf705c863
reuse code from tolower char (#583) 
* reuse code from tolower char

* c_LocaleInvariant table to do tolower instead of toUpper
 2020-09-03 22:46:28 -07:00
Kan Tang
d12db7f413
Added ChangeLog/Readme for file service. (#573) 2020-09-04 04:31:07 +08:00
Kan Tang
d9b58fd935
Resolved breaking change introduced by URL. (#584) 2020-09-04 04:18:48 +08:00
Victor Vazquez
38d90d62f3
URL encode and URL Unification (#561) 
* Update URL from CORE with uri builder from storage and make Request to take URL to be created
 2020-09-02 23:57:03 -07:00
Daniel Jurek
919610f429
Use version.hpp for package versions (#572) 
* Add version.txt
* Add doc generation for template
* Add version.hpp parsing and update capabilities to cmake and engsys
* Get-SdkVersion -> Get-PkgVersion
* Move Update-PkgVersion.ps1 under eng/scripts
* Get-PackageVersion -> Get-PkgVersion
* Update paths, params, verbosity
* Couple fixes to output and make use of new SemVer version
* Add fallback support for verison.txt in cases where we still use it to unblock release artifact generation
* Use version information in release pipeline
* Add workaround to generate storage pipeline artifacts
* eng/scripts/
* Write warning
* Haven't released storage-file-shares yet according to releases on GitHub
* Set release date on changelog.md
* Update CHANGELOG.md to indicate this is a test release
* Remove fallback exception for storage
* Re-add Rick's suggestions
* Revert "Remove fallback exception for storage"
 2020-09-02 18:53:46 -07:00
Daniel Jurek
67b21fed12
Template ci.yml (#569) 
* Add ci.yml to template project
* triggers on sdk/template
 2020-09-01 21:44:02 -07:00
Victor Vazquez
b46a544a7b
fix for unit tests for cleanner (#558) 
* fix for unit tests for cleanner
 2020-08-28 16:17:16 -07:00
Kan Tang
97bfdf91d2
Rewritten the user agent. (#555) 2020-08-28 21:23:31 +08:00
Kan Tang
f9fee4f56a
Added file/datalake changelog (#554) 2020-08-28 18:26:29 +08:00
JinmingHu
9a1f84fbfb
Update changelog (#551) 2020-08-28 17:09:05 +08:00
Victor Vazquez
6e33262be5
Fix for connection re-use on response error (#548) 
* Fix for connection re-use on response error
 2020-08-27 22:45:33 -07:00
Victor Vazquez
e782efbb47
perf stress basic struct folder and no op herarchy structure (#390) 
* perf stress basic struct folder and no op herarchy structure
 2020-08-27 15:27:31 -07:00
JinmingHu
66c331e52b
Resolve review comments (#545) 
* Rename UndeleteContainer->Undelete

* Remove concurrent upload page blob

* move offset to the first parameter

* Rename: TransactionalMd5 TransactionalCrc64

* add batch protocol layer
fix x-ms-server-encrypted
transactional-md5

* transcational md5

* Remove Transactional headers from ClearPagesResult

* parse x-ms-blob-content-md5

* Remove redundant space
 2020-08-27 22:44:29 +08:00
Kan Tang
62dd39c1be
Resolved review comments. (#544) 
* Fixed review comments.

* Resolved some review comments
 2020-08-27 16:54:35 +08:00
JinmingHu
3a4e1f3b49
Restructure storage directory (#536) 
* Restructure azure storage directory

* Add tests and sample

* reformat with clang-format

* Reorder files in CMake

* load versions from version.txt

* fix crash

* Update README.md

* Use relative links

* fix CI

* Fix CI

* Try to fix CI

* Move option to the top of the file
 2020-08-27 16:16:08 +08:00
Kan Tang
53bd00034b
Added samples and more test cases to file service and resolved some issues. (#539) 2020-08-26 19:56:15 -07:00
Victor Vazquez
1f0da6fcc4
Clean routine (#530) 
* adding cleaner routine
 2020-08-26 16:51:24 -07:00
Kan Tang
2c84e3f094
Resolve some casing issue (#534) 2020-08-26 12:09:06 +08:00
Rick Winter
c5438d623b
Restructure the azure inc folder (#514) 
* Restructure the azure inc folder
 2020-08-25 20:08:34 -07:00
Kan Tang
ae6ada5cfb
Added lease support for DataLake's Path (#521) 2020-08-26 07:43:29 +08:00
Kan Tang
b87bd0816c
Added GetSubDirectory. (#524) 2020-08-26 07:43:08 +08:00
Kan Tang
9c9e631c0d
Fixed datalake/file service protocol layer remaining issues. (#523) 
* Fixed datalake build warnings on linux

* Pass context by reference instead.

* Added metadata key case check

* Fixed acronym casing.

* Fixes more acronym casing.
 2020-08-26 07:42:46 +08:00
Victor Vazquez
760c645af0
remove double checking mutex (#528) 2020-08-25 15:52:02 -07:00
Victor Vazquez
80f2c2f407
Reuse connection when calling ReadToCount() (#518) 
* change EOF for IsEOF function to avoid setting EOF after checking read everytime

* fix setting size to read

* move IsEOF to be private

* Update comment about not moving a connection back to the pool
 2020-08-25 10:06:47 -07:00
JinmingHu
cf08d39d14
Remove context from StorageError::CreateFromResponse (#511) 
* Remove context from StorageError::CreateFromResponse

* Resolved issues in datalake/file protocol layer

Co-authored-by: Tank Tang <kat@microsoft.com>
 2020-08-25 14:38:18 +08:00
Kan Tang
38241bb152
Added support for directory/file client for file service. (#510) 
* Added support for directory/file client for file service.

* Resolve multiple comments

* Resolved some further comments

* Removed ShareSnapshot

* Fixed protocol layer and integrated refined concurrent download test from blob service.

* Fixed CI issue on Linux/Mac

* Adapted to change of Storage per-retry policy.

* Removed inconsistency comparing towards other SDKs.
 2020-08-25 12:17:21 +08:00
JinmingHu
f0ece5fd7a
[Storage Blobs] Optimize blob ut (#513) 2020-08-25 10:14:20 +08:00
JinmingHu
b2dfbabd04
StoragePerRetryPolicy (#512) 2020-08-25 09:52:11 +08:00
Victor Vazquez
70eeec5984
Connection pool for keep alive (#500) 
* keep-alive. reuse same connection based on host
 2020-08-21 15:41:45 -07:00
JinmingHu
755085f25d
GetBlobServiceStatistics (#496) 2020-08-21 09:29:26 +08:00
Victor Vazquez
67abbb3728
fix clang warnings on e2e tests (#495) 2020-08-20 00:07:44 -07:00
JinmingHu
b9299478ee
[Storage Blob Service] Concurrent upload for Page Blob (#486) 2020-08-20 10:54:28 +08:00
JinmingHu
070772e7c5
Remove Content-MD5 and ContentCRC64 from Create{PageBlob|AppendBlob}Result (#487) 2020-08-20 10:52:21 +08:00
Mitch Denny
420a72a9d5
Adjust CI YAML headers (#448) 2020-08-19 13:49:45 +10:00
JinmingHu
4c5286803b
[Storage Blob Service] ORS (#467) 2020-08-19 09:13:13 +08:00
Victor Vazquez
5cb3a644a4
Thow runtime error if reading fails at FileStream (#481) 
* Handle non eof errors on Windows

* trhow on pread error for linux

* adding errno.h to fix macOS
 2020-08-18 15:16:47 -07:00
Kan Tang
e0bb037cdd
Fixed test failure due to network latency too low. (#466) 2020-08-18 11:13:39 +08:00
JinmingHu
42ffbc853e
[Storage Blobs Service] Seal Append Blob (#465) 
* seal append blob

* copy seal append blob
 2020-08-18 09:55:12 +08:00
Kan Tang
3042f69d5b
Rename return types for Datalake and file services. (#464) 2020-08-18 09:28:31 +08:00
JinmingHu
1dce74c642
[Storage Blobs Service] Undelete Container (#462) 
* Undelete Container
 2020-08-18 09:11:59 +08:00
JinmingHu
24959f30da
[Storage Blobs Service] Rename Results and Options (#460) 
* rename UploadFrom

* Rename CommitBlockListResult/Options GetBlockListResult/Options

* Rename DownloadBlobTo{Options/Result} UploadBlockBlobFrom{Options/Result}
 2020-08-17 10:06:58 +08:00
JinmingHu
86a22901e9
[Storage Blobs Service] Transactional MD5 and CRC64 (#456) 
* MD5

* Crc64

* crc64 concatenate
 2020-08-16 00:30:49 +08:00
Rick Winter
0b2b688e72
Context improvements (#457) 
* Expose the ContextValueType so callers can use it to get at key values.

* Add a const char * overload for construction

* Remove explicit conversion which adds an extra move construction.
const char* implicitly converts to std::string
 2020-08-14 13:02:16 -07:00
Victor Vazquez
e031696bce
handle size 0 chunked response (#451) 2020-08-14 09:57:42 -07:00
Victor Vazquez
311902fe25
Fix waitforsocket usage when receiving from socket (#453) 2020-08-14 09:03:54 -07:00
JinmingHu
069e359562
Rename return types and option types (#449) 
* rename return types and option types

* define ConcurrentUploadBlockBlobFromBufferOptions and ConcurrentUploadBlockBlobFromFileOptions

* use std::move

* Rename DownloadTo

* update doc

* Resolved datalake build issues.

* Resolved some cmake issue when linking

Co-authored-by: Tank Tang <kat@microsoft.com>
 2020-08-14 13:02:10 +08:00
Kan Tang
d77ecf7917
Added support for share service (#450) 2020-08-14 13:01:51 +08:00
Anton Kolesnyk
cc78776bcb
EnvironmentCredential with ClientSecretCredential support (#442) 2020-08-13 14:28:08 -07:00
Rick Winter
e3394ec3f5
Null out the union for the Undefined type (#444) 2020-08-13 13:11:17 -07:00
JinmingHu
698c4f5848
Replace old RFC1123 impl which cannot be built until GCC 5 (#440) 2020-08-13 08:17:27 +08:00
JinmingHu
a848c65933
x-ms-client-request-id header (#439) 2020-08-13 08:16:52 +08:00
JinmingHu
4c549b1a29
Fix build error (#438) 2020-08-13 08:16:21 +08:00
Rick Winter
1a32179fec
Create template project (#443) 
* Create template project
Support retrieving version from code
 2020-08-12 15:08:46 -07:00
JinmingHu
2027d5102f
add test cases for base64 encode/decode, hash wrapper (#431) 2020-08-12 10:13:16 +08:00
JinmingHu
65bd5c6bf4
use #include "" instead of #include <> (#418) 2020-08-12 10:12:48 +08:00
Anton Kolesnyk
83174eeec3
Context tweaks (#378) 2020-08-11 17:11:27 -07:00
JinmingHu
ee0b8d07b8
pass Context by const ref (#432) 2020-08-12 07:02:28 +08:00
Rick Winter
8821aadb80
Rename UUID -> Uuid (#436) 
* Rename UUID -> Uuid
Update header references
 2020-08-11 13:23:14 -07:00
Anton Kolesnyk
302bbf251e
Add authority URL support for ClientSecretCredential (#424) 2020-08-11 11:22:09 -07:00
JinmingHu
68643e3ee2
[Storage Blobs Service] Add test cases for LastModifiedTime and ETag and lease id (#425) 
* add test cases for LastModifiedTime and ETag and lease id
 2020-08-11 10:40:59 +08:00
JinmingHu
8372d39cc1
[Storage Blobs Service] Customer-Provided Key (CPK-V) and Encryption Scope (CPK-N) (#427) 
* cpk-v and cpk-n
 2020-08-11 09:45:35 +08:00
JinmingHu
a47789c311
Fix bug: CopyBlob always sends empty access-tier header (#426) 2020-08-11 07:25:09 +08:00
JinmingHu
329a30f0e3
[Storage Blob Service] integrate reliable stream (#421) 
* integrate reliable stream

* define c_reliableStreamRetryCount
 2020-08-10 16:07:38 +08:00
JinmingHu
cc0ff27eec
[Storage Blobs Service] Only make one HTTP request if the blob size is small for Concurrent Upload API (#419) 
* Only make one HTTP request if the blob size is small for Concurrent Upload API
 2020-08-08 08:44:03 +08:00
KarishmaGhiya
3060f7341c
clean up links and add link verification (#410) 2020-08-07 11:55:11 -07:00
JinmingHu
c700b7811c
[Storage Blobs Service] Blob Versioning (#409) 
* blob versioning
 2020-08-07 12:14:26 +08:00
Rick Winter
75590c6d96
Add requestId policy implementation (#239) 
* Add requestId policy implementation
Includes uuid class
 2020-08-06 15:38:53 -07:00
Victor Vazquez
a5c3f10b7d
204 http client support (#408) 
* 204 http client support

* adding test for 204 response
 2020-08-06 09:00:09 -07:00
JinmingHu
355184ef4f
[Storage Blob Service] Container Lease and Blob Lease (#402) 
* container lease

* blob lease
 2020-08-06 13:50:15 +08:00
Kan Tang
46c0af9a70
Added service prefix to file names. (#399) 2020-08-06 13:09:02 +08:00
JinmingHu
1081ed6979
Fix compiler warning (#404) 2020-08-06 07:47:36 +08:00
JinmingHu
5e596b723e
Fix compiler warning (#403) 2020-08-06 07:47:20 +08:00
JinmingHu
52dbc6b2f2
Pascal case for acronyms (#391) 2020-08-05 10:32:03 +08:00
Kan Tang
626a8856f0
Added support for get/set file service properties. (#384) 2020-08-05 10:31:48 +08:00
Victor Vazquez
eeffd6248f
update context to const ref (#389) 2020-08-04 09:45:13 -07:00
Kan Tang
3de57667d4
Added support for create/delete file shares. (#382) 
* Added support for create/delete file shares.

* Removed nullable for metadata.
 2020-08-04 09:54:04 +08:00
JinmingHu
8867c7abcb
[Storage Blob Service] Get/SetBlobContainerAccessPolicy (#381) 
* Get/SetBlobContainerAccessPolicy

* Remove ResetPermissions()
 2020-08-04 09:53:34 +08:00
JinmingHu
18b02094ed
Parse error message only from bodyBuffer (#380) 2020-08-04 09:53:22 +08:00
Victor Vazquez
5426cf7a07
Retriable stream (#369) 
* Adding retriable_stream
 2020-08-03 10:09:12 -07:00
JinmingHu
22f4ba12fc
GetAccountInfo (#371) 2020-08-03 10:32:43 +08:00
Kan Tang
1b4ea7ac70
Added file protocol layer. (#367) 
* Added file protocol layer.

* Resolved some comments.
 2020-08-01 20:23:50 -07:00
Victor Vazquez
fb729fcf10
Http/download on error (#376) 
* Download body on error response codes from request

* Adding test case for downloading body
 2020-07-31 22:11:31 -07:00
Anton Kolesnyk
4bf1f62ba8
Core logging infrastructure + logging policy + retry logging (#330) 2020-07-31 16:43:47 -07:00
JinmingHu
b9212922e7
GetBlobServiceProperties and SetBlobServiceProperties (#366) 2020-07-30 16:39:06 +08:00
JinmingHu
cbec5c6af6
Add unit test cases that require SAS token (#359) 2020-07-29 17:42:14 +08:00
JinmingHu
b0b5a18d18
User Delegation SAS (#358) 2020-07-29 16:11:21 +08:00
Victor Vazquez
6e3c3d9acf
avoid making a copy from vectorBody (#364) 2020-07-29 00:50:55 -07:00
Victor Vazquez
9563d9dd3c
Http/making upload chunk size overridle with Request option (#342) 
* adding http request option to customize the upload chunk size for bodyStream
 2020-07-29 00:16:36 -07:00
JinmingHu
b0facd3dd5
adapt to breaking change in Azure Core (#356) 
* adapt to breaking change in Azure Core

* Adapt breaking change for Datalake service.

* Adapt to the breaking change

* Adapt breaking change for Datalake service.

* fix ut

* Fixed UT.

Co-authored-by: Tank Tang <kat@microsoft.com>
 2020-07-29 14:55:53 +08:00
Victor Vazquez
d9e39a0e6e
Http/moving DownloadViaStream option to request (#362) 
* move DownloadViaStream option to Request

* Fix credentials request

* Fix unit tests

* use constructor instead of set method

* fix tests
 2020-07-28 14:10:26 -07:00
JinmingHu
9d1566c5ea
Add Account SAS and Blob SAS (#353) 
* Add Account SAS and Blob SAS

* add doc for sas

* remove Nones

* remove Nones
 2020-07-28 13:43:04 +08:00
JinmingHu
b380dfb76a
Fix inconsistent RFC1123 date format in different system locales (#352) 2020-07-27 18:49:42 -07:00
Victor Vazquez
ef0c530ee0
Pipeline/download content on pipeline to let Retry policy to handle read/get issues (#323) 
make upload chunk size custumizable
 2020-07-27 11:40:40 -07:00
Kan Tang
573ffdf1f7
Added Readme/Changelog and 3rd party notice. (#340) 2020-07-24 11:14:10 +08:00
JinmingHu
ef03d3b3ec
Rename XxxRespone->XxxInfo (#337) 
* Rename XxxRespone->XxxInfo

* fix doc, remove unused include headers, remove fab4

* Rename SetAccessTierInfo->SetBlobAccessTierInfo
 2020-07-24 09:40:15 +08:00
Kan Tang
8568327a56
Refined DataLake sample (#336) 
* Refined DataLake sample

* Added DirectoryClient::GetFileClient, resolved some comment and test failures.

* Resolved an issue introduced by lowercasing response headers resulting in error code/message not being passed, and refined sample.

* Refined the structure according to comments.

* Changed buffer initialziation to stack allocated.

* Resolved some further comments.
 2020-07-23 15:40:16 +08:00
JinmingHu
29f5e30ad3
integrate TelemetryPolicy into Blob Service (#328) 
* integrate TelemetryPolicy into Blob Service

* Also add telemetry support to ADLS Gen 2.

Co-authored-by: Tank Tang <kat@microsoft.com>
 2020-07-23 15:39:51 +08:00
Kan Tang
b0b348e9cb
Resolved API review comments and added FileClient and DirectoryClient… (#308) 
* Added API to extract raw response.

* Resolved API review comments and added FileClient and DirectoryClient for DataLake.

* Added some blob/adls Gen2 interop functionality.

* Resolved some issues/comments

* Adds more interop, support retry and concurrent upload/download.

* Added support for Azure Core's token credential to support bearer token credential.

* Added integration on RawResponse/Response<T> and resolved some test issues.

* Added validation for Client secret authentication.

* Resolved some review comments and resolved CI issue.

* Resolved a UT failure in Azure Core.

* Resolved some further comments.
 2020-07-22 16:03:44 +08:00
JinmingHu
cd023c49f0
Remove MD5 and CRC64 function interface (#324) (#329) 2020-07-22 11:27:27 +08:00
JinmingHu
4d19f3b078
Integrate Response<T> into Storage Blobs Service (#327) 
* Revert changes to storage code

* adapt to breaking changes in Azure::Core, Response->RawResponse, pipeline clone returns unique_ptr

* just to make build pass, remove this commit after https://github.com/Azure/azure-sdk-for-cpp/pull/326 is merged

* adapt to Response<T>

* concurrent upload/download also return Response<T>

* add BlobInfo and BlobContainerInfo
 2020-07-21 10:31:00 +08:00
Daniel Jurek
1a9918c4db
add CMakeLists.txt and eng to CI and PR triggers (#314) 2020-07-20 10:09:50 -07:00
JinmingHu
2c21d4b018
Remove MD5 and CRC64 function interface (#324) 2020-07-20 10:35:09 +08:00
Anton Kolesnyk
b259db5a3b
Telemetry policy (#264) 2020-07-17 17:03:47 -07:00
Victor Vazquez
6122529bac
Core/response t (#316) 
* rename http response to RawResponse

* Adding Response T
 2020-07-17 14:43:17 -07:00
JinmingHu
0f37994e44
add perf benchmark code (#319) 
* Add multithread perf testcase

* add large scale upload testcase

* Fix compiler error on GCC 9

* Fix failed testcase
 2020-07-17 11:16:18 +08:00
Rick Winter
bbbaa06b5c
Exception objects should be thrown and not the pointer to the exception object. (#322) 
Exception objects should be thrown and not the pointer to the exception object. 
   https://azure.github.io/azure-sdk/cpp_design.html#c-exceptions
The pattern for the catch expects a reference to the exception and not the pointer.

Example:
try{
   throw Myxception();
}
catch (MyException const& e) {  //process  }
 2020-07-16 15:44:34 -07:00
JinmingHu
204c025d09
suggested changes in API review (#312) 
* suggested changes in API review

* Rename UrlBuilder->UriBuilder

* add perf test case

* Integrate retrypolicy into blob clients

* remove `Content-Length` header for GET/HEAD/DELETE http requests

* Remove temp files in ut
 2020-07-16 00:49:55 -07:00
Victor Vazquez
12b389a579
Http/throw on read error (#274) 
* throw exception on Read from wire Error instead of returning -1

* throw exception if read from socket is not CURLE_OK

* missing header for Win

* fix header on windows

* Add more description to transport errors
 2020-07-15 10:27:38 -07:00
JinmingHu
3db59439c9
[Storage Blobs Service] ListBlobsByHierarchy (#265) 
* add API ListBlobsByHierarchy

* fix compiler error on GCC 8

* Update Blob API version to 2019-12-12

* use lowercase header key
 2020-07-15 10:45:22 +08:00
Victor Vazquez
0eacb230cb
Http/fix reading more than content (#311) 
* Fix reading more data than content length

* fix for head request
 2020-07-14 16:38:20 -07:00
Victor Vazquez
c0faea5f90
Http transport adapter - read all chunks from server until chunkSize is zero (#273) 
* fix for getting all chunks from a chunked response until chuksize is zero

* fix for pulling from wire when inner buffer is empty
 2020-07-13 23:00:23 -07:00
Victor Vazquez
05c91d6002
Http/missing change for to lower (#279) 
* throw exception on Read from wire Error instead of returning -1

* missing change for tolower
 2020-07-13 22:02:32 -07:00
Victor Vazquez
57bdc0f6d6
Adding toLower for header names and unit testd (#270) 2020-07-13 17:21:08 -07:00
Victor Vazquez
59d7ebabe1
Http/fix gcc 8 build (#275) 
* throw exception on Read from wire Error instead of returning -1
 2020-07-13 17:20:44 -07:00
Kan Tang
a1ec5119a6
Datalake full feature support PR. (#257) 
* Added test cases.

* Adapt stream breaking change and adding usage for Nullable.

* Resolve CI issue.

* Resolved comments from review.

* Integrate access condition support and resolve more comments.

* Resolved some further comments.

* Resolved some further comments and removed GetMetadata.
 2020-07-13 05:31:02 -07:00
Victor Vazquez
c699888daa
Make sure Read will always start on body start. (#256) 
* make stream use int64_t instead of uint64_t
 2020-07-10 23:02:18 -07:00
Anton Kolesnyk
43dcc6c495
Retry policy (#241) 2020-07-10 00:23:40 -07:00
JinmingHu
83406f23dd
Storage Blob Service Access Conditions, Bitwise enum class (#252) 
* access conditions

* bitwise enum class

* Update x-ms-date on each retry

* add a header for all constant strings

* fix some ut

* rename ModifiedTimeAccessConditons->LastModifiedTimeAccessConditions
 2020-07-09 21:03:32 -07:00
Billy O'Neal
f6defdf25a
Add tests and locale invariant string equal function in support of the 'extensible enum' guideline. (#197) 
* Add locale invariant string equal function in support of the 'extensible enum' guideline.

* Resolve gcc narrowing warning.

* Fix case flipping table to go the correct direction 😳

* organize tests and add one test for invariant locale compare as exaple

* Add more test cases.

* Move to Details namespace.
 2020-07-08 22:34:29 -07:00
JinmingHu
90d4ee3203
Add constructor for HttpPipeline which accepts rvalue (#165) 2020-07-08 09:18:33 -07:00
JinmingHu
95aa6361ef
Concurrent upload block blob from file, concurrent download blob to file (#247) 
* concurrent download to file

* concurrent upload block blob from file

* update sample

* Change default download chunk size from 8MB to 4MB

* fix CI
 2020-07-08 13:26:22 +08:00
JinmingHu
66c7518dce
Suggested changes in API review (#244) 
* Rename Properties->HttpHeaders

* Rename BlobXxxItems->Items

* Remove MaxResults in response of list operations

* specify time format in comments for GetUSerDelegationKey API

* per operation pipelines and per retry pipelines

* Define some response types and rename ListBlobsFlat

* Add different return types for some APIs

* Rename BlobDownloadInfo->BlobDownloadResponse

* Assign default value to BlobContentLength to supporess compiler warnings

* add concurrent download to buffer

* concurrent upload block blob from buffer
 2020-07-07 10:54:05 +08:00
Victor Vazquez
9fb4119ccb
Memory Stream - File Stream (win/lin) - HTTP Request / Response - Updates (#236) 
* make stream use int64_t instead of uint64_t
 2020-07-03 22:22:16 -07:00
Chidozie Ononiwu
c22e4f8386
Clean up azure-sdk-tools and reduce dependency on external resources (#228) 2020-07-02 14:20:12 -07:00
JinmingHu
e61c3ff51a
Documentation for BlockBlobClient and Blob options (#235) 
* Documentation for blob options

* Rename struct UploadBlobOptions -> UploadBlockBlobOptions

* documentation for BlockBlobClient
 2020-07-02 10:01:27 +08:00
JinmingHu
74ce80659b
Documentation for Storage Blob Service, Nullable, signed int, and others (#213) 
* use Nullable

* use C++ style cast

* Add documentation

* use signed int instead of unsigned

* disable storage ut

* add timeout in protocol layer

* enable stroage ut

* undelete test case

* Support copy status in properties

* Remove default value for SequenceNumber in CreatePageBlobOptions
 2020-06-30 03:03:42 -07:00
Victor Vazquez
2877c959e1
Enable storage unit tests (#227) 
* enable core unit tests to be compiled
* Avoid running core unit tests in CI
 2020-06-29 14:19:46 -07:00
Victor Vazquez
d58cbad14d
Unique ptr for body stream (#214) 
* change bodyStream to unique ptr
 2020-06-29 10:33:31 -07:00
Anton Kolesnyk
ad2e63afe1
Remake ClientSecretCredential (#212) 2020-06-27 15:27:11 -07:00
Daniel Jurek
0cfcdca725
Unified Pipelines for storage (#184) 
* Add ci.yml for storage

* OSVmImage

* Use correct name for storage

* Update ci.ymls

* Documentation generation

* Fix tabbing

* More tabbing

* Use correct service directory for storage ci.yml

* Add docs assets

* Use cpp for dropdown generation

* Use cmake to generate documentation

* Use CMake to generate doxygen docs

* BuildArgs -> GenerateArgs

* Correct template path

* More CURL options

* Install curl to satisfy minimum build requirements

* use dependency variable name

* Add VCPKG_DEFAULT_TRIPLET

* Always generate documentaion when -DBUILD_DOCUMENTATION=YES

* Build docs at top level

* Change variable names, simplify cmake-build.yml

* -DBUILD_DOCUMENTATION

* Try using MathJax for formula rendering instead of Latex

* Add version.txt for storage

* artifact.Name -> artifact.Path

* Build docs by target

* Remove Doxyfile

* Remove Doxyfile.template

* Remove generate_docs.py, we are using cmake

* Pass CtestRegex to archetype-sdk-client job template)
 2020-06-26 10:42:48 -07:00
Rick Winter
078cbc2205
Fix for non-msvc std lib (#222) 2020-06-26 09:45:29 -07:00
Rick Winter
692cab5651
Nullable type (#204) 
* Nullable type
Add Nullable type and tests
 2020-06-25 13:58:27 -07:00
Kan Tang
1564e5106e
Resolved comments and rewrote StorageError. (#199) 
* Resolved comments and rewrote StorageError.

* Changed Upn name, removed ';', refined error output, moved local function to unamed namespace.
 2020-06-24 08:54:06 -07:00
JinmingHu
f74011a2e0
Add Unittest for Blob Service, other fixes and enhancements found during validation (#181) 
* Give AccessTier a default value to eliminate warning

* Add blob clients conversion functions

* Fix bug in shared key authentication

* Add GetUri().

* make lease-status and lease-state optional

* Check duplicates in metadata

* add tests for blob service

* AppendBlocb doesn't support AccessTier

* fix bug in "RangeFromXml"

* redefine PageRange in convenience layer

* suppress warnings from gtest

* add API AppendBlockFromUri

* connection string parsing

* Add memorystream

* Rename connection string constants

* Adapt to new bodystream, this will be rewritten when bosystream is changed to unique_ptr

* fix compiler errors

* Change MemoryStream interface

* samples framework

* Add newline at the end of file

* fix compiler error
 2020-06-24 01:17:09 -07:00
Victor Vazquez
e1e88b3984
Support for requests with no body (#202) 
* avoid fail if no body in request

* request with no body

* fix for win86

* Update sdk/samples/http_client/curl/src/azure_core_with_curl_bodyBuffer.cpp

Co-authored-by: Rick Winter <rick.winter@microsoft.com>

Co-authored-by: Rick Winter <rick.winter@microsoft.com>
 2020-06-22 18:38:35 -07:00
Victor Vazquez
90345e090c
fix the number of bytes that are read by stream (#203) 2020-06-22 18:24:09 -07:00
Victor Vazquez
e5e063f88c
support no path request (#201) 2020-06-22 18:23:42 -07:00
Victor Vazquez
614fa143ba
adding host header automatically if missing for libcurl transport (#200) 2020-06-22 18:23:30 -07:00
Kan Tang
a8a200ef26
Added convenience layer for datalake service (#178) 2020-06-20 19:55:41 -07:00
Victor Vazquez
90e57362bf
Victor/http/add streams (#183) 
* Adding body Stream for HTTP
* Adding libcurl session with custom send and receive
 2020-06-18 21:43:00 -07:00
JinmingHu
5758bedc5c
Export symbols when building dll (#177) 2020-06-16 13:28:37 +08:00
JinmingHu
4366159c50
Add more APIs in storage sdk (#169) 
* Add xml serializer/deserializer

* Add blob service client, add undelete, set access tier, start copy, abort copy, create snapshot, stage block from uri

* add support for conditional headers

* support range download

* Change the helper functions order to alphabetical

so that we always get the same result in different environemnts.

* use c++ casting

* Add support for append blob and page blob

* remove redundant ; added by auto-generator

* Remove BlobType in BlockBlob::Upload

* Rename blob_client_options.hpp->blob_options.hpp

* Remove API version in request options
 2020-06-15 17:31:36 +08:00
Kan Tang
18408f848a
Adding ADLS gen2 protocol layer code. (#153) 
* Adding test framework for azure storage.

* Adding ADLS gen2 protocol layer code.
 2020-06-09 06:31:12 -07:00
JinmingHu
401298577e
Shared Key Authentication Policy (#160) 
* Remove Date in request options, assign x-ms-version a default value

* reformat files with clang-format

* Add shared key policy and basic request policy

* Add openssl dependency for linux and macOS

* add some comments, some slight fixes

* Rename CommonRequestPolicy -> CommonHeaderRequestPolicy
 2020-06-09 03:38:35 -07:00
Kan Tang
6e01498038
Adding test framework for azure storage. (#152) 2020-06-09 02:45:11 -07:00
JinmingHu
11f842bfbe
Add support for HTTP methods to unblock storage team (#158) 
* Support all HTTP methods

* Add const qualifier

* fix compiler error on some platforms
 2020-06-04 09:44:40 -07:00
JinmingHu
5fc6fea9f4
Auto-generated protocol layer of Container and BlockBlob (#144) 
* add blob service auto generated protocol layer

* Add storage uri builder

* integrate with pipeline

* Add libxml2 dependency

* Fix variables name

* Rename variable and function name

* Move xxx_options.hpp out of internal directory

* Rename FromConnectionString -> CreateFromConnectionString
 2020-06-04 13:21:08 +08:00
JinmingHu
502d3f15a9
Use move to initialize the body buffer (#150) 2020-06-03 10:13:26 -07:00
Rick Winter
602f75744a
HttpPipeline and HttpPolicies (#63) 
* HttpPipeline
 2020-05-29 10:57:10 -07:00
Kan Tang
0b1eb288db
Use move to initialize the body buffer (#148) 2020-05-28 09:18:54 -07:00
JinmingHu
39f7c37e90
Discard the space after colon in HTTP respone headers (#143) 
* Discard the space after colon in HTTP respone headers

* also discard tab
 2020-05-28 09:11:46 -07:00
Victor Vazquez
c19f9e2b05
Adding writing response from curl to buffer (#64) 
* write headers and response code to Response
 2020-05-20 14:48:26 -07:00
Rick Winter
5350d1dbf8
Fix namespace case and file formating (#98) 2020-05-12 11:04:59 -07:00
Rick Winter
6b7b428e71
Fix casing on enum (#94) 
* Fix casing on enum
* Update tests
 2020-05-08 10:49:30 -07:00
Anton Kolesnyk
55deee50ec
Move scopes to ClientSecret credential, fix multi threading, 'CoW' token that is shared between copies (#62) 2020-04-06 11:08:53 -07:00
Victor Vazquez
61b8cdc3d4
Adding curl and nohttp transport options (#54) 
* http client
 2020-04-02 11:05:26 -07:00
Anton Kolesnyk
9631e5978a
Add credential classes (#42) 2020-04-01 15:51:24 -07:00
Danny Amirault
a6bb11ed01
Remove dependancy on azure-sdk-build-tools (#58) 2020-04-01 09:01:40 -07:00
Danny Amirault
00b8ba52b3
Auto update package versions upon release generation (#52) 
* Auto update package versions upon release generation
- Adapted from .Net package incrementing
 - https://github.com/Azure/azure-sdk-for-net/blob/master/eng/Update-PkgVersion.ps1
- Seed Changelog file to allow updates to happen

* Spelling fix
 2020-03-31 09:58:06 -07:00
Victor Vazquez
9f1493af27
Adding http request (#41) 
* adding gtest framework

* http request
 2020-03-26 11:38:07 -07:00
Danny Amirault
2708ca8f11
Specify artifact path in YML to locate artifact files correctly (#45) 
* Specify artifact path in YML to locate artifact files correctly

* Remove doc generation for now
 2020-03-25 12:41:15 -07:00
Victor Vazquez
7971d525df
Victor/core/basic structure for cmake to work (#37) 
* moving files and updating cmake to make it compilable
 2020-03-18 15:39:36 -07:00
Danny Amirault
5dff0dad92
Initial CI pipeline work (#36) 
* Replicate C pipeline files to CPP

* Adjust to build CPP

* Remove pipeline pieces copied from C that are not needed for C++ build.

* Remove extraneous debugging step.
 2020-03-18 13:32:30 -07:00
Victor Vazquez
010038a342
moving files and updating cmake to make it compilable (#35) 
* moving files and updating cmake to make it compilable

* Adding http namespace
 2020-03-18 10:58:28 -07:00
Rick Winter
5ee2b47171
Add simple contract implementation 2020-03-17 11:44:40 -07:00
Rick Winter
5fb8226875
Core namespace casing (#12) 2020-02-25 09:01:21 -08:00
Anton Kolesnyk
67a110a055 End namespace comment 2020-02-24 17:53:51 -08:00
Anton Kolesnyk
50d0998a79 Apply style 2020-02-24 17:46:42 -08:00
Anton Kolesnyk
cf249bcc8d Use the same clangformat we ended up using in the Embedded C99 SDK 2020-02-24 17:42:48 -08:00
Rick Winter
eab3352932
Add Core scaffolding 2020-02-20 12:10:01 -08:00