Commit Graph

446 Commits

Author SHA1 Message Date
Kan Tang
e23e9333c8
Integrate DateTime into Storage's file service. (#1154) 2020-12-22 15:38:46 +08:00
JinmingHu
37b55c1e11
HttpHeaders.ContentMd5 is changed to Contenthash (#1241)
* HttpHeaders.ContentMd5 is changed to Contenthash

* changelog
2020-12-22 15:13:20 +08:00
Kan Tang
d9c65ac445
ContentHash integration for File/DataLake (#1236)
* Integrate content hash for file/datalake

* Changelog update for content hash in file/datalake

* Resolve minor build error/warning.

* Resolved review comments
2020-12-22 11:30:31 +08:00
JinmingHu
9a59445888
rename some bool variables, make IsServerEncrypted non-nullable (#1238)
* rename some bool variables, make IsServerEncrypted non-nullable
* remove encryption stuff from ClearPages response, since this API never returns these stuff
2020-12-22 10:02:29 +08:00
JinmingHu
763f38549b
Fix build error caused by storage-common CMakeFile (#1233)
# Pull Request Checklist

Please leverage this checklist as a reminder to address commonly occurring feedback when submitting a pull request to make sure your PR can be reviewed quickly:

See the detailed list in the [contributing guide](https://github.com/Azure/azure-sdk-for-cpp/blob/master/CONTRIBUTING.md#pull-requests).

- [x] [C++ Guidelines](https://azure.github.io/azure-sdk/cpp_introduction.html)
- [x] Doxygen docs
- [x] Unit tests
- [x] No unwanted commits/changes
- [x] Descriptive title/description
  - [x] PR is single purpose
  - [x] Related issue listed
- [x] Comments in source
- [x] No typos
- [x] Update changelog
- [x] Not work-in-progress
- [x] External references or docs updated
- [x] Self review of PR done
- [x] Any breaking changes?
2020-12-19 07:26:06 +00:00
Victor Vazquez
606dd98ea2
Adding missing lib for building tests with Ninja from command prompt (#1230)
fixes: #1228
2020-12-19 04:45:51 +00:00
Anton Kolesnyk
bdc2931855
Token: use DateTime (#1221) 2020-12-18 19:10:54 -08:00
Anton Kolesnyk
d40b4fb642
DateTime: add default constructor (#1220) 2020-12-18 18:21:24 -08:00
Anton Kolesnyk
e3d8719281
Fix gtest and related warnings (#1224) 2020-12-18 18:20:02 -08:00
Victor Vazquez
1502468dba
Reuse connection pool depending on host and connection options (#1189)
* Reuse connection pool depending on host and connection options
2020-12-18 17:27:47 -08:00
Victor Vazquez
5525d68a15
Fix main ut tests when not using libcurl (#1227)
* Fix for test cases when not using libcurl
2020-12-18 17:18:35 -08:00
Anton Kolesnyk
89351e4484
AuthenticationException: derives from std::exception (#1222)
Closes #1178
2020-12-19 00:42:00 +00:00
Marcelo Juchem
2443e7cfcb
fix curl dependency on non-standard install prefix (#1218)
* fix curl dependency on non-standard install prefix

When `libcurl` is installed to a non-standard install prefix `azure-core` will configure include/lib directories correctly (as long as `CMAKE_FIND_ROOT_PATH` is set appropriately) for its dependencies (`INTERFACE`) but not for itself (`PRIVATE`), thus failing the build.
2020-12-18 15:25:55 -08:00
Victor Vazquez
62949025b1
Merge param-tests for the transport adapter (#1217)
fixes: #1216 
fixes: #1087
2020-12-18 22:21:40 +00:00
Anton Kolesnyk
324c0955f0
List all possible environment variables EnvironmentCredential reads, or may ever read from (#1219) 2020-12-18 11:13:54 -08:00
Victor Vazquez
78df96ab6c
removed e2e core tests (#1215) 2020-12-18 11:02:10 -08:00
Victor Vazquez
0d312028ce
Check if error during test after opening a file (#1205)
fixes: #1074
2020-12-18 18:42:16 +00:00
JinmingHu
b59b65bb87
Add ContentHash struct, replace TransactionalContentMD5 and TransactionContentCrc64 with TransactionalContentHash (#1212)
* use std::vector<uint8_t> for binary input/output

* struct ContentHash

* ContentHash in Blob Service

* Update sdk/storage/azure-storage-common/src/crypt.cpp

* Update sdk/storage/azure-storage-common/src/crypt.cpp

* add doc

* changelog

* EncryptionKeySha256 and ContentMd5 are changed to binary

* changelog

* fix build error

* fix crash issue

* FIX BUILD ERROR on linux

* Fix bug on Linux

* fix bug
2020-12-18 16:09:35 +08:00
Rick Winter
60e70a3695
Fix doxygen comments for Operation<T> (#1210) 2020-12-18 02:39:55 +00:00
Victor Vazquez
8aac9091c2
Mention min clang format version and format all cpp and hpp files with clang-format version 9.0 (#1208)
* Add info about clang-format version

* updates for cpp and hpp format

* special cases
2020-12-17 18:34:23 -08:00
Victor Vazquez
6a317e8b87
Move the default transport adapter assignation to the source (#1206)
fixes: #1169
2020-12-18 02:13:03 +00:00
JinmingHu
7d2cc26553
improve CMake (#1167) 2020-12-18 09:20:27 +08:00
Victor Vazquez
942c6aaffa
replace ifdef for if defined (#1199)
fixes: #1057
2020-12-17 22:57:40 +00:00
Rick Winter
bcb684f95e
Add Operation<T> (#1186)
* Add Operation<T>
2020-12-17 14:47:20 -08:00
Victor Vazquez
20954d5dba
unify fileBodyStream in one single definition for Win and Lin (#1198)
* unify fileBodyStream in one single definition for Win and Lin
2020-12-17 11:23:01 -08:00
JinmingHu
d9c05e3d06
replace #ifdef/#ifndef with #if defined() in storage (#1203) 2020-12-17 18:51:01 +08:00
JinmingHu
e1a9ba9b4d
move sas stuff into Sas namespace (#1192)
* move sas stuff into Sas namespace

* changelog

* Update sdk/storage/azure-storage-blobs/CHANGELOG.md

* Update sdk/storage/azure-storage-common/CHANGELOG.md

* Update sdk/storage/azure-storage-files-datalake/CHANGELOG.md

* Update sdk/storage/azure-storage-files-shares/CHANGELOG.md
2020-12-17 09:51:59 +08:00
Victor Vazquez
1bfbaf7330
use gtest_discover_tests for creating tests (#1195) 2020-12-16 15:00:01 -08:00
Victor Vazquez
dacd6aa6c1
Added HTTP Range (#1188)
* Added HTTP Rangeom>
2020-12-16 14:27:17 -08:00
Victor Vazquez
fc7d52926a
init fields to avoid MSVC warning (#1172)
Fixes: https://github.com/Azure/azure-sdk-for-cpp/issues/922
2020-12-15 22:21:24 +00:00
Victor Vazquez
8cd93803c4
Remove libcurl non required options (#1153)
Fixes: https://github.com/azure/azure-sdk-for-cpp/issues/931
2020-12-15 22:08:48 +00:00
Victor Vazquez
0b9befe13d
update default value to true for the SDK CurlTransportSSLOptions -> NoRevoke (#1181)
fixes: #1101
2020-12-15 01:01:12 +00:00
Ahson Khan
f2394ddb02
Following the guidelines, use quotes for files within the same project, and angle brackets for external dependencies. (#1150) 2020-12-11 14:04:59 -08:00
Anton Kolesnyk
3eae7c130c
Add VcPkg support (#1013) 2020-12-11 11:53:37 -08:00
Ahson Khan
c22392e943
Add context.IsCanceled to provide a non-throwing alternative to ThrowIfCanceled. (#1106) 2020-12-10 23:01:12 +00:00
Ahson Khan
0f854ffa9b
Add WinHTTP Transport support to the SDK for windows clients as another HTTP Transport. (#897)
Fixes https://github.com/Azure/azure-sdk-for-cpp/issues/354
2020-12-10 22:00:52 +00:00
Victor Vazquez
8f03807101
Use the default coverage report path (#1118) 2020-12-09 14:42:55 -08:00
Anton Kolesnyk
828bb4098a
Make changes towards making libraries individually buildable (#1108) 2020-12-09 04:02:29 -08:00
Kan Tang
414a5769f1
Resolved a test error hidden by connection reuse. (#1095) 2020-12-09 20:01:46 +08:00
JinmingHu
5e04553a31
disable unstable test (#1109) 2020-12-09 17:54:51 +08:00
JinmingHu
09e174865a
replace * with - (#1110) 2020-12-09 16:15:25 +08:00
Anton Kolesnyk
035ba8509c
Move BearerTokenAuthenticationPolicy to Http namespace/policy.hpp (#1104) 2020-12-08 17:04:03 -08:00
Anton Kolesnyk
d20d5eb139
Check for BUILD_TESTING and BUILD_SAMPLES inside Storage's cmakefiles (#1071) 2020-12-08 12:34:14 -08:00
JinmingHu
24c0e72601
GetPageRangesDiff and GetManagedDiskRangesDiff (#1090)
* GetPageRangesDiff GetManagedDiskRangesDiff
2020-12-08 13:35:05 +08:00
Anton Kolesnyk
bbe4b54528
Do not use ${TARGET_NAME} unless necessary (#1094) 2020-12-07 20:20:06 -08:00
Anton Kolesnyk
d1f162f9e3
Fix typo (#1091)
This change was extracted from #1013, in order to isolate some of the changes.
2020-12-08 03:56:21 +00:00
Anton Kolesnyk
46419412c3
Use CONFIG QUIET when looking for packages (#1092)
This change was extracted from #1013, in order to isolate some of the changes.
2020-12-08 03:55:21 +00:00
Ahson Khan
dd65f20a1f
Try to remove the dependency on a curl header in client secret credential implementation (#1086)
Ideally, there should be no direct dependency on a specific transport adapter, even in the implementation.
2020-12-07 15:07:14 -08:00
Victor Vazquez
4cc1754b63
fix warning while building master (#1083) 2020-12-04 16:08:18 -08:00
Anton Kolesnyk
ce98087f7e
Don't use WINDOWS/POSIX/NOMINMAX macros defined in cmake, move them to source code instead (#1070) 2020-12-04 11:55:59 -08:00
Victor Vazquez
3ca1104e91
use INCLUDE_DISABLED_TESTS for disabling tests (#1077)
* use INCLUDE_DISABLED_TESTS for disabling tests
2020-12-04 10:58:52 -08:00
Anton Kolesnyk
9d3b488524
Remove last pieces of Storage libs dependency on Identity (#1079) 2020-12-03 22:21:47 -08:00
Anton Kolesnyk
7d6d3dbf8f
Make SDK buildable in VS 2017 (#1078) 2020-12-03 19:16:18 -08:00
Victor Vazquez
34146cc7af
disable problematic test until it gets fixed (#1065)
Temporal patch for https://github.com/azure/azure-sdk-for-cpp/issues/1060.
2020-12-03 20:05:11 +00:00
JinmingHu
222967cc89
new field IsHnsEnabled in AccountInfo (#1068) 2020-12-03 05:53:52 +00:00
Kan Tang
72a6ea98a9
Update Readme for nlohmann-json. (#1069) 2020-12-03 04:22:15 +00:00
JinmingHu
9febf43832
CreateIfNotExists and DeleteIfExists (#1059)
* CreateIfNotExists DeleteIfExists for containers

* DeleteIfExists for blobs

* CreateIfNotExists for append blob

* CreateIfNotExists for page blob

* changelog
2020-12-03 11:19:52 +08:00
Victor Vazquez
c3afb7798f
Remove CMake nlohmann module (#1042)
fixes: https://github.com/Azure/azure-sdk-for-cpp/issues/1041

Make nlohmann a 3rd party required lib. Do not fetch it with CMake if it is not found
2020-12-03 01:52:56 +00:00
JinmingHu
46ce66d150
case-insensitive metadata (#1050)
* case-insensitive metadata

* Added support for case insensitive metadata for file/datalake service

Co-authored-by: Tank Tang <kat@microsoft.com>
2020-12-03 09:49:33 +08:00
Victor Vazquez
3822ca8729
use private as suffix for private headers (#1040)
fixes: https://github.com/Azure/azure-sdk-for-cpp/issues/1039

Adding `private` suffix for private headers.

Updating core test CMake script to include the /src folder from CORE to expose the private headers to the tests. Then tests don't need to do relative-path includes.
2020-12-03 01:16:46 +00:00
Anton Kolesnyk
d61e106e89
Remove alternative token usage (#1053) 2020-12-02 16:14:17 -08:00
JinmingHu
31cd0d1e76
sas raw permissions (#1036) 2020-12-02 13:32:28 +08:00
JinmingHu
d0b128049d
Move StoragePerRetryPolicy and SharedKeyPolicy to Details namespace (#1046)
* move some policies to Details namespace

* changelog

* move StorageRetryPolicy to Details namespace

* changelog
2020-12-02 10:19:23 +08:00
Kan Tang
96892d9923
Resolved some API review comments from Arch board on File Share service. (#1033) 2020-12-02 10:18:41 +08:00
JinmingHu
4e38e8961e
fix typo (#1045) 2020-12-02 08:15:18 +08:00
JinmingHu
9b83bec0b4
rename variables for append blob access condition (#1035)
* rename variables for append blob access condition

* changelog
2020-12-01 10:14:18 +08:00
JinmingHu
f378a3a467
block id list now is a vector of strings (#1034)
* block id list now is a vector of strings

* changelog
2020-12-01 09:57:49 +08:00
Victor Vazquez
cc75233a54
Remove curl transport adapter models and private headers form public layer (#1023) 2020-11-30 15:54:21 -08:00
JinmingHu
85fb3e3530
Add "Blob" before every "Container" (#1028)
* Add "Blob" before every "Container"

* rename more

* rename more

* more

* more

* changelog
2020-11-26 18:46:21 +08:00
JinmingHu
4de5bcff96
rename SharedKeyCredential -> StorageSharedKeyCredential (#1025)
* rename SharedKeyCredential -> StorageSharedKeyCredential

* fix

* rename
2020-11-26 14:32:58 +08:00
JinmingHu
be601f2cdd
fix parameter name case (#1024)
* fix parameter name case

* more
2020-11-26 14:32:43 +08:00
Kan Tang
50170a062d
Removed client secret credential support for file service. (#1015)
* Removed client secret credential support for file service.

* Removed #include "azure/identity/client_secret_credential.hpp"
2020-11-26 14:06:48 +08:00
Victor Vazquez
c9c12e27aa
let azure core provide json interface (#1004)
* let azure core provide json interface
2020-11-24 15:55:46 -08:00
Kan Tang
847e769576
Add more test cases to increase datalake service test coverage. (#1014)
* Add more test cases to increase datalake service test coverage.

* add coverage for download to file.

* Reformat the include files.
2020-11-24 15:51:32 +08:00
Kan Tang
fdc06b978d
Removed Share Lease due to it not supported until STG 76 (#1016)
* Removed Share Lease due to it not supported until STG 76

* Update breaking change.

* Added removed APIs list in change log.
2020-11-24 13:39:02 +08:00
Kan Tang
7c8d40bddf
Resolve protocol layer latest comment proposed changes from review. (#1003)
* Removed c_ in datalake/file's protocol layer

* Changed to use Azure::Core's ToLower
2020-11-23 12:42:34 +08:00
Gabor Gyimesi
50806328d6
Fix linker error of missing pthread on Linux (#980) 2020-11-20 00:07:59 -08:00
JinmingHu
fadb43e664
remove c_ (#1000)
* remove c_

* remove more c_

* remove more
2020-11-20 12:24:23 +08:00
JinmingHu
2b56b8b026
clients accept TokenCredential as param (#998) 2020-11-20 12:24:04 +08:00
JinmingHu
9fae36a4f7
rename uri->url (#997) 2020-11-20 10:55:10 +08:00
JinmingHu
980f858676
AccessConditions as a member (#996) 2020-11-20 10:54:27 +08:00
JinmingHu
c6da8da8c7
Rename Get{Block/Append/Page}BlobClient -> As{Block/Append/Page}BlobClient (#995) 2020-11-20 10:46:13 +08:00
Victor Vazquez
ac09ee6f44
Fix coverage report for template and core pipelines (#1002)
Root Cause:
Storage project generates coverage files in a different location (sdk/*/*cov_xml.xml) from where Core and Template (sdk/*/*/*cov_xml.xml). Basically one level up.

When I added the coverage for Storage, I didn’t know we were also running live tests for Core and Template pipelines. It failed on them because the xml files were not found.

In the PR, I add a new parameter to pipelines to change the default path, and also I am disabling LiveTests from Core and Template, since it only runs the same thing that we run on CI pipelines (We can enable it if we ever have some live tests)


fix: #1001
2020-11-19 20:19:57 +00:00
JinmingHu
91c6116ead
fix (#994) 2020-11-19 09:34:44 +08:00
Victor Vazquez
b8d9d42e5a
Update Notice and add cgmanifest.json (#839)
* Update Notice and add cgmanifest.json
2020-11-18 11:44:22 -08:00
Victor Vazquez
84f690e968
Allow exclude for codecoverage (#939)
* Add support for EXCLUDE path from code coverage

* code coverage for live tests
2020-11-18 09:57:56 -08:00
Kan Tang
d906a89310
Updated Readme to reflect the change of default triplet. (#986) 2020-11-18 15:38:17 +08:00
JinmingHu
801e072e42
Blob test enhancements (#987) 2020-11-17 14:36:43 +08:00
JinmingHu
485b526a26
unify blob client options (#989)
* unify blob client options

* Unified client options is datalake/files and adapt blob breaking change.

Co-authored-by: Tank Tang <kat@microsoft.com>
2020-11-17 14:35:27 +08:00
Gabor Gyimesi
a716e094fe
Fix default EndpointSuffix when parsing connection string (#981) 2020-11-16 09:58:01 +08:00
Azure SDK Bot
e0ddcfec89
Increment version for storage releases (#979)
* Increment package version after release of azure-storage-common

* Increment package version after release of azure-storage-blobs

* Increment package version after release of azure-storage-files-datalake

* Increment package version after release of azure-storage-files-shares
2020-11-13 13:15:48 -08:00
Ahson Khan
498d8429df
Add a simplified identity header. (#971)
* Add a simplified identity header.

* Update the CL.
2020-11-13 13:14:57 -08:00
Kan Tang
a96f4c6f7d
Changelog update for file/datalake service for beta.5 (#978)
* Changelog update for file/datalake service for beta.5

* Resolved review comments and refined the documentation.

* Add full stops.

* Moved bug fix below the features/breaking change section.
2020-11-13 14:55:21 +08:00
Kan Tang
206c8fb2d8
Changed version string for beta.5 release. (#973) 2020-11-13 13:15:16 +08:00
JinmingHu
c32f9b0cb2
changelog for storage common and blob (#974) 2020-11-13 13:13:31 +08:00
Kan Tang
97af13d7e6
Moved model types in file share service into Models namespace. (#965) 2020-11-13 10:52:00 +08:00
Kan Tang
216c88483a
Moved model types in datalake service into Models namespace. (#966) 2020-11-13 10:51:43 +08:00
Anton Kolesnyk
bbfffc5e46
Remove DateTime::operator Duration() (#967)
No need for it, other than the unit tests, which still can get it by subtracting epoch.
(https://github.com/Azure/azure-sdk-for-cpp/pull/938/files#r522344899)
2020-11-12 20:09:00 +00:00
Anton Kolesnyk
78e34a2189
Update/correct DateTime exception documentation (#950) 2020-11-12 01:59:14 -08:00
JinmingHu
2eff3aa1b1
rename ToSasQueryParameters->GenerateSasToken (#958) 2020-11-12 08:30:04 +00:00