Commit Graph

1558 Commits

Author SHA1 Message Date
Victor Vazquez
a4f2e510e5
Adding timeout option (#2991) 2021-10-25 12:12:53 -07:00
Victor Vazquez
f90ab8a9b5
Add Storage Performance tests for DownloadTo API (#2987)
Adding 3 new tests for Storage Performance
The next tests are expected to find out the overhead between each layer of the Azure SDK client while performing a download operation. The current performance test is measuring the client + azure core pipeline + http transport.

The next tests removes authentication policy and then each layer up to the HTTP transport adapter directly.

DownloadBlobSas
Generates a SaS token to download a blob. This way the authentication policy "sharedKey" won't run in the pipeline.

DownloadBlobWithPipelineOnly
Use the SaS token as well but send the request without the BlobClient. Instead it uses the Azure Core Pipeline directly

DownloadBlobWithTransportOnly
Same as before, the SaS token is used to download the blob but consuming only the libcurl-transport adapter. This option skips the HttpPipeline. The only elements used from Azure Core are the HttpRequest and the Azure::Context

Note
porting tests from the .NET equivalent:

https://github.com/Azure/azure-sdk-for-net/blob/main/sdk/storage/Azure.Storage.Blobs/perf/Azure.Storage.Blobs.Perf/Scenarios/DownloadSasUriBlobClient.cs

https://github.com/Azure/azure-sdk-for-net/blob/main/sdk/storage/Azure.Storage.Blobs/perf/Azure.Storage.Blobs.Perf/Scenarios/DownloadSasUriHttpClient.cs

https://github.com/Azure/azure-sdk-for-net/blob/main/sdk/storage/Azure.Storage.Blobs/perf/Azure.Storage.Blobs.Perf/Scenarios/DownloadSasUriHttpPipeline.cs
2021-10-25 11:48:55 -07:00
Azure SDK Bot
3fdf66bb55
Fully automate cluster buildout. Add azure file share mount to stress tests. (#2989)
Co-authored-by: Ben Broderick Phillips <bebroder@microsoft.com>
2021-10-22 18:05:57 -04:00
Daniel Jurek
c534a1e160
Cognitive Matrix Consolidation (#2947)
* Refactor template to use multiple builds on the same machine resetting the machine and runtime varaibles along the way

Move template expression out of default matrix parameters

Remove extra reference to ci/jobs.yml

Remove unnecessary ci.yml, change param declaration in devops-variables-set.yml

Heredoc

Fix set/reset scripts after testing with devops outputs

-ErrorAction Ignore

Smaller matrix

OsVMImage comes from machine, not parameters

Add Ubuntu 20 to matrix

Remove checkout: self, it is implied

Move machine-setup steps outside of loop

CODE_COVERAGE handling

tab

Remove creation of CODE_COVERAGE

Use AptDependencies and add apt update to dependency install step

Remove extra preparation steps

Enable code coverage check scenario

Add MacOS 11

Disable vcpkg cache

Coverage configuration

Pass parameter properly

bool -> boolean

Install coverage tools if it's possible that coverage may run

More logging on code coverage

Show contents of Makefile

One vcpkg to build them all

Verbose

SourcesDirectory

Nesting VcpkgInstall

workingDirectory for vcpkg install

AptDependencies

complete the conditional

Enable all matrix entries

sudo

Remove extra chatter

More scrubbing post-build to help with Windows scenarios

sudo echo

Get-ChildItem

ErrorAction

sudo sh -c

More ErrorAction

output sourceListFile

Disable additional sources.list

Install coverage tools when used for coverage

COndition

Do not build testing for Windows arm64

Correct path for coverage tools

ne -> eq

Add more scenarios to the matrix

Remove libxml2

Add MacOS 10.15 to matrix

Revert "Remove libxml2"

This reverts commit 178af8b89abb21ee84dbcd25b4d54bd90ec1d44c.

Add libxml2 to MacOS 10.15 matrix entry

Display name decorator, refine the matrix

Remove OsVmImage variable

Add commentary to tests about matrix

Rebalance matrix, nest EnvVars, DisplayNameDecorator

Correct parameter access

AptDependencies

Ensure building for WindowsStore in UWP builds, Only build tests for debug builds in altered matrix entires, Linux build type specified as environment variable

Rebalance matrix for better timing

Remove all instances of libxml2 in vcpkg dependencies

Move common devops tasks to eng/common

Set eng/common paths in pipelines

Revert "Remove all instances of libxml2 in vcpkg dependencies"

This reverts commit 35ffbc7aac87f400fdf3351076346750c1c750ed.

https://github.com/Azure/azure-sdk-for-cpp/issues/2946

Permit words like iname in more pipeline .yml files

Remove libxml2 from vcpkg dependencies for Windows

Perf test matrix maxParallel: 10

Validate

apt install first

apt install first

maxParallel: 12

-j 8

-j 10

Use matrix generator

Add expected parameters

Move parameters to appropriate file, fix cloud spec

Specify correct platform matrix location

DependsOn

Platform matrix

Remove DisplayNameDecorator, try more clang information

Rapid iteration matrix

clang --version

install clang-11

Use correct pool

Use full matrix, revert additional logic in jobs/ci.yml

* Review feedback: newline

* Review feedback: Test in release, too

* Remove DisplayNameDecorator (it was useful when we were putting multiple builds into a single job, now it is redundant)

* Remove displayNames

* Matrix review feedback

* Conditions

* Rename ci.yml -> ci.tests.yml
2021-10-22 13:49:10 -07:00
Victor Vazquez
ef72f3c8a1
expose Curl nosignal opt (#2985)
* add NoSignalOption

* cl

* tests
2021-10-21 17:25:02 -07:00
George Arama
5ad55ecb6e
Download import merge (#2976)
* functioning, tests updated

* download import merge

* latest and greatest

* build issues

* spellcheck

* PR comments

* PR comments

* one last PR comment
2021-10-20 21:32:38 -07:00
Azure SDK Bot
24b34875ff
Sync eng/common directory with azure-sdk-tools for PR 2093 (#2984)
* Consume Codeowners parser library, ceperate users from teams in codeownerse

* Update get-pr-owners and related logic

Co-authored-by: Chidozie Ononiwu <chononiw@microsoft.com>
2021-10-20 12:07:56 -07:00
Victor Vazquez
dcc6f12c20
force http 1.1 on the libcurl transport adapter (#2978)
* force http 1.1

* update wording
2021-10-20 18:43:28 +00:00
Anton Kolesnyk
e0dcc20a82
Remove incorrect scope comments (#2983)
Co-authored-by: Anton Kolesnyk <antkmsft@users.noreply.github.com>
2021-10-19 18:22:03 -07:00
Anton Kolesnyk
6c0901b2ff
Fix build warning in no-RTTI config (#2981)
* Fix build warning in no-RTTI config

* Fix build warning in no-RTTI config

Co-authored-by: Anton Kolesnyk <antkmsft@users.noreply.github.com>
2021-10-19 16:09:06 -07:00
Anton Kolesnyk
b477373a9c
Remove extra semicolons (#2979)
Co-authored-by: Anton Kolesnyk <antkmsft@users.noreply.github.com>
2021-10-19 16:08:42 -07:00
Azure SDK Bot
7efea8c523
update to latest test-proxy tag (#2980)
Co-authored-by: scbedd <45376673+scbedd@users.noreply.github.com>
2021-10-19 14:44:38 -07:00
Azure SDK Bot
0d0810c349
Sync eng/common directory with azure-sdk-tools for PR 2085 (#2975)
* Fix up identity resolver to make it more reliable, publish notification configuration as a tool

* Use both username and email to resolve queuing user

Co-authored-by: Chidozie Ononiwu <chononiw@microsoft.com>
2021-10-18 19:53:29 -07:00
George Arama
60ba5599f8
Rework create (#2967)
* functioning, tests updated

* PR build

* PR comments
2021-10-18 19:25:38 -07:00
Azure SDK Bot
ebe9a75a68
Sync eng/common directory with azure-sdk-tools for PR 2100 (#2972)
* Add group id into metadata for java use

* Update Update-DocsMsPackages.ps1

* Update Update-DocsMsPackages.ps1

* Update eng/common/scripts/Update-DocsMsPackages.ps1

Co-authored-by: Ben Broderick Phillips <ben@benbp.net>

* Update eng/common/scripts/Update-DocsMsPackages.ps1

Co-authored-by: Ben Broderick Phillips <ben@benbp.net>

Co-authored-by: Sima Zhu <sizhu@microsoft.com>
Co-authored-by: Sima Zhu <48036328+sima-zhu@users.noreply.github.com>
Co-authored-by: Ben Broderick Phillips <ben@benbp.net>
2021-10-18 16:10:59 -07:00
Victor Vazquez
5e3cd1fb01
Adding a static-blocking libcurl transport adapter (#2948)
* static libcurl transport adapter

* ignore cspell

* updates to implementation
2021-10-18 15:01:00 -07:00
Victor Vazquez
8f3263a7ec
Missing fix for testing windows w/o RTTI (#2969)
* Enable no-rtti

* Apply suggestions from code review

Co-authored-by: Anton Kolesnyk <41349689+antkmsft@users.noreply.github.com>

* pass target

* rename

* rename

* fix for installed header

* update

* compile with tests

* add unit test for CI

* rename for each package

* wording updates

* renames

* rename

* update name

* fix for testing context pre-condition

Co-authored-by: Anton Kolesnyk <41349689+antkmsft@users.noreply.github.com>
2021-10-18 15:00:47 -07:00
Azure SDK Bot
5d4024f683
adjust the docker-start-proxy to take advantage of the linux specific commands that allow contact of localhost (#2971)
Co-authored-by: scbedd <45376673+scbedd@users.noreply.github.com>
2021-10-18 13:32:26 -07:00
JinmingHu
9dac89c675
make DefaultEncryptionScope and PreventEncryptionScopeOverride optional (#2968) 2021-10-16 10:06:18 +08:00
Victor Vazquez
f4e6390dff
Enable no-rtti (#2963)
* Enable no-rtti
2021-10-14 18:12:03 -07:00
George Arama
27747b1898
Get Paged responses (#2964)
* props and versions

* some more clients

* cmake

* cmake

* eweq

* comments

* tests

* formating and build issues

* Certicate-> Certificate

* remove uneeded comment
2021-10-13 12:24:13 -07:00
Azure SDK Bot
51e569e110
Sync eng/common directory with azure-sdk-tools for PR 2095 (#2960)
* Mitigate relative path calculation error on multiple iterations

* Revert "Mitigate relative path calculation error on multiple iterations"

This reverts commit 45baedd990c6a3085742a38a4891d8706a93be77.

* GetRelativePath should check if path is already relative before calling [IO.Path]::GetRelativePath

Co-authored-by: Daniel Jurek <djurek@microsoft.com>
2021-10-13 10:43:44 -07:00
George Arama
11b6fc8d3a
backup & restore (#2959)
* backup & restore

* build errors

* fixes from merging
2021-10-12 18:10:50 -07:00
George Arama
239c3c9f54
Get and update certificate policy (#2958)
* Get and update certificate policy

* build issue
2021-10-12 17:30:53 -07:00
George Arama
a2e5262d6f
Delete/getDeleted/Purge/recover (#2914)
* functionality, next tests

* Updates for tests, and bug fix found in test

* PR comments

* missed comment

* PR comments

* catch by value
2021-10-12 14:55:05 -07:00
Victor Vazquez
4eb33a0015
Update Key Vault packages to use Shared-code (#2905)
* Use key vault shared code strategy for code-reuse between packages

* use a class instead of function only

* unwanted change

* unwanted change

* remove the install interface

* typo
2021-10-11 14:17:55 -07:00
Azure SDK Bot
eb2fab16a0
Avoid overwriting package info properties when dev version is added (#2957)
Co-authored-by: Praveen Kuttappan <praveen.kuttappan@gmail.com>
2021-10-08 14:50:22 -07:00
Azure SDK Bot
e7747b4af9
Skip unnecessary and misleading role assignment warnings in local test resource deployment (#2954)
Co-authored-by: Ben Broderick Phillips <bebroder@microsoft.com>
2021-10-07 13:06:09 -04:00
George Arama
bcfbe44a73
rework the polling method (#2949)
* rework th polling method

* fix typo for clang

* typo 2

* moved method to private

* expose properties

* Update to use Properties instead of redirecting to internal member

* formar files
2021-10-06 15:48:33 -07:00
George Arama
e5a01a29bd
Certificate Contacts API (#2912)
* Certificate Contacts API

* PR issues

* spell

* revert cspell , set disables in code

* set disables in code

* PR comments

* PR comments

* pr issue

* pr comments

* oops

* missed replace
2021-10-06 12:12:18 -07:00
Azure SDK Bot
5aa13f541d
Increment package version after release of azure-security-keyvault-keys (#2951) 2021-10-06 10:53:14 -07:00
Azure SDK Bot
aab2b798f8
Add devops variable setting/clearing to eng/common (#2952)
Co-authored-by: Daniel Jurek <djurek@microsoft.com>
2021-10-06 10:30:24 -07:00
Azure SDK Bot
975ad22708
Sync eng/common directory with azure-sdk-tools for PR 2064 (#2953) 2021-10-06 09:30:57 -07:00
Azure SDK Bot
6303dd6d32
Revert change back (#2950)
Reverts back to a version that does not have mysterious Credential Issue

Co-authored-by: Sean Kane <68240067+seankane-msft@users.noreply.github.com>
2021-10-05 16:11:03 -04:00
Azure SDK Bot
e5f190c7a5
Handle multiple segments in service directory path (#2943)
Co-authored-by: Ben Broderick Phillips <bebroder@microsoft.com>
2021-10-05 11:56:45 -07:00
Victor Vazquez
6044c63ad1
update changelog to release verion (#2937) 2021-10-05 11:38:02 -07:00
George Arama
613972c4c4
Certificates Issuers API (#2911)
* issuers

* PR issues

* PR comments
2021-10-04 12:08:43 -07:00
Azure SDK Bot
cfd115ed59
Update docker-start-proxy.ps1 (#2941)
Update to the latest version of the container

Co-authored-by: Sean Kane <68240067+seankane-msft@users.noreply.github.com>
2021-10-01 17:06:49 -04:00
Victor Vazquez
fc01933f28
disable cert tests for now (#2939) 2021-09-29 13:45:00 -07:00
Azure SDK Bot
cde679782a
Sync eng/common directory with azure-sdk-tools for PR 2046 (#2931)
* Pass package name from calling pipeline to uniquely identify pull request review

* Update log summary

* Update eng/common/scripts/Detect-Api-Changes.ps1

Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com>

Co-authored-by: praveenkuttappan <prmarott@microsoft.com>
Co-authored-by: praveenkuttappan <55455725+praveenkuttappan@users.noreply.github.com>
Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com>
2021-09-29 07:05:08 -07:00
Victor Vazquez
8a12a64629
Adding GetCryptographyClient to KeyClient (#2917)
* Adding GetCryptographyClient to KeyClient

* update arg name
2021-09-27 15:36:37 -07:00
Azure SDK Bot
02be9fc757
Use stress-test-resources file naming to avoid live test auto-discovery (#2919)
Co-authored-by: Ben Broderick Phillips <bebroder@microsoft.com>
2021-09-27 11:32:19 -07:00
Azure SDK Bot
6785c17149
Sync eng/common directory with azure-sdk-tools for PR 2027 (#2915)
* Handle assembly already loaded errors in deploy stress test script

* Add dependency checks and installation links to deploy-stress-tests.ps1

Co-authored-by: Ben Broderick Phillips <bebroder@microsoft.com>
2021-09-27 10:47:37 -07:00
Azure SDK Bot
58b19709c7
Add common policheck steps (#2920)
Co-authored-by: Chidozie Ononiwu <chononiw@microsoft.com>
2021-09-24 16:39:08 -07:00
Azure SDK Bot
9ffa5c06cd
Sync eng/common directory with azure-sdk-tools for PR 2035 (#2918)
* Add

* Add more description to docs of where the variable is consumed

Co-authored-by: Daniel Jurek <djurek@microsoft.com>
2021-09-24 13:10:58 -07:00
Azure SDK Bot
b02dec3cf5
Clean-up changelog scripts (#2913)
Co-authored-by: Wes Haggard <Wes.Haggard@microsoft.com>
2021-09-21 19:58:11 -07:00
George Arama
8727030623
Start create certificate (#2909)
* fix tests local

* first stab

* second

* operation

* HUzaaaah

* split header file

* updates

* error

* format, error

* clang due to certificates

* remove useless line used for debugginng

* Update .vscode/cspell.json

Co-authored-by: Anton Kolesnyk <41349689+antkmsft@users.noreply.github.com>

* Update .vscode/cspell.json

Co-authored-by: Anton Kolesnyk <41349689+antkmsft@users.noreply.github.com>

* Update sdk/keyvault/azure-security-keyvault-certificates/inc/azure/keyvault/certificates/certificate_client_models.hpp

Co-authored-by: Anton Kolesnyk <41349689+antkmsft@users.noreply.github.com>

* Update sdk/keyvault/azure-security-keyvault-certificates/src/certificate_client_operations.cpp

Co-authored-by: Anton Kolesnyk <41349689+antkmsft@users.noreply.github.com>

* PR fixes

* revert wrong changes

Co-authored-by: Anton Kolesnyk <41349689+antkmsft@users.noreply.github.com>
2021-09-21 12:38:41 -07:00
Azure SDK Bot
0646d2ddfe
Sync eng/common directory with azure-sdk-tools for PR 2010 (#2907)
* Remove empty sections in changelog entry as part of prepare release

* Update SECTIONS_HEADER_REGEX to accomodate various header levels

Co-authored-by: Chidozie Ononiwu <chononiw@microsoft.com>
2021-09-17 10:20:51 -07:00
Azure SDK Bot
d0991c71d2
Sync eng/common directory with azure-sdk-tools for PR 2011 (#2903)
* Common pipeline template and script to detect API changes

* Cahnges as per review comments

* Review comment changes

* CCahgnes as per review comments

* Show warning for list of failed packages to detect API changes

* Apply suggestions from code review

Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com>

Co-authored-by: praveenkuttappan <prmarott@microsoft.com>
Co-authored-by: praveenkuttappan <55455725+praveenkuttappan@users.noreply.github.com>
Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com>
2021-09-16 12:33:40 -07:00
Rick Winter
bb8b889cf5
Remove static_cast (#2815)
* Remove static_cast

* Add additional checks around our Logger::Level to ensure its lock_free
2021-09-16 11:54:18 -07:00