Commit Graph

455 Commits

Author SHA1 Message Date
Daniel Jurek
eae7b14f57
Add Xcode 12.5.1 (#3023) 2021-11-04 14:42:29 -07:00
Daniel Jurek
f1aae9d79e
Readd -V to ctest invocation (#3042) 2021-11-04 10:17:02 -07:00
Azure SDK Bot
9043580dbf
Add prompt before replasing latest release title on prepare release run (#3036)
Co-authored-by: Chidozie Ononiwu <chononiw@microsoft.com>
2021-11-03 19:22:15 -07:00
Azure SDK Bot
35c4a7eb32
Stress test usability feedback (#3032)
Co-authored-by: Ben Broderick Phillips <bebroder@microsoft.com>
2021-11-03 15:29:02 -07:00
Daniel Jurek
413b4b7665
Add coverage enforcement (#2992)
* Add coverage enforcement

* Add spelling exception for mspremier

* Use previous build coverage data, enforce 3% variance, use Skip.CoverageEnforcement feature flag

* Use version 8 of quality checks

* Remove forceCoverageImprovement, it doesn't allow 0% improvements (e.g. doc changes, etc.)

* branch -> branches

* Configure coverage thresholds per-service

* Use fixed coverage

* Review feedback

* Per-service coverage plumbing

* Flip branch and line coverage requirements for KV to accurately reflect current baseline
2021-11-03 10:56:32 -07:00
Daniel Jurek
52e0eeb393
Add test result uploading (#3017)
* Add test result uploading

* Use -T

* Add displayName and buildConfiguration

* Add live testing result upload

* buildConfiguration -> testRunTitle

* Live tests 'Validate' -> 'ValidateLive' to differentiate job names in Test results output
2021-11-03 10:54:43 -07:00
Azure SDK Bot
b3bd976866
Sync eng/common directory with azure-sdk-tools for PR 2053 (#3027)
* Changing inline bash for stress test resource deployment

* PR-mod

* pr-mod

* pr-mod

* pr-mod

Co-authored-by: Albert Cheng <albertcheng@microsoft.com>
2021-11-02 23:05:22 -07:00
Chidozie Ononiwu (His Righteousness)
58c1ecfc1d
Add ReplaceLatestEntryTitle parameter for updating changelog (#3008) 2021-11-02 12:29:38 -07:00
Azure SDK Bot
10861b3c3d
Use docker to do package validation. (#3020)
Co-authored-by: Sima Zhu <sizhu@microsoft.com>
2021-11-01 23:04:13 -07:00
Azure SDK Bot
b028304d82
Use https for sparse checkout command (#3019)
Co-authored-by: Ben Broderick Phillips <bebroder@microsoft.com>
2021-11-01 18:37:23 -07:00
Azure SDK Bot
fbe38f7fb3
Sync eng/common directory with azure-sdk-tools for PR 2177 (#3016)
* Create an issue template

* rename the function

* Add description

* Update eng/common/scripts/Invoke-GitHubAPI.ps1

Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com>

Co-authored-by: Sima Zhu <sizhu@microsoft.com>
Co-authored-by: Sima Zhu <48036328+sima-zhu@users.noreply.github.com>
Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com>
2021-11-01 13:40:53 -07:00
Azure SDK Bot
fe42c0f831
Sync eng/common directory with azure-sdk-tools for PR 2152 (#2999) 2021-10-27 14:19:48 -07:00
Azure SDK Bot
1055ff8c14
Add latest released version to prepare prerelease (#2998)
Co-authored-by: Chidozie Ononiwu <chononiw@microsoft.com>
2021-10-26 14:10:46 -07:00
Azure SDK Bot
3fdf66bb55
Fully automate cluster buildout. Add azure file share mount to stress tests. (#2989)
Co-authored-by: Ben Broderick Phillips <bebroder@microsoft.com>
2021-10-22 18:05:57 -04:00
Daniel Jurek
c534a1e160
Cognitive Matrix Consolidation (#2947)
* Refactor template to use multiple builds on the same machine resetting the machine and runtime varaibles along the way

Move template expression out of default matrix parameters

Remove extra reference to ci/jobs.yml

Remove unnecessary ci.yml, change param declaration in devops-variables-set.yml

Heredoc

Fix set/reset scripts after testing with devops outputs

-ErrorAction Ignore

Smaller matrix

OsVMImage comes from machine, not parameters

Add Ubuntu 20 to matrix

Remove checkout: self, it is implied

Move machine-setup steps outside of loop

CODE_COVERAGE handling

tab

Remove creation of CODE_COVERAGE

Use AptDependencies and add apt update to dependency install step

Remove extra preparation steps

Enable code coverage check scenario

Add MacOS 11

Disable vcpkg cache

Coverage configuration

Pass parameter properly

bool -> boolean

Install coverage tools if it's possible that coverage may run

More logging on code coverage

Show contents of Makefile

One vcpkg to build them all

Verbose

SourcesDirectory

Nesting VcpkgInstall

workingDirectory for vcpkg install

AptDependencies

complete the conditional

Enable all matrix entries

sudo

Remove extra chatter

More scrubbing post-build to help with Windows scenarios

sudo echo

Get-ChildItem

ErrorAction

sudo sh -c

More ErrorAction

output sourceListFile

Disable additional sources.list

Install coverage tools when used for coverage

COndition

Do not build testing for Windows arm64

Correct path for coverage tools

ne -> eq

Add more scenarios to the matrix

Remove libxml2

Add MacOS 10.15 to matrix

Revert "Remove libxml2"

This reverts commit 178af8b89abb21ee84dbcd25b4d54bd90ec1d44c.

Add libxml2 to MacOS 10.15 matrix entry

Display name decorator, refine the matrix

Remove OsVmImage variable

Add commentary to tests about matrix

Rebalance matrix, nest EnvVars, DisplayNameDecorator

Correct parameter access

AptDependencies

Ensure building for WindowsStore in UWP builds, Only build tests for debug builds in altered matrix entires, Linux build type specified as environment variable

Rebalance matrix for better timing

Remove all instances of libxml2 in vcpkg dependencies

Move common devops tasks to eng/common

Set eng/common paths in pipelines

Revert "Remove all instances of libxml2 in vcpkg dependencies"

This reverts commit 35ffbc7aac87f400fdf3351076346750c1c750ed.

https://github.com/Azure/azure-sdk-for-cpp/issues/2946

Permit words like iname in more pipeline .yml files

Remove libxml2 from vcpkg dependencies for Windows

Perf test matrix maxParallel: 10

Validate

apt install first

apt install first

maxParallel: 12

-j 8

-j 10

Use matrix generator

Add expected parameters

Move parameters to appropriate file, fix cloud spec

Specify correct platform matrix location

DependsOn

Platform matrix

Remove DisplayNameDecorator, try more clang information

Rapid iteration matrix

clang --version

install clang-11

Use correct pool

Use full matrix, revert additional logic in jobs/ci.yml

* Review feedback: newline

* Review feedback: Test in release, too

* Remove DisplayNameDecorator (it was useful when we were putting multiple builds into a single job, now it is redundant)

* Remove displayNames

* Matrix review feedback

* Conditions

* Rename ci.yml -> ci.tests.yml
2021-10-22 13:49:10 -07:00
Azure SDK Bot
24b34875ff
Sync eng/common directory with azure-sdk-tools for PR 2093 (#2984)
* Consume Codeowners parser library, ceperate users from teams in codeownerse

* Update get-pr-owners and related logic

Co-authored-by: Chidozie Ononiwu <chononiw@microsoft.com>
2021-10-20 12:07:56 -07:00
Azure SDK Bot
7efea8c523
update to latest test-proxy tag (#2980)
Co-authored-by: scbedd <45376673+scbedd@users.noreply.github.com>
2021-10-19 14:44:38 -07:00
Azure SDK Bot
0d0810c349
Sync eng/common directory with azure-sdk-tools for PR 2085 (#2975)
* Fix up identity resolver to make it more reliable, publish notification configuration as a tool

* Use both username and email to resolve queuing user

Co-authored-by: Chidozie Ononiwu <chononiw@microsoft.com>
2021-10-18 19:53:29 -07:00
Azure SDK Bot
ebe9a75a68
Sync eng/common directory with azure-sdk-tools for PR 2100 (#2972)
* Add group id into metadata for java use

* Update Update-DocsMsPackages.ps1

* Update Update-DocsMsPackages.ps1

* Update eng/common/scripts/Update-DocsMsPackages.ps1

Co-authored-by: Ben Broderick Phillips <ben@benbp.net>

* Update eng/common/scripts/Update-DocsMsPackages.ps1

Co-authored-by: Ben Broderick Phillips <ben@benbp.net>

Co-authored-by: Sima Zhu <sizhu@microsoft.com>
Co-authored-by: Sima Zhu <48036328+sima-zhu@users.noreply.github.com>
Co-authored-by: Ben Broderick Phillips <ben@benbp.net>
2021-10-18 16:10:59 -07:00
Azure SDK Bot
5d4024f683
adjust the docker-start-proxy to take advantage of the linux specific commands that allow contact of localhost (#2971)
Co-authored-by: scbedd <45376673+scbedd@users.noreply.github.com>
2021-10-18 13:32:26 -07:00
Victor Vazquez
f4e6390dff
Enable no-rtti (#2963)
* Enable no-rtti
2021-10-14 18:12:03 -07:00
Azure SDK Bot
51e569e110
Sync eng/common directory with azure-sdk-tools for PR 2095 (#2960)
* Mitigate relative path calculation error on multiple iterations

* Revert "Mitigate relative path calculation error on multiple iterations"

This reverts commit 45baedd990c6a3085742a38a4891d8706a93be77.

* GetRelativePath should check if path is already relative before calling [IO.Path]::GetRelativePath

Co-authored-by: Daniel Jurek <djurek@microsoft.com>
2021-10-13 10:43:44 -07:00
Azure SDK Bot
eb2fab16a0
Avoid overwriting package info properties when dev version is added (#2957)
Co-authored-by: Praveen Kuttappan <praveen.kuttappan@gmail.com>
2021-10-08 14:50:22 -07:00
Azure SDK Bot
e7747b4af9
Skip unnecessary and misleading role assignment warnings in local test resource deployment (#2954)
Co-authored-by: Ben Broderick Phillips <bebroder@microsoft.com>
2021-10-07 13:06:09 -04:00
Azure SDK Bot
aab2b798f8
Add devops variable setting/clearing to eng/common (#2952)
Co-authored-by: Daniel Jurek <djurek@microsoft.com>
2021-10-06 10:30:24 -07:00
Azure SDK Bot
975ad22708
Sync eng/common directory with azure-sdk-tools for PR 2064 (#2953) 2021-10-06 09:30:57 -07:00
Azure SDK Bot
6303dd6d32
Revert change back (#2950)
Reverts back to a version that does not have mysterious Credential Issue

Co-authored-by: Sean Kane <68240067+seankane-msft@users.noreply.github.com>
2021-10-05 16:11:03 -04:00
Azure SDK Bot
e5f190c7a5
Handle multiple segments in service directory path (#2943)
Co-authored-by: Ben Broderick Phillips <bebroder@microsoft.com>
2021-10-05 11:56:45 -07:00
Azure SDK Bot
cfd115ed59
Update docker-start-proxy.ps1 (#2941)
Update to the latest version of the container

Co-authored-by: Sean Kane <68240067+seankane-msft@users.noreply.github.com>
2021-10-01 17:06:49 -04:00
Azure SDK Bot
cde679782a
Sync eng/common directory with azure-sdk-tools for PR 2046 (#2931)
* Pass package name from calling pipeline to uniquely identify pull request review

* Update log summary

* Update eng/common/scripts/Detect-Api-Changes.ps1

Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com>

Co-authored-by: praveenkuttappan <prmarott@microsoft.com>
Co-authored-by: praveenkuttappan <55455725+praveenkuttappan@users.noreply.github.com>
Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com>
2021-09-29 07:05:08 -07:00
Azure SDK Bot
02be9fc757
Use stress-test-resources file naming to avoid live test auto-discovery (#2919)
Co-authored-by: Ben Broderick Phillips <bebroder@microsoft.com>
2021-09-27 11:32:19 -07:00
Azure SDK Bot
6785c17149
Sync eng/common directory with azure-sdk-tools for PR 2027 (#2915)
* Handle assembly already loaded errors in deploy stress test script

* Add dependency checks and installation links to deploy-stress-tests.ps1

Co-authored-by: Ben Broderick Phillips <bebroder@microsoft.com>
2021-09-27 10:47:37 -07:00
Azure SDK Bot
58b19709c7
Add common policheck steps (#2920)
Co-authored-by: Chidozie Ononiwu <chononiw@microsoft.com>
2021-09-24 16:39:08 -07:00
Azure SDK Bot
9ffa5c06cd
Sync eng/common directory with azure-sdk-tools for PR 2035 (#2918)
* Add

* Add more description to docs of where the variable is consumed

Co-authored-by: Daniel Jurek <djurek@microsoft.com>
2021-09-24 13:10:58 -07:00
Azure SDK Bot
b02dec3cf5
Clean-up changelog scripts (#2913)
Co-authored-by: Wes Haggard <Wes.Haggard@microsoft.com>
2021-09-21 19:58:11 -07:00
Azure SDK Bot
0646d2ddfe
Sync eng/common directory with azure-sdk-tools for PR 2010 (#2907)
* Remove empty sections in changelog entry as part of prepare release

* Update SECTIONS_HEADER_REGEX to accomodate various header levels

Co-authored-by: Chidozie Ononiwu <chononiw@microsoft.com>
2021-09-17 10:20:51 -07:00
Azure SDK Bot
d0991c71d2
Sync eng/common directory with azure-sdk-tools for PR 2011 (#2903)
* Common pipeline template and script to detect API changes

* Cahnges as per review comments

* Review comment changes

* CCahgnes as per review comments

* Show warning for list of failed packages to detect API changes

* Apply suggestions from code review

Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com>

Co-authored-by: praveenkuttappan <prmarott@microsoft.com>
Co-authored-by: praveenkuttappan <55455725+praveenkuttappan@users.noreply.github.com>
Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com>
2021-09-16 12:33:40 -07:00
Azure SDK Bot
8070ab2392
Sync eng/common directory with azure-sdk-tools for PR 2016 (#2904)
* Make ServiceName optional for verify-changelog

In cases like go where we don't pass a service name having this default to "not-specified" breaks things so we should allow for ServiceName and/or ServiceDirectory to be empty.

* Put quotes around the strings to allow for empty

Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com>
2021-09-15 15:32:47 -07:00
Azure SDK Bot
15b6a7abc4
Sync eng/common directory with azure-sdk-tools for PR 2009 (#2897)
* Skip PSModule caching in container jobs

* Add succeeded check to condition

Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com>

Co-authored-by: Ben Broderick Phillips <bebroder@microsoft.com>
Co-authored-by: Ben Broderick Phillips <ben@benbp.net>
Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com>
2021-09-15 12:45:36 -07:00
Azure SDK Bot
818cab9a2a
Add for multiple levels of Atx Headers in the CHANGELOG.md (#2900)
Co-authored-by: Chidozie Ononiwu <chononiw@microsoft.com>
2021-09-14 16:56:12 -07:00
Daniel Jurek
14aa1516d0
Add spell check exceptions and enable CI failure for spelling errors in changed files (#2865)
* Add spell check exceptions and enable spell check failures

* Add HRESULT and sort spelling list

* Add exceptions for cmake-modules
2021-09-13 14:38:49 -07:00
Azure SDK Bot
9088500ec6
Sync eng/common directory with azure-sdk-tools for PR 1979 (#2864)
* Move logic for removing empty sections to ChangeLog-Operations.ps1

* Refactor sections regex

* Add SanitizeEntry parameter

Co-authored-by: Chidozie Ononiwu <chononiw@microsoft.com>
2021-09-13 13:50:35 -07:00
Azure SDK Bot
34cb6c76ae
Fix SemVer.ToString to handle v0 case (#2863)
Since we are treating v0 versions as prerelease we need to make sure
we don't accidently start to add the bogus prerelease label in cases where
we call ToString() on the version.

Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com>
2021-09-13 13:06:08 -07:00
Azure SDK Bot
4aacb5f59f
Sync eng/common directory with azure-sdk-tools for PR 1946 (#2862)
* Add ability to exit gracefully when all files in the diff are excluded

* Address case where cspell exits with an error when all files from the 'files' config list are excluded by the expressions in 'ignorePaths'

* Add tests

* Review feedback: impl goes at the bottom and should be treated as a script, logic for testing should happen above that and exit appropriately if running tests

* Import common instead of logging

* Enable strict mode

Co-authored-by: Daniel Jurek <djurek@microsoft.com>
2021-09-13 13:04:47 -07:00
Azure SDK Bot
3e2e5a6dfc
Sync eng/common directory with azure-sdk-tools for PR 1983 (#2860)
* Doc Updates and Revisions for External Use

The focus of these changes is to revise the script to better support use
by external contributors and others outside of the Azure SDK ecosystem and
without access to the Microsoft AAD Tenant.

Changes include:

- Creation of a new Test Application service principal is now possible
  from a non-Microsoft AAD tenant.

- When a new Test Application principal is created, the principle of least
  privilege is now applied; the new Test Application is granted ownership
  of the resource group associated with the test resources and no longer
  has access to any other resources in the subscription.

- If an existing Test Application principal is specified, it will be
  assigned ownership of the resource group created.  This supports using
  a Test Application principal without privileges at the subscription-level.

- When no provisioner is specified, the script is now executed in the
  context of the caller rather than the Test Application principal.
  This supports using a Test Application principal that has restricted
  privileges and better aligns to the purpose of the Test Application
  principal.

- The `$TestApplicationOid` is now explicitly bound at the time a new Test
  Application principal is created rather than having to query for it later.

- Common error scenarios resulting from lack of permissions now provide
  messaging with more context of why the failure occurred and suggest
  remediation.

- Added new examples to illustrate the common call patterns needed by
  external contributors running the script, outside of the Microsoft tenant
  and Azure SDK ecosystem.

- Documentation has been enhanced with additional context to detail the
  permissions and roles assigned by the script.

- Added documentation details for Bicep template use.

* Add the provisioner OID to the deployment params

Key Vault needs this to deploy Managed HSMs. There's a corresponding change necessary in test-resources.json I'll roll out across languages.

* Fixing typos and spelling mistakes

Co-authored-by: Jesse Squire <jesse.squire@gmail.com>
Co-authored-by: Heath Stewart <heaths@microsoft.com>
2021-09-13 09:21:47 -07:00
Daniel Jurek
af44672837
Releases to vcpkg tag codeowners (#2825)
* Attempt tagging of @danieljurek in PRBody

* Attempt to assign reviewers

* Use codeowners, filter out groups, use a default owner, add comments to issue.

* Move variables to right level of config

* Set PrOwners variable

* Remove PR owners, requires admin permissions

* Escape DevOps variable to expand into string

* Add AuthToken

* Tweak portfile and codeowners to validate multiple artifact scenario

* Revert "Tweak portfile and codeowners to validate multiple artifact scenario"

This reverts commit bcc7a36119c7f399f1b079f51889d6ff0d499142.

* Review feedback

* Validate fallback logic

* Deal with empty list of owners

* Revert "Validate fallback logic"

This reverts commit ade2dff5a7d9cac9bb61fdc0f92cd50412b7c31c.
2021-09-09 14:47:15 -07:00
Azure SDK Bot
99ff3b04bd
Install az module if not installed in deploy-stress-tests.ps1 (#2857)
Co-authored-by: Ben Broderick Phillips <bebroder@microsoft.com>
2021-09-09 14:01:10 -07:00
Azure SDK Bot
517902128f
Explicitly exit 0 so a failed inner command (like mvn) doesn't propagate up to a failure of the pipeline (#2859)
Co-authored-by: Daniel Jurek <djurek@microsoft.com>
2021-09-09 11:03:45 -07:00
Azure SDK Bot
003eb57488
Sync eng/common directory with azure-sdk-tools repository (#2856) 2021-09-08 17:27:39 -07:00
Azure SDK Bot
91b459b560
Add Skip.SetTestPipelineVersion to allow overidiing of use of BuildID for test version (#2849)
Co-authored-by: Chidozie Ononiwu <chononiw@microsoft.com>
2021-09-08 12:58:47 -07:00