Commit Graph

1109 Commits

Author SHA1 Message Date
Azure SDK Bot
cfcfac67f7
Sync eng/common directory with azure-sdk-tools for PR 8902 (#5965)
* Add descriptive error when variable groups are not added to pipeline

* Add emoji to deploy step title to make it easier to find

* Move yaml json checking into powershell script

* Fix base sub config empty/string checking

---------

Co-authored-by: Ben Broderick Phillips <bebroder@microsoft.com>
2024-09-10 17:04:41 -04:00
Wes Haggard
5f90646d3e
Refactor prepare-pipelines.yml (#5964) 2024-09-09 15:23:43 -07:00
Azure SDK Bot
d77c11839a
Sync eng/common directory with azure-sdk-tools for PR 8929 (#5966)
* Refactor prepare-pipelines

* Convert pipeling generation single to use template

* Convert to pwsh for setting the variables

* Fix switch expression

* Add path separator in front of devopspath

* Continue on error for individual step failures

* Remove unnecessary parameters

---------

Co-authored-by: Wes Haggard <Wes.Haggard@microsoft.com>
Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com>
2024-09-09 10:44:03 -07:00
Wes Haggard
10025fd2a2
Fix vcpkg cache (#5963) 2024-09-06 09:57:58 -07:00
Azure SDK Bot
01d0ac359f
update package lock to deal with the component governance alert (#5961)
Co-authored-by: Scott Beddall <scbedd@microsoft.com>
2024-09-04 14:30:16 -07:00
Azure SDK Bot
aeb335d14f
Add support for aka.ms, github wiki and crates.io checking (#5957)
Co-authored-by: Patrick Hallisey <pahallis@microsoft.com>
2024-09-03 15:53:26 -07:00
Azure SDK Bot
14e5fcd057
Avoid adding the same package twice, use TrimStart instead of substring (#5956)
Co-authored-by: Patrick Hallisey <pahallis@microsoft.com>
2024-09-03 15:51:44 -07:00
Wes Haggard
e636fc5f3e
Remove unused variable group (old cpp cache key) (#5955) 2024-09-03 11:04:40 -07:00
Azure SDK Bot
5a4a4a1b20
add quotes to powershell args (#5953)
Co-authored-by: Patrick Hallisey <pahallis@microsoft.com>
2024-08-30 14:53:24 -07:00
Wes Haggard
11a61fa980
Switch to User Delegate SAS for vcpkg caching (#5950) 2024-08-30 10:33:47 -07:00
Azure SDK Bot
7e9246794a
Sync eng/common directory with azure-sdk-tools for PR 8900 (#5951)
* Add save-package-properties yaml

* Encapsulate Save-Package-Properties.ps1 invocation into yaml

* Fix output formatting

* Fix code style

---------

Co-authored-by: Patrick Hallisey <pahallis@microsoft.com>
2024-08-29 14:44:37 -07:00
Azure SDK Bot
ab68436d2c
Sync eng/common directory with azure-sdk-tools for PR 8878 (#5949)
* Apply a few changes to Get-PRPackageProperties to make it more customizable for our users. Remove wonky gap + extra spacing that should pass the patch application process now that we've manually aligned common.ps1

* account for feedback -- rename CanaryPackages to AdditionalValidationPackages

* dependentPackagesforInclusion -> additionalValidationPackages

---------

Co-authored-by: Scott Beddall <scbedd@microsoft.com>
2024-08-28 18:11:21 -07:00
Wes Haggard
45cb4a5f87
Turn off warnings from sdl disablement (#5945)
See https://eng.ms/docs/cloud-ai-platform/devdiv/one-engineering-system-1es/1es-docs/1es-pipeline-templates/features/sdlanalysis/disablingtools for info on this new flag.
2024-08-28 16:32:49 -07:00
Azure SDK Bot
c9d308d6d5
Sync eng/common directory with azure-sdk-tools for PR 8875 (#5941)
* chore(): add playwright-testing to product slugs

* Update eng/common/scripts/Test-SampleMetadata.ps1

---------

Co-authored-by: Siddharth Singha Roy <ssingharoy@microsoft.com>
Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com>
2024-08-28 03:19:20 +05:30
Azure SDK Bot
5c082753ac
Sync eng/common directory with azure-sdk-tools for PR 8865 (#5933)
* bump proxy version

* bump proxy version

* restore most of the old performance, only fall back to json matching when something goes wrong

* use newest version with protection from invalid json

---------

Co-authored-by: Scott Beddall <scbedd@microsoft.com>
2024-08-25 11:36:13 -07:00
Azure SDK Bot
227ae0ea0b
Allow Save-package-properties to exit 0 when prs produce no package changes (#5936)
Co-authored-by: Patrick Hallisey <pahallis@microsoft.com>
2024-08-23 17:15:24 -07:00
Azure SDK Bot
758460d618
Add FilePattern support for .github\workflow sync (#5919)
Given we cannot create subfolders under .github\workflow folder
and we have repos that want additional workflows then we have
in the tools repo we need to setup a file pattern matching for
the sync processing to only sync the ones we want to be common.

For now just use the existing *event* pattern but we can move them
to another pattern similar to *common* or *sync* in the future as
we add more common workflows.

Co-authored-by: Wes Haggard <Wes.Haggard@microsoft.com>
2024-08-16 14:03:15 -07:00
Wes Haggard
244b4b5d51
Remove azure-sdk-docs-prod-blob-name usage (#5911) 2024-08-16 12:25:19 -07:00
Azure SDK Bot
6d77ab85dc
Sync eng/common directory with azure-sdk-tools for PR 8842 (#5912)
* Clean-up publish-blobs.yml to have better defaults

* Update copy-docs-to-blobstorage.ps1

* Update publish-blobs.yml

---------

Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com>
2024-08-15 10:45:52 -07:00
Azure SDK Bot
4d829f32ba
Sync eng/common directory with azure-sdk-tools for PR 8830 (#5915)
* Add RestAPISpecsDocsRepos to branch cleanup.

* Remove commented out yml, add pre-message to limit output and output core limit at the start of processing

* updates for feedback

---------

Co-authored-by: James Suplizio <jasupliz@microsoft.com>
2024-08-15 10:03:50 -07:00
Azure SDK Bot
c3e0967d16
Sync eng/common directory with azure-sdk-tools for PR 8831 (#5913)
* we want the path that we write to to be defined by literalpath, otherwise files with [ or ] will break powershell when writing the file to disk

* slight wording adjustment so the command can be invoked directly

---------

Co-authored-by: Scott Beddall <scbedd@microsoft.com>
2024-08-14 17:58:38 -07:00
Azure SDK Bot
b4020493c4
Sync eng/common directory with azure-sdk-tools for PR 8754 (#5884)
* more compatibility with expanding/contracting packages. add ability for packages to have DependentPackages that must be included in the set of packages that should be built given a changeset


---------

Co-authored-by: Scott Beddall <scbedd@microsoft.com>
Co-authored-by: Scott Beddall <45376673+scbedd@users.noreply.github.com>
Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com>
2024-08-07 16:18:42 -07:00
Azure SDK Bot
65e2547763
Sync eng/common directory with azure-sdk-tools for PR 8760 (#5874)
* Do not mark values as secret that are from git-hosted sub config files

* Simplify sub config build yaml

---------

Co-authored-by: Ben Broderick Phillips <bebroder@microsoft.com>
2024-08-06 12:54:24 -07:00
Azure SDK Bot
4da0180c98
bump proxy to one with an audit log and more correct locking (#5878)
Co-authored-by: Scott Beddall <scbedd@microsoft.com>
2024-08-06 12:32:07 -07:00
Azure SDK Bot
f9ea69c0e8
Sync eng/common directory with azure-sdk-tools for PR 8746 (#5865)
* update targeted proxy version


---------

Co-authored-by: Scott Beddall <scbedd@microsoft.com>
2024-08-02 12:45:48 -07:00
George Arama
34c2441523
Enable UseFederatedAuth by default (#5852)
* enable use federated

* 401 unauthorized

* 401

* cleanup readmes

* DISABLE RUN

* Remove UseFederatedAuth overrides from ci.yml

* DISABLE RUN for admin samples,
2024-07-31 17:10:39 -07:00
Azure SDK Bot
ce0e7ced1d
update the migration script entrypoint to catch git config errors before the push happens (#5853)
Co-authored-by: Scott Beddall <scbedd@microsoft.com>
2024-07-30 12:49:46 -07:00
Azure SDK Bot
3b6a7a80d5
updating the proxy certs (#5849)
Co-authored-by: Scott Beddall (from Dev Box) <scbedd@microsoft.com>
2024-07-28 13:01:49 -07:00
Azure SDK Bot
67f1632454
Change the daily docs branch name (#5847)
Co-authored-by: James Suplizio <jasupliz@microsoft.com>
2024-07-26 12:55:04 -07:00
Azure SDK Bot
7176808c7f
Add remaining preview/sov cloud sub configs to common dir (#5844)
Co-authored-by: Ben Broderick Phillips <bebroder@microsoft.com>
2024-07-24 12:38:54 -07:00
Wes Haggard
c32fd0dc80
Explicitly install python (#5833)
Looks like the latest windows image failed to have python installed. So explicitly installing it.
2024-07-22 15:19:42 -07:00
Ahson Khan
bbc5a307a8
Update live.tests.yml samples display name to be shorter. (#5828) 2024-07-19 14:24:22 -07:00
Azure SDK Bot
522b25508d
Sync eng/common directory with azure-sdk-tools for PR 8650 (#5812)
* missed a condition passthrough

---------

Co-authored-by: Scott Beddall <scbedd@microsoft.com>
Co-authored-by: Scott Beddall <45376673+scbedd@users.noreply.github.com>
2024-07-19 13:44:47 -07:00
Azure SDK Bot
0ec395d016
Add Azure Health Data Service product slug (#5831)
Co-authored-by: Scott Addie <scott.addie@microsoft.com>
2024-07-19 13:40:59 -07:00
Wes Haggard
3329e9d854
Update Preview Test Sub to use new connection (#5826)
In order to get both deployment and clean-up working we need to have a connection that points at the right subscription. Today azure-sdk-tests points to the name Test Sub but I created azure-sdk-tests-preview connection which points to the Preview Test Sub.

This will fix the clean-up step which is currently failing for things deployed in Preview.
2024-07-18 15:20:39 -07:00
Ahson Khan
9b9f76a737
Re-enable running previously disabled samples using AzureCliCredential. (#5818)
* Re-enable running KeyVault samples on Ubuntu using AzureCliCredential.

* Re-enable running Attestation samples using AzureCliCredential.

* Re-enable running EventHubs samples using AzureCliCredential.

* Re-enable running Identity samples.

* Disable client_secret_credential_sample since it depends on env vars
that don't exist.
2024-07-18 14:45:27 -07:00
Azure SDK Bot
e67bcaa558
Sync eng/common directory with azure-sdk-tools for PR 8602 (#5801)
* add additional argument to Save-Package-Properties to allow for usage in pull request context

---------

Co-authored-by: Scott Beddall (from Dev Box) <scbedd@microsoft.com>
Co-authored-by: Scott Beddall <45376673+scbedd@users.noreply.github.com>
Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com>
2024-07-18 11:44:18 -07:00
Azure SDK Bot
ae14b41e8e
Sync eng/common directory with azure-sdk-tools for PR 8598 (#5777)
* Set storage account test resources to disable blob public access

* Skip adding network rules to storage accounts that don't need them during cleanup

* Add succeeded check to set pipeline subnet info step

* Disable network firewall by default in resource creation/removal

---------

Co-authored-by: Ben Broderick Phillips <bebroder@microsoft.com>
2024-07-12 17:15:32 -04:00
George Arama
313fb0e58f
Move tests to use azure pipeline credentials (#5754)
* test1

* hgdfchg

* remove the remnants of azure client secret

* test KV with federated auth

* UseFederatedAuth

* fdsa

* kv template with managed

* try try again

* retry permissions

* add net acls

* blunt force replace the resource json

* put back stuff

* trey again with new method

* attempt

* missed something

* flip if else

* Temporarily use empty sub config file path for preview cloud

* remove client secret

* try to fix the identity tests

* live skip failing tests and return in samples

* samples for identity fix

* disable failing samples in identity

* fix winhttp failing test

* comment out code

* remove managed identity

* restore version from main

* revert readme changes

* PR comments

* test 2

* clang

* attempt default creds with pipeline chanined

* clangs

* identity test and clangs

* oops

* live

* cleanup

* reter

* test

* revert the DAC change

* missed one

* taking the samples to a farm upstate

* PR comments

* Fix bad merge

---------

Co-authored-by: Daniel Jurek <djurek@microsoft.com>
Co-authored-by: Anton Kolesnyk <antkmsft@users.noreply.github.com>
Co-authored-by: Anton Kolesnyk <41349689+antkmsft@users.noreply.github.com>
2024-07-11 17:38:19 -07:00
Anton Kolesnyk
69ce3d7cfa
Show-FailureLogs to include vcpkg build failure logs (#5776)
* Show-FailureLogs to include vcpkg build failure logs

* Add comment

* Add proper array syntax

* Use proper syntax to create an array even if there's only a single element

Co-authored-by: Ben Broderick Phillips <ben@benbp.net>

---------

Co-authored-by: Anton Kolesnyk <antkmsft@users.noreply.github.com>
Co-authored-by: Ben Broderick Phillips <ben@benbp.net>
2024-07-11 16:34:44 -07:00
Azure SDK Bot
1143b6bf4d
Support regex/negative regex filters for stress test discovery. Add storage env defaults (#5779)
Co-authored-by: Ben Broderick Phillips <bebroder@microsoft.com>
2024-07-11 13:25:01 -04:00
Azure SDK Bot
b1207fc87a
add the ability to override default succeeded() conditioning by parameter (#5780)
Co-authored-by: Scott Beddall <scbedd@microsoft.com>
2024-07-10 14:26:42 -07:00
Azure SDK Bot
bc547c4f4c
Sync eng/common directory with azure-sdk-tools for PR 8558 (#5764)
* Support storage network access and worm removal in remove test resources script

* Move storage network access script to common resource helpers file

* Improve storage container deletion resilience

* Plumb through pool variable to live test cleanup template

* Add sleep for network rule application

---------

Co-authored-by: Ben Broderick Phillips <bebroder@microsoft.com>
2024-07-08 17:56:18 -04:00
Azure SDK Bot
32250eaf25
Delete eng/common/InterdependencyGraph.html which is unused. (#5763)
Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com>
2024-07-05 13:15:17 -04:00
Wes Haggard
2e4e87f490
Disable codeql as it is causing build issues (#5761)
All the other languages have disabled codeql and we are now hitting blocking issues when running codeql on macos (https://dev.azure.com/twcdot/Data/_workitems/edit/138580) and even on the other OS's the configuration causes the builds to run for a long time.
2024-07-03 15:03:29 -07:00
Azure SDK Bot
8b39000b42
Sync eng/common directory with azure-sdk-tools for PR 8549 (#5762)
* commit the file changes so that we can see them running

* use standalone tool

---------

Co-authored-by: Scott Beddall (from Dev Box) <scbedd@microsoft.com>
2024-07-03 14:54:52 -07:00
Azure SDK Bot
5251c27034
Sync eng/common directory with azure-sdk-tools for PR 8516 (#5752)
* Ensure subConfigFiles is not an empty string

* Skip instances where $file is an empty string

---------

Co-authored-by: Daniel Jurek <djurek@microsoft.com>
2024-07-03 17:51:11 -04:00
Azure SDK Bot
a7ce5b43c3
Sync eng/common directory with azure-sdk-tools for PR 8528 (#5755)
* Fix default value for env vars in build-test-resource-config template

* Add empty pool condition

---------

Co-authored-by: Ben Broderick Phillips <bebroder@microsoft.com>
2024-07-03 14:23:56 -04:00
Anton Kolesnyk
f8130a26ae
If formatting fails in CI, print detailed diff (#5756)
Co-authored-by: Anton Kolesnyk <antkmsft@users.noreply.github.com>
2024-07-01 17:43:22 -07:00
Daniel Jurek
b0aa9bb924
Add federated auth support (#5740)
* Add federated auth support

* Wire up UseFederatedAuth more and EnvVars

* parameters.

* Testing

* ServiceConnection

* ServiceConnection (again)

* Remove testApplicaitonSecret

* Parameters

* exit $LASTEXITCODE

* Merge EnvVars correctly, only include SubscriptionConfigurationFilePaths if using federated auth

* Review comments

* Revert identity changes so tests continue passing
2024-07-01 21:36:07 +00:00