Commit Graph

251 Commits

Author SHA1 Message Date
Azure SDK Bot
5a0882f770
Sync eng/common directory with azure-sdk-tools for PR 1719 (#2468)
* Update pipeline generation tool version

Consume latest changes from pipeline generation tool in https://github.com/Azure/azure-sdk-tools/pull/1708

* Update tool version to include fix for public ci

Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com>
2021-06-21 16:42:43 -07:00
Azure SDK Bot
8b0ebb39f5
Sync eng/common directory with azure-sdk-tools for PR 1716 (#2467)
* Update links with master to use main

* Update ci.yml files

Co-authored-by: Chidozie Ononiwu <chononiw@microsoft.com>
2021-06-21 12:18:52 -07:00
Azure SDK Bot
0163b09994
Fix hard-coded master (#2463)
Co-authored-by: Chidozie Ononiwu <chononiw@microsoft.com>
2021-06-18 13:42:32 -07:00
Azure SDK Bot
36cee34fbd
Sync eng/common directory with azure-sdk-tools for PR 1688 (#2453)
* Add verification of changelog sections

* Update eng/common/scripts/ChangeLog-Operations.ps1

Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com>

Co-authored-by: Chidozie Ononiwu <chononiw@microsoft.com>
Co-authored-by: Chidozie Ononiwu <31145988+chidozieononiwu@users.noreply.github.com>
Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com>
2021-06-15 17:15:49 -07:00
Azure SDK Bot
d5d585500d
Strict mode needs the variables initialized (#2443)
Co-authored-by: Wes Haggard <Wes.Haggard@microsoft.com>
2021-06-09 18:48:16 -07:00
Azure SDK Bot
f9bf94d018
Sync eng/common directory with azure-sdk-tools for PR 1633 (#2429)
* Update format of new Changelog Entry

* Add parsing of changelog sections

* Update ChangeLog Logic

Co-authored-by: Chidozie Ononiwu <chononiw@microsoft.com>
2021-06-08 12:05:10 -07:00
Azure SDK Bot
7f21263cc9
Use generate matrix job name parameter as display name (#2404)
Co-authored-by: Ben Broderick Phillips <bebroder@microsoft.com>
2021-06-04 16:26:13 -07:00
Azure SDK Bot
63a0116197
Fetch specific branch name only in git-branch-push script (#2374)
Co-authored-by: Ben Broderick Phillips <bebroder@microsoft.com>
2021-06-04 16:11:15 -07:00
Azure SDK Bot
e279c9220b
Add the ability to check for open pull request to a different repo. (#2396)
Co-authored-by: Chidozie Ononiwu <chononiw@microsoft.com>
2021-06-03 15:51:40 -07:00
Azure SDK Bot
dfd2933a66
Sync eng/common directory with azure-sdk-tools for PR 1611 (#2349)
* Add API status check

* Revert temp change

* Update as per review comments

* Removed blank line

* Review comments to use az cli

* Changes to move az cli commands to caller script and other review comments

* Skip languages that's not supported in APIView

* Fix bug in language mapping

Co-authored-by: praveenkuttappan <prmarott@microsoft.com>
2021-06-01 14:22:44 -04:00
Azure SDK Bot
5e071a07d7
Enable Caching of PS Modules (#2363)
- Remove copied AzPowershell utilities
- Add latest AZ module path already on hosted agents to PSModulePath
- Rename setup-az-modules template setup-environments to reflect what is is doing
- Add support for Caching the current user PS Module folder
- Add support for install-module if not already present in module folder
- Organize the live test clean-up script to be in the standard location

Co-authored-by: Wes Haggard <Wes.Haggard@microsoft.com>
2021-05-27 19:04:12 -04:00
Azure SDK Bot
97ba448859
Sync eng/common directory with azure-sdk-tools for PR 1635 (#2353)
* Update common engineering system for docs onboarding

* Add updates from review feedback

* Space nit

Co-authored-by: Daniel Jurek <djurek@microsoft.com>
2021-05-26 18:15:25 -04:00
Azure SDK Bot
55cd432693
Add Get-ChangeLogEntriesFromContent (#2345)
Co-authored-by: Chidozie Ononiwu <chononiw@microsoft.com>
2021-05-25 20:03:58 -04:00
Azure SDK Bot
0feac90f09
Sync eng/common directory with azure-sdk-tools for PR 1627 (#2344)
* Refactor sparse checkout template: idempotency and no yaml loops

* Add logging, re-organize sparse checkout script

Co-authored-by: Ben Broderick Phillips <bebroder@microsoft.com>
2021-05-25 16:53:57 -04:00
Azure SDK Bot
bb0d1287bc
Sync eng/common directory with azure-sdk-tools for PR 1615 (#2335)
* Move docindex.yml from steps -> jobs

* Add docindex.yml

Co-authored-by: Daniel Jurek <djurek@microsoft.com>
2021-05-20 17:20:46 -04:00
Azure SDK Bot
d6d5120931
Sync eng/common directory with azure-sdk-tools for PR 1585 (#2308)
* Sparse checkout docs repository in release step

* Detect default branch for custom sparse checkout repository

* Use sparse checkout paths parameter in docs metadata release

Co-authored-by: Ben Broderick Phillips <bebroder@microsoft.com>
2021-05-18 19:43:29 -04:00
Azure SDK Bot
ea072fff4d
allow multiple invocations of archetype-sdk-tests-generate (#2269)
Co-authored-by: scbedd <45376673+scbedd@users.noreply.github.com>
2021-05-14 18:23:12 +00:00
Azure SDK Bot
5d46edbe65
Sync eng/common directory with azure-sdk-tools for PR 1594 (#2243)
* Update sparse checkout create directory step name

* plumb BaseBranchName to create pull request

Co-authored-by: Ben Broderick Phillips <bebroder@microsoft.com>
2021-05-12 14:44:10 -04:00
Azure SDK Bot
5e6d4be92c
Add better error handling in Prepare-Release (#2233)
Co-authored-by: Wes Haggard <Wes.Haggard@microsoft.com>
2021-05-07 23:34:45 -04:00
Azure SDK Bot
f5d9a25d41
Revert changes to SetDevVersion. (#2213)
Co-authored-by: Mitch Denny <midenn@microsoft.com>
2021-05-07 09:35:53 +10:00
Azure SDK Bot
cdb5fbfb35
Sync eng/common directory with azure-sdk-tools for PR 1524 (#2179)
* Make RELEASE_TITLE_REGEX more specific

* Update eng/common/scripts/ChangeLog-Operations.ps1

Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com>

* Update release REGEX

* tighten up changelog verification

* Ensure releaseDate is in the appriopriate format.

* Update error messages.

* Retrun false after error

Co-authored-by: Chidozie Ononiwu <chononiw@microsoft.com>
Co-authored-by: Chidozie Ononiwu <31145988+chidozieononiwu@users.noreply.github.com>
Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com>
2021-05-03 10:27:04 -07:00
Azure SDK Bot
3bb84c8de6
Sync eng/common directory with azure-sdk-tools for PR 1579 (#2171)
* Allow propogation of SetDevVersion.

* Allow use of SetDevVersion locally and across stages.

Co-authored-by: Mitch Denny <midenn@microsoft.com>
2021-05-02 17:49:56 -07:00
Azure SDK Bot
aafdeeb526
Sync Devops helper scripts from azure-sdk repo (#2177)
DevOps helper scripts were updated in azure-sdk repo
so syncing those changes into the tools repo so they
can be used prepare-release script.

Co-authored-by: Wes Haggard <Wes.Haggard@microsoft.com>
2021-04-29 15:42:28 -07:00
Azure SDK Bot
ead97d476b
Set multiple sparse checkout paths in one command/job (#2169)
Co-authored-by: Ben Broderick Phillips <bebroder@microsoft.com>
2021-04-29 13:23:33 -04:00
Azure SDK Bot
df2ffc0577
Sync eng/common directory with azure-sdk-tools for PR 1572 (#2172)
* Update prepare pipelines template.

* Update prepare-pipelines as well.

* Remove default line.

Co-authored-by: Mitch Denny <midenn@microsoft.com>
2021-04-29 03:39:14 +00:00
Azure SDK Bot
248dc0b96a
Parse MD files coming over http as raw markdown files (#2168)
This will allow us to point our verify-link script at a raw
MD file in a github repo and have it parsed correctly for
links.

Co-authored-by: Wes Haggard <Wes.Haggard@microsoft.com>
Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com>
2021-04-28 13:41:26 -07:00
Azure SDK Bot
85e358a2ba
Add caching support to verify-links (#2150)
- Update link checking pipeline to enable caching
- Add loading cache file from a http endpoint
- Add retry logic when hitting 429

Fix verify link renaming scenarios

- Correctly error if link format is incorrect
- Handle case where the replace regex is not passed
- Improve the error logging so it is easier to
  identify the broken links
2021-04-22 14:14:23 -07:00
Azure SDK Bot
2ea6ee6d54
Sync eng/common directory with azure-sdk-tools for PR 1565 (#2137)
* Fix retain runs auth.

* Emit encoded token as secret.

Co-authored-by: Mitch Denny <midenn@microsoft.com>
2021-04-21 10:14:16 +10:00
Azure SDK Bot
5408d199eb
Sync eng/common directory with azure-sdk-tools for PR 1558 (#2142) 2021-04-20 15:47:03 -07:00
Azure SDK Bot
beda7bcaf8
Stop filtering projects by ci.yml files (#2139)
- This removes the ci.yml filtering which means all projects can be discovered
- This eliminates the need for the yml parsing module for most common scenarios
- This does introduce some potential issues with duplicate package names for
  languages like java. The only known case currently is azure-storage-blobs and
  if there is ever a need to explicitly pick the correct one someone can pass
  in the ServiceDirectory filter similar to "storage/azure*" for new and "storage/microsoft*"
  for the older sdk. By default azure usually comes first so the new one gets discovered
  which is likely all we need for now. If this turns out not to be true we might
  need another way to disambiguate.

Co-authored-by: Wes Haggard <Wes.Haggard@microsoft.com>
Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com>
2021-04-20 14:59:37 -07:00
Azure SDK Bot
d3d4fdfe2a
Use underscore-prefixed variable name when setting sub config values as secrets (#2134)
Co-authored-by: Ben Broderick Phillips <bebroder@microsoft.com>
2021-04-19 14:43:09 -07:00
Azure SDK Bot
760026715a
Sync eng/common directory with azure-sdk-tools for PR 1560 (#2133)
* Add template to merge multiple subscription configurations

* Update eng/common/TestResources/build-test-resource-config.yml

Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com>

Co-authored-by: Ben Broderick Phillips <bebroder@microsoft.com>
Co-authored-by: Ben Broderick Phillips <ben@benbp.net>
Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com>
2021-04-19 11:00:40 -07:00
Azure SDK Bot
6b50feb0d4
Sync eng/common directory with azure-sdk-tools for PR 1559 (#2123)
* Handle empty files in Test-SampleMetadata

Relates to Azure/azure-sdk-for-java#20684

* Remove condition from verify-samples

* Use forward slash in path

* Fix directory typo

Co-authored-by: Heath Stewart <heaths@microsoft.com>
2021-04-14 22:37:40 -07:00
Azure SDK Bot
8002b63f61
Sync eng/common directory with azure-sdk-tools for PR 1555 (#2120)
* Verify samples during CIs

Replaces Azure/azure-sdk-for-python#17999 for use in all language repos.

* Move exit to proper scope

Co-authored-by: Heath Stewart <heaths@microsoft.com>
2021-04-14 17:56:19 -07:00
Azure SDK Bot
df69a35c88
Call bypass-local-dns.yml from verify-agent-os.yml - Easy way to ensure the DNS workaround is run in (almost) all pipelines (#2119)
Co-authored-by: Mike Harder <mharder@microsoft.com>
2021-04-14 17:23:12 -07:00
Azure SDK Bot
c297b63b9b
Sync eng/common directory with azure-sdk-tools for PR 1552 (#2110) 2021-04-13 11:12:50 -07:00
Azure SDK Bot
edd6152632
Sync eng/common directory with azure-sdk-tools for PR 1553 (#2108)
* Remove condition.

* Fix up system access token usage.

Co-authored-by: Mitch Denny <midenn@microsoft.com>
2021-04-13 16:02:29 +10:00
Azure SDK Bot
7da44d90bb
Update eng/common dev version template. (#2106)
Co-authored-by: Mitch Denny <midenn@microsoft.com>
2021-04-13 10:45:42 +10:00
Azure SDK Bot
cf071db26a
Sync eng/common directory with azure-sdk-tools for PR 1551 (#2104)
* make -checkout: none an optional phase

Co-authored-by: scbedd <45376673+scbedd@users.noreply.github.com>
2021-04-13 00:01:50 +00:00
Azure SDK Bot
05b73d3232
Removed the update CI target packages step. (#2102)
Co-authored-by: Sima Zhu <sizhu@microsoft.com>
Co-authored-by: Sima Zhu <48036328+sima-zhu@users.noreply.github.com>
2021-04-12 14:05:52 -07:00
Azure SDK Bot
2a945c3053
Sync eng/common directory with azure-sdk-tools for PR 1515 (#2088)
* Add lease to runs.
2021-04-12 00:39:39 +00:00
Azure SDK Bot
14cc77a963
Sync eng/common directory with azure-sdk-tools for PR 1548 (#2098)
* Remove passing -Mode Complete to deployment

When passing Complete it will remove any resources
already in the resource group that weren't part
of the current deployment. That removal breaks a
lot of assumptions, like multiple deployments when
testing things like smoke-tests or if you are reusing
an existing resource group. We don't want that to happen.

* Remove ServiceDirectory as required parameter for remove/update

When this was made mandatory it broke some usages which didn't
pass the value. Those usages don't need to pass it because
the pass required information in other ways so removing the
requirement for the parameter to be passed.

Co-authored-by: Wes Haggard <Wes.Haggard@microsoft.com>
2021-04-09 18:10:44 -07:00
Azure SDK Bot
1ab49d17d0
Fix BaseName initialization (#2096)
Initializing the BaseName with a ServiceDirectory that contains
a "/", because it is a multiple level path, causes the BaseName
initialization code to fail because it doesn't support the
validation pattern.

In all the known cases we already pass the ResourceGroupName
explicitly so don't need to set the BaseName so we can
skip the initialization in those cases.

Co-authored-by: Wes Haggard <Wes.Haggard@microsoft.com>
2021-04-09 13:32:50 -07:00
Azure SDK Bot
642c311676
Use single quotes for matrix generator command line arguments (#2028)
Co-authored-by: Ben Broderick Phillips <bebroder@microsoft.com>
2021-04-05 12:53:33 -04:00
Azure SDK Bot
0c1ec5c69e
Sync eng/common directory with azure-sdk-tools for PR 1525 (#2015)
* Use SubscriptionId throughout TestResources

Fixes #1454

* Resolve PR feedback

* Default DeleteAfterHours to 48 for SDK team

Also makes a few other adjustments for subscriptions, like restoring the previous one if available and another was specified.

* Resolve PR feedback

* Change deployment mode to Complete

Also fixes an issue where if the user opted not to deploy to the same resource group, the script would continue execution anyway.

* Use consistent aka links to satisfy link checker

Only need it for the new Update-TestResources.ps1 script, but I wanted them to look consistent.

Co-authored-by: Heath Stewart <heaths@microsoft.com>
2021-04-01 09:39:24 -07:00
Azure SDK Bot
fcbaf7301c
Sync eng/common directory with azure-sdk-tools repository (#2014) 2021-03-31 11:19:45 -07:00
Azure SDK Bot
0990a8599e
Add DependsOn parameter to matrix job generation template (#2001)
Co-authored-by: Ben Broderick Phillips <bebroder@microsoft.com>
2021-03-30 11:25:11 -07:00
Azure SDK Bot
b4110380f0
Sync eng/common directory with azure-sdk-tools for PR 1477 (#1981)
* Checked in the changes directly.

* Address feedback and remove the check of set-default-branch

* Fixed base repo branch

* Update git-branch-push.ps1

* Fixed the docs-metadata-release

* Change the typo

* Update eng/common/scripts/git-branch-push.ps1

Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com>

* Keep origin format

* Update git-branch-push.ps1

* Keep fixing the typo

Co-authored-by: Sima Zhu <sizhu@microsoft.com>
Co-authored-by: Sima Zhu <48036328+sima-zhu@users.noreply.github.com>
Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com>
2021-03-26 17:30:54 -07:00
Azure SDK Bot
24f44838a8
Sync eng/common directory with azure-sdk-tools for PR 1521 (#1982)
* Fix issue where 2d index arrays with length 1 get flattened by powershell

* Pass NonSparseParameters to imported matrix generation

Co-authored-by: Ben Broderick Phillips <bebroder@microsoft.com>
2021-03-26 12:52:31 -07:00
Azure SDK Bot
8d435df2d3
Support default branch for the workflow. Part 1 (#1979)
Co-authored-by: Sima Zhu <sizhu@microsoft.com>
2021-03-26 10:28:32 -07:00