Commit Graph

138 Commits

Author SHA1 Message Date
Azure SDK Bot
cdb5fbfb35
Sync eng/common directory with azure-sdk-tools for PR 1524 (#2179)
* Make RELEASE_TITLE_REGEX more specific

* Update eng/common/scripts/ChangeLog-Operations.ps1

Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com>

* Update release REGEX

* tighten up changelog verification

* Ensure releaseDate is in the appriopriate format.

* Update error messages.

* Retrun false after error

Co-authored-by: Chidozie Ononiwu <chononiw@microsoft.com>
Co-authored-by: Chidozie Ononiwu <31145988+chidozieononiwu@users.noreply.github.com>
Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com>
2021-05-03 10:27:04 -07:00
Azure SDK Bot
aafdeeb526
Sync Devops helper scripts from azure-sdk repo (#2177)
DevOps helper scripts were updated in azure-sdk repo
so syncing those changes into the tools repo so they
can be used prepare-release script.

Co-authored-by: Wes Haggard <Wes.Haggard@microsoft.com>
2021-04-29 15:42:28 -07:00
Azure SDK Bot
248dc0b96a
Parse MD files coming over http as raw markdown files (#2168)
This will allow us to point our verify-link script at a raw
MD file in a github repo and have it parsed correctly for
links.

Co-authored-by: Wes Haggard <Wes.Haggard@microsoft.com>
Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com>
2021-04-28 13:41:26 -07:00
Azure SDK Bot
85e358a2ba
Add caching support to verify-links (#2150)
- Update link checking pipeline to enable caching
- Add loading cache file from a http endpoint
- Add retry logic when hitting 429

Fix verify link renaming scenarios

- Correctly error if link format is incorrect
- Handle case where the replace regex is not passed
- Improve the error logging so it is easier to
  identify the broken links
2021-04-22 14:14:23 -07:00
Azure SDK Bot
2ea6ee6d54
Sync eng/common directory with azure-sdk-tools for PR 1565 (#2137)
* Fix retain runs auth.

* Emit encoded token as secret.

Co-authored-by: Mitch Denny <midenn@microsoft.com>
2021-04-21 10:14:16 +10:00
Azure SDK Bot
beda7bcaf8
Stop filtering projects by ci.yml files (#2139)
- This removes the ci.yml filtering which means all projects can be discovered
- This eliminates the need for the yml parsing module for most common scenarios
- This does introduce some potential issues with duplicate package names for
  languages like java. The only known case currently is azure-storage-blobs and
  if there is ever a need to explicitly pick the correct one someone can pass
  in the ServiceDirectory filter similar to "storage/azure*" for new and "storage/microsoft*"
  for the older sdk. By default azure usually comes first so the new one gets discovered
  which is likely all we need for now. If this turns out not to be true we might
  need another way to disambiguate.

Co-authored-by: Wes Haggard <Wes.Haggard@microsoft.com>
Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com>
2021-04-20 14:59:37 -07:00
Azure SDK Bot
6b50feb0d4
Sync eng/common directory with azure-sdk-tools for PR 1559 (#2123)
* Handle empty files in Test-SampleMetadata

Relates to Azure/azure-sdk-for-java#20684

* Remove condition from verify-samples

* Use forward slash in path

* Fix directory typo

Co-authored-by: Heath Stewart <heaths@microsoft.com>
2021-04-14 22:37:40 -07:00
Azure SDK Bot
8002b63f61
Sync eng/common directory with azure-sdk-tools for PR 1555 (#2120)
* Verify samples during CIs

Replaces Azure/azure-sdk-for-python#17999 for use in all language repos.

* Move exit to proper scope

Co-authored-by: Heath Stewart <heaths@microsoft.com>
2021-04-14 17:56:19 -07:00
Azure SDK Bot
05b73d3232
Removed the update CI target packages step. (#2102)
Co-authored-by: Sima Zhu <sizhu@microsoft.com>
Co-authored-by: Sima Zhu <48036328+sima-zhu@users.noreply.github.com>
2021-04-12 14:05:52 -07:00
Azure SDK Bot
2a945c3053
Sync eng/common directory with azure-sdk-tools for PR 1515 (#2088)
* Add lease to runs.
2021-04-12 00:39:39 +00:00
Azure SDK Bot
642c311676
Use single quotes for matrix generator command line arguments (#2028)
Co-authored-by: Ben Broderick Phillips <bebroder@microsoft.com>
2021-04-05 12:53:33 -04:00
Azure SDK Bot
b4110380f0
Sync eng/common directory with azure-sdk-tools for PR 1477 (#1981)
* Checked in the changes directly.

* Address feedback and remove the check of set-default-branch

* Fixed base repo branch

* Update git-branch-push.ps1

* Fixed the docs-metadata-release

* Change the typo

* Update eng/common/scripts/git-branch-push.ps1

Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com>

* Keep origin format

* Update git-branch-push.ps1

* Keep fixing the typo

Co-authored-by: Sima Zhu <sizhu@microsoft.com>
Co-authored-by: Sima Zhu <48036328+sima-zhu@users.noreply.github.com>
Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com>
2021-03-26 17:30:54 -07:00
Azure SDK Bot
24f44838a8
Sync eng/common directory with azure-sdk-tools for PR 1521 (#1982)
* Fix issue where 2d index arrays with length 1 get flattened by powershell

* Pass NonSparseParameters to imported matrix generation

Co-authored-by: Ben Broderick Phillips <bebroder@microsoft.com>
2021-03-26 12:52:31 -07:00
Azure SDK Bot
8d435df2d3
Support default branch for the workflow. Part 1 (#1979)
Co-authored-by: Sima Zhu <sizhu@microsoft.com>
2021-03-26 10:28:32 -07:00
Azure SDK Bot
f1688491d9
Sync eng/common directory with azure-sdk-tools for PR 1508 (#1956)
* Skip API create step when running from feature branch with non GA version
2021-03-26 01:40:47 -07:00
Azure SDK Bot
ea57783e05
Sync eng/common directory with azure-sdk-tools for PR 1478 (#1978)
* actually pass the _content_ of the reviewers or teamreviewers variable within create-pull-request.yml, update logic in Set-GitHubParameter
2021-03-26 01:25:26 +00:00
Azure SDK Bot
c0769b8e33
Sync eng/common directory with azure-sdk-tools for PR 1517 (#1977)
* Add chagelogpath to Update-ChangeLog.ps1

* Make PackageName and ServiceDirectory not mandatory, test ChangelogPath

Co-authored-by: Chidozie Ononiwu <chononiw@microsoft.com>
2021-03-25 15:52:00 -07:00
Azure SDK Bot
b6c354f435
Sync eng/common directory with azure-sdk-tools for PR 1514 (#1960)
* Handle null values when generating display names

* Fix issue processing matrices where the base matrix is only an import

Co-authored-by: Ben Broderick Phillips <bebroder@microsoft.com>
2021-03-23 12:51:00 -07:00
Azure SDK Bot
eb1177ea3a
Add ReleaseTrackingOnly option to Prepare-Release (#1958) 2021-03-22 20:21:13 -07:00
Azure SDK Bot
47d7a91c0c
Ensure version is sorted as semVer (#1948)
Co-authored-by: Chidozie Ononiwu <chononiw@microsoft.com>
2021-03-19 14:36:15 -07:00
Azure SDK Bot
d577d25041
Sync eng/common directory with azure-sdk-tools for PR 1489 (#1928)
* Add draft to Submit-PullRequest.ps1

* Add -Draft to create-pull-request.yml

* Add documentation

* Rename: Draft[Pr] -> OpenAsDraft

* Update docs

Co-authored-by: Daniel Jurek <djurek@microsoft.com>
2021-03-18 14:50:46 -07:00
Azure SDK Bot
e464f8b01e
Sync eng/common directory with azure-sdk-tools for PR 1498 (#1924)
* Fix null check against matrix parameter array

* add negative test cases

Co-authored-by: Ben Broderick Phillips <bebroder@microsoft.com>
Co-authored-by: Chidozie Ononiwu <31145988+chidozieononiwu@users.noreply.github.com>
2021-03-18 13:34:30 -04:00
Azure SDK Bot
ca1692e375
Sync eng/common directory with azure-sdk-tools for PR 1463 (#1919)
* Add 'replace' support. Improve handling of dynamic parameter types.

* Support display name import and overrides

* Support regex capture groups for replace. Force fully matching regex.

Co-authored-by: Ben Broderick Phillips <bebroder@microsoft.com>
2021-03-16 16:46:41 -07:00
Azure SDK Bot
6e19575491
Revert to Checking only ci.yml (#1918)
Pull only artifacts from `ci.yml` to resolve issue with conflicting package names.

Co-authored-by: Chidozie Ononiwu <31145988+chidozieononiwu@users.noreply.github.com>
2021-03-16 14:53:03 -07:00
Azure SDK Bot
d08bebfb6a
Sync eng/common directory with azure-sdk-tools for PR 1418 (#1759)
* Update Package Properties Logic, make prepare release require only 1 argument, make rerun of Get-PkgProperties in Update-Changelog not required

* Remove ServiceDirectory parameter from PrepareRelease.ps1

* changes to argument names

* pass service directory to Get-AllPackageInfoFromRepo

* Remove changes in Update-ChangeLog.ps1

* updates to Package-Properties.ps1

Co-authored-by: Chidozie Ononiwu <chononiw@microsoft.com>
Co-authored-by: Chidozie Ononiwu <31145988+chidozieononiwu@users.noreply.github.com>
2021-03-15 23:23:26 -07:00
Azure SDK Bot
d7924ce12f
Address PR feedback (#1826)
Co-authored-by: Sima Zhu <sizhu@microsoft.com>
Co-authored-by: Sima Zhu <48036328+sima-zhu@users.noreply.github.com>
2021-03-15 10:04:22 -07:00
Azure SDK Bot
6a8aff701c
Fix bug in Changelog URL path using packageDirectoryName (#1878)
Co-authored-by: Chidozie Ononiwu <chononiw@microsoft.com>
2021-03-11 16:50:56 -08:00
Azure SDK Bot
8dcea0f47f
Sort changelogs by date then version (#1832)
Fixes #1389

Co-authored-by: Heath Stewart <heaths@microsoft.com>
2021-03-10 11:57:49 -08:00
Azure SDK Bot
37454b68ef
Sync eng/common directory with azure-sdk-tools for PR 1452 (#1814)
* Use sparse checkout for generate matrix job

* Add repository parameter

Co-authored-by: Ben Broderick Phillips <bebroder@microsoft.com>
2021-03-08 18:07:54 -08:00
Azure SDK Bot
b96f42481c
Fix logic in SetTestPipelineVersionInEngCommon (#1794)
Co-authored-by: Chidozie Ononiwu <chononiw@microsoft.com>
2021-03-05 13:49:38 -08:00
Azure SDK Bot
64d18ea182
Fix bug where imported matrix parameter duplicates are not overrided (#1790)
Co-authored-by: Ben Broderick Phillips <bebroder@microsoft.com>
2021-03-05 12:59:49 -08:00
Azure SDK Bot
f3e98ffb47
Sync eng/common directory with azure-sdk-tools for PR 1448 (#1774)
* Added more logging to API view create

* Updated logs with arch board rescue email address

* Fix as per review comments

* Update logging to show API URL

Co-authored-by: praveenkuttappan <prmarott@microsoft.com>
2021-03-05 06:46:59 -08:00
Azure SDK Bot
d8b532af57
Fix PackageName typo (#1782)
Co-authored-by: Chidozie Ononiwu <chononiw@microsoft.com>
2021-03-04 20:38:17 -08:00
Azure SDK Bot
a475980de6
Move SetTestPipelineVersion.ps1 to eng/common (#1780)
Co-authored-by: Chidozie Ononiwu <chononiw@microsoft.com>
2021-03-04 18:42:45 -08:00
Azure SDK Bot
d782c99777
Fix LanguageShort typo (#1768)
Co-authored-by: Chidozie Ononiwu <chononiw@microsoft.com>
2021-03-03 12:24:09 -08:00
Azure SDK Bot
02622fff74
Update Prepare-Release script (#1757)
- Remove BuildType parameter as we can default it from package properties
- Stop passing BuildType and GroupId and instead defaul them from package properties
- Enable StrictMode to help identify potential errors
- Start passing sdktype and isnewsdk properties to devops script
- Sync latest changes with devops work item to fix a couple bugs

Co-authored-by: Wes Haggard <Wes.Haggard@microsoft.com>
2021-02-26 18:46:42 -08:00
Azure SDK Bot
824853d948
Sync eng/common directory with azure-sdk-tools for PR 1421 (#1720)
* Add common tools for spell check

* Updates from further iteration

* Review feedback: Add check for git as well

* Review feedback * Use common approach to resolving base branch name * Eliminate default base branch "master" as this will be changed later, providing no default and using a mandatory parameter means a dev must provide the value * Check for existence of $CspellConfigPath * No need to Set-Location if run from the root of the repo (most common scenario) * -join

* Review feedback: Rename TargetRef -> TargetBranch, add SourceBranch, Add reference to spelling docs, exit 0, Rename to check-spelling-in-changed-files.ps1,

* Review feedback: Remove ValidateNotNullOrEmpty (we do more definitive validation farther down that will also catch these errors), Update comments and script name

Co-authored-by: Daniel Jurek <djurek@microsoft.com>
2021-02-22 22:16:09 -08:00
Azure SDK Bot
7e22da08b9
Restore pipeline output variable for Agent OS name (#1709)
Co-authored-by: Ben Broderick Phillips <bebroder@microsoft.com>
2021-02-22 16:47:08 -05:00
Azure SDK Bot
5a1fedd0d5
Sync eng/common directory with azure-sdk-tools for PR 1429 (#1705)
* Add job matrix generation scripts

* Add working job matrix example pipeline and common matrix generation pipeline.

* Update job matrix tests path

* Parameterize matrix generation job path

* Add global variable to override nuget security checks to sample matrix pipeline

* Update readme matrix pipeline example to match sample file

Co-authored-by: Ben Broderick Phillips <bebroder@microsoft.com>
2021-02-19 14:45:31 -08:00
Azure SDK Bot
5e97c8f67f
Sync eng/common directory with azure-sdk-tools for PR 1425 (#1698)
* Trim off the target branch

* Update eng/common/scripts/get-markdown-files-from-changed-files.ps1

Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com>

* Update get-markdown-files-from-changed-files.ps1

* Update get-markdown-files-from-changed-files.ps1

* Trim the slash

Co-authored-by: Sima Zhu <sizhu@microsoft.com>
Co-authored-by: Sima Zhu <48036328+sima-zhu@users.noreply.github.com>
Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com>
2021-02-19 12:02:01 -08:00
Azure SDK Bot
f929894274
Sync eng/common directory with azure-sdk-tools for PR 1374 (#1686)
* Create package property file using artifact name

* Add option to pass config file dir

* Set default config file directory to avoid script execution failure

Co-authored-by: praveenkuttappan <prmarott@microsoft.com>
2021-02-16 11:57:56 -08:00
Azure SDK Bot
74bfafcb52
Sync eng/common directory with azure-sdk-tools for PR 1371 (#1634)
* Rework verify agent OS step.

* Address feedback

* Justing string matching instead.

* ! instead of -not

Co-authored-by: Mitch Denny <midenn@microsoft.com>
2021-02-14 15:56:25 -08:00
Azure SDK Bot
9e0494674f
Change script parameters to boolean (#1672)
Co-authored-by: Chidozie Ononiwu <chononiw@microsoft.com>
2021-02-11 13:43:16 -08:00
Azure SDK Bot
e99c6df201
Enable passing devops pat for work item scripts (#1670)
Co-authored-by: Wes Haggard <Wes.Haggard@microsoft.com>
2021-02-11 11:12:18 -08:00
Azure SDK Bot
2741ad4762
Sync eng/common directory with azure-sdk-tools for PR 1303 (#1667)
* Add PrepareRelease Script

* Update Package-Properties.ps1

* Update Collect-ChangeLog Script

* Update Collect-ChangeLog.ps1 and Collect-Unreleased.ps1

* Update GeneralReleaseNotesParser.ps1 script

* Change GeneralReleaseNotesParser logic

* Change GeneralReleaseNotesParser.ps1 logic

* Remoce GeneralReleaseNotesParsercopy

* Update collect changelog and generalreleasenotes parser logic

* Refine CollectChangelog Logic

* Add logic for filtering collected changelog

* Add Filter-ReleaseHighlights function

* Update General ReleasNotes Logic

* Delete GeneralReleaseNotesLogic.ps1

* Update Collect ChangeLogLogic

Co-authored-by: Chidozie Ononiwu <chononiw@microsoft.com>
2021-02-10 18:43:01 -08:00
Azure SDK Bot
234a0eff28
Update devops helper script based on changes in azure-sdk repo (#1628)
- Sync devops helper script changes
- Fix issue in SemVer script when using strict mode with Language not set

Co-authored-by: Wes Haggard <Wes.Haggard@microsoft.com>
2021-02-08 12:45:38 -08:00
Azure SDK Bot
30938091ff
Sync eng/common directory with azure-sdk-tools for PR 1364 (#1586)
* Support sub directory for artifact location

* Fix as per review comment to avoid artifact sub path

* Package property file is not created for track1 and management pacakges.

* Fix property name case

* Fix as per review comments

* Fix as per review comments

* Use Config File param value as is

* Change to make path joineasily readable

Co-authored-by: praveenkuttappan <prmarott@microsoft.com>
2021-02-03 13:29:43 -08:00
Azure SDK Bot
75255c2247
Sync eng/common directory with azure-sdk-tools for PR 1353 (#1562)
* Use a helper function to normalize the package name for readme

* Get the readme name from artifact-metadata-parsing

* Change to the readme

* Update eng/common/scripts/artifact-metadata-parsing.ps1

Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com>

Co-authored-by: Sima Zhu <sizhu@microsoft.com>
Co-authored-by: Sima Zhu <48036328+sima-zhu@users.noreply.github.com>
Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com>
2021-02-01 18:56:20 -08:00
Azure SDK Bot
67472249de
Fix DateTime bug (#1538)
Co-authored-by: Chidozie Ononiwu <chononiw@microsoft.com>
2021-02-01 14:52:43 -08:00
Azure SDK Bot
31fc4a5dee
Sync eng/common directory with azure-sdk-tools for PR 1345 (#1517)
* Enforce API approval status for GA and include SDK type in package properties

* Fix per review comment

* Fixes as per review comments to avoid changing constructor signature

* Fixes as per review comments to handle track 1 packages

* Fix yaml format error

Co-authored-by: praveenkuttappan <prmarott@microsoft.com>
2021-01-29 13:13:41 -08:00