Commit Graph

323 Commits

Author SHA1 Message Date
Daniel Jurek
8cf7746b6b
Add spellcheck (#2181)
* Add spellcheck

* Add spelling error

* Format cspell.json

* Revert "Add spelling error"

This reverts commit 37446522791492e8ee2c1c54af0d2da1e162d2e4.
2021-05-03 19:13:02 +00:00
Azure SDK Bot
cdb5fbfb35
Sync eng/common directory with azure-sdk-tools for PR 1524 (#2179)
* Make RELEASE_TITLE_REGEX more specific

* Update eng/common/scripts/ChangeLog-Operations.ps1

Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com>

* Update release REGEX

* tighten up changelog verification

* Ensure releaseDate is in the appriopriate format.

* Update error messages.

* Retrun false after error

Co-authored-by: Chidozie Ononiwu <chononiw@microsoft.com>
Co-authored-by: Chidozie Ononiwu <31145988+chidozieononiwu@users.noreply.github.com>
Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com>
2021-05-03 10:27:04 -07:00
Azure SDK Bot
3bb84c8de6
Sync eng/common directory with azure-sdk-tools for PR 1579 (#2171)
* Allow propogation of SetDevVersion.

* Allow use of SetDevVersion locally and across stages.

Co-authored-by: Mitch Denny <midenn@microsoft.com>
2021-05-02 17:49:56 -07:00
Azure SDK Bot
aafdeeb526
Sync Devops helper scripts from azure-sdk repo (#2177)
DevOps helper scripts were updated in azure-sdk repo
so syncing those changes into the tools repo so they
can be used prepare-release script.

Co-authored-by: Wes Haggard <Wes.Haggard@microsoft.com>
2021-04-29 15:42:28 -07:00
Azure SDK Bot
ead97d476b
Set multiple sparse checkout paths in one command/job (#2169)
Co-authored-by: Ben Broderick Phillips <bebroder@microsoft.com>
2021-04-29 13:23:33 -04:00
Azure SDK Bot
df2ffc0577
Sync eng/common directory with azure-sdk-tools for PR 1572 (#2172)
* Update prepare pipelines template.

* Update prepare-pipelines as well.

* Remove default line.

Co-authored-by: Mitch Denny <midenn@microsoft.com>
2021-04-29 03:39:14 +00:00
Anton Kolesnyk
cd36753d76
PackageVersion made constexpr and moved to src/package_version.hpp (#2166) 2021-04-28 17:34:24 -07:00
Azure SDK Bot
248dc0b96a
Parse MD files coming over http as raw markdown files (#2168)
This will allow us to point our verify-link script at a raw
MD file in a github repo and have it parsed correctly for
links.

Co-authored-by: Wes Haggard <Wes.Haggard@microsoft.com>
Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com>
2021-04-28 13:41:26 -07:00
Daniel Jurek
61aa827d5c
EngSys updates to support new vcpkg.json format (#2153)
* Use linux for vcpkg release

* Force lf line endings

* Set config correctly

* Better core.eol syntax and sequencing

* Try using linux host which uses LF by default

* Revert "Try using linux host which uses LF by default"

This reverts commit 160eb22b647e851a50f9d1e7b157a1e385fe946f.

* Use vcpkg.exe to format the manifest

* Spell correctly

* Move format-manfiest
2021-04-26 15:56:37 +00:00
Mitch Denny
79c9e12741
Enable retain runs. (#2145) 2021-04-23 09:17:08 +10:00
Azure SDK Bot
85e358a2ba
Add caching support to verify-links (#2150)
- Update link checking pipeline to enable caching
- Add loading cache file from a http endpoint
- Add retry logic when hitting 429

Fix verify link renaming scenarios

- Correctly error if link format is incorrect
- Handle case where the replace regex is not passed
- Improve the error logging so it is easier to
  identify the broken links
2021-04-22 14:14:23 -07:00
Azure SDK Bot
2ea6ee6d54
Sync eng/common directory with azure-sdk-tools for PR 1565 (#2137)
* Fix retain runs auth.

* Emit encoded token as secret.

Co-authored-by: Mitch Denny <midenn@microsoft.com>
2021-04-21 10:14:16 +10:00
Azure SDK Bot
5408d199eb
Sync eng/common directory with azure-sdk-tools for PR 1558 (#2142) 2021-04-20 15:47:03 -07:00
Azure SDK Bot
beda7bcaf8
Stop filtering projects by ci.yml files (#2139)
- This removes the ci.yml filtering which means all projects can be discovered
- This eliminates the need for the yml parsing module for most common scenarios
- This does introduce some potential issues with duplicate package names for
  languages like java. The only known case currently is azure-storage-blobs and
  if there is ever a need to explicitly pick the correct one someone can pass
  in the ServiceDirectory filter similar to "storage/azure*" for new and "storage/microsoft*"
  for the older sdk. By default azure usually comes first so the new one gets discovered
  which is likely all we need for now. If this turns out not to be true we might
  need another way to disambiguate.

Co-authored-by: Wes Haggard <Wes.Haggard@microsoft.com>
Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com>
2021-04-20 14:59:37 -07:00
Azure SDK Bot
d3d4fdfe2a
Use underscore-prefixed variable name when setting sub config values as secrets (#2134)
Co-authored-by: Ben Broderick Phillips <bebroder@microsoft.com>
2021-04-19 14:43:09 -07:00
Ahson Khan
d452e94337
Update vcpkg ports to use a manifest json file instead of a CONTROL file. (#2132)
* Update vcpkg ports to use a manifest json file instead of a CONTROL file.

* Update vcpkg ports to use a manifest json file instead of a CONTROL file
for remaining packages.

* Add the new vcpkg manifet json files and also update the template
package.

* Update paths in the cmake and eng scripts to find the right file now
that CONTROL is gone.
2021-04-19 12:50:50 -07:00
Azure SDK Bot
760026715a
Sync eng/common directory with azure-sdk-tools for PR 1560 (#2133)
* Add template to merge multiple subscription configurations

* Update eng/common/TestResources/build-test-resource-config.yml

Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com>

Co-authored-by: Ben Broderick Phillips <bebroder@microsoft.com>
Co-authored-by: Ben Broderick Phillips <ben@benbp.net>
Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com>
2021-04-19 11:00:40 -07:00
Azure SDK Bot
6b50feb0d4
Sync eng/common directory with azure-sdk-tools for PR 1559 (#2123)
* Handle empty files in Test-SampleMetadata

Relates to Azure/azure-sdk-for-java#20684

* Remove condition from verify-samples

* Use forward slash in path

* Fix directory typo

Co-authored-by: Heath Stewart <heaths@microsoft.com>
2021-04-14 22:37:40 -07:00
Azure SDK Bot
8002b63f61
Sync eng/common directory with azure-sdk-tools for PR 1555 (#2120)
* Verify samples during CIs

Replaces Azure/azure-sdk-for-python#17999 for use in all language repos.

* Move exit to proper scope

Co-authored-by: Heath Stewart <heaths@microsoft.com>
2021-04-14 17:56:19 -07:00
Azure SDK Bot
df69a35c88
Call bypass-local-dns.yml from verify-agent-os.yml - Easy way to ensure the DNS workaround is run in (almost) all pipelines (#2119)
Co-authored-by: Mike Harder <mharder@microsoft.com>
2021-04-14 17:23:12 -07:00
Azure SDK Bot
c297b63b9b
Sync eng/common directory with azure-sdk-tools for PR 1552 (#2110) 2021-04-13 11:12:50 -07:00
Mitch Denny
5f7f4783bb
Revert retain. (#2109) 2021-04-13 16:25:39 +10:00
Azure SDK Bot
edd6152632
Sync eng/common directory with azure-sdk-tools for PR 1553 (#2108)
* Remove condition.

* Fix up system access token usage.

Co-authored-by: Mitch Denny <midenn@microsoft.com>
2021-04-13 16:02:29 +10:00
Mitch Denny
ff2de0e506
Enable retain runs. (#2101) 2021-04-13 03:35:20 +00:00
Azure SDK Bot
7da44d90bb
Update eng/common dev version template. (#2106)
Co-authored-by: Mitch Denny <midenn@microsoft.com>
2021-04-13 10:45:42 +10:00
Azure SDK Bot
cf071db26a
Sync eng/common directory with azure-sdk-tools for PR 1551 (#2104)
* make -checkout: none an optional phase

Co-authored-by: scbedd <45376673+scbedd@users.noreply.github.com>
2021-04-13 00:01:50 +00:00
Azure SDK Bot
05b73d3232
Removed the update CI target packages step. (#2102)
Co-authored-by: Sima Zhu <sizhu@microsoft.com>
Co-authored-by: Sima Zhu <48036328+sima-zhu@users.noreply.github.com>
2021-04-12 14:05:52 -07:00
Daniel Jurek
35950242fb
Remove Manual build reason at the archetype-sdk-client.yml level. The appropriate check is already in place in archetype-cpp-release.yml (#2095) 2021-04-12 08:53:03 -07:00
Azure SDK Bot
2a945c3053
Sync eng/common directory with azure-sdk-tools for PR 1515 (#2088)
* Add lease to runs.
2021-04-12 00:39:39 +00:00
Azure SDK Bot
14cc77a963
Sync eng/common directory with azure-sdk-tools for PR 1548 (#2098)
* Remove passing -Mode Complete to deployment

When passing Complete it will remove any resources
already in the resource group that weren't part
of the current deployment. That removal breaks a
lot of assumptions, like multiple deployments when
testing things like smoke-tests or if you are reusing
an existing resource group. We don't want that to happen.

* Remove ServiceDirectory as required parameter for remove/update

When this was made mandatory it broke some usages which didn't
pass the value. Those usages don't need to pass it because
the pass required information in other ways so removing the
requirement for the parameter to be passed.

Co-authored-by: Wes Haggard <Wes.Haggard@microsoft.com>
2021-04-09 18:10:44 -07:00
Azure SDK Bot
1ab49d17d0
Fix BaseName initialization (#2096)
Initializing the BaseName with a ServiceDirectory that contains
a "/", because it is a multiple level path, causes the BaseName
initialization code to fail because it doesn't support the
validation pattern.

In all the known cases we already pass the ResourceGroupName
explicitly so don't need to set the BaseName so we can
skip the initialization in those cases.

Co-authored-by: Wes Haggard <Wes.Haggard@microsoft.com>
2021-04-09 13:32:50 -07:00
Daniel Jurek
5a99f38df1
Add nightly vcpkg publishing (#2025)
* Tool changes to support nightly test package release

* Initial wiring up and refactor vcpkg-publish.yml

* Use vcpkg-clone.yml

* Disable publishing for verification of nightly builds

* Complete the comment

* Dependency is enforced at the stage level, not the deployment/job level

* Remove environment, no approval needed

* Add ability to enable test release parameters

* deploy -> job

* deployment -> job

* Remove strategy

* Download pipeline artifacts

* task -> download

* Set appropriate working directory

* git status

* Set working directory

* Add pipeline for nightly vcpkg PR update

* Correct vcpkg-clone.yml path

* Add identity parameters to git merge commands

* Remove GitIdentityParameters, the merge command does not suppor tthem. Add instead in the pipeline

* Split lines

* Write-Host

* Template for nightly branch name, update comments, Check for scheduling or "PublishNightlyVcpkg"

* include archetype-cpp-release.yml changes

* Re-enable publishing stage

* Close the and

* Runtime condition for integration stage

* Move integration below package publishing stages

* try -- to disambiguate

* ^ -> ~

* Remove --

* Documentation and variable naming

* Move documentation comment

* Update eng/pipelines/templates/steps/generate-nightly-branch-name.yml

Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com>

* Apply suggestions from code review

Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com>

* Review feedback

* Add ability to skip all release steps

* Equal sign

* The right number of dashes

* Checkout before merge

* Checkout the default branch

* --no-ff

* git reset

* Skip publishing for artifacts which are not publishign to vcpkg

* Add git config --unset

* Apply suggestions from code review

Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com>

* Review feedback

* Review feedback

* Remove extra reset

* TestRelease -> DailyRelease

Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com>
2021-04-06 14:48:32 -07:00
Azure SDK Bot
642c311676
Use single quotes for matrix generator command line arguments (#2028)
Co-authored-by: Ben Broderick Phillips <bebroder@microsoft.com>
2021-04-05 12:53:33 -04:00
Azure SDK Bot
0c1ec5c69e
Sync eng/common directory with azure-sdk-tools for PR 1525 (#2015)
* Use SubscriptionId throughout TestResources

Fixes #1454

* Resolve PR feedback

* Default DeleteAfterHours to 48 for SDK team

Also makes a few other adjustments for subscriptions, like restoring the previous one if available and another was specified.

* Resolve PR feedback

* Change deployment mode to Complete

Also fixes an issue where if the user opted not to deploy to the same resource group, the script would continue execution anyway.

* Use consistent aka links to satisfy link checker

Only need it for the new Update-TestResources.ps1 script, but I wanted them to look consistent.

Co-authored-by: Heath Stewart <heaths@microsoft.com>
2021-04-01 09:39:24 -07:00
Victor Vazquez
cd4ea9966d
remove verbose config from win ci (#2002) 2021-04-01 01:32:26 +00:00
Daniel Jurek
e396888726
Manually install gcc and g++ 8 if needed (#2012) 2021-03-31 18:36:44 +00:00
Azure SDK Bot
fcbaf7301c
Sync eng/common directory with azure-sdk-tools repository (#2014) 2021-03-31 11:19:45 -07:00
Azure SDK Bot
0990a8599e
Add DependsOn parameter to matrix job generation template (#2001)
Co-authored-by: Ben Broderick Phillips <bebroder@microsoft.com>
2021-03-30 11:25:11 -07:00
Azure SDK Bot
b4110380f0
Sync eng/common directory with azure-sdk-tools for PR 1477 (#1981)
* Checked in the changes directly.

* Address feedback and remove the check of set-default-branch

* Fixed base repo branch

* Update git-branch-push.ps1

* Fixed the docs-metadata-release

* Change the typo

* Update eng/common/scripts/git-branch-push.ps1

Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com>

* Keep origin format

* Update git-branch-push.ps1

* Keep fixing the typo

Co-authored-by: Sima Zhu <sizhu@microsoft.com>
Co-authored-by: Sima Zhu <48036328+sima-zhu@users.noreply.github.com>
Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com>
2021-03-26 17:30:54 -07:00
Azure SDK Bot
24f44838a8
Sync eng/common directory with azure-sdk-tools for PR 1521 (#1982)
* Fix issue where 2d index arrays with length 1 get flattened by powershell

* Pass NonSparseParameters to imported matrix generation

Co-authored-by: Ben Broderick Phillips <bebroder@microsoft.com>
2021-03-26 12:52:31 -07:00
Azure SDK Bot
8d435df2d3
Support default branch for the workflow. Part 1 (#1979)
Co-authored-by: Sima Zhu <sizhu@microsoft.com>
2021-03-26 10:28:32 -07:00
Azure SDK Bot
f1688491d9
Sync eng/common directory with azure-sdk-tools for PR 1508 (#1956)
* Skip API create step when running from feature branch with non GA version
2021-03-26 01:40:47 -07:00
Azure SDK Bot
ea57783e05
Sync eng/common directory with azure-sdk-tools for PR 1478 (#1978)
* actually pass the _content_ of the reviewers or teamreviewers variable within create-pull-request.yml, update logic in Set-GitHubParameter
2021-03-26 01:25:26 +00:00
Azure SDK Bot
c0769b8e33
Sync eng/common directory with azure-sdk-tools for PR 1517 (#1977)
* Add chagelogpath to Update-ChangeLog.ps1

* Make PackageName and ServiceDirectory not mandatory, test ChangelogPath

Co-authored-by: Chidozie Ononiwu <chononiw@microsoft.com>
2021-03-25 15:52:00 -07:00
Chidozie Ononiwu
e25807adc2
Cleanup language settings file (#1968)
Co-authored-by: Wes Haggard <weshaggard@users.noreply.github.com>
2021-03-24 14:51:44 -07:00
Chidozie Ononiwu
7d9032fcc8
Add flag for closing the pull request immediately after opening it (#1965) 2021-03-24 09:52:36 -07:00
Azure SDK Bot
b6c354f435
Sync eng/common directory with azure-sdk-tools for PR 1514 (#1960)
* Handle null values when generating display names

* Fix issue processing matrices where the base matrix is only an import

Co-authored-by: Ben Broderick Phillips <bebroder@microsoft.com>
2021-03-23 12:51:00 -07:00
Chidozie Ononiwu
3d1a58e3f8
Fixup CHANGELOG.md, add SetPackageVersion, add calls to set-test-pipe… (#1936)
* Fixup CHANGELOG.md, add SetPackageVersion, add calls to set-test-pipeline-version.yml

* Run set-test-pipeline-version.yml per artifact, open testpipeline as draft

* git diff to view changes in file

* Move set-test-pipeline-version.yml after Validate Clang Format

* remove second artifact loop in archetype-cpp-release.yml
2021-03-23 11:34:30 -07:00
Azure SDK Bot
eb1177ea3a
Add ReleaseTrackingOnly option to Prepare-Release (#1958) 2021-03-22 20:21:13 -07:00
Azure SDK Bot
47d7a91c0c
Ensure version is sorted as semVer (#1948)
Co-authored-by: Chidozie Ononiwu <chononiw@microsoft.com>
2021-03-19 14:36:15 -07:00