Commit Graph

143 Commits

Author SHA1 Message Date
Ben Broderick Phillips
1715a288d3
Add auto apiview review creation (#3763)
* Add create api auto review step

* Continue on api view upload failure

* Add comment explaining ast generation in api view script
2022-06-28 15:54:51 -04:00
Ben Broderick Phillips
e3dd52a649
Revert "Override live test location default to westus (#3696)" (#3761)
This reverts commit d4192609d5.
2022-06-21 20:45:15 -04:00
Victor Vazquez
f4bbfaa7da
[EngSys] Get Vcpkg automatically (#3614)
* get vcpkg automatically
2022-06-07 18:45:50 -07:00
Ben Broderick Phillips
d4192609d5
Override live test location default to westus (#3696) 2022-06-06 20:07:52 -04:00
Daniel Jurek
7574e73c9c
Tab vcpkg publishing condition in to apply to the task (#3709) 2022-06-06 11:07:32 -07:00
Larry Osterman
7c93854125
Complete the initial implementation of OpenTelemetry (#3677)
* Added telemetry support for HTTP pipeline elements

* Finish OpenTelemetry implementation

* clang-format and added doxygen comments
2022-05-31 10:57:32 -07:00
George Arama
855f000f63
Vcpkg sample (#3670)
* one commit to rule them all

* main merge

* error

* all smoke

* typo

* 120 minutes

* timeout param missing on job

* actual url

* Update samples/integration/vcpkg-all-smoke/src/main.cpp

Co-authored-by: Larry Osterman <LarryOsterman@users.noreply.github.com>

* actual creds

Co-authored-by: Larry Osterman <LarryOsterman@users.noreply.github.com>
2022-05-27 12:17:43 -07:00
Larry Osterman
8ca08a1429
Initial implementation of OpenTelemetry APIs. (#3561)
* Start of tracing prototype

* Created initial implementation of azure-core-opentelemetry package

* New version of enabling MSVCRT Lib for static configs

* Attempt to add OpenTelemetry tests to build

* Take a dependency on OpenTelemetry version 1.3

* Added service API level tracing support

* API Review feedback
2022-05-23 16:44:22 -07:00
Larry Osterman
7c2682b14d
Removed uwp-x86 from platform matrix. (#3629) 2022-05-11 12:20:29 -07:00
Anton Kolesnyk
5cb60868e1
Add ClientCertificateCredential (#3578)
* Add ClientCertificateCredential

* Update unit test

* cspell

* Update Readme

* Cosmetic fixes

* Changelog to mention env cred update

* Fix warning

* cspell

* Tell CI to install openssl

* openssl for all Windows

* update dependency manifest

* Re-phrase changelog

* Clang warnings

* Clang warning

* Clang warning - 2

* Ubuntu18 warning

* Update sdk/identity/azure-identity/CHANGELOG.md

Co-authored-by: Victor Vazquez <victor.vazquez@microsoft.com>

* PR feedback

Co-authored-by: Anton Kolesnyk <antkmsft@users.noreply.github.com>
Co-authored-by: Victor Vazquez <victor.vazquez@microsoft.com>
2022-04-28 10:47:45 -07:00
Daniel Jurek
140e05baa7
Migrate to matrix generator (#3553)
* Represent existing matrix in json
* Use new matrix
* Move to stage
* Cloud configuration
* MaxParallel
* DependsOn
* Quote CtestRegex
* Use template for cmake generate tests
* Template name mappings
* Formatting, parameters
* Remove duplicate bypass-local-dns.yml
* Enable Location override
* Add Location
* Add spelling words
* Use Ubuntu 20 where the name specifies Ubuntu 20
* Apply suggestions from code review

Co-authored-by: Ben Broderick Phillips <ben@benbp.net>

* PR feedback
* fix storage sample
* Matrix documentation

Co-authored-by: Ben Broderick Phillips <ben@benbp.net>
Co-authored-by: Victor Vazquez <vhvb1989@gmail.com>
2022-04-26 14:34:23 +00:00
Daniel Jurek
04cd29039b
Vcpkg Binary Cache Cleanup (#3482)
* Expiration time, eliminate AzureRm warning, condition on Set-VcpkgWriteModeCache

* Attempt uninstalling AzureRM and installing Az.Storage

* Import PSModule-Helpers.ps1

* Unsintall-AzureRm if the function exists

* Get-Command

* Uninstall-Module Azure.Storage

* Log

* quotes

* Get-Command some more

* Format list

* Alias fun

* Naming

* show PSModulePath

* Attempt to handle module double backslash

* do not observe

* do not observe for real

* Spelling

* Empty commit to re-trigger CI with a full matrix
2022-04-04 13:12:16 -07:00
Daniel Jurek
a91d151e79
Vcpkg Beta Automation (for real) (#3497)
* Script that automates updating vcpkg betas

* Wire up to pipeline

* Spelling, commentary

* Clone into repo name

* Remove-Item requires the path to exist, even if -Force is specified

* Bootstrap vcpkg

* Arguments to Test-ShouldReleaseToVcpkg.ps1

* More commit

* Escape quotes

* Quote git commit

* Set strict mode

* Use tags

* Actually tag

* Run git commands

* Invoke-Expression

* Onboard releasing package to vcpkg before attempting to isntall from overaly

* temporarily disable matrix generation (30s tasks sometimes runs for 20+ minutes)

* Test-ShouldReleaseToVcpkg.ps1

* Test-Path

* Test vcpkg build, also ensure we push

* Just the tags... low probabiltiy of success given that '--' if frequently treated as a separator

* Add ability to skip link verification for tighter inner loop

* Push tag separately

* Unnecessary condition and conjunction

* Base repo owner: Azure

* Specify remote name

* Tighten inner loop

* git remote -v

* workingDirectory

* Go back to two tags and a regular push

* Saving some progress

* Use original push method

* BaseRepoOwner

* Cleanup, put changes in the default branch (vcpkg does not look at refs outside of the default branch)

* Use default branch

* Revert changes used to tighten up devops inner loop

* Revert an unrelated change

* Revert unrelated changes

* Revert unrelated changes

* Add spelling
2022-04-01 06:30:03 -07:00
Daniel Jurek
ca8b843954
Revert "Vcpkg Beta Automation (#3430)" (#3495)
This reverts commit 60f0dfdcea.
2022-03-31 13:14:19 -07:00
Daniel Jurek
60f0dfdcea
Vcpkg Beta Automation (#3430)
* Script that automates updating vcpkg betas

* Wire up to pipeline

* Spelling, commentary

* Clone into repo name

* Remove-Item requires the path to exist, even if -Force is specified

* Bootstrap vcpkg

* Arguments to Test-ShouldReleaseToVcpkg.ps1

* More commit

* Escape quotes

* Quote git commit

* Set strict mode

* Use tags

* Actually tag

* Run git commands

* Invoke-Expression

* Onboard releasing package to vcpkg before attempting to isntall from overaly

* temporarily disable matrix generation (30s tasks sometimes runs for 20+ minutes)

* Test-ShouldReleaseToVcpkg.ps1

* Test-Path

* Test vcpkg build, also ensure we push

* Just the tags... low probability of success given that '--' if frequently treated as a separator

* Add ability to skip link verification for tighter inner loop

* Push tag separately

* Unnecessary condition and conjunction

* Base repo owner: Azure

* Specify remote name

* Tighten inner loop

* git remote -v

* workingDirectory

* Go back to two tags and a regular push

* Saving some progress

* Use original push method

* BaseRepoOwner

* Cleanup, put changes in the default branch (vcpkg does not look at refs outside of the default branch)

* Use default branch
2022-03-31 12:52:14 -07:00
George Arama
b7a79158d2
Verify changelog (#3489)
* bump keys version to 7.3

* Revert "bump keys version to 7.3"

This reverts commit e348e966de56f28996b4cb32104088b4414559ed.

* bump keys version to 7.3

* Revert "bump keys version to 7.3"

This reverts commit e348e966de56f28996b4cb32104088b4414559ed.

* add ps1

* dsd

* test2

* update paths

* package info

* conditional

* remove extra spaces

* missing paran
2022-03-31 11:24:24 -07:00
Victor Vazquez
835f156af9
Vcpkg manifest and binary caching (#3329)
* binary cache and manifest

* update packages

* udpate

* add cache to private pipeline

* next try

* aver

* other

* again

* aver quick

* more

* this way

* again

* one more

* print

* test

* use depend

* more deps

* dep

* Apply suggestions from code review

Co-authored-by: Daniel Jurek <djurek@microsoft.com>

* updated to use group variable

* update identity

* end line

* Update vcpkg.json

* Apply suggestions from code review

* cspell

* remove comment

* updates

* make cache mode depend on SAS env var

* map env var only for internal pipelines

* other approach

* what about this

* and this

* try

* amd

* another

* extra step

* typo

* override for internal

* use default succeded

* azure core update manifest

* a

* run cmake-generate nightly as well

* check for SAS

* check cache

* no secret

* fix is secret

* pass explicit

* use secret all the time

* char

* One more

* export

* echos

* last

* array

* remove question

* ok

* weird

* use account key

* substring

* VCPKG_BINARY_SOURCES

* Add module installation

* task:

* Correct pathing for module

* update source gen

* format

* update spelling

* IsWindoows

* Use pwsh

* Cannot clobber with PSModule-Helpers. Attempt plain install

* Attempt plain install

* Revert unnecessary change to Update-DocsMsToc.ps1

* template ready

* curl is required on Windows as well for some CI gates

* attestation

* fix format

Co-authored-by: Daniel Jurek <djurek@microsoft.com>
2022-03-24 09:11:30 -07:00
Victor Vazquez
67fd525d23
Run tests on Release mode for Windows CI gates (nightly) (#3473)
* run tests on Release mode

* typo

* one step only
2022-03-23 17:29:43 -07:00
Daniel Jurek
ca61b8b214
Update prepare-pipelines.yml (#3459) 2022-03-22 12:19:28 -07:00
Victor Vazquez
feaaf0b414
Update release mode windows + samples (#3451)
* changes

* vs generator

* use macro

* release and samples

* add target to build smoke test

* revert

* reuse macro for samples

* extra legs for samples only

* storage connection string

* format

* order and macro

* update

* samples

* missing
2022-03-22 01:39:39 +00:00
Daniel Jurek
44310b635a
Log binary sizes (excl. UWP changes) (#3357)
* Output binary sizes (Get-BinarySizes.ps1 works for linux environment)

* Add better support for Windows binary output

* Update matrix to properly build Debug and Release on Windows

* Add TEAMPROJECTID to spell check

* Add extra labels

* Ensure BuildArgs doesn't get duplicated

* Log additional metrics

* Add openssl to Win32Api_curl

* SourceBranchName -> SourceBranch

* Fix matrix entries

* Document included

* Review feedback for Get-BinarySizes.ps1

* Infer many metrics from the environment

* Add issecret to cspell.json

* Extra equal signs

* Correct directory depth for $BuildDirectory

* Correct casing for mac VM image
2022-03-03 11:36:11 -08:00
Larry Osterman
ddc9eb355f
Fixed Live Tests for Attestation SDK. (#3366)
* Set WinHTTP_OPTION_CLIENT_CERT_CONTEXT to enable connections to attestation service

* Set serviceDirectory from environment variables

Co-authored-by: Victor Vazquez <victor.vazquez@microsoft.com>
2022-02-24 22:48:15 +00:00
Larry Osterman
cd9ae61a8e
Created Attestation Administration client (#3355)
* Created Attestation Administration client

* Integrated with main
2022-02-19 01:56:35 +00:00
Daniel Jurek
d741007571
Add relevant variable groups to new pipelines (#3353) 2022-02-17 06:00:28 +00:00
Larry Osterman
d2fd862ce1
Create Attestation SDK (#3228)
* Created Attestation


Co-authored-by: Victor Vazquez <victor.vazquez@microsoft.com>
Co-authored-by: Daniel Jurek <djurek@microsoft.com>
2022-02-16 09:15:18 -08:00
Daniel Jurek
a97903770a
Skip release stage on private repository (#3322) 2022-02-04 23:15:16 -08:00
Victor Vazquez
0414dd3b15
restore uwp, only remove tests (#3300) 2022-02-01 11:05:56 -08:00
Victor Vazquez
1cd14b196d
diable uwp gates (#3296) 2022-01-31 16:09:30 -08:00
George Arama
71d4b87bb0
fix build (#3270)
* fix build

* add build samples to ci
2022-01-25 14:26:10 -08:00
Victor Vazquez
c10de791cc
Build ci gates per service (#3260) 2022-01-20 18:09:06 +00:00
Scott Beddall
8474c4c69c
Fix BOM artifact upload failure on failed cmake (#3256)
* ensure bom generation matches the artifact conditions. unless cancelled, it'll always be generated and uploaded
2022-01-18 15:26:55 -08:00
Victor Vazquez
20bb1ec276
Recordings for storage (#3194)
* Recordings for storage (#4)
2022-01-18 14:50:15 -08:00
George Arama
9d1ede92ec
Prototype build from source (#3180)
* prepPR

* gitignore updates

* cspell.json

* spell

* cspell typo

* deisable option

* need to look out for this

* reenable tests

* set unset location properly

* building in docker

* format file

* final changes

* PR comments

* update git ignore

* test cmake build

* test 2

* ren steps

* test new step

* try again

* again

* oops

* try again

* put back

* test2

* test5_46

* progress

* more again

* test6_35

* test 6_55

* test_again

* move up

* test

* output params

* try try again

* one more test

* put back curl

* os

* run only on one

* try again

* typo

* switch variable

* set things back

* set things back

* prep for next step

* test source deps new

* try again

* try try again

* typo

* test rewire

* params

* typo

* fix

* get rid of vcpkg

* linux

* mac

* try brew

* try exports

* try again

* typo

* set env

* include dir

* root

* try again

* typo

* dfsfsda

* try agan

* try again

* oops

* sdfsd

* typo

* dsdsad

* hghhg

* update env

* ghhgj

* sAdsad

* try again

* fdfd

* rewrew

* dsadas

* sdasda

* ggggg

* envs2

* envs3

* typo

* order

* try again

* make sure we don't blow up other pipelines

* typo

* typo

* fsdfs

* check null

* put back
2022-01-14 13:06:00 -08:00
Scott Beddall
67dce1292e
Add Manifest Generation (#3241)
* add manifest generation

* enable bom signing

* swap to publish-artifact, add necessary artifact upload for ci.tests.
2022-01-14 09:06:31 -08:00
Victor Vazquez
30c5d77d88
Remove Logging from the LibcurlConnectionPool - cleaning routine (#3219)
Remove Logging from the LibcurlConnectionPool - cleaning routine (#3219)
2022-01-13 20:04:18 +00:00
Victor Vazquez
dc5b45e759
Test Cmake generate configs (#3230)
Adding extra stage for individual packages generation
2022-01-11 15:49:56 -08:00
Daniel Jurek
afe34f63ef
Upload map files to specific artifact locations (#3229)
* Require success to upload map files

* Use a different artifact name for each attempt

* Agent.JobAttempt -> System.JobAttempt, add some display names
2022-01-10 15:25:32 -08:00
Victor Vazquez
e7c610dcb3
aver (#3212) 2022-01-05 12:24:55 -08:00
George Arama
f60db74f21
Enable extra logging for tests (#3202)
* enable -VV

* verbose

* PR comments

* PR discussion
2022-01-04 12:03:04 -08:00
Daniel Jurek
fa0fa97155
Generate map files (#3181)
* Generate map files in build

* Add .map file artifact publishing

* Add Xlinker to spelling exceptions

* Remove PublishMapFiles from clang builds

* Generate the map file artifact name

* CXX_COMPILER_ID and some logging for Clang which might be linking using the GNU linker by default

* More logging

* Move logging out of conditional

* Logging up high, use OS to determine which link flags to set

* Use linker options specific to AppleClang's context, publish map files for all platforms
2022-01-03 13:56:41 -08:00
George Arama
468b84c170
increalse live test timeout (#3205) 2022-01-03 11:45:46 -08:00
Victor Vazquez
0bde2ad3f8
Define env from each service ci (#3184)
use env vars by service config
2021-12-14 17:23:44 -08:00
Victor Vazquez
7301f348b0
Recordings for identity (#3156)
Adding test recordings for Identity
2021-12-14 21:42:08 +00:00
Daniel Jurek
ef12972c5c
Move macos up to 10.15 or remove where there is sufficient 10.15 coverage (#3169) 2021-12-08 13:08:00 -08:00
Victor Vazquez
50e984f35c
Recording for Key Vault Keys (#3146)
* test recordings for KeyVault Keys
2021-12-06 20:58:33 +00:00
Sima Zhu
b28496a9fb
Fixed the get-codeowner in release step. (#3130) 2021-11-22 17:31:43 -08:00
Victor Vazquez
ea9c1efe86
Run service samples on CI gate with ubuntu (#3105)
* samples on ubuntu-default
2021-11-18 10:47:18 -08:00
Daniel Jurek
198327e16c
Reduce incidence of build storms (#3079)
* Narrower build trigger matrix, introduce batching so changes to main don't trigger builds for every checkin if there are other builds running, expand core to test everything in CI

* Wire up CtestExcludeRegex

* Improvements including scoping to exclude storage tests

* Use correct trigger settings for storage
2021-11-08 15:01:50 -08:00
Daniel Jurek
eae7b14f57
Add Xcode 12.5.1 (#3023) 2021-11-04 14:42:29 -07:00
Daniel Jurek
f1aae9d79e
Readd -V to ctest invocation (#3042) 2021-11-04 10:17:02 -07:00