Commit Graph

73 Commits

Author SHA1 Message Date
Scott Beddall (from Dev Box)
da1190ffb1 pull across all changes to scripts that are required to support 1es templates. still need to update the reference to archetype-sdk-tests-generate -> generate-job-matrix 2024-03-11 14:53:31 -07:00
Anton Kolesnyk
39392a8181
Publishing to vcpkg-betas syncs vcpkg baseline to our repo (#5330)
* Publishing to vcpkg-betas syncs vcpkg baseline to our repo

* PR Feedback

---------

Co-authored-by: Anton Kolesnyk <antkmsft@users.noreply.github.com>
2024-02-15 16:31:00 -08:00
Anton Kolesnyk
0f7d02b999
Fix case-sensitive spelling in non-common /eng (#5346)
* PR Feedback

* Remove unnecessary instance

---------

Co-authored-by: Anton Kolesnyk <antkmsft@users.noreply.github.com>
2024-02-12 14:19:59 -08:00
Daniel Jurek
ce4f25da23
Upload logs on cmake generate/build failure (#5293)
* Upload logs on cmake generate/build failure

* Copy relevant files to staging location, clean up after publishing

* Update cspell words

* Test: break cmake generate in a way that'll produce SOME log files.

* Revert "Test: break cmake generate in a way that'll produce SOME log files."

This reverts commit d5a300587b3359ed3f2bf7be5abea40868f958a7.

* Show failure logs instead of uploading artifacts. Only show log files for vcpkg at this time

* Reapply "Test: break cmake generate in a way that'll produce SOME log files."

This reverts commit 582629ad587f3c9b652ac1f8a7eda5e12d46843a.

* Revert "Reapply "Test: break cmake generate in a way that'll produce SOME log files.""

This reverts commit 7a35250c7e598fc6e1c060f896cbc952704e40bf.

* Another type of test

* Revert inadvertent whitespace changes

* Revert "Another type of test"

This reverts commit e38013f95b152e4e2a3b9d27ccf1eb9b63fa1817.

* More logging
2024-02-07 06:36:36 +00:00
Anton Kolesnyk
5a70fcabce
Workaround for vcpkg-tool regression bug (#5328)
Co-authored-by: Anton Kolesnyk <antkmsft@users.noreply.github.com>
2024-02-06 14:12:06 -08:00
Daniel Jurek
7c751a503b
Domain-specific changes to fix docindex (#5319)
* Add domains-specific changes needed for updated Generate-DocIndex.ps1 to work

* Spelling
2024-02-05 16:28:38 -08:00
Larry Osterman
faeb832f8a
Initial cut at snippet generation tool. Also updated KeyVault Secrets readme to use snippets as a working proof of concept. (#5213)
* First cut at snippet generation - markdown files only for now.

* Removed trailing blank lines in updated file

* Use snippet generator for keyvault snippets
2023-11-30 19:40:30 +00:00
Daniel Jurek
25a96f1322
Fix SAS token generation (#5215)
* Fix token generation

* Ordering of steps

* Demonstrate proper redaction

* Revert "Demonstrate proper redaction"

This reverts commit 1e67e0ac3a67c857c5ea0df6abfae89e4a94b63e.

* Spelling
2023-11-30 11:27:26 -08:00
Larry Osterman
590502c92e
Added Powershell script to auto-generate the merged headers for a client SDK (#5078)
* Added Powershell script to auto-generate the merged headers for a client SDK

* Removed tracing unified header
2023-10-27 13:37:54 -07:00
Anton Kolesnyk
a12232d200
Drop Get-ApiViewCommandLine.ps1 (a script that was used for the old ApiView process) (#5074)
* Drop Get-ApiViewCommandLine.ps1

---------

Co-authored-by: Anton Kolesnyk <antkmsft@users.noreply.github.com>
2023-10-26 17:30:01 -07:00
Daniel Jurek
f0a379bf21
Do not log email address (#5037) 2023-10-13 11:21:33 -07:00
Daniel Jurek
f437eb0f23
Temporary: Fix vcpkg PR notification logic (#5015)
* Fix vcpkg PR notification logic

* Clean up fallback accounts, fix cspell errors

* Use environment variable for EmailAddress (no logging)
2023-10-12 11:49:30 -07:00
Daniel Jurek
04409f28df
Add X_VCPKG_ASSET_SOURCES to vcpkg cache configuration (#4824)
* Add X_VCPKG_ASSET_SOURCES to vcpkg cache configuration

* Prefix with quesiton mark

* Remove question mark

* add --debug

* /,?

* x-azurl

* Remove --debug

* Test no binary cache

* Clear

* Ensure ending of X_VCPKG_ASSET_SOURCES

* Include secrets

* Undo some investigation

* + _SECRET

* Revert testing-related changes
2023-09-19 18:54:20 +00:00
Larry Osterman
a627ab3f22
Initial creation of EventHubs service by @gearama (#4755) 2023-07-13 12:39:18 -07:00
Anton Kolesnyk
b1af5282fb
Vcpkg beta release automation: update to the new requirements (#4766)
Co-authored-by: Anton Kolesnyk <antkmsft@users.noreply.github.com>
2023-07-06 18:29:28 -07:00
Konrad Jamrozik
00b38d6b9f
fix Get-BinarySizes.ps1 to handle new OsVMImage names for Ubuntu (#4562) 2023-04-20 10:28:43 -07:00
Daniel Jurek
02bb09aac1
Add support for Ubuntu 22 to Get-BinarySzies.ps1 (#4511) 2023-04-03 14:47:38 -07:00
Daniel Jurek
50589d65b5
Always release to vcpkg when doing Daily Release (#4334)
* Always release to vcpkg when doing Daily Release

* Add ability to skip live tests via variable

* Use 1ES agents instead of Azure Pipelines
2023-03-06 11:47:15 -08:00
Praven Kuttappan
7da07d5072
Generate API review for C++ using new parser (#4302) 2023-02-21 17:35:41 -05:00
Konrad Jamrozik
971d20be3e
Where applicable, update Windows pools used to azsdk-pool-mms-win-2022-general and rename vmImage to the windows-20xx format (#4360) 2023-02-16 19:02:10 -08:00
George Arama
3762c59552
Test proxy start (#4295)
* lll

* sss

* oipio

* vcvc

* enable test proxy start at test suite start for KV and storage , example created for attestation, we cannot find the base definitions for the test suites,

* Contrib

* clangs

* clangs

* test logs

* pipeline

* more clangs

* pipeline

* clang

* try try again

* try try again

* try again

* try again

* again

* update paths , moved to macro , call macro in target code

* core

* capitalization
2023-02-07 10:52:20 -08:00
George Arama
cad042256b
proper regex for win 2022 (#4339) 2023-02-03 14:46:35 -08:00
Daniel Jurek
8891d30f4e
Use Azure Pipelines and workaround for WSL installation (#4215)
* Use Azure Pipelines and workaround for WSL installation
2023-01-03 10:35:01 -08:00
Azure SDK Bot
fa6ebb26b7
Migrate from win2019 to win2022 (#4157) 2022-12-22 10:12:28 -08:00
George Arama
ef4d41267f
Test proxy (#4118)
* start

* recording

* playback

* refactor, playback and record

* recordings for kv

* klklk

* open telemetry, identity

* attest

* all tests recorded except storage

* STORAGE RECORDINGDS

* some cleanup

* ignore result

* testproxy remade

* fiiine , do something with the result , goooosh

* install test proxy

* clang

* clang

* certs maybe

* cmake generate fix,

* start test proxy script

* start test proxy on env

* clang, move TP after build

* reregen

* certs

* sda

* dss

* allow insecure connections

* put back

* debug

* iuy

* try again

* ewew

* chmod

* try again

* update sanitizer

* output testproxy log

* sjhgasjgdajh

* folder

* worxy

* fix tests and log file

* format files

* clang format

* clang

* sa

* sa

* cleanup

* cspell

* oops

* remove redundant method

* tests

* put back original

* restore to 933486385a

* recordings

* remove storage values

* storage recordings

* disable non functioning tests

* remove core install of test proxy

* _LIVEONLY_ tests

* clang install when needed

* logs on condition

* skip tests

* revert cpp to original version

* quick test

* right that one

* one skip

* identity pushed

* maybe

* override

* clang

* clang

* attestetion

* keyvault

* reenable 20+ tests

* 5 tests left , lease related

* a bit of cleanup

* try now

* snitizers

* some fixes

* capitalization

* clang , cover, peakA

* WEIRD NAME THING ON WINDOWS

* storage recordings

* one more livee

* createappenddelete_liveonly

* CreateWithTags_LIVEONLY_

* try capitalization

* another onw

* maybe now

* all liveonly

* try restore before test

* typo

* condition

* clang and cc

* azure core ci

* qwqwq

* dsasdas

* cleanup1

* typo

* spaces

* cleanup2

* cleanup 3

* remove start proxy

* cleanup +1

* Update cmake-modules/TestProxyPrep.cmake

Co-authored-by: Rick Winter <rick.winter@microsoft.com>

* Update eng/scripts/Start-TestProxy.ps1

Co-authored-by: Rick Winter <rick.winter@microsoft.com>

* Update eng/scripts/Stop-TestProxy.ps1

Co-authored-by: Rick Winter <rick.winter@microsoft.com>

* PR comments

* clangs

* Update sdk/core/azure-core-test/src/test_proxy_policy.cpp

* build

Co-authored-by: Rick Winter <rick.winter@microsoft.com>
2022-12-13 10:58:19 -08:00
Larry Osterman
bb95a22e3f
Added the ability to select OpenSSL 1.1.1n if desired. (#4045)
* Added ability to switch to OpenSSL 1.1.1n

* Fixed OpenSSL compilation challenges - the CRL stuff works now

* Added instructions on using OpenSSL 1.1.1 to README

* Added vcpkg args to handle openssl variants
2022-10-28 15:57:51 -07:00
Larry Osterman
53c9da1552
Pull all Websockets changes to main except for WebSockets itself. (#3954)
* Pulled WebSocket fixes into main except for WebSockets functionality


Co-authored-by: Rick Winter <rick.winter@microsoft.com>
Co-authored-by: Daniel Jurek <djurek@microsoft.com>
Co-authored-by: George Arama <50641385+gearama@users.noreply.github.com>
Co-authored-by: Ahson Khan <ahson_ahmedk@yahoo.com>
Co-authored-by: Ben Broderick Phillips <bebroder@microsoft.com>
Co-authored-by: Anton Kolesnyk <antkmsft@users.noreply.github.com>
2022-10-04 14:58:56 -07:00
Larry Osterman
f8c41df5a2
Simpler get-binarysizes check for OSX (#3901)
* Simpler get-binarysizes check for OSX

* Missed wildcard
2022-08-24 15:22:05 -07:00
Larry Osterman
634df137e3
Fixed #3899 - Handle new OSX version correctly; reformatted platform-matrix JSON files (#3900) 2022-08-24 21:22:53 +00:00
Anton Kolesnyk
ee36dd3abb
OpenTelemetry ApiView fix (#3784) 2022-06-30 21:19:11 +00:00
Ben Broderick Phillips
1715a288d3
Add auto apiview review creation (#3763)
* Add create api auto review step

* Continue on api view upload failure

* Add comment explaining ast generation in api view script
2022-06-28 15:54:51 -04:00
Anton Kolesnyk
82c77b0251
ApiView command line generation script (#3711)
* ApiView command line generation script

* Strongly typed parameters

Co-authored-by: Ben Broderick Phillips <ben@benbp.net>

Co-authored-by: Anton Kolesnyk <antkmsft@users.noreply.github.com>
Co-authored-by: Ben Broderick Phillips <ben@benbp.net>
2022-06-16 12:45:39 -07:00
Victor Vazquez
f4bbfaa7da
[EngSys] Get Vcpkg automatically (#3614)
* get vcpkg automatically
2022-06-07 18:45:50 -07:00
Daniel Jurek
04cd29039b
Vcpkg Binary Cache Cleanup (#3482)
* Expiration time, eliminate AzureRm warning, condition on Set-VcpkgWriteModeCache

* Attempt uninstalling AzureRM and installing Az.Storage

* Import PSModule-Helpers.ps1

* Unsintall-AzureRm if the function exists

* Get-Command

* Uninstall-Module Azure.Storage

* Log

* quotes

* Get-Command some more

* Format list

* Alias fun

* Naming

* show PSModulePath

* Attempt to handle module double backslash

* do not observe

* do not observe for real

* Spelling

* Empty commit to re-trigger CI with a full matrix
2022-04-04 13:12:16 -07:00
Daniel Jurek
a91d151e79
Vcpkg Beta Automation (for real) (#3497)
* Script that automates updating vcpkg betas

* Wire up to pipeline

* Spelling, commentary

* Clone into repo name

* Remove-Item requires the path to exist, even if -Force is specified

* Bootstrap vcpkg

* Arguments to Test-ShouldReleaseToVcpkg.ps1

* More commit

* Escape quotes

* Quote git commit

* Set strict mode

* Use tags

* Actually tag

* Run git commands

* Invoke-Expression

* Onboard releasing package to vcpkg before attempting to isntall from overaly

* temporarily disable matrix generation (30s tasks sometimes runs for 20+ minutes)

* Test-ShouldReleaseToVcpkg.ps1

* Test-Path

* Test vcpkg build, also ensure we push

* Just the tags... low probabiltiy of success given that '--' if frequently treated as a separator

* Add ability to skip link verification for tighter inner loop

* Push tag separately

* Unnecessary condition and conjunction

* Base repo owner: Azure

* Specify remote name

* Tighten inner loop

* git remote -v

* workingDirectory

* Go back to two tags and a regular push

* Saving some progress

* Use original push method

* BaseRepoOwner

* Cleanup, put changes in the default branch (vcpkg does not look at refs outside of the default branch)

* Use default branch

* Revert changes used to tighten up devops inner loop

* Revert an unrelated change

* Revert unrelated changes

* Revert unrelated changes

* Add spelling
2022-04-01 06:30:03 -07:00
Daniel Jurek
ca8b843954
Revert "Vcpkg Beta Automation (#3430)" (#3495)
This reverts commit 60f0dfdcea.
2022-03-31 13:14:19 -07:00
Daniel Jurek
60f0dfdcea
Vcpkg Beta Automation (#3430)
* Script that automates updating vcpkg betas

* Wire up to pipeline

* Spelling, commentary

* Clone into repo name

* Remove-Item requires the path to exist, even if -Force is specified

* Bootstrap vcpkg

* Arguments to Test-ShouldReleaseToVcpkg.ps1

* More commit

* Escape quotes

* Quote git commit

* Set strict mode

* Use tags

* Actually tag

* Run git commands

* Invoke-Expression

* Onboard releasing package to vcpkg before attempting to isntall from overaly

* temporarily disable matrix generation (30s tasks sometimes runs for 20+ minutes)

* Test-ShouldReleaseToVcpkg.ps1

* Test-Path

* Test vcpkg build, also ensure we push

* Just the tags... low probability of success given that '--' if frequently treated as a separator

* Add ability to skip link verification for tighter inner loop

* Push tag separately

* Unnecessary condition and conjunction

* Base repo owner: Azure

* Specify remote name

* Tighten inner loop

* git remote -v

* workingDirectory

* Go back to two tags and a regular push

* Saving some progress

* Use original push method

* BaseRepoOwner

* Cleanup, put changes in the default branch (vcpkg does not look at refs outside of the default branch)

* Use default branch
2022-03-31 12:52:14 -07:00
Victor Vazquez
835f156af9
Vcpkg manifest and binary caching (#3329)
* binary cache and manifest

* update packages

* udpate

* add cache to private pipeline

* next try

* aver

* other

* again

* aver quick

* more

* this way

* again

* one more

* print

* test

* use depend

* more deps

* dep

* Apply suggestions from code review

Co-authored-by: Daniel Jurek <djurek@microsoft.com>

* updated to use group variable

* update identity

* end line

* Update vcpkg.json

* Apply suggestions from code review

* cspell

* remove comment

* updates

* make cache mode depend on SAS env var

* map env var only for internal pipelines

* other approach

* what about this

* and this

* try

* amd

* another

* extra step

* typo

* override for internal

* use default succeded

* azure core update manifest

* a

* run cmake-generate nightly as well

* check for SAS

* check cache

* no secret

* fix is secret

* pass explicit

* use secret all the time

* char

* One more

* export

* echos

* last

* array

* remove question

* ok

* weird

* use account key

* substring

* VCPKG_BINARY_SOURCES

* Add module installation

* task:

* Correct pathing for module

* update source gen

* format

* update spelling

* IsWindoows

* Use pwsh

* Cannot clobber with PSModule-Helpers. Attempt plain install

* Attempt plain install

* Revert unnecessary change to Update-DocsMsToc.ps1

* template ready

* curl is required on Windows as well for some CI gates

* attestation

* fix format

Co-authored-by: Daniel Jurek <djurek@microsoft.com>
2022-03-24 09:11:30 -07:00
Daniel Jurek
44310b635a
Log binary sizes (excl. UWP changes) (#3357)
* Output binary sizes (Get-BinarySizes.ps1 works for linux environment)

* Add better support for Windows binary output

* Update matrix to properly build Debug and Release on Windows

* Add TEAMPROJECTID to spell check

* Add extra labels

* Ensure BuildArgs doesn't get duplicated

* Log additional metrics

* Add openssl to Win32Api_curl

* SourceBranchName -> SourceBranch

* Fix matrix entries

* Document included

* Review feedback for Get-BinarySizes.ps1

* Infer many metrics from the environment

* Add issecret to cspell.json

* Extra equal signs

* Correct directory depth for $BuildDirectory

* Correct casing for mac VM image
2022-03-03 11:36:11 -08:00
Chidozie Ononiwu (His Righteousness)
58c1ecfc1d
Add ReplaceLatestEntryTitle parameter for updating changelog (#3008) 2021-11-02 12:29:38 -07:00
Scott Beddall
3f25c5d2e5
add ga to index and individual docs (#2687) 2021-07-29 20:53:51 +00:00
Anton Kolesnyk
f6765e667e
Put dependency versions (#2518)
* Put dependency versions

* Update version

* Core does not have any 1.1 functionality

* Core 1.1

* 1.1.0

Co-authored-by: Anton Kolesnyk <antkmsft@users.noreply.github.com>
2021-06-30 17:05:16 -07:00
Wes Haggard
015c34a029
Update links from master to main (#2488)
* Update links from master to main

* Upate other references from master to main
2021-06-24 22:27:14 -07:00
Wes Haggard
e1d53996dc
Fix Prepare-Release and version update code (#2469)
- Passes through ReleaseDate
- Removes old version.txt logic
- Cleans up version scripts to import common.ps1
2021-06-23 16:56:49 -07:00
Daniel Jurek
fda88bf7b8
Update for "master" -> "main" branch rename (#2455)
* vcpkg.json -- update all links to point to "main" .. This is hardcoded and will go out in future releases.
* ci.yml -- add `- main` to trigger criteria near `- master` ... This adds forward compatilbitiy when we rename the branch in the repo
* archetype-cpp-release.yml use a script which evaluates a repo's default branch and sets that in a global variable, then use that variable instead. When vcpkg updates their branch the publishing scripts will work transparently.
* Collect-Changelogs.ps1 -- Add default hardcoded branch name for use with future releases. This can be optionally overridden with a parameter when invoking the script.
* eng/pipelines/client.yml -- Delete this file. It is no longer in use.
2021-06-18 09:09:27 -07:00
Daniel Jurek
26f43fd359
Narrow $packagePattern to exclude vcpkg.json files which are now part of the publishing process (#2330) 2021-05-20 17:19:18 -07:00
Ahson Khan
fd9c3e5ebb
Fix true spelling errors across all source and header files within the SDK and add exceptions for false positives. (#2209)
Part of https://github.com/Azure/azure-sdk-for-cpp/issues/1277, checking what types of warnings the CI emits.

Verified all SDK product `.cpp`, `.hpp`, `.txt`, and `.md` files, primarily focused on azure-core. They are all clean now. There are some exceptions that needs to be added for keyvault and storage, but they are false positives, so not a concern.

> `cspell lint --config .vscode/cspell.json *.hpp */**/*.hpp`

CSpell: Files checked: 188, Issues found: 0 in 0 files

> `cspell lint --config .vscode/cspell.json *.cpp */**/*.cpp`

CSpell: Files checked: 186, Issues found: 88 in 15 files (keyvault and storage false positives, or tests)

> `cspell lint --config .vscode/cspell.json *.md */**/*.md`

CSpell: Files checked: 45, Issues found: 5 in 2 files (eng/common)

> `cspell lint --config .vscode/cspell.json *.txt */**/*.txt`

CSpell: Files checked: 44, Issues found: 0 in 0 files

> `cspell lint --config .vscode/cspell.json *.* */**/*`

CSpell: Files checked: 646, Issues found: 328 in 69 files (most of these are in eng\docs\api\assets\style.css or eng/common)

Deprioritize and ignored the errors from the test files (including test resource json files), and `eng/common` since those need to be centrally fixed.
2021-05-07 21:04:58 +00:00
Anton Kolesnyk
cd36753d76
PackageVersion made constexpr and moved to src/package_version.hpp (#2166) 2021-04-28 17:34:24 -07:00
Daniel Jurek
61aa827d5c
EngSys updates to support new vcpkg.json format (#2153)
* Use linux for vcpkg release

* Force lf line endings

* Set config correctly

* Better core.eol syntax and sequencing

* Try using linux host which uses LF by default

* Revert "Try using linux host which uses LF by default"

This reverts commit 160eb22b647e851a50f9d1e7b157a1e385fe946f.

* Use vcpkg.exe to format the manifest

* Spell correctly

* Move format-manfiest
2021-04-26 15:56:37 +00:00
Ahson Khan
d452e94337
Update vcpkg ports to use a manifest json file instead of a CONTROL file. (#2132)
* Update vcpkg ports to use a manifest json file instead of a CONTROL file.

* Update vcpkg ports to use a manifest json file instead of a CONTROL file
for remaining packages.

* Add the new vcpkg manifet json files and also update the template
package.

* Update paths in the cmake and eng scripts to find the right file now
that CONTROL is gone.
2021-04-19 12:50:50 -07:00