79 Commits
Author SHA1 Message Date
Jeff Kluge dc442403b9 [CI] Re-enable Mac Mono Tests (#5945) 2024-08-01 13:54:31 -07:00
Jeff Kluge 017074bee3 Split hosted build test running up for unit tests, functional tests, and Mono tests (#5152) 2023-05-05 11:06:50 -04:00
Jeff Kluge 476dca9762 Improve installation of .NET for building NuGet.Client repository (#5134) 2023-04-19 14:13:57 -05:00
Jeff Kluge 2407dd2541 Use Directory.Build.props/targets/rsp in NuGet.Client repo (#4880) 2022-11-09 09:37:10 -08:00
Jeff Kluge 69af0e6768 Update where test results are placed (#4889) 2022-11-07 20:08:05 -08:00
Damon Tivel 493d6b3848 Signing: update to August 2022 CTL (#4791)
Resolve https://github.com/NuGet/Home/issues/12033.
2022-10-12 05:18:54 -07:00
Jeff Kluge ff4efab6b0 Fix all build warnings and treat all future warnings as an error (#4799) 2022-10-11 10:44:44 -07:00
Damon Tivel fa2fde459f Test: update test SDK from 6.0.3xx to 6.0.4xx (#4697)
Resolve https://github.com/NuGet/Client.Engineering/issues/1693.
2022-06-22 19:19:52 -07:00
Heng Liu d692f4ce5e Update sdk version for testing from 5 to 6 (#4689) 2022-06-20 10:51:10 -07:00
Jeff Kluge 8513d48a4f Add binlogs to all build phases and upload them on failure (#4590) 2022-04-22 15:50:41 -04:00
Jeff Kluge 919c7e10eb Run unit tests with dotnet test instead of xunit runner (#4499) 2022-03-14 16:24:46 -05:00
Nikolche Kolev d619bad07d Move projects that target netcoreapp2.1 to netcoreapp3.1 (#4402) 2022-01-28 08:44:05 -08:00
Erick Yondon b8fe2a0f84 Download latest dotnet-install.sh for Linux tests (#4400)
* Replace static copy of dotnet-install.sh with dynamic
2022-01-14 15:18:36 -08:00
Nirmal Guru 10fcc61919 Build NuGet.Client even if response file (rsp) is detected (#3623) 2021-04-01 13:37:23 -07:00
784274cc9b Enable cross-platform package signature verification for restore (#3458)
* Signing: Support signature verification on .NET Core

Remove 2nd N.B.T.P package (#2984)

remove WorkaroundNetStandard target, change SDK for build from 3.0 preview to 3.1 stable (#3161)

* remove WorkaroundNetStandard target, change SDK for build from 3.0 preview to 3.1 stable version, fix error; change LockSDKVersion default value from empty string to false; apply Linux workaround in my change

Retarget to netcore5.0 (#3162)

* retarget to netcore5.0;  Linux script workaround need to apply for downloading SDK for build

add pkcs and cng packages

Temporary fix on patching SDK, add System.Security.Cryptography.Pkcs.dll and update deps.json, use dll from .nuget/packages

Address PR comments

implement add cert to store on Mac; display openssl version (#3166)

Implement timestamp integrity verification; Implement an equivalent NativeCms; enable signing APIs and tests (#3168)

* implement timestamp integrity verification; implement ManagedCms; enable signing APIs and tests

fix xplat verification branch after rebase (#3191)

Fixes: https://github.com/NuGet/Home/issues/9012

check different cross-platform error messages for self-signed cert test (#3208)

Fixes: https://github.com/NuGet/Home/issues/8933

Xplat Signing/Verification : Fix broken tests for setting privatekey of a X509Certificate2 (#3195)

use workaround to set private key for X509Certificate2 (netcore), change ToRSA to workaround for netcore(especially for non-windows)

enable PathTooLongException test (#3216)

Fixes: https://github.com/NuGet/Home/issues/8920

enable TrustedSignerActionsProvider on netcore, along with tests (#3213)

Fixes: https://github.com/NuGet/Home/issues/8921

Enable SignedPackageIntegrityVerificationTests for netcore5.0 (#3220)

Enable SignedPackageIntegrityVerificationTests for netcore, remove extra preprocessors

Enable timestamp provider test and fix 3 broken tests (#3210)

enable all unit tests; enable 8 more tests; enable timestampProviderTest; fix 3 broken tests in TimestampProviderTests

Fix 4 tests in SignatureTrustAndValidityVerificationProviderTests (#3242)

fix untrusted msg for different platforms

fixed broken tests using utility methods (#3263)

disable outdated tests (#3274)

enable 4 tests on Mac (#3275)

fix 5 broken tests in SignatureTrustAndValidityVerificationProviderTests, add workaround for Linux (#3252)

fix broken test case ExecuteCommandAsync_WithAmbiguousMatch_ThrowsAsync (#3291)

* Enable test ExecuteCommandAsync_WithMultiplePackagesAndInvalidCertificate_RaisesErrorsOnceAsync (#3342)

* enable a test, change the comments; extend test limitation on Linux

* Updated SDK version and removed the hardcoded version when reading from JSON file (#3372)

* update Pkcs package to the preview3 version (#3382)

* fix 2 warnings in CodeAnalysis (#3388)

* fix 2 warnings in CodeAnalysis

* disable dynamic revoke tests on Mac (#3373)

* fix 1 test (#3371)

* Fix more warnings reported by CodeAnalysis (#3393)

* fix string warnings raised by CodeAnalysis

* Retarget xplat verification to netcoreapp5.0 (#3386)

* retarget netcoreapp5.0 (a workaround for net5.0)

* fix all the rest warnings raised by code analysis (#3401)

* Suppress CA1307 warning for string.GetHashCode() method (#3404)

* Linux test failure due to generic exception (#3405)

* add TFM netcoreapp5.0 to N.B.T.Console and N.P.Core projects (#3419)

* add TFM netcoreapp5.0 to N.B.T.Console and N.P.Core projects

* add PIN prompt for netcore (#3389)

* Run dotnet nuget tests on multiple TFMs (#3387)

* enabled mac assertions

* Revert "enabled mac assertions"

This reverts commit d8a52e20c204720f106eaf116d1895f68b557d56.

* Enable test GetCertificateChain_WithUntrustedRoot_Throws on Mac (#3428)

* run signing integration tests cross plat (#3415)

* added GetNonce() to IRfc3161TimestampRequest interface (#3427)

* disable test for netcore (#3445)

* log Status and StatusInformation, fix 2 tests (#3268)

* Disable verification during extraction for Mono, disable a test on Mono (#3451)

* disable verification during extraction on mono,disable a mono test on Mac

* adapt 2 newly added dotnet integration tests for multiple TFMs (#3460)

* remove useless Sdk2x.targets

* get TimestampTests working again (#3218)

* get TimestampTests working again

Fixes: https://github.com/NuGet/Home/issues/8935

* change GetTimestampAsync into internal

* fix runFuncTests.sh and InstallCLIforBuild.sh

* address feedback

* upgrade dotnet 5 to preview4 as preview5 is broken

* Fix exception thrown in SigningTestFixture during disposing (#3464)

Co-authored-by: Kartheek Penagamuri <52756182+kartheekp-ms@users.noreply.github.com>
Co-authored-by: Andy Zivkovic <zivkan@users.noreply.github.com>
Co-authored-by: Kat Marchán <kzm@zkat.tech>
2020-06-20 12:23:29 -07:00
Andy Zivkovic b6367674cb Use net472 xunit.runner.exe (#3453) 2020-06-15 18:08:31 -07:00
Andy Zivkovic 1529f00644 Make all tests run in verbose mode (#3281) 2020-03-09 18:04:40 -07:00
Andy Zivkovic d2cdc90364 Use Azure DevOps hosted Linux agents (#3224) 2020-02-07 10:21:31 -08:00
donnie-msft 0a491526db Temporarily changing dotnet-install script path (#3167) 2019-12-19 10:47:43 -05:00
donnie-msft 6cd94934c2 Linux Machine workaround - include dotnet-install.sh directly in build (#3163)
* Temporarily point runFuncTests script to dotnet-install script on the machine
2019-12-13 17:18:22 -08:00
Nikolche Kolev a5c635b0e4 Use SDK 3.0 for the integration tests, switch mac pools, re-enable failing tests, remove redundant tests (#3003) 2019-12-08 16:55:27 -08:00
Nikolche Kolev 2d50628197 Use supported CLI version (#3146) 2019-12-05 11:35:48 -08:00
Fernando Aguilar 52ee9a5a94 Removes packages.config file in NuGet.Client (#3073) 2019-11-05 12:31:09 -08:00
Andy Zivkovic 7acd1dba52 make curl follow redirects (#3102) 2019-10-29 11:08:48 -07:00
Fernando Aguilar 1ab8d26520 Disable tests with multiple MockServer instances on Mono (#3063)
Skip tests on Mono with multiple MockServer instances. Fixes https://github.com/NuGet/NuGet.Client/pull/3063
2019-09-19 15:04:30 -07:00
Damon Tivel 6562bb7f47 Build: retry nuget.exe download on failure (#3030)
Resolve https://github.com/NuGet/Home/issues/8499.
2019-08-27 11:55:53 -07:00
Xavier Decoster c223aca745 Convert async void test methods to async Task (#2973) 2019-07-31 10:46:42 +02:00
Andy Zivkovic 1f80b0264a Use recommended version of dotnet cli for bootstrapping xplat (#2971) 2019-07-30 12:40:34 -07:00
Andy Zivkovic 1bbd8dc1a9 Add -verbose to running CommandLine tests on Mac (#2958) 2019-07-26 16:02:14 -07:00
Damon Tivel ce298e4bde Test: update dotnet-install.* URL's (#2951)
Fix https://github.com/NuGet/Home/issues/8366.
2019-07-23 11:41:58 -07:00
Damon Tivel 22cfeef18c Test: workaround dotnet-install.sh failing on macOS (#2946)
Fix https://github.com/NuGet/Home/issues/8362.
2019-07-22 10:45:22 -07:00
Damon Tivel cb8a79ef3c Test: fix scripts/funcTests/runFuncTests.sh on macOS (#2945)
Fix https://github.com/NuGet/Home/issues/8361.
2019-07-22 10:17:10 -07:00
donnie-msft 6bbf84b175 Linux Tests now has TMP Cleanup (#2931)
* Linux Tests now has TMP Cleanup
2019-07-19 16:32:03 -07:00
Nikolche Kolev bb13b10e8a Move cross-plat libraries to .NET Standard 2.0 (#2118)
* Move xplat libraries to netstandard2.0 and netcoreapp2.1

* Update dotnet cli to 2.2.200

* Remove CandidateAssemnblyFiles from RAR search paths
Microsoft.Build.Runtime package has an mscorlib.dll content file that
ends up winning over mscorlib.dll in .NET Framework targeting pack
mscorlib.dll if CandidateAssemblyFiles are searched.

Legacy project search paths are left unchanaged because they were not
impacted by this and some of the rely on resolution in GAC or
AssemblyFolders.

* Initialize ILMerge with appropriate reference assemblies

Previously, ILMerge was always default-initialized with current machine's
C:\Windows\Microsoft.NET\Framework\v4.0.30319. Furthermore, in the .NET
Standard case, it was mixed with implementation assemblies on /lib from
a one-off CoreCLR implementation. It was pure luck that the resulting
assembly used to work.

This also removes the one-off CLI that carries the one-off CoreCLR from
the build altogether.

* Disabled failing signing tests on macOS

* Remove explicity reference to system.collections.immutable

* Add the ability to insert to multiple CLI/SDK branches
2018-12-19 16:37:43 -08:00
AbdallahAbuHashem 7ca842c438 list package tests (#2413) 2018-11-12 15:10:46 -08:00
Rohit Agrawal f378e0bbe2 fix exit code for unix test scripts (#2042) 2018-02-20 14:24:26 -08:00
Rohit Agrawal c602783bf2 add github-vsts integration with test run url for linux/mac (#1952)
* update github status through powershell on linux

* update git commit status through powershell on mac

* fix edge case where tests fail to run
2018-01-16 16:16:23 -08:00
Rohit Agrawal cea0dd1ba7 post test failure status and link test run url on github for windows tests (#1928)
* try running all tests from dotnet vstest

* use xunitxml.logger to output vstest results in xml format

* modify build to only output xml results across all tests

* keep xplat test format as trx

* fix xml tag

* provide explicit path to xunit xml logger adapter

* change name of test files when they are  generated on linux/mac

* update git commit status description

* obtain test run details via rest api

* try powershell task on linuux

* Revert "try powershell task on linuux"

This reverts commit 11a03c75935d6ef7469424562fedf15152a611bb.

* make getting test run id resilient to failures
2018-01-10 20:41:53 -08:00
Rohit Agrawal 7537e3a59c enable yaml based builds and other engineering improvements (#1872)
* enable yaml based builds and testing for nuget

* add retry logic to installation and downgrading of vsix

* fix delay signing on apex DLLs

* add admin switch for vsix installation

* install nuget vsix should not fail on standard error

* fix publishing of e2e result step

* disable v2feedparser third party server tests by not downloading config files

* add initial build number format

* fix e2e publishing for real

* keep running tests on unix if unit or func tests fail
2017-12-14 14:12:56 -08:00
Justin Emgarten a2d9a5afe7 Update to xunit 2.3.1
Fix test cases with serious issues. Non-serious issues have been added to NoWarn.
2017-12-11 18:00:37 -08:00
Justin Emgarten cabbcd5700 Build improvements
* Update xunit runner to 2.3.1
* Update CLI to 2.0.2 and 1.0.4
* Auto run configure.ps1 instead of erroring out
2017-11-20 20:32:08 -08:00
Rohit Agrawal bf1b84e5af fix mono test failure exit code and flaky test (#1734)
* exit with error if mono tests fail

* remove flaky assertion from mono test

* fix flakiness of mono push command assertion

* fix exit condition

* check non 0 amount of credentials in http request
2017-10-05 18:24:17 -07:00
Rohit Agrawal fd74b599bf collect mono test results from xunit in vsts (#1724)
* fix output location of test results when running mono on mac

* fixing exit code in case of mono failures

* fix error code asignment

* check error code after xunit exits
2017-09-27 23:35:40 -07:00
Rohit Agrawal 79a745606a Improve E2E infra and adapt to VSTS (#1714)
* remove clearing recycle bin

* add logging for vso

* kill running instances of vs regardless

* do not fail if a test times out

* fix logging typo

* more powershell fixes

* re-enable uwp specific tests

* fix termination condition of tests

* change how test result file gets copied to CI machine

* breaking out of while loop and more logging

* fix path issue for results.html

* more fixes in termination condition

* diagnosing parsing errors for first two tests

* log currently running test and fix log.txt logging

* log to console from log.txt using currentTestId

* trying to fix initial logging issue with one line in realtimeresults

* remove unnecesary diag logging

* fix log formatting and add back write-error in case of failure

* fix count of tests and logging

* fix numbering of test and re-enable commented code

* count tests after all assemblies have been loaded

* adding try catch block

*  fix try-catch

* fix numbering for test case factory scenario

* changes to parsing realtimeresults

* first pass at junit xml results

* write out junit test result file

* implement missing API in InternalApiTestHook for project.json migrator

* fix logging test results duration to junit

* start copying log and results file to nuget drop share

* update UwpPackageRefClassLibrary template

* fix project.json migrator uwp e2e test

* fix uwp package ref test

* fix new-item cmdlet to create directory instead of file

* change where to output full log in build drop

* change name of uwpclasslibrary project template

* get screenshot if test times out

* get screenshot only iff running on CI

* fix uwp migrator project json test

* fix nit

* don't queue functional tests via rest api

* fix screen capture type not found exception

* add mono to path explicitly

* echo path in mono and mac and output version

* no need to add mono to path
2017-09-26 14:27:28 -07:00
Rohit Agrawal edcd69f4d1 engineering fix to enable linux/mac testing in vsts (#1677)
* uppercase env variable

* print env variables in linux

* replace wget with curl to work on both mac and linux
2017-08-29 10:08:43 -07:00
Zhi Li 3d05df498b fix mono test script 2017-04-10 14:53:47 -07:00
Ankit Mishra 08f88384c2 Migrating projects to net core and merging client and core solutions 2017-03-27 14:13:09 -07:00
Ankit Mishra 17fc5ba73c Fixing nuget.exe download to v3.5.0 on CI machines(#1189) 2017-02-14 20:25:37 -08:00
Rohit Agrawal f707364083 added msbuild integrations tests for pack command (#1116)
* add test infra for pack integration tests

* added msbuild integration tests for pack command
2017-01-13 20:29:27 -08:00
ragrawal 9c7e8b495c fix broken tests as a result of PR #1028 2016-12-15 11:43:06 -08:00