Commit graph

35138 commits

Author SHA1 Message Date
Jackson Schuster
3ed90968ee Don't validate Sdk archive diffs on shortstack 2024-03-01 11:21:40 -08:00
Jackson Schuster
f84323905d PR Feedback:
- Extract common archive diffing into a base class
- Move Diff utils to a separate class
- Return all valid archives and assert only one valid SDK archive
- Use Arcade VersionIdentifier util class
2024-03-01 10:42:14 -08:00
Jackson Schuster
478bb285c1 PR Feedback: use underscore prefix for 'local' properties 2024-02-29 10:32:22 -08:00
Jackson Schuster
3cf9a383be Use cancellation token in FindArchiveDiff and move directory separator in path builder 2024-02-29 10:00:40 -08:00
Jackson Schuster
7632ab4d74 PR Feedback:
- Use 'archive' rather than 'tarball'
- Remove dead code
- Discard unused return values
2024-02-29 09:48:31 -08:00
Jackson Schuster
9ffe5c200d Make long running tasks cancellable 2024-02-28 10:06:38 -08:00
Jackson Schuster
b6fba7eb7c Use property notation instead of item 2024-02-28 09:56:49 -08:00
Jackson Schuster
45728f7ba5 Add task to find the single best tarball, and remove unused usings 2024-02-28 07:36:59 -08:00
Jackson Schuster
f704a53482 Fix error message 2024-02-28 07:02:52 -08:00
Jackson Schuster
d30c7408d7 Rename GetVersionAnonymousPath 2024-02-26 09:31:36 -08:00
Jackson Schuster
8a5244cdf2 Merge branch 'TarballDiff' of https://github.com/jtschuster/installer into TarballDiff 2024-02-26 09:29:28 -08:00
Jackson Schuster
0eea7e0579 Fix stack overflow and rename method 2024-02-26 09:29:22 -08:00
Jackson Schuster
7b16584a7f
Merge branch 'main' into TarballDiff 2024-02-26 08:07:10 -08:00
Viktor Hofer
94aea21ee6
Enable dotnet/format in unified-build (#18773) 2024-02-26 15:58:33 +01:00
Matt Mitchell
d070660282
Enable installer and SDK repos in VMR build (#18632)
Co-authored-by: Viktor Hofer <viktor.hofer@microsoft.com>
2024-02-26 10:51:44 +00:00
Noah Gilson
884fddb17a
Branding for Preview 3 (#18764) 2024-02-23 13:40:05 -08:00
Noah Gilson
47dc86aa18
Branding for Preview 3
I made the preview 2 branch off main as today was the deadline. Please see https://github.com/dotnet/installer/pull/18325 for an example of how this has been done previously.
2024-02-23 12:33:39 -08:00
dotnet-maestro[bot]
66bcbd8c81
[main] Update dependencies from dotnet/sdk (#18760)
[main] Update dependencies from dotnet/sdk
- Coherency Updates:
  - VS.Redist.Common.NetCore.SharedFramework.x64.9.0: from 9.0.0-preview.2.24122.4 to 9.0.0-preview.2.24123.1 (parent: Microsoft.NET.Sdk)
  - Microsoft.NETCore.App.Ref: from 9.0.0-preview.2.24122.4 to 9.0.0-preview.2.24123.1 (parent: Microsoft.NET.Sdk)
  - VS.Redist.Common.NetCore.TargetingPack.x64.9.0: from 9.0.0-preview.2.24122.4 to 9.0.0-preview.2.24123.1 (parent: Microsoft.NET.Sdk)
  - Microsoft.NETCore.App.Host.win-x64: from 9.0.0-preview.2.24122.4 to 9.0.0-preview.2.24123.1 (parent: Microsoft.NET.Sdk)
  - Microsoft.NETCore.Platforms: from 9.0.0-preview.2.24122.4 to 9.0.0-preview.2.24123.1 (parent: Microsoft.NET.Sdk)
  - Microsoft.SourceBuild.Intermediate.runtime.linux-x64: from 9.0.0-preview.2.24122.4 to 9.0.0-preview.2.24123.1 (parent: Microsoft.NET.Sdk)
  - Microsoft.NET.ILLink.Tasks: from 9.0.0-preview.2.24122.4 to 9.0.0-preview.2.24123.1 (parent: Microsoft.NET.Sdk)
  - Microsoft.NETCore.App.Runtime.win-x64: from 9.0.0-preview.2.24122.4 to 9.0.0-preview.2.24123.1 (parent: Microsoft.NET.Sdk)
  - Microsoft.NETCore.App.Runtime.win-x64: from 9.0.0-preview.2.24122.4 to 9.0.0-preview.2.24123.1 (parent: Microsoft.NET.Sdk)
2024-02-23 20:16:47 +00:00
dotnet-maestro[bot]
39605ca720
[main] Update dependencies from dotnet/sdk (#18752)
[main] Update dependencies from dotnet/sdk
- Coherency Updates:
  - Microsoft.WindowsDesktop.App.Ref: from 9.0.0-preview.2.24120.1 to 9.0.0-preview.2.24122.1 (parent: Microsoft.NET.Sdk)
  - VS.Redist.Common.WindowsDesktop.SharedFramework.x64.9.0: from 9.0.0-preview.2.24120.1 to 9.0.0-preview.2.24122.1 (parent: Microsoft.NET.Sdk)
  - VS.Redist.Common.WindowsDesktop.TargetingPack.x64.9.0: from 9.0.0-preview.2.24120.1 to 9.0.0-preview.2.24122.1 (parent: Microsoft.NET.Sdk)
  - VS.Redist.Common.NetCore.SharedFramework.x64.9.0: from 9.0.0-preview.2.24120.11 to 9.0.0-preview.2.24122.4 (parent: Microsoft.NET.Sdk)
  - Microsoft.NETCore.App.Ref: from 9.0.0-preview.2.24120.11 to 9.0.0-preview.2.24122.4 (parent: Microsoft.NET.Sdk)
  - VS.Redist.Common.NetCore.TargetingPack.x64.9.0: from 9.0.0-preview.2.24120.11 to 9.0.0-preview.2.24122.4 (parent: Microsoft.NET.Sdk)
  - Microsoft.NETCore.App.Host.win-x64: from 9.0.0-preview.2.24120.11 to 9.0.0-preview.2.24122.4 (parent: Microsoft.NET.Sdk)
  - Microsoft.NETCore.Platforms: from 9.0.0-preview.2.24120.11 to 9.0.0-preview.2.24122.4 (parent: Microsoft.NET.Sdk)
  - Microsoft.SourceBuild.Intermediate.runtime.linux-x64: from 9.0.0-preview.2.24120.11 to 9.0.0-preview.2.24122.4 (parent: Microsoft.NET.Sdk)
  - Microsoft.WindowsDesktop.App.Runtime.win-x64: from 9.0.0-preview.2.24120.1 to 9.0.0-preview.2.24122.1 (parent: Microsoft.NET.Sdk)
  - Microsoft.Dotnet.WinForms.ProjectTemplates: from 9.0.0-preview.2.24118.1 to 9.0.0-preview.2.24122.2 (parent: Microsoft.WindowsDesktop.App.Runtime.win-x64)
  - Microsoft.WindowsDesktop.App.Runtime.win-x64: from 9.0.0-preview.2.24120.1 to 9.0.0-preview.2.24122.1 (parent: Microsoft.NET.Sdk)
  - Microsoft.DotNet.Wpf.ProjectTemplates: from 9.0.0-preview.2.24119.1 to 9.0.0-preview.2.24122.1 (parent: Microsoft.WindowsDesktop.App.Runtime.win-x64)
  - Microsoft.FSharp.Compiler: from 12.8.300-beta.24120.1 to 12.8.300-beta.24122.3 (parent: Microsoft.NET.Sdk)
  - Microsoft.SourceBuild.Intermediate.fsharp: from 8.0.300-beta.24120.1 to 8.0.300-beta.24122.3 (parent: Microsoft.NET.Sdk)
  - Microsoft.NET.Test.Sdk: from 17.10.0-preview-24119-01 to 17.10.0-preview-24120-01 (parent: Microsoft.NET.Sdk)
  - Microsoft.SourceBuild.Intermediate.vstest: from 17.10.0-preview-24119-01 to 17.10.0-preview-24120-01 (parent: Microsoft.NET.Sdk)
  - Microsoft.NET.ILLink.Tasks: from 9.0.0-preview.2.24120.11 to 9.0.0-preview.2.24122.4 (parent: Microsoft.NET.Sdk)
  - Microsoft.Net.Compilers.Toolset: from 4.10.0-2.24120.7 to 4.10.0-2.24122.3 (parent: Microsoft.NET.Sdk)
  - Microsoft.SourceBuild.Intermediate.roslyn: from 4.10.0-2.24120.7 to 4.10.0-2.24122.3 (parent: Microsoft.NET.Sdk)
  - Microsoft.Build: from 17.10.0-preview-24120-06 to 17.10.0-preview-24122-01 (parent: Microsoft.NET.Sdk)
  - Microsoft.SourceBuild.Intermediate.msbuild: from 17.10.0-preview-24120-06 to 17.10.0-preview-24122-01 (parent: Microsoft.NET.Sdk)
  - NuGet.Build.Tasks: from 6.10.0-preview.2.32 to 6.10.0-preview.2.41 (parent: Microsoft.NET.Sdk)
  - Microsoft.NETCore.App.Runtime.win-x64: from 9.0.0-preview.2.24120.11 to 9.0.0-preview.2.24122.4 (parent: Microsoft.NET.Sdk)
  - Microsoft.NET.Workload.Emscripten.Current.Manifest-9.0.100.Transport: from 9.0.0-preview.2.24114.5 to 9.0.0-preview.2.24121.1 (parent: Microsoft.NETCore.App.Runtime.win-x64)
  - Microsoft.NETCore.App.Runtime.win-x64: from 9.0.0-preview.2.24120.11 to 9.0.0-preview.2.24122.4 (parent: Microsoft.NET.Sdk)
  - Microsoft.SourceBuild.Intermediate.emsdk: from 9.0.0-preview.2.24114.5 to 9.0.0-preview.2.24121.1 (parent: Microsoft.NETCore.App.Runtime.win-x64)

 - Rebase fsharp patch

 - Roslyn patch to fix NetRoslyn value
2024-02-23 17:13:59 +00:00
Michael Simons
3e38a7a77a
Update sync script reference in VMR readme (#18754) 2024-02-23 09:21:46 -06:00
Jeremy Koritzinsky
4b127e32d4
Add VMR support for Windows-x64 PGO Instrumented leg (#18672)
Co-authored-by: Matt Mitchell <mmitche@microsoft.com>
Co-authored-by: Viktor Hofer <viktor.hofer@microsoft.com>
2024-02-23 15:18:09 +00:00
Viktor Hofer
c557d5b91f
Remove separate package-source-build project (#18750) 2024-02-23 15:04:42 +01:00
Jackson Schuster
8c32f67bad Don't autoredirect and check for correct aka.ms redirect code 2024-02-22 15:32:02 -08:00
Jackson Schuster
a3256e2d70
Update src/SourceBuild/content/eng/tools/tasks/Microsoft.DotNet.SourceBuild.Tasks.SdkArchiveDiff/Microsoft.DotNet.SourceBuild.Tasks.SdkArchiveDiff.csproj
Co-authored-by: Viktor Hofer <viktor.hofer@microsoft.com>
2024-02-22 14:44:51 -08:00
Jackson Schuster
a336dd0f65
Update src/SourceBuild/content/eng/tools/tasks/Microsoft.DotNet.SourceBuild.Tasks.SdkArchiveDiff/Microsoft.DotNet.SourceBuild.Tasks.SdkArchiveDiff.csproj
Co-authored-by: Viktor Hofer <viktor.hofer@microsoft.com>
2024-02-22 14:44:46 -08:00
Matt Thalman
9dc1ce8ad0
Arcade patch to ignore std error warning format (#18751) 2024-02-22 21:15:25 +00:00
dotnet-maestro[bot]
046598fc16
[main] Update dependencies from dotnet/sdk (#18749)
Co-authored-by: dotnet-maestro[bot] <dotnet-maestro[bot]@users.noreply.github.com>
2024-02-22 14:28:13 -06:00
Jackson Schuster
2862e1f75c Report if there is no sdk produced in the build 2024-02-22 09:14:53 -08:00
Jackson Schuster
5cc5ee0532 Run the archive diff by default 2024-02-22 08:52:31 -08:00
Jackson Schuster
a4bee9104a Forgot to make the project a library after testing 2024-02-22 08:47:34 -08:00
Jackson Schuster
cd1b907f80 fix name 2024-02-22 08:38:05 -08:00
Jackson Schuster
e894991b5f Add SdkArchiveDiff task to verify the sdk archive has all the expected outputs 2024-02-22 08:30:29 -08:00
Matt Thalman
ed324e09c7
Isolate package flow between repos (#18557)
As a prerequisite to enabling parallel builds of the repos in the VMR, it's necessary to isolate the package flow between repos. This ensures that repo dependencies are defined correctly. Prior to these changes, the packages outputted by repos went to the same directory (Shipping or NonShipping) and those two directories were used as the package feed inputs to dependent repos. This would be dangerous in the context of running builds in parallel across repos because any ill-defined dependencies could lead to race conditions. For example, consider the msbuild repo's dependency on System.Text.Json from the runtime repo. If runtime was not defined as a dependency of msbuild, then there's no guarantee that System.Text.Json will exist when it restores it. Based on timing, it may exist in one build and then not exist in another build.

To solve this problem, the packages output from a repos build are placed in a repo-specific package location as a sub-directory of the package location (Shipping or NonShipping). Previously, all repos would output their packages to `artifacts/packages/Release/[NonShipping|Shipping]`. With these changes, they output to `artifacts/packages/Release/[NonShipping|Shipping]/<repo-name>`. This isolates all packages on a per-repo basis. The next step is to provide access to these packages based on dependencies. Going back to msbuild's dependency on runtime, this is accomplished by modifying msbuild's nuget.config file to include feeds specific to runtime:

```xml
<add key="source-built-runtime" value="/vmr/artifacts/packages/Release/Shipping/runtime/" />
<add key="source-built-transport-runtime" value="/vmr/artifacts/packages/Release/NonShipping/runtime/" />
```
2024-02-22 10:25:55 -06:00
Viktor Hofer
0a73f814e1
Don't append to but overwrite the log file (#18746) 2024-02-22 15:29:39 +01:00
v-wuzhai
b271530f9c
[automated] Merge branch 'release/8.0.3xx' => 'main' (#18744) 2024-02-22 01:29:57 -08:00
Matt Mitchell
ff773a4b6d
Remove aspire exclusion (#18663)
Co-authored-by: Viktor Hofer <viktor.hofer@microsoft.com>
2024-02-22 10:08:00 +01:00
Jason Zhai
31c903f533 Merge branch 'release/8.0.3xx' 2024-02-21 23:36:19 -08:00
v-wuzhai
bea3f0fa06
[release/8.0.3xx] Update dependencies from dotnet/arcade-services (#18732) 2024-02-21 18:31:49 -08:00
v-wuzhai
47869c206f
[main] Update dependencies from dotnet/sdk (#18743) 2024-02-21 18:31:21 -08:00
v-wuzhai
a42fc15b12
[release/8.0.3xx] Update dependencies from dotnet/sdk (#18742) 2024-02-21 18:30:54 -08:00
dotnet-maestro[bot]
48c79ed97e Update dependencies from https://github.com/dotnet/sdk build 20240221.6
Microsoft.SourceBuild.Intermediate.sdk , Microsoft.DotNet.Common.ItemTemplates , Microsoft.DotNet.MSBuildSdkResolver , Microsoft.NET.Sdk , Microsoft.TemplateEngine.Cli
 From Version 9.0.100-preview.2.24121.3 -> To Version 9.0.100-preview.2.24121.6
2024-02-22 00:54:30 +00:00
dotnet-maestro[bot]
8ffd45b9ce
[main] Update dependencies from dotnet/sdk (#18741)
[main] Update dependencies from dotnet/sdk
- Coherency Updates:
  - Microsoft.Build: from 17.10.0-preview-24120-03 to 17.10.0-preview-24120-06 (parent: Microsoft.NET.Sdk)
  - Microsoft.SourceBuild.Intermediate.msbuild: from 17.10.0-preview-24120-03 to 17.10.0-preview-24120-06 (parent: Microsoft.NET.Sdk)
2024-02-21 22:38:47 +00:00
dotnet-maestro[bot]
e7a45ecd84 Update dependencies from https://github.com/dotnet/sdk build 20240221.4
Microsoft.DotNet.Common.ItemTemplates , Microsoft.DotNet.MSBuildSdkResolver , Microsoft.NET.Sdk , Microsoft.TemplateEngine.Cli
 From Version 8.0.300-preview.24120.28 -> To Version 8.0.300-preview.24121.4

Dependency coherency updates

Microsoft.FSharp.Compiler,Microsoft.SourceBuild.Intermediate.fsharp,Microsoft.Net.Compilers.Toolset,Microsoft.Build
 From Version 12.8.300-beta.24119.1 -> To Version 12.8.300-beta.24120.1 (parent: Microsoft.NET.Sdk
2024-02-21 21:53:33 +00:00
dotnet-maestro[bot]
d8c5b2d9af Update dependencies from https://github.com/dotnet/sdk build 20240221.2
Microsoft.DotNet.Common.ItemTemplates , Microsoft.DotNet.MSBuildSdkResolver , Microsoft.NET.Sdk , Microsoft.TemplateEngine.Cli
 From Version 8.0.300-preview.24120.28 -> To Version 8.0.300-preview.24121.2

Dependency coherency updates

Microsoft.FSharp.Compiler,Microsoft.SourceBuild.Intermediate.fsharp,Microsoft.Build
 From Version 12.8.300-beta.24119.1 -> To Version 12.8.300-beta.24120.1 (parent: Microsoft.NET.Sdk
2024-02-21 21:09:23 +00:00
dotnet-maestro[bot]
bc50a67feb Update dependencies from https://github.com/dotnet/arcade-services build 20240221.1
Microsoft.DotNet.Darc , Microsoft.DotNet.DarcLib
 From Version 1.1.0-beta.24120.2 -> To Version 1.1.0-beta.24121.1
2024-02-21 13:28:49 +00:00
v-wuzhai
81b4b366c7
[main] Update dependencies from dotnet/sdk (#18731) 2024-02-21 02:08:02 -08:00
v-wuzhai
9869caffa1
[automated] Merge branch 'release/8.0.3xx' => 'main' (#18724) 2024-02-21 01:32:23 -08:00
dotnet-maestro[bot]
9f09c9e767 Update dependencies from https://github.com/dotnet/sdk build 20240221.1
Microsoft.SourceBuild.Intermediate.sdk , Microsoft.DotNet.Common.ItemTemplates , Microsoft.DotNet.MSBuildSdkResolver , Microsoft.NET.Sdk , Microsoft.TemplateEngine.Cli
 From Version 9.0.100-preview.2.24120.27 -> To Version 9.0.100-preview.2.24121.1

Dependency coherency updates

Microsoft.AspNetCore.App.Ref,Microsoft.AspNetCore.App.Ref.Internal,Microsoft.AspNetCore.App.Runtime.win-x64,VS.Redist.Common.AspNetCore.SharedFramework.x64.9.0,dotnet-dev-certs,dotnet-user-jwts,dotnet-user-secrets,Microsoft.SourceBuild.Intermediate.aspnetcore
 From Version 9.0.0-preview.2.24120.3 -> To Version 9.0.0-preview.2.24120.6 (parent: Microsoft.NET.Sdk
2024-02-21 08:46:00 +00:00
dotnet-maestro[bot]
6ee0587fd7 Update dependencies from https://github.com/dotnet/sdk build 20240220.31
Microsoft.SourceBuild.Intermediate.sdk , Microsoft.DotNet.Common.ItemTemplates , Microsoft.DotNet.MSBuildSdkResolver , Microsoft.NET.Sdk , Microsoft.TemplateEngine.Cli
 From Version 9.0.100-preview.2.24120.27 -> To Version 9.0.100-preview.2.24120.31
2024-02-21 07:37:58 +00:00
Jason Zhai
6dd3976c70 Merge branch 'release/8.0.3xx' 2024-02-20 23:29:17 -08:00