Commit graph

670 commits

Author SHA1 Message Date
Matt Thalman
ed324e09c7
Isolate package flow between repos (#18557)
As a prerequisite to enabling parallel builds of the repos in the VMR, it's necessary to isolate the package flow between repos. This ensures that repo dependencies are defined correctly. Prior to these changes, the packages outputted by repos went to the same directory (Shipping or NonShipping) and those two directories were used as the package feed inputs to dependent repos. This would be dangerous in the context of running builds in parallel across repos because any ill-defined dependencies could lead to race conditions. For example, consider the msbuild repo's dependency on System.Text.Json from the runtime repo. If runtime was not defined as a dependency of msbuild, then there's no guarantee that System.Text.Json will exist when it restores it. Based on timing, it may exist in one build and then not exist in another build.

To solve this problem, the packages output from a repos build are placed in a repo-specific package location as a sub-directory of the package location (Shipping or NonShipping). Previously, all repos would output their packages to `artifacts/packages/Release/[NonShipping|Shipping]`. With these changes, they output to `artifacts/packages/Release/[NonShipping|Shipping]/<repo-name>`. This isolates all packages on a per-repo basis. The next step is to provide access to these packages based on dependencies. Going back to msbuild's dependency on runtime, this is accomplished by modifying msbuild's nuget.config file to include feeds specific to runtime:

```xml
<add key="source-built-runtime" value="/vmr/artifacts/packages/Release/Shipping/runtime/" />
<add key="source-built-transport-runtime" value="/vmr/artifacts/packages/Release/NonShipping/runtime/" />
```
2024-02-22 10:25:55 -06:00
Viktor Hofer
0a73f814e1
Don't append to but overwrite the log file (#18746) 2024-02-22 15:29:39 +01:00
Matt Mitchell
ff773a4b6d
Remove aspire exclusion (#18663)
Co-authored-by: Viktor Hofer <viktor.hofer@microsoft.com>
2024-02-22 10:08:00 +01:00
Tom Deseyn
4a54301016
Improve/fix cross-build support. (#18658) 2024-02-20 09:07:53 -08:00
Matt Thalman
b503b6ae70
Exclude format/watch from SDK diff (#18707) 2024-02-20 10:59:41 -06:00
Marc Paine
044c324be7
Merge branch 'release/8.0.2xx' into merge/release/8.0.1xx-to-release/8.0.2xx 2024-02-15 13:30:43 -08:00
NET Source-Build Bot
124c9f8435
.NET Source-Build 8.0.102 February 2024 Updates (#18655) 2024-02-15 14:45:17 +00:00
vseanreesermsft
c92f4231d3
Merging internal commits for release/8.0.1xx (#18650) 2024-02-15 07:39:04 -06:00
Matt Mitchell
a4860bb6bf
Remove SDK repo exclusion (#18667) 2024-02-15 07:40:19 +01:00
Jo Shields
1343db3344 Try wiring up all remaining Short Stack lanes 2024-02-14 11:14:01 -05:00
Matt Mitchell
cb23ae9ae2
Enable deployment tools (#18642)
Co-authored-by: Alexander Köplinger <alex.koeplinger@outlook.com>
2024-02-14 15:05:17 +01:00
Matt Mitchell
19d3b3891b
Revert "Disables test-templates build again" (#18597)
Co-authored-by: Viktor Hofer <viktor.hofer@microsoft.com>
2024-02-14 08:00:07 +01:00
dotnet-maestro[bot]
273f49c44f
[main] Update dependencies from dotnet/sdk (#18641)
[main] Update dependencies from dotnet/sdk
- Coherency Updates:
  - Microsoft.WindowsDesktop.App.Ref: from 9.0.0-preview.2.24112.5 to 9.0.0-preview.2.24113.4 (parent: Microsoft.NET.Sdk)
  - VS.Redist.Common.WindowsDesktop.SharedFramework.x64.9.0: from 9.0.0-preview.2.24112.5 to 9.0.0-preview.2.24113.4 (parent: Microsoft.NET.Sdk)
  - VS.Redist.Common.WindowsDesktop.TargetingPack.x64.9.0: from 9.0.0-preview.2.24112.5 to 9.0.0-preview.2.24113.4 (parent: Microsoft.NET.Sdk)
  - VS.Redist.Common.NetCore.SharedFramework.x64.9.0: from 9.0.0-preview.2.24112.33 to 9.0.0-preview.2.24113.5 (parent: Microsoft.NET.Sdk)
  - Microsoft.NETCore.App.Ref: from 9.0.0-preview.2.24112.33 to 9.0.0-preview.2.24113.5 (parent: Microsoft.NET.Sdk)
  - VS.Redist.Common.NetCore.TargetingPack.x64.9.0: from 9.0.0-preview.2.24112.33 to 9.0.0-preview.2.24113.5 (parent: Microsoft.NET.Sdk)
  - Microsoft.NETCore.App.Host.win-x64: from 9.0.0-preview.2.24112.33 to 9.0.0-preview.2.24113.5 (parent: Microsoft.NET.Sdk)
  - Microsoft.NETCore.Platforms: from 9.0.0-preview.2.24112.33 to 9.0.0-preview.2.24113.5 (parent: Microsoft.NET.Sdk)
  - Microsoft.SourceBuild.Intermediate.runtime.linux-x64: from 9.0.0-preview.2.24112.33 to 9.0.0-preview.2.24113.5 (parent: Microsoft.NET.Sdk)
  - Microsoft.AspNetCore.App.Ref: from 9.0.0-preview.2.24112.25 to 9.0.0-preview.2.24113.4 (parent: Microsoft.NET.Sdk)
  - Microsoft.AspNetCore.App.Ref.Internal: from 9.0.0-preview.2.24112.25 to 9.0.0-preview.2.24113.4 (parent: Microsoft.NET.Sdk)
  - Microsoft.AspNetCore.App.Runtime.win-x64: from 9.0.0-preview.2.24112.25 to 9.0.0-preview.2.24113.4 (parent: Microsoft.NET.Sdk)
  - VS.Redist.Common.AspNetCore.SharedFramework.x64.9.0: from 9.0.0-preview.2.24112.25 to 9.0.0-preview.2.24113.4 (parent: Microsoft.NET.Sdk)
  - dotnet-dev-certs: from 9.0.0-preview.2.24112.25 to 9.0.0-preview.2.24113.4 (parent: Microsoft.NET.Sdk)
  - dotnet-user-jwts: from 9.0.0-preview.2.24112.25 to 9.0.0-preview.2.24113.4 (parent: Microsoft.NET.Sdk)
  - dotnet-user-secrets: from 9.0.0-preview.2.24112.25 to 9.0.0-preview.2.24113.4 (parent: Microsoft.NET.Sdk)
  - Microsoft.SourceBuild.Intermediate.aspnetcore: from 9.0.0-preview.2.24112.25 to 9.0.0-preview.2.24113.4 (parent: Microsoft.NET.Sdk)
  - Microsoft.WindowsDesktop.App.Runtime.win-x64: from 9.0.0-preview.2.24112.5 to 9.0.0-preview.2.24113.4 (parent: Microsoft.NET.Sdk)
  - Microsoft.Dotnet.WinForms.ProjectTemplates: from 9.0.0-preview.2.24112.2 to 9.0.0-preview.2.24112.7 (parent: Microsoft.WindowsDesktop.App.Runtime.win-x64)
  - Microsoft.WindowsDesktop.App.Runtime.win-x64: from 9.0.0-preview.2.24112.5 to 9.0.0-preview.2.24113.4 (parent: Microsoft.NET.Sdk)
  - Microsoft.DotNet.Wpf.ProjectTemplates: from 9.0.0-preview.2.24112.2 to 9.0.0-preview.2.24112.4 (parent: Microsoft.WindowsDesktop.App.Runtime.win-x64)
  - Microsoft.FSharp.Compiler: from 12.8.300-beta.24112.4 to 12.8.300-beta.24113.3 (parent: Microsoft.NET.Sdk)
  - Microsoft.SourceBuild.Intermediate.fsharp: from 8.0.300-beta.24112.4 to 8.0.300-beta.24113.3 (parent: Microsoft.NET.Sdk)
  - Microsoft.NET.Test.Sdk: from 17.10.0-preview-24107-02 to 17.10.0-preview-24112-02 (parent: Microsoft.NET.Sdk)
  - Microsoft.SourceBuild.Intermediate.vstest: from 17.10.0-preview-24107-02 to 17.10.0-preview-24112-02 (parent: Microsoft.NET.Sdk)
  - Microsoft.NET.ILLink.Tasks: from 9.0.0-preview.2.24112.33 to 9.0.0-preview.2.24113.5 (parent: Microsoft.NET.Sdk)
  - Microsoft.Net.Compilers.Toolset: from 4.10.0-2.24112.4 to 4.10.0-2.24113.3 (parent: Microsoft.NET.Sdk)
  - Microsoft.SourceBuild.Intermediate.roslyn: from 4.10.0-2.24112.4 to 4.10.0-2.24113.3 (parent: Microsoft.NET.Sdk)
  - Microsoft.NETCore.App.Runtime.win-x64: from 9.0.0-preview.2.24112.33 to 9.0.0-preview.2.24113.5 (parent: Microsoft.NET.Sdk)
  - Microsoft.NETCore.App.Runtime.win-x64: from 9.0.0-preview.2.24112.33 to 9.0.0-preview.2.24113.5 (parent: Microsoft.NET.Sdk)

 - Delete obsolete format patch

 - Update WASI container to react to 1a9e0cdb3b

 - Update aspnetcore.proj
2024-02-14 01:56:14 +00:00
Jo Shields
cc8e163e7d
[VMR] Enable all Android & Linux Bionic Mono CI lanes (#18560)
Co-authored-by: Alexander Köplinger <alex.koeplinger@outlook.com>
2024-02-13 17:36:00 +00:00
Viktor Hofer
94def2ee6c
Put artifacts in well-known locations (#18591) 2024-02-13 09:19:33 -06:00
Viktor Hofer
331a02da30
Enable wpf and winforms in the VMR (#18636) 2024-02-13 11:09:04 +00:00
Matt Mitchell
2af211f133
Move RootRepo property up (#18633) 2024-02-13 07:50:10 +00:00
Matt Mitchell
6af6235128
Do not copy restored package content if already exists (#18626) 2024-02-12 20:00:19 +00:00
Matt Mitchell
aca78d6450
Change log message verbosity in resolver to "Low" (#18622) 2024-02-12 18:40:03 +00:00
Matt Thalman
a01e2fb11d
Ignore false positive license ref in SBRP (#18620) 2024-02-12 16:48:15 +00:00
Viktor Hofer
99a960108b
Enable templating and roslyn-analyzers in UB (#18618) 2024-02-12 08:05:05 -08:00
dotnet-maestro[bot]
bf6f78261f
[main] Update dependencies from dotnet/sdk (#18457) 2024-02-10 01:39:12 +00:00
Jeremy Koritzinsky
66f3b383a8
Enable building WPF in the unified build (#18577) 2024-02-09 22:36:23 +00:00
Michael Simons
300280a9a4
Stop running vmr-scan in public CI (#18608) 2024-02-09 21:40:55 +00:00
Matt Mitchell
e4d3343347
Update DotNetBuildSkipTests -> DotNetBuildTests (#18583) 2024-02-09 09:26:28 -08:00
Viktor Hofer
d34ff88c51
Disables test-templates build again (#18592) 2024-02-09 11:47:52 +01:00
Viktor Hofer
4cd842ec04
Remove dead code (#18579) 2024-02-09 08:19:15 +01:00
Matt Mitchell
02edd8e839
Enable test-templates build (#18581)
Co-authored-by: dotnet-maestro[bot] <dotnet-maestro[bot]@users.noreply.github.com>
2024-02-09 08:14:42 +01:00
Matt Mitchell
7eb0143369
Enable roslyn-analyzers (#18585) 2024-02-08 19:26:18 -06:00
Jackson Schuster
ee1dce81b3 Add PackageDiff tool and tasks 2024-02-08 12:44:17 -08:00
Viktor Hofer
5003feccb9
Update README.md (#18569)
Co-authored-by: Alexander Köplinger <alex.koeplinger@outlook.com>
Co-authored-by: Přemek Vysoký <premek.vysoky@microsoft.com>
2024-02-08 10:42:26 -06:00
Ella Hathaway
b368584e4a
Enable error on prebuilts (#18173)
Co-authored-by: Michael Simons <msimons@microsoft.com>
2024-02-08 15:53:11 +00:00
Viktor Hofer
95ad39aa68
Update package-source-build.proj (#18555) 2024-02-08 12:38:31 +01:00
Jeremy Koritzinsky
637b8a6eaf
Export the custom SDK resolvers dir in build.sh (#18565) 2024-02-08 12:35:01 +01:00
Michael Simons
f7e396bfa7
Update source-build build instructions to reflect recent option changes (#18559)
Co-authored-by: Matt Thalman <mthalman@microsoft.com>
2024-02-07 16:01:15 -06:00
Jo Shields
debb6bf8f0
[VMR] Support for short stack builds. (#18463) 2024-02-07 15:59:30 -05:00
Jeremy Koritzinsky
3242c17f66
Update SdkResolver layout to work for Desktop and Core MSBuild (#18505)
Co-authored-by: Viktor Hofer <viktor.hofer@microsoft.com>
2024-02-07 20:22:44 +00:00
Jo Shields
3a55a8ebaa
Merge branch 'main' into shortstack 2024-02-07 13:09:19 -05:00
Jo Shields
3df779e4f6 If we want to do a short stack Windows build, tweak the RID 2024-02-07 13:07:38 -05:00
Viktor Hofer
ee9a93b4cc
Follow-up on CopyRepoArtifacts directly in the VMR (#18551) 2024-02-07 17:44:09 +00:00
Viktor Hofer
540504fb32
Enable target that copies binaries to final location for non source-b… (#18552) 2024-02-07 16:58:02 +00:00
Viktor Hofer
2c49b20264
Change the package cache dir to repo-root/.packages (#18550) 2024-02-07 16:27:55 +00:00
Jo Shields
d5e8ffb6ea Merge remote-tracking branch 'origin/main' into shortstack 2024-02-07 10:31:32 -05:00
Matt Mitchell
722bcd86aa
Enable overriding of the arcade cmake SDK in VMR (#18539) 2024-02-07 01:03:36 +00:00
Ella Hathaway
17cb70b35e
Update artifacts baseline (#18523) 2024-02-06 19:17:57 +00:00
Alexander Köplinger
bfc1601838
Update triggers in ci.yml (#18520) 2024-02-06 16:04:50 +00:00
Jo Shields
30138aab29
Merge branch 'main' into shortstack 2024-02-06 09:20:29 -05:00
Alexander Köplinger
fb7b9a4b9e
Don't run vmr-scan.yml for PRs in ci.yml and treat main-ub as a main branch (#18515) 2024-02-06 14:22:36 +01:00
Alexander Köplinger
28012e74ff
Add VMR unified build pipelines (#18409)
Contributes to https://github.com/dotnet/source-build/issues/3823

- Removes and consolidates vmr-cross-build.yml/ci-cross-build.yml POC into vmr-build.yml/ci.yml
- Add stage for building vertical/unified build legs into vmr-build.yml
- Adds Windows build and handling for Windows/Unix differences
2024-02-06 09:57:00 +01:00
Matt Thalman
530bfbd9d4
Bootstrap SB SDK and artifacts (#18504) 2024-02-05 16:24:05 +01:00