Commit graph

1302 commits

Author SHA1 Message Date
Michael Simons
fe0187f55e
[ArPow] Misc changes to reduce tarball build size (#11683) 2021-08-26 16:30:50 +00:00
Michael Simons
3be0fd4f08
Source-build updates to handle internal repo names (#11661) 2021-08-25 01:46:35 +00:00
Chris Rummel
f3ea71b28f
[ArPow] Add NuGet.Client (#11489)
* [main] Update dependencies from dotnet/sdk (#11565)

[main] Update dependencies from dotnet/sdk
- Coherency Updates:
  - Microsoft.AspNetCore.App.Ref: from 6.0.0-rc.1.21417.2 to 6.0.0-rc.1.21417.8 (parent: Microsoft.NET.Sdk)
  - Microsoft.AspNetCore.App.Ref.Internal: from 6.0.0-rc.1.21417.2 to 6.0.0-rc.1.21417.8 (parent: Microsoft.NET.Sdk)
  - Microsoft.AspNetCore.App.Runtime.win-x64: from 6.0.0-rc.1.21417.2 to 6.0.0-rc.1.21417.8 (parent: Microsoft.NET.Sdk)
  - VS.Redist.Common.AspNetCore.SharedFramework.x64.6.0: from 6.0.0-rc.1.21417.2 to 6.0.0-rc.1.21417.8 (parent: Microsoft.NET.Sdk)
  - dotnet-dev-certs: from 6.0.0-rc.1.21417.2 to 6.0.0-rc.1.21417.8 (parent: Microsoft.NET.Sdk)
  - dotnet-user-secrets: from 6.0.0-rc.1.21417.2 to 6.0.0-rc.1.21417.8 (parent: Microsoft.NET.Sdk)

* Update dependencies from https://github.com/dotnet/sdk build 20210817.21 (#11569)

[main] Update dependencies from dotnet/sdk
- Coherency Updates:
  - Microsoft.NET.Test.Sdk: from 17.0.0-preview-20210817-01 to 17.0.0-preview-20210817-02 (parent: Microsoft.NET.Sdk)

* Update dependencies from https://github.com/dotnet/arcade build 20210817.1 (#11570)

[main] Update dependencies from dotnet/arcade
- Coherency Updates:
  - Microsoft.SourceLink.GitHub: from 1.1.0-beta-21309-01 to 1.1.0-beta-21416-05 (parent: Microsoft.DotNet.Arcade.Sdk)
  - Microsoft.DotNet.XliffTasks: from 1.0.0-beta.21412.1 to 1.0.0-beta.21414.1 (parent: Microsoft.DotNet.Arcade.Sdk)

* [ArPow] Add runtime repo to tarball (#11506)

* Add runtime repo / update runtime project

* Update runtime-portable logs and properties

* Create runtime-portable git-info

* Fix unpack of IntermediatePackages

* Re-enable references to runtime

* Pass TargetRid and NonPortable to runtime build

* Only build allconfigurations in non-portable build

* Add SDK patch to disable new CA warning

* Increase built tarball timeout

* Update prebuilt version

* Remove 5.0.3xx and preview 7
Add rc1, 6.0 daily, and move main to 7.0

* Removing 7.0 for now as there aren't builds yet.

* Update dependencies from https://github.com/dotnet/arcade build 20210818.12 (#11594)

[main] Update dependencies from dotnet/arcade
- Coherency Updates:
  - Microsoft.SourceLink.GitHub: from 1.1.0-beta-21416-05 to 1.1.0-beta-21417-01 (parent: Microsoft.DotNet.Arcade.Sdk)
  - Microsoft.DotNet.XliffTasks: from 1.0.0-beta.21414.1 to 1.0.0-beta.21417.1 (parent: Microsoft.DotNet.Arcade.Sdk)

* [ArPow] Add installer repo to tarball (#11483)

* Fix the rc2 aka.ms links

* Add NuGet

* Make safe repo name safer.

* some more props filename stuff

* Patches to get the repo to build

* Use NuGet build script instead of manually calling msbuild.

* Add patch for source-build in build.sh in nuget.

* Use existing 5.0 nuget patch.

* Fixes for build scripts and .NET 6 SDK upgrade.

* Remove obsolete patch - this was caused by not using the correct source-build SDK.

* Address code review comment for source-build build script.

* Restore reference from installer to NuGet.

* Fix patch not applying.

* Don't try to pass Arcade build args to MSBuild.

* Fix script typo.

* Patch NuGet.Frameworks to produce netstandard2.0 for VSTest.

* Did this patch the wrong way around.

* Ignore  failure in no-network case

* UPdate prebuilts version.

Co-authored-by: dotnet-maestro[bot] <42748379+dotnet-maestro[bot]@users.noreply.github.com>
Co-authored-by: Dan Seefeldt <dseefeld@microsoft.com>
Co-authored-by: Marc Paine <marcpop@microsoft.com>
Co-authored-by: Michael Simons <msimons@microsoft.com>
Co-authored-by: Matt Galbraith <mattgal@microsoft.com>
2021-08-24 20:01:06 +00:00
Michael Simons
7c4b93e5b7
[ArPow Tarball] Tier 3 - Add roslyn-analyzers repo to arpow tarball (#11114) 2021-08-24 15:33:44 +00:00
Chris Rummel
f932fe8d77
[ArPow] Merge new repos to release/6.0.1xx (#11620)
* [ArPow] Add runtime repo to tarball (#11506)

* Add runtime repo / update runtime project

* Update runtime-portable logs and properties

* Create runtime-portable git-info

* Fix unpack of IntermediatePackages

* Re-enable references to runtime

* Pass TargetRid and NonPortable to runtime build

* Only build allconfigurations in non-portable build

* Add SDK patch to disable new CA warning

* Increase built tarball timeout

* Update prebuilt version

* [ArPow] Add installer repo to tarball (#11483)

* Ignore  failure in no-network case

Co-authored-by: Dan Seefeldt <dseefeld@microsoft.com>
Co-authored-by: Michael Simons <msimons@microsoft.com>
Co-authored-by: Matt Galbraith <mattgal@microsoft.com>
2021-08-23 22:05:58 +00:00
Michael Simons
f2576ec09d
[ArPow] Add installer repo to tarball (#11483) 2021-08-19 10:11:11 -05:00
Dan Seefeldt
6bd49343d9
[ArPow] Add runtime repo to tarball (#11506)
* Add runtime repo / update runtime project

* Update runtime-portable logs and properties

* Create runtime-portable git-info

* Fix unpack of IntermediatePackages

* Re-enable references to runtime

* Pass TargetRid and NonPortable to runtime build

* Only build allconfigurations in non-portable build

* Add SDK patch to disable new CA warning

* Increase built tarball timeout

* Update prebuilt version
2021-08-18 17:18:01 +00:00
Dan Seefeldt
381ea7f7ae
[ArPow Tarball] Uptake new version of SBRP (#11491)
* Uptake new version of SBRP

* Remove SBRP patch

* Remove unneeded runtime patch
2021-08-12 08:27:52 -05:00
Michael Simons
7538de49ce
[ArPow] Add sdk repo to arpow tarball (#11454) 2021-08-10 16:43:07 +00:00
Michael Simons
c810711af2
Update the ArPow dotnet tool version (#11460) 2021-08-10 09:32:42 -05:00
Michael Simons
e7cd00d5bf
[ArPow Tarball] Tier 2 - Add runtime-portable repo to arpow tarball (#11078)
* [ArPow Tarball] Tier 2 - Add runtime-portable repo to arpow tarball

* Update TemporaryBootstrapPackageVersions.props

* Revert too aggressive of version updates in TemporaryBootstrapPackageVersions.props

* Remove allconfigurations flag since some are not valid in source-build

* Don't copy tools anymore after Package

This target is no longer needed as it was meant to copy ilasm/ildasm to
a known directory to be picked up by SBRP.  SBRP now uses the nupkg.

* Update binlog param to ensure we get inner binlog

* Don't build stable versions for preview

* Update DirectoryBuild.props in src if root one isn't found

* Add dotnet6 feed to NuGet.Configs

* Remove unneeded properties in runtime.common.props

* Increase timeout on create tarball job

* Update portable build cleanup

* Remove timeout on Create Tarball job

* Only add source when building online

* Update prebuilts version

Co-authored-by: dseefeld <dseefeld@microsoft.com>
2021-08-06 18:53:24 -05:00
Matt Mitchell
9994b20baa
Changes for internal runtime build support for .NET 6 (#11422)
- Cherry pick the internal runtime download changes over
- Cherry pick changes to the arcade SB template over (making the next update a noop and unblocking P7+)
- Hoist out the variable groups and parameters needed for the internal download to the top level yaml file.
- Remove the old DownloadFile task and replace this with the Arcade version. Specifically this allows us to remove
  set/use of the DOTNETCLIMSRC_READ_SAS_TOKEN environment variable and instead rely on that task's ability to decode and
  use a base64 encoded SAS token. The reason for the environment variable usage before was that the
  non-encoded SAS token was getting mangled by msbuild/bash/etc. on non-Windows OSs.
- Update the source build tarball template with support for internal runtimes

Update to source build template
2021-08-06 13:54:33 -07:00
Michael Simons
5268979bef
[ArPow] Add offline tarball build infra and CI (#11403)
* Add offline build to CI

* Add sourcelink patches to unblock offline aspnetcore build
2021-08-06 12:50:48 -05:00
Logan Bussell
f2fb118bdd
Rename the PackageVersions.props files used in source-build (#11407)
* rename PackageVersions.props files used for source-build
2021-08-06 10:07:54 -07:00
Dan Seefeldt
33c0d0250d
[ArPow Tarball] Clean up src directories when building (#11421)
* Clean up src directories when building

* Updates based on PR review comments
2021-08-06 09:12:04 -05:00
Marc Paine
92984ff7e5
Merge pull request #11365 from dotnet/marcpopMSFT-newtonsoftupdate
Update our version of newtonsoft.json.dll to latest.
2021-08-05 13:52:57 -07:00
Michael Simons
2897e82c96
Add prebuilt acquisition and production build infra (#11417) 2021-08-05 15:19:38 -05:00
Michael Simons
0b62347ded
[ArPow Tarball] Tier 4 - Add aspnetcore repo to arpow tarball (#11113) 2021-08-03 20:11:34 -05:00
Logan Bussell
39d5733f3a
rename tarball/packages/source-built folder to previously-source-built (#11386) 2021-08-03 09:12:12 -07:00
Marc Paine
238e293a44 Update our version of newtonsoft.json.dll to latest. 2021-07-30 15:56:26 -07:00
Logan Bussell
98b681d564
[ArPow] Check in the empty src/Directory.Build.props and targets instead of generating them (#11350)
* check in directory.build.props and targets instead of generating them
* make empty build props and targets comments more reader friendly
2021-07-30 11:59:59 -07:00
Dan Seefeldt
b6e2615047
Update clicommandlineparser to build offline (#11327) 2021-07-28 16:07:24 -05:00
Michael Simons
30734f0b61
Add tarball pipeline logic to publish Private.SourceBuilt.Artifacts (#11297) 2021-07-27 16:51:44 +00:00
Dan Seefeldt
69fcba5df7
[ArPow] Update tarball build to build with current version of previously source-built packages (#11293)
* Collect prebuilt packages

* WIP offline build

* Update ReplaceTextInFile(s) to honor line endings

* Build changes required to build with current Roslyn

* Look for 6.0 version of logger

* Add patch for SBRP to get eng/common updated.

* Update previously source-built version

* Add additional comments on patches

* Add comment on TemporaryBootstrap file

* Updates based on PR comments
2021-07-27 10:27:40 -05:00
Michael Simons
f247377f4d
Use consistent BuildCommandArgs pattern (#11281) 2021-07-27 08:25:36 -05:00
Dan Seefeldt
702587dcbb
[ArPow] Update SBRP to get version with updated ilasm (#11233)
* Update SBRP to get version with updated ilasm

Also, remove the prebuilts for packages that weren't being built
correctly.

* Add empty prebuilt directory
2021-07-23 16:25:22 -05:00
Chris Rummel
7841b20804
[ArPow Tarball] Tier 1 - Add roslyn repo to arpow tarball (#11142)
Co-authored-by: Michael Simons <msimons@microsoft.com>
2021-07-22 16:34:51 -05:00
Chris Rummel
6ff5eb4add
[ArPow] Update SourceBuild tasks to netcoreapp6. (#11163)
* Update SourceBuild tasks to netcoreapp6.

* Another couple packages with bad IL generic extension methods with 'with' constraints.
2021-07-20 00:50:48 +00:00
Michael Simons
f1b634b690
[ArPow Tarball] Tier 4 - Add vstest repo to arpow tarball (#11077) 2021-07-12 16:54:36 -05:00
Michael Simons
58bfec72c1
[ArPow Tarball] Tier 4 - Add fsharp repo to arpow tarball (#11081) 2021-07-12 15:19:52 -05:00
Michael Simons
305f2635bd
[ArPow Tarball] Tier 2 - Add msbuild repo to arpow tarball (#11079) 2021-07-09 23:43:57 +00:00
Chris Rummel
91afacfc09
[ArPow] Temporary fix for reference packages with broken extension methods (#11092)
* Add some needed prebuilt packages to override temporarily bad ref packages.

* Remove bad ref packages.

* Also don't copy new versions of the bad SBRP packages after the SBRP build.

* Account for missing intermediate packages and different paths.

* Address code review comment.
2021-07-09 22:43:30 +00:00
Dan Seefeldt
5048e0f143
[Arpow Tarball] Add flag to build with online sources (#11091)
* Add SBRP packages to prev source-built

* Don't delete SBRP packages

* Add BuildWithOnlineSources flag

* Build tarball in CI with online sources

* Remove OfflineBuild / add BuildWithOnlineSources

* Add --online option to tarball build.sh

* Additional cleanup for tarball build

* Rename baseline file

* Update baseline

* Remove acquire-darc.proj

* Default DotNetBuildOffline to true

* Fix line endings in RemoveInternetSources

* Update src/SourceBuild/Arcade/eng/common/templates/steps/source-build-run-tarball-build.yml

Co-authored-by: Michael Simons <msimons@microsoft.com>

Co-authored-by: Michael Simons <msimons@microsoft.com>
2021-07-09 21:42:42 +00:00
Michael Simons
40235466e9
Fix source-build ci and build infra (#11088) 2021-07-08 20:09:54 -05:00
Dan Seefeldt
a5587571df
[ArPow Tarball] Handle SBRP packages in previously source-built artifacts (#11072)
* Add SBRP packages to prev source-built

* Update to new version of prev source-built

* Update SBRP reference

* Don't delete SBRP packages

* Update private source-built version
2021-07-08 09:35:21 -05:00
Michael Simons
229bc924ef
[ArPow] Add templating repo to arpow tarball (#11055) 2021-07-07 11:27:27 -05:00
Michael Simons
addb1b1961
Refactor tarball creation to avoid retrieving all git history (#11029) 2021-07-07 09:24:46 -05:00
Michael Simons
f078968813
[ArPow Tarball] Tier 1 - Add diagnostics repo to arpow tarball (#11031) 2021-07-06 08:33:00 -05:00
Michael Simons
a26f3594e7
[ArPow] Add cliCommandLineParser repo to arpow tarball (#11027) 2021-07-01 15:32:30 -05:00
Michael Simons
a465da6364
[ArPow] Add test-templates repo to arpow tarball (#11013) 2021-07-01 03:30:51 +00:00
Michael Simons
fb7e06599f
[ArPow] Add symreader repo to arpow tarball (#11024) 2021-07-01 02:26:26 +00:00
Omair Majid
4d8c6ab2ad
[ArPow] Add xliff-tasks to arpow tarball (#11022)
Fixes: https://github.com/dotnet/source-build/issues/2270
2021-06-30 21:21:38 -05:00
Dan Seefeldt
31b6510fd5
[ArPow] Reconcile prebuilt checks between inner and outer builds (#11021)
* Setup inner build prebuilt checks to use global package caches

* Update previously source-built version to include version built from tarball build

* Update NuGet.config and global.json for SBRP

* Copy restored packages from inner build

* Update src/SourceBuild/tarball/content/repos/source-build-reference-packages.proj

Co-authored-by: Michael Simons <msimons@microsoft.com>

Co-authored-by: Michael Simons <msimons@microsoft.com>
2021-06-30 21:17:54 -05:00
Michael Simons
660f661ab4
Misc source-build repo project cleanup (#11012) 2021-06-30 11:21:05 -05:00
Michael Simons
e86584a8ca
Add xdt repo to arpow tarball (#11007) 2021-06-30 06:02:10 +00:00
Michael Simons
5cd9c6c06c
Add command-line-api to arpow tarball (#11006) 2021-06-30 04:06:52 +00:00
Michael Simons
b6071293dc
[ArPow] Add source-build repo to arpow tarball (#11002) 2021-06-30 02:36:40 +00:00
Michael Simons
8288ae2e6d
Add source-build tarball build ci (#10995) 2021-06-29 08:33:40 -05:00
Dan Seefeldt
1d29250565
ArPow: Add package-source-build project (#10998)
* Add package-source-build project

* Remove unneccessary reference
2021-06-28 17:19:27 -05:00
Dan Seefeldt
00cd0d1ac2
Propagate DotNetBuildOffline and DotNetPackageVersionPropsPath to inner source-build tarball repo builds (#10986)
* Allow overriding of arcade targets for quicker dev flow

* Add StandardArpowBuildArgs

* Update naming based on PR review comment
2021-06-28 14:24:48 -05:00
Michael Simons
69803dae86
Create tarball file and add tarball creation CI (#10972) 2021-06-28 07:36:57 -05:00
Dan Seefeldt
832010fdf6
Initial checkin of source-build tarball build infrastructure (#10961)
* Initial checkin of source-build tarball build infra

* Add a couple more comments

* Update eng/SourceBuild.Version.Details.xml based on PR review

Co-authored-by: Chris Rummel <crummel@microsoft.com>

* Updates based on PR review comments

Co-authored-by: Chris Rummel <crummel@microsoft.com>
2021-06-24 16:36:04 -05:00