* Add option to bootstrap previously source-built packages
This option modifies the previously source-built archive
to include portable packages that are downloaded from
a microsoft official feed rather than source-built.
* Remove working directory
* Add newlines
* Add additional comment about feeds
* Update source-build prebuilts
* Remove original archive rather than backup
Co-authored-by: MichaelSimons <msimons@microsoft.com>
* add text-only packages to tarball
* add BuildTextOnlyPackages target to tarball build targets
* fix typo
* add content to text only package nuspec files
* Change reference to single nuspec file
* Update based on PR review
* prevent inner buildlog from being overwritten
* condition SourceBuildIntermediate.proj copy and build on the file not existing
* condition entire copy target on SourceBuildIntermediateProjTarget file existing
* Revert "condition entire copy target on SourceBuildIntermediateProjTarget file existing"
This reverts commit 995e106c81751b7d9597abf0c120963c2ab5374b.
* Revert "condition SourceBuildIntermediate.proj copy and build on the file not existing"
This reverts commit 3fbaa11bdb34cf9bb8f006f4c27bbd16783cac09.
* Revert "prevent inner buildlog from being overwritten"
This reverts commit f994e885fd7e0938dcc80150f3a0a8aad215f014.
Co-authored-by: dseefeld <dseefeld@microsoft.com>
* [ArPow] Run smoke tests for tarball CI
Fixes: dotnet/source-build#2298
* Update smoke-tests version reference
* comment out tests with missing templates and temporarily accommodate missing xml files
* Disable f# and blazorwasm tests
Co-authored-by: Michael Simons <msimons@microsoft.com>
Co-authored-by: Logan Bussell <36081148+lbussell@users.noreply.github.com>
* Tweaks for RTM stable building and servicing
- When building from source offline in a stable configuration, the shared frameworks versions will match the directory from which the runtime archives are located in, both stable. This is in contrast to when not building from source, in which the runtime archives will appear in non-stable directories.
- The targeting pack versions should not be assumed to always match the runtime framework versions, and the blob directories containing them are the same. Add new dependencies so that we can track where the targeting pack directory is over time.
- PGO archives coming from runtime are always built non-stable. This means the download location needs to be tweaks, and crossgen calls need to look for shared framework binaries in the non-stable locations.
- For source-build, the templating should move to a new non-stable dependency. This is used to determine the version of the source build intermediate package.
* Generate the full nuget version in the source build tarball job.
The source build tarball job needs the full nuget version so that it can publish the blob to the right location (`Sdk/<full version>/source-<stable version>.zip). This involves being able to call the GenerateFullNuGetVersion target and the targets it depends on.
* Use correct package version prop for crossgen targets
* Tweaks for RTM stable building and servicing
- When building from source offline in a stable configuration, the shared frameworks versions will match the directory from which the runtime archives are located in, both stable. This is in contrast to when not building from source, in which the runtime archives will appear in non-stable directories.
- The targeting pack versions should not be assumed to always match the runtime framework versions, and the blob directories containing them are the same. Add new dependencies so that we can track where the targeting pack directory is over time.
- PGO archives coming from runtime are always built non-stable. This means the download location needs to be tweaks, and crossgen calls need to look for shared framework binaries in the non-stable locations.
- For source-build, the templating should move to a new non-stable dependency. This is used to determine the version of the source build intermediate package.
* Generate the full nuget version in the source build tarball job.
The source build tarball job needs the full nuget version so that it can publish the blob to the right location (`Sdk/<full version>/source-<stable version>.zip). This involves being able to call the GenerateFullNuGetVersion target and the targets it depends on.
* Copy instead of clone and remove .git/objects directories
* Add depth 1 to fetch command
* Add commit count to git-info for installer repo
* Update targets to fix dependency ordering
Some repos take a dependency on PrepareInnerSourceBuildRepoRoot,
assuming that the inner repo will be setup. The condition for copy
instead of clone caused a conflict.
Keep PrepareInnerSourceBuildRepoRoot and make it depend on
either copy or clone completing.
* Don't copy artifacts dir
* Actually don't remove artifacts directory
* Update prebuilt version
* [main] Update dependencies from dotnet/sdk (#11565)
[main] Update dependencies from dotnet/sdk
- Coherency Updates:
- Microsoft.AspNetCore.App.Ref: from 6.0.0-rc.1.21417.2 to 6.0.0-rc.1.21417.8 (parent: Microsoft.NET.Sdk)
- Microsoft.AspNetCore.App.Ref.Internal: from 6.0.0-rc.1.21417.2 to 6.0.0-rc.1.21417.8 (parent: Microsoft.NET.Sdk)
- Microsoft.AspNetCore.App.Runtime.win-x64: from 6.0.0-rc.1.21417.2 to 6.0.0-rc.1.21417.8 (parent: Microsoft.NET.Sdk)
- VS.Redist.Common.AspNetCore.SharedFramework.x64.6.0: from 6.0.0-rc.1.21417.2 to 6.0.0-rc.1.21417.8 (parent: Microsoft.NET.Sdk)
- dotnet-dev-certs: from 6.0.0-rc.1.21417.2 to 6.0.0-rc.1.21417.8 (parent: Microsoft.NET.Sdk)
- dotnet-user-secrets: from 6.0.0-rc.1.21417.2 to 6.0.0-rc.1.21417.8 (parent: Microsoft.NET.Sdk)
* Update dependencies from https://github.com/dotnet/sdk build 20210817.21 (#11569)
[main] Update dependencies from dotnet/sdk
- Coherency Updates:
- Microsoft.NET.Test.Sdk: from 17.0.0-preview-20210817-01 to 17.0.0-preview-20210817-02 (parent: Microsoft.NET.Sdk)
* Update dependencies from https://github.com/dotnet/arcade build 20210817.1 (#11570)
[main] Update dependencies from dotnet/arcade
- Coherency Updates:
- Microsoft.SourceLink.GitHub: from 1.1.0-beta-21309-01 to 1.1.0-beta-21416-05 (parent: Microsoft.DotNet.Arcade.Sdk)
- Microsoft.DotNet.XliffTasks: from 1.0.0-beta.21412.1 to 1.0.0-beta.21414.1 (parent: Microsoft.DotNet.Arcade.Sdk)
* [ArPow] Add runtime repo to tarball (#11506)
* Add runtime repo / update runtime project
* Update runtime-portable logs and properties
* Create runtime-portable git-info
* Fix unpack of IntermediatePackages
* Re-enable references to runtime
* Pass TargetRid and NonPortable to runtime build
* Only build allconfigurations in non-portable build
* Add SDK patch to disable new CA warning
* Increase built tarball timeout
* Update prebuilt version
* Remove 5.0.3xx and preview 7
Add rc1, 6.0 daily, and move main to 7.0
* Removing 7.0 for now as there aren't builds yet.
* Update dependencies from https://github.com/dotnet/arcade build 20210818.12 (#11594)
[main] Update dependencies from dotnet/arcade
- Coherency Updates:
- Microsoft.SourceLink.GitHub: from 1.1.0-beta-21416-05 to 1.1.0-beta-21417-01 (parent: Microsoft.DotNet.Arcade.Sdk)
- Microsoft.DotNet.XliffTasks: from 1.0.0-beta.21414.1 to 1.0.0-beta.21417.1 (parent: Microsoft.DotNet.Arcade.Sdk)
* [ArPow] Add installer repo to tarball (#11483)
* Fix the rc2 aka.ms links
* Add NuGet
* Make safe repo name safer.
* some more props filename stuff
* Patches to get the repo to build
* Use NuGet build script instead of manually calling msbuild.
* Add patch for source-build in build.sh in nuget.
* Use existing 5.0 nuget patch.
* Fixes for build scripts and .NET 6 SDK upgrade.
* Remove obsolete patch - this was caused by not using the correct source-build SDK.
* Address code review comment for source-build build script.
* Restore reference from installer to NuGet.
* Fix patch not applying.
* Don't try to pass Arcade build args to MSBuild.
* Fix script typo.
* Patch NuGet.Frameworks to produce netstandard2.0 for VSTest.
* Did this patch the wrong way around.
* Ignore failure in no-network case
* UPdate prebuilts version.
Co-authored-by: dotnet-maestro[bot] <42748379+dotnet-maestro[bot]@users.noreply.github.com>
Co-authored-by: Dan Seefeldt <dseefeld@microsoft.com>
Co-authored-by: Marc Paine <marcpop@microsoft.com>
Co-authored-by: Michael Simons <msimons@microsoft.com>
Co-authored-by: Matt Galbraith <mattgal@microsoft.com>
* [ArPow] Add runtime repo to tarball (#11506)
* Add runtime repo / update runtime project
* Update runtime-portable logs and properties
* Create runtime-portable git-info
* Fix unpack of IntermediatePackages
* Re-enable references to runtime
* Pass TargetRid and NonPortable to runtime build
* Only build allconfigurations in non-portable build
* Add SDK patch to disable new CA warning
* Increase built tarball timeout
* Update prebuilt version
* [ArPow] Add installer repo to tarball (#11483)
* Ignore failure in no-network case
Co-authored-by: Dan Seefeldt <dseefeld@microsoft.com>
Co-authored-by: Michael Simons <msimons@microsoft.com>
Co-authored-by: Matt Galbraith <mattgal@microsoft.com>
* [ArPow Tarball] Tier 2 - Add runtime-portable repo to arpow tarball
* Update TemporaryBootstrapPackageVersions.props
* Revert too aggressive of version updates in TemporaryBootstrapPackageVersions.props
* Remove allconfigurations flag since some are not valid in source-build
* Don't copy tools anymore after Package
This target is no longer needed as it was meant to copy ilasm/ildasm to
a known directory to be picked up by SBRP. SBRP now uses the nupkg.
* Update binlog param to ensure we get inner binlog
* Don't build stable versions for preview
* Update DirectoryBuild.props in src if root one isn't found
* Add dotnet6 feed to NuGet.Configs
* Remove unneeded properties in runtime.common.props
* Increase timeout on create tarball job
* Update portable build cleanup
* Remove timeout on Create Tarball job
* Only add source when building online
* Update prebuilts version
Co-authored-by: dseefeld <dseefeld@microsoft.com>
- Cherry pick the internal runtime download changes over
- Cherry pick changes to the arcade SB template over (making the next update a noop and unblocking P7+)
- Hoist out the variable groups and parameters needed for the internal download to the top level yaml file.
- Remove the old DownloadFile task and replace this with the Arcade version. Specifically this allows us to remove
set/use of the DOTNETCLIMSRC_READ_SAS_TOKEN environment variable and instead rely on that task's ability to decode and
use a base64 encoded SAS token. The reason for the environment variable usage before was that the
non-encoded SAS token was getting mangled by msbuild/bash/etc. on non-Windows OSs.
- Update the source build tarball template with support for internal runtimes
Update to source build template
* Collect prebuilt packages
* WIP offline build
* Update ReplaceTextInFile(s) to honor line endings
* Build changes required to build with current Roslyn
* Look for 6.0 version of logger
* Add patch for SBRP to get eng/common updated.
* Update previously source-built version
* Add additional comments on patches
* Add comment on TemporaryBootstrap file
* Updates based on PR comments
* Update SBRP to get version with updated ilasm
Also, remove the prebuilts for packages that weren't being built
correctly.
* Add empty prebuilt directory
* Add some needed prebuilt packages to override temporarily bad ref packages.
* Remove bad ref packages.
* Also don't copy new versions of the bad SBRP packages after the SBRP build.
* Account for missing intermediate packages and different paths.
* Address code review comment.
* Add SBRP packages to prev source-built
* Update to new version of prev source-built
* Update SBRP reference
* Don't delete SBRP packages
* Update private source-built version
* Setup inner build prebuilt checks to use global package caches
* Update previously source-built version to include version built from tarball build
* Update NuGet.config and global.json for SBRP
* Copy restored packages from inner build
* Update src/SourceBuild/tarball/content/repos/source-build-reference-packages.proj
Co-authored-by: Michael Simons <msimons@microsoft.com>
Co-authored-by: Michael Simons <msimons@microsoft.com>
* Initial checkin of source-build tarball build infra
* Add a couple more comments
* Update eng/SourceBuild.Version.Details.xml based on PR review
Co-authored-by: Chris Rummel <crummel@microsoft.com>
* Updates based on PR review comments
Co-authored-by: Chris Rummel <crummel@microsoft.com>
