git-annex/doc/todo/test_suite_failures_since_7.20181121.mdwn

Since 7.20181121 Debian has been seeing test suite failures, on the mips autobuilders and on the amd64 CI infrastructure, but not on the amd64 autobuilders.

I attempted to reproduce the failure on a mips and could not; instead, four different tests failed in a different way.

The most recent failures on the CI infrastructure and the mips autobuilders looks to be the same set of tests that have failed.

- [mips autobuilder log](https://spwhitton.name/pub/git-annex-dec18/mipsbuildd.txt)

- [mips reproduction attempt log](https://spwhitton.name/pub/git-annex-dec18/mipsporterbox.txt)

- [CI log](https://spwhitton.name/pub/git-annex-dec18/debci.txt)

I am inclined to think that there are several bugs here: the test suite is overly sensitive to its environment and can fail in different ways in different environments.  What's mysterious is why all this started happening so recently.

It seems unlikely to me that anyone has time to fix these bugs before the upcoming Debian freeze.  Getting git-annex v7.x into buster is a priority.  Maybe the test suite should be disabled during the package build, since it's flaky?  I'd like to hear Joey's opinion on doing that.

--spwhitton

> The logs are no longer available, but I recently did a lot
> of pounding on the test suite to fix interrmittent failures,
> and the mention of `git annex copy --from` sounds like
> one of the failures I fixed. 
> [[!commit fa62c3223383d8377d27576a0e32f7bfec0c826d]]
> seems to have fixed the problem that made copying from v7 repos
> sometimes fail.
> 
> Closing on that basis; if you see a new test suite failure, please open a
> new bug. [[done]] --[[Joey]]