Commit graph

10441 commits

Author SHA1 Message Date
Joey Hess
e1a9b79fa6
fix hardcoded origin name in checkAdjustedClone
init: Fix a crash when the repo's was cloned from a repo that had an
adjusted branch checked out, and the origin remote is not named "origin".

The only other hardcoding of the name of origin is in:

- Upgrade.V2, which can be ignored probably
- Annex.Branch, which doesn't fail if it has some other name, but just
  doesn't set up the git-annex branch with quite as linear a history in
  that case.
2021-04-14 18:53:27 -04:00
kyle
4c3d8241ae crippledfilesystem override not needed 2021-04-14 21:26:32 +00:00
kyle
c489b471d5 bug: init crash with remote name other than "origin" 2021-04-14 20:44:23 +00:00
Joey Hess
8e7dc958d2
forget: Preserve currently exported trees
Avoiding problems with exporttree remotes in some unusual circumstances.

This commit was sponsored by Brett Eisenberg on Patreon.
2021-04-13 15:00:23 -04:00
Joey Hess
a58e955293
bug report 2021-04-13 13:31:51 -04:00
Joey Hess
805d325a8d
diffdriver: Support unlocked files 2021-04-08 14:32:09 -04:00
yarikoptic
e1ffa3e10a note on the order 2021-04-08 17:47:22 +00:00
yarikoptic
8f0a3799d0 initial report on diff driver behavior on unlocked files 2021-04-08 17:44:39 +00:00
https://launchpad.net/~r0lf
10c04ed3b1 Added a comment: still an issue in Ubuntu Focal 2021-04-05 01:28:49 +00:00
https://launchpad.net/~r0lf
507b0fa6ea removed 2021-04-05 01:22:24 +00:00
https://launchpad.net/~r0lf
ed30ba4397 Added a comment: still an issue in focal 2021-04-05 01:20:30 +00:00
Joey Hess
370e71aa73
improve man page wording 2021-04-01 12:58:06 -04:00
Joey Hess
8868a3a4c7
Fix build with persistent-2.12.0.1
persistent stopped using askLogFunc, and the thing to use is askLoggerIO
from monad-logger. Bumped the dep to the first version that contained that.

Note that the i386ancient build uses a newer monad-logger than 0.3.10,
so the new versioned dep should not break it, and presumably nothing else
either.

This commit was sponsored by Noam Kremen on Patreon.
2021-04-01 12:21:02 -04:00
nrg@bd619d1ebf16e6324c546adea8be8fe1cc2b4325
3b1088a865 2021-03-31 14:43:28 +00:00
Ilya_Shlyakhter
57cbad31dd Added a comment 2021-03-30 19:17:08 +00:00
Joey Hess
24c576bfa7
Merge branch 'master' of ssh://git-annex.branchable.com 2021-03-30 12:58:34 -04:00
Lukey
01c00717f8 Added a comment 2021-03-30 16:51:53 +00:00
Lukey
6efe5d2931 removed 2021-03-30 16:50:35 +00:00
Lukey
557d718ee3 Added a comment 2021-03-30 16:49:05 +00:00
Joey Hess
4459e04117
comment 2021-03-30 12:48:43 -04:00
Ilya_Shlyakhter
075e209ce2 added bug report re: git-annex-sync succeeding without fetching all files 2021-03-30 15:00:56 +00:00
Joey Hess
91b8121c8d
close 2021-03-29 13:08:22 -04:00
Joey Hess
4611813ef1
Fix bug importing from a special remote into a subdirectory more than one level deep
Which generated unusual git trees that could confuse git merge,
since they incorrectly had 2 subtrees with the same name.

Root of the bug was a) not testing that at all! but also
b) confusing graftdirs, which contains eg "foo/bar" with
non-recursively read trees, which would contain eg "bar"
when reading a subtree of "foo".

It's worth noting that Annex.Import uses graftTree, but it really
shouldn't have needed to. Eg, when importing into foo/bar from a remote,
it's enough to generate a tree of foo/bar/x, foo/bar/y, and does not
include other files that are at the top of the master branch. It uses
graftTree, so it does include the other files, as well as the foo/bar
tree. git merge will do the same thing for both trees. With that said,
switching it away from graftTree would result in another import
generating a new commit that seems to delete files that were there in a
previous commit, so it probably has to keep using graftTree since it
used it before.

This commit was sponsored by Kevin Mueller on Patreon.
2021-03-26 16:04:36 -04:00
Joey Hess
1a8f984634
initial analysis 2021-03-26 14:27:48 -04:00
Joey Hess
f085ae4937
borg: Support importing files that are hard linked in the borg backup
Note that a key with no size field that is hard linked will
result in listImportableContents reporting a file size of 0,
rather than the actual size of the file. One result is that
the progress meter when getting the file will seem to get stuck
at 100%. Another is that the remote's preferred content expression,
if it tries to match against file size, will treat it as an empty file.
I don't see a way to improve the latter behavior, and the former behavior
is a minor enough problem.

This commit was sponsored by Jake Vosloo on Patreon.
2021-03-26 13:29:34 -04:00
Joey Hess
31eb5fddf3
borg: Fix a bug that prevented importing keys of type URL and WORM
Keys stored on the filesystem are mangled by keyFile to avoid problem
chars. So, that mangling has to be reversed when parsing files from a
borg backup back to a key.

The directory special remote also so mangles them. Some other special
remotes do not; eg S3 just serializes the key -- but S3 object names are
not limited to filesystem valid filenames anyway, so a S3 server must
not map them directly to files in any case. It seems unlikely that a
borg backup of some such special remote will get broken by this change.

This commit was sponsored by Graham Spencer on Patreon.
2021-03-26 12:07:00 -04:00
Joey Hess
537f9d9a11
Improved display of errors when accessing a git http remote fails.
New error message:

  Remote foo not usable by git-annex; setting annex-ignore

  http://localhost/foo/config download failed: Configuration of annex.security.allowed-ip-addresses does not allow accessing address ::1

If git config parse fails, or the git config file is not available at the url,
a better error message for that is also shown.

This commit was sponsored by Mark Reidenbach on Patreon.
2021-03-24 14:19:32 -04:00
git-annex@6f13b739194f758abc0b86556b7ce966c1bf3c00
14b846e9fa Added a comment: borg hardlinks 2021-03-24 10:29:16 +00:00
git-annex@6f13b739194f758abc0b86556b7ce966c1bf3c00
d4a3465f8b Added a comment: / vs. % in key 2021-03-24 10:07:30 +00:00
git-annex@6f13b739194f758abc0b86556b7ce966c1bf3c00
cc9d6889e2 2021-03-24 09:44:49 +00:00
Joey Hess
e09560eea2
open a bug based on comment thread 2021-03-23 11:50:07 -04:00
Joey Hess
637229c593
fix fsck --from --all to not fall over trying to check required content
fsck: When --from is used in combination with --all or similar options, do
not verify required content, which can't be checked properly when operating
on keys.

This commit was sponsored by Boyd Stephen Smith Jr. on Patreon.
2021-03-22 15:08:07 -04:00
Joey Hess
5545e78a1e
Make --debug also enable debugging in child git-annex processes
Especially necessary with stalldetection using child processes for
transfers.

This commit was sponsored by Jack Hill on Patreon.
2021-03-22 14:25:28 -04:00
Joey Hess
1ddaa6b541
comment 2021-03-22 13:52:11 -04:00
Lukey
25cf5e39df Added a comment 2021-03-22 17:19:37 +00:00
Joey Hess
5d75cbcdcf
webdav: deal with buggy webdav servers in renameExport
box.com already had a special case, since its renaming was known buggy.
In its case, renaming to the temp file succeeds, but then renaming the temp
file to final destination fails.

Then this 4shared server has buggy handling of renames across directories.
While already worked around with for the temp files when storing exports
now being in the same directory as the final filename, that also affected
renameExport when the file moves between directories.

I'm not entirely clear what happens on the 4shared server when it fails
this way. It kind of looks like it may rename the file to destination and
then still fail.

To handle both, when rename fails, delete both the source and the
destination, and fall back to uploading the content again. In the box.com
case, the temp file is the source, and deleting it makes sure the temp file
gets cleaned up. In the 4shared case, the file may have been renamed to the
destination and so cleaning that up avoids any interference with the
re-upload to the destination.
2021-03-22 13:08:18 -04:00
Joey Hess
f175d4cc90
rmurl: remove all forms of an url, no matter what the downloader is set to
* rmurl: When youtube-dl was used for an url, it no longer needs to be
  prefixed with "yt:" in order to be removed.
* rmurl: If an url is both used by the web and also claimed by another
  special remote, fix a bug that caused the url to to not be removed.

The youtube-dl change is a consequence of how the bug fix is implemented.
But I also think it's the right thing to do. Consider that, before,
git-annex addurl $url followed by git-annex rmurl $url would not remove the
url in the case where youtube-dl was used. That was surprising behavior.

In the unlikely case where a special remote claims an url, and it's been
added using OtherDownloader, but it was also added already as a web url,
it seems better for rmurl to remove both than to arbitrarily remove only one.

And in the case the bug report was filed for, when an url was added as a
web url, but a special remote now claims it, that should not prevent rmurl
removing the web url.

Calling setUrlMissing lets other callers of it behave differently.
Probably the calls to it in eg, Remote.External and Remote.BitTorrent are
fine, since they don't mangle the url and just remove what was provided,
and the OtherDownloader form of a bittorrent url, respectively.
I suspect unregisterurl needs to have a similar change made to rmurl, for
similar reasons.
2021-03-22 12:09:15 -04:00
Joey Hess
77d3d4350d
forgot to close this 2021-03-22 11:31:00 -04:00
Joey Hess
ee49bdd410
comment 2021-03-22 10:20:58 -04:00
Joey Hess
5dedaa3efa
close 2021-03-22 10:17:41 -04:00
gerta
4176634d8d Added a comment 2021-03-21 11:56:27 +00:00
Lukey
5a8b9a57a8 Added a comment 2021-03-20 18:28:51 +00:00
Lukey
2021c31be7 Added a comment 2021-03-20 17:33:32 +00:00
gerta
f695a8e128 Bug: Importing into nested directory overwrites files? 2021-03-20 07:29:12 +00:00
Ilya_Shlyakhter
a76f16cd8d added bug report about fsck failing on dead keys missing from require-everything repos 2021-03-18 18:58:27 +00:00
jwrauch
81c51fa538 2021-03-17 18:59:04 +00:00
mih
1886fa420f Added a comment 2021-03-17 17:03:35 +00:00
Joey Hess
b0bf620b2b
comment 2021-03-17 11:29:57 -04:00
yarikoptic
3ae0552b64 Added a comment 2021-03-17 14:56:20 +00:00
Joey Hess
f9e73e23f2
comment 2021-03-17 10:22:38 -04:00