Commit graph

39368 commits

Author SHA1 Message Date
Joey Hess
41d9148c72
fix attoparsec lower bound
needed for parseOnly
2021-03-24 11:54:16 -04:00
Joey Hess
f19271c5d9
comment 2021-03-23 15:51:21 -04:00
Joey Hess
806b6f77b9
Merge branch 'master' of ssh://git-annex.branchable.com 2021-03-23 15:47:21 -04:00
Joey Hess
1e3b228154
speed up init
This was making it git checkout master when that branch was already
checked out, for apparently no good reason at all. In a 100,000 file
repo, that takes about 1 second.

Note, I'm not sure why it checks out the branch in the Nothing case, so
I left that alone.
2021-03-23 15:43:42 -04:00
Ilya_Shlyakhter
3925235805 Added a comment: annex.supportunlocked 2021-03-23 19:30:44 +00:00
Joey Hess
5d78cd9d08
Sped up git-annex init in a clone of an existing repository
Seems that hasOrigin was never finding origin's git-annex branch, so a new
one got created each time. And so then it later needed to merge the two
branches, which is expensive.

Added --no-track to git branch to avoid it displaying a message about
setting up tracking branches. Of course there's no reason to make the
git-annex branch a tracking branch since git-annex auto-merges it.
2021-03-23 15:23:13 -04:00
yarikoptic
ed5fd5b896 Added a comment 2021-03-23 18:43:32 +00:00
Joey Hess
798f685077
New annex.supportunlocked config
Can beet to false to avoid some expensive things needed to support unlocked
files.

See my comment for why this only controls what init sets up, and not other
behavior.

I didn't bother with making the v5 upgrade code path look at this, though
it easily could, because the docs say to run git-annex init after setting
it to make it take effect.
2021-03-23 14:04:34 -04:00
Joey Hess
af96b49145
comment 2021-03-23 13:53:32 -04:00
Joey Hess
a8b837aaef
add git ls-tree --long parser
Not yet used, but allows getting the size of items in the tree fairly
cheaply.

I noticed that CmdLine.Seek uses ls-tree and the feeds the files into
another long-running process to check their size. That would be an
example of a place that might be sped up by using this. Although in that
particular case, it only needs to know the size of unlocked files, not
locked. And since enabling --long probably doubles the ls-tree runtime
or more, the overhead of using it there may outwweigh the benefit.
2021-03-23 12:47:00 -04:00
Joey Hess
d89a9b0f78
comments 2021-03-23 12:05:05 -04:00
Joey Hess
e09560eea2
open a bug based on comment thread 2021-03-23 11:50:07 -04:00
Joey Hess
0af8df6714
Merge remote-tracking branch 'origin/master' 2021-03-23 11:49:43 -04:00
Lukey
2ac2cc79c2 Added a comment 2021-03-23 07:19:40 +00:00
Joey Hess
c68ba7d893
whereis: Don't include yt: prefix when showing url to content retrieved with youtube-dl
I don't think this was really intentional behavior. It may be that it was
useful to include it so it could be passed to rmurl, since without it rmurl
would not actually remove the url. Since that was changed earlier today,
now seems like a good time to clean up the display of these urls.

This commit was sponsored by Jochen Bartl on Patreon.
2021-03-22 19:56:24 -04:00
tomdhunt
a50071b60f Added a comment 2021-03-22 23:35:32 +00:00
Ilya_Shlyakhter
3b748d522b clarified git-annex-unlock docs re: git add 2021-03-22 19:58:43 +00:00
Ilya_Shlyakhter
420e402779 Added a comment: replacing a locked file with new content 2021-03-22 19:50:27 +00:00
Joey Hess
29f9cf188d
comment 2021-03-22 15:20:28 -04:00
Joey Hess
3a125a8a9a
Merge branch 'master' of ssh://git-annex.branchable.com 2021-03-22 15:09:22 -04:00
Joey Hess
637229c593
fix fsck --from --all to not fall over trying to check required content
fsck: When --from is used in combination with --all or similar options, do
not verify required content, which can't be checked properly when operating
on keys.

This commit was sponsored by Boyd Stephen Smith Jr. on Patreon.
2021-03-22 15:08:07 -04:00
kyle
e15a185107 Added a comment: Re: push doc-only changes 2021-03-22 18:58:36 +00:00
Joey Hess
b8df74c016
comment 2021-03-22 14:44:24 -04:00
Joey Hess
da989596cd
git-annex is in openbsd ports 2021-03-22 14:37:06 -04:00
Joey Hess
e8ee1a4506
reorder
it seems to make sense to have linux and osx first since a lot of users
use those, and windows at the end because well, it's windows. but it
seemed odd to start with osx, so moved linux up.

alphabetical would maybe be better, but then android comes first, which
just feels weird since it's such a niche port. also the linux distro
sublist has a good reason not to be alphabetical, eg docker and conda
are on there as kind of last resorts
2021-03-22 14:30:23 -04:00
Joey Hess
9b8d6a86e8
freebsd is not a linux distribution 2021-03-22 14:28:03 -04:00
Joey Hess
5545e78a1e
Make --debug also enable debugging in child git-annex processes
Especially necessary with stalldetection using child processes for
transfers.

This commit was sponsored by Jack Hill on Patreon.
2021-03-22 14:25:28 -04:00
Joey Hess
1ddaa6b541
comment 2021-03-22 13:52:11 -04:00
Joey Hess
2af5bc8fa2
Merge branch 'master' of ssh://git-annex.branchable.com 2021-03-22 13:50:58 -04:00
Joey Hess
3a3832fcb4
remove link to old windows 7 build
that autobuilder is no longer available
2021-03-22 13:48:46 -04:00
Joey Hess
79b3e0dca9
comment 2021-03-22 13:43:58 -04:00
Lukey
25cf5e39df Added a comment 2021-03-22 17:19:37 +00:00
Joey Hess
5d75cbcdcf
webdav: deal with buggy webdav servers in renameExport
box.com already had a special case, since its renaming was known buggy.
In its case, renaming to the temp file succeeds, but then renaming the temp
file to final destination fails.

Then this 4shared server has buggy handling of renames across directories.
While already worked around with for the temp files when storing exports
now being in the same directory as the final filename, that also affected
renameExport when the file moves between directories.

I'm not entirely clear what happens on the 4shared server when it fails
this way. It kind of looks like it may rename the file to destination and
then still fail.

To handle both, when rename fails, delete both the source and the
destination, and fall back to uploading the content again. In the box.com
case, the temp file is the source, and deleting it makes sure the temp file
gets cleaned up. In the 4shared case, the file may have been renamed to the
destination and so cleaning that up avoids any interference with the
re-upload to the destination.
2021-03-22 13:08:18 -04:00
Joey Hess
0af9d1dcb6
unregisterurl: remove all forms of an url, no matter what the downloader is set to
unregisterurl: Fix a bug that caused an url to not be unregistered when it
is claimed by a special remote other than the web.

See commit f175d4cc90 for rationalle.
2021-03-22 12:17:17 -04:00
Joey Hess
c984d248d2
clarify 2021-03-22 12:15:54 -04:00
Joey Hess
f175d4cc90
rmurl: remove all forms of an url, no matter what the downloader is set to
* rmurl: When youtube-dl was used for an url, it no longer needs to be
  prefixed with "yt:" in order to be removed.
* rmurl: If an url is both used by the web and also claimed by another
  special remote, fix a bug that caused the url to to not be removed.

The youtube-dl change is a consequence of how the bug fix is implemented.
But I also think it's the right thing to do. Consider that, before,
git-annex addurl $url followed by git-annex rmurl $url would not remove the
url in the case where youtube-dl was used. That was surprising behavior.

In the unlikely case where a special remote claims an url, and it's been
added using OtherDownloader, but it was also added already as a web url,
it seems better for rmurl to remove both than to arbitrarily remove only one.

And in the case the bug report was filed for, when an url was added as a
web url, but a special remote now claims it, that should not prevent rmurl
removing the web url.

Calling setUrlMissing lets other callers of it behave differently.
Probably the calls to it in eg, Remote.External and Remote.BitTorrent are
fine, since they don't mangle the url and just remove what was provided,
and the OtherDownloader form of a bittorrent url, respectively.
I suspect unregisterurl needs to have a similar change made to rmurl, for
similar reasons.
2021-03-22 12:09:15 -04:00
Joey Hess
9856e10d3c
call out behavior change 2021-03-22 11:34:23 -04:00
Joey Hess
77d3d4350d
forgot to close this 2021-03-22 11:31:00 -04:00
Joey Hess
f15d083e75
Merge branch 'master' of ssh://git-annex.branchable.com 2021-03-22 10:59:57 -04:00
Joey Hess
34374a679d
comment 2021-03-22 10:58:12 -04:00
Joey Hess
a39a6096ec
comment 2021-03-22 10:37:33 -04:00
Joey Hess
f6833312a9
comment 2021-03-22 10:24:57 -04:00
Joey Hess
ee49bdd410
comment 2021-03-22 10:20:58 -04:00
Joey Hess
5dedaa3efa
close 2021-03-22 10:17:41 -04:00
Ilya_Shlyakhter
14fafeea8a Added a comment: another deduplication option 2021-03-22 13:51:35 +00:00
Ilya_Shlyakhter
99f090db0b Added a comment: keeping state re: unlocked files? 2021-03-21 18:29:17 +00:00
tomdhunt
9f932e0b4c Added a comment 2021-03-21 17:10:43 +00:00
gerta
4176634d8d Added a comment 2021-03-21 11:56:27 +00:00
Lukey
a66fafba1f Added a comment 2021-03-21 08:11:01 +00:00
tomdhunt
c6a08dc3c2 Added a comment 2021-03-21 01:11:28 +00:00