mirrors/git-annex
2
0
Fork 0
Code Issues Pull requests Projects Releases Packages 1 Wiki Activity Actions
37008 commits 13 branches 445 tags 110 MiB
Commit graph

27784 commits

Author SHA1 Message Date
Joey Hess
87bab2d7c2
close 2020-04-21 11:29:51 -04:00
Joey Hess
cee6b344b4
cat-file resource pool 
Avoid running a large number of git cat-file child processes when run with
a large -J value.

This implementation takes care to avoid adding any overhead to git-annex
when run without -J. When run with -J, there is a small bit of added
overhead, to manipulate the resource pool. That optimisation added a
fair bit of complexity.
 2020-04-20 15:19:31 -04:00
Joey Hess
87b7b0f202
comment 2020-04-20 12:06:14 -04:00
Joey Hess
5446379cd9
Merge branch 'master' of ssh://git-annex.branchable.com 2020-04-20 10:03:38 -04:00
thk
ffeef75917 2020-04-19 08:15:47 +00:00
Joey Hess
1b2dd74d8d
bug 2020-04-18 23:57:48 -04:00
yarikoptic
6c9c974e55 Added a comment 2020-04-18 02:14:32 +00:00
yarikoptic
67f0407477 Added a comment 2020-04-18 02:05:52 +00:00
Joey Hess
b480ce01f7
Merge branch 'master' of ssh://git-annex.branchable.com 2020-04-17 17:47:59 -04:00
Joey Hess
2da760fcae
comment 2020-04-17 17:32:49 -04:00
yarikoptic
a2b2708ab6 Added a comment: quick follow up 2020-04-17 20:34:55 +00:00
Joey Hess
988317634b
comment 2020-04-17 14:11:17 -04:00
Joey Hess
6c39ec9b27
comment 2020-04-17 12:37:28 -04:00
Dan
b325dfea4d Added a comment: find wanted on remote? 2020-04-16 21:19:44 +00:00
yarikoptic
5dc513ccdb Added a comment 2020-04-16 03:43:13 +00:00
yarikoptic
1705d3657e Added a comment: it is many more "open files" in reality 2020-04-16 03:41:07 +00:00
Joey Hess
957a87b437
fix absolute filenames fed into --batch and git-annex info 2020-04-15 16:04:05 -04:00
Joey Hess
a14168a321
reproduced 2020-04-15 15:06:53 -04:00
Joey Hess
503abb6d54
remove warning about git gc for annex.alwayscommit=false 
I doubt that warning has ever been right, but I'm sure it is not right
now.

For there to be a risk of git gc deleting objects that are in the annex
index, journal files would have to be staged into it, and deleted, but
the index not committed to the git-annex branch. And AFAICS, there is no
code path where that actually happens. I considered adding one recently,
but didn't.

The way it actually works is, as long as the user has annex.alwayscommit=false
the data lives in the journal, where it's safe from git gc. Then when
git-annex is run w/o that config, the journal is staged into the index,
which is immediately committed to the branch. There's no window where
git gc could delete the objects, because git gc only deletes objects
after some time (2 weeks by default).

Now, if git-annex gets suspended at just the wrong time, or interrupted,
then yes, it's possible. But doesn't matter whether that config was ever
set or not. And many uses of git-annex also recover from that situation
by committing to the git-annex branch.
 2020-04-15 14:25:33 -04:00
Joey Hess
ddadc0c1aa
Merge branch 'master' of ssh://git-annex.branchable.com 2020-04-15 14:20:06 -04:00
Joey Hess
891e9a81eb
close bug that was apparently fixed satisfactorally 2020-04-15 14:17:21 -04:00
Joey Hess
a2fed82267
close 2020-04-15 14:15:41 -04:00
Joey Hess
7ef030b576
close old bug since git-annex no longer uses rsync like it used to 2020-04-15 14:08:48 -04:00
kyle
1a040e0c0a Added a comment 2020-04-15 18:02:29 +00:00
Joey Hess
43a9808292
disable journal read optimisation when alwayscommit=false 
The journal read optimisation in aeca7c220 later got fixed in eedd73b84
to stage and commit any files that were left in the journal by a
previous git-annex run. That's necessary for the optimisation to work
correctly. But it also meant that alwayscommit=false started committing
the previous git-annex processes journalled changes, which defeated the
purpose of the config setting entirely.

So, disable the optimisation when alwayscommit=false, leaving the
files in the journal and not committing them. See my comments on the bug
report for why this seemed the best approach.

Also fixes a problem when annex.merge-annex-branches=false and there
are changes in the journal. That config indirectly prevents committing
the journal. (Which seems a bit odd given its name, but it always has..)
So, when there were changes in the journal, perhaps left there due to
alwayscommit=false being set before, the optimisation would prevent
git-annex from reading the journal files, and it would operate with out
of date information.
 2020-04-15 13:24:33 -04:00
Joey Hess
9f17242f29
comment 2020-04-15 12:48:55 -04:00
Joey Hess
8ac44498d6
comment 2020-04-15 12:43:22 -04:00
Joey Hess
1aa7082c9a
better response 2020-04-15 12:17:57 -04:00
Joey Hess
b241f579c0
hm 2020-04-15 12:14:39 -04:00
Joey Hess
f4d5ec1457
correction 2020-04-15 12:12:11 -04:00
Joey Hess
520ddf1c75
comment 2020-04-15 12:10:51 -04:00
Christoph.Schmidpeter@d3e5d124c7d5459315c2a9f983ab9a70b88e1d03
95b505c22f 2020-04-15 13:06:14 +00:00
Christoph.Schmidpeter@d3e5d124c7d5459315c2a9f983ab9a70b88e1d03
98c1047a29 removed 2020-04-15 13:00:12 +00:00
Christoph.Schmidpeter@d3e5d124c7d5459315c2a9f983ab9a70b88e1d03
c510e83001 Added a comment: Problems with Assistant and Android 2020-04-15 12:59:44 +00:00
Christoph.Schmidpeter@d3e5d124c7d5459315c2a9f983ab9a70b88e1d03
98fac2be0e 2020-04-15 12:59:04 +00:00
Christoph.Schmidpeter@d3e5d124c7d5459315c2a9f983ab9a70b88e1d03
61ba4d6387 2020-04-15 12:09:08 +00:00
kyle
b11931a4aa bug: alwayscommit=false creating commits 2020-04-14 22:43:34 +00:00
erewhon
92c1d0863b Added a comment 2020-04-14 21:45:35 +00:00
erewhon
5d1495ee0f removed 2020-04-14 21:30:38 +00:00
erewhon
40a3545149 Added a comment 2020-04-14 21:20:51 +00:00
erewhon
a9f7770cde removed 2020-04-14 21:19:46 +00:00
erewhon
6add91fefd Added a comment 2020-04-14 21:18:23 +00:00
Joey Hess
ba6f46c113
--auto doc wording 
try to make more clear that --auto is not --all
 2020-04-13 16:12:48 -04:00
kyle
b60f29f17b Added a comment 2020-04-13 18:58:50 +00:00
Joey Hess
c22c07bbed
Merge branch 'master' of ssh://git-annex.branchable.com 2020-04-13 14:32:46 -04:00
Joey Hess
e57aebf6ad
comment 2020-04-13 14:07:23 -04:00
Joey Hess
fbd78cff64
improve documentation 2020-04-13 12:33:35 -04:00
bjornw@6a7d7d0413efc7ed3bb44922586f040bb768b71c
e96d3b5776 2020-04-13 16:30:33 +00:00
4omecha@fff0ca6fa5307d92706e5ee6812d8db8f8067df0
25ac0ef160 Best way to restore objects with correct names w/o git log present? 2020-04-13 09:19:23 +00:00
4omecha@fff0ca6fa5307d92706e5ee6812d8db8f8067df0
16f2ccfc7c bad edit 
This reverts commit ce664ebc7b
 2020-04-13 09:16:39 +00:00
4omecha@fff0ca6fa5307d92706e5ee6812d8db8f8067df0
ce664ebc7b Best way to restore objects with correct names w/o git log present? 2020-04-13 09:13:51 +00:00
Ilya_Shlyakhter
995d327784 Added a comment 2020-04-13 00:53:59 +00:00
erewhon
4714d2cc5e 2020-04-12 19:28:38 +00:00
erewhon
f6e0345b07 2020-04-12 19:10:35 +00:00
Joey Hess
df587ff068
Merge branch 'master' of ssh://git-annex.branchable.com 2020-04-10 14:46:59 -04:00
Joey Hess
2caf579718
cache annex index filename for 1.5% speedup to queries 2020-04-10 13:37:04 -04:00
christoph@62dc589e980f444024ff1a9808022914e056f386
893239ed8f rename bugs/fsck_lies_about_checksum__63__.mdwn to bugs/fsck_tells___39__ok__39___also_if_no_file_present.mdwn 2020-04-10 12:06:52 +00:00
christoph@62dc589e980f444024ff1a9808022914e056f386
5c8deb61e1 2020-04-10 12:04:29 +00:00
christoph@62dc589e980f444024ff1a9808022914e056f386
fec5b99901 2020-04-10 12:02:35 +00:00
Joey Hess
5e4423c058
new optimisation target 2020-04-09 14:13:00 -04:00
Joey Hess
aeca7c2207
Sped up query commands that read the git-annex branch by around 5% 
The only price paid is one additional MVar read per write to the journal.
Presumably writing a journal file dominiates over a MVar read time by
several orders of magnitude.

--batch does not get the speedup because then it needs to notice when
another process has made a change. Also made the assistant and other damon
modes bypass the optimisation, which would not help them anyway.
 2020-04-09 13:54:43 -04:00
Joey Hess
aba905152a
Merge branch 'master' of ssh://git-annex.branchable.com 2020-04-08 14:12:20 -04:00
Joey Hess
89c3b20695
Merge branch 'bytestring-ref' 2020-04-08 14:10:24 -04:00
Chymera
02672e4734 2020-04-08 05:18:15 +00:00
yarikoptic
0209a8f55a Added a comment 2020-04-08 01:08:10 +00:00
Joey Hess
c0cd07c36b
Ref ByteString conversion done 
Test suite passes.
 2020-04-07 17:41:09 -04:00
Joey Hess
8b75da0521
comment 2020-04-07 14:49:08 -04:00
yarikoptic
5d076ee847 Added a comment 2020-04-07 18:25:46 +00:00
Joey Hess
0b91c0e314
comment 2020-04-07 13:46:10 -04:00
kyle
c8829eedc0 Added a comment 2020-04-07 15:30:55 +00:00
yarikoptic
b7f9f3fdf5 initial remote 2020-04-06 21:35:32 +00:00
kyle
909fcbaae5 bug: wanted=anything and deleted files 2020-04-06 16:51:44 +00:00
Joey Hess
6e9714612b
update 2020-04-05 18:35:34 -04:00
javkalas@30f67400375ff022347b37236b63786ecf79cd82
e9d138e717 Added a comment 2020-04-03 19:09:52 +00:00
Joey Hess
23c1809aab
respond to confused user and close non-bug 2020-04-01 20:40:43 -04:00
mike@920d668f9cacd7a1a8886c180a95a0150e2ab283
3388f53391 2020-04-02 00:36:08 +00:00
mike@920d668f9cacd7a1a8886c180a95a0150e2ab283
6d85c0932b 2020-04-02 00:33:24 +00:00
mike@920d668f9cacd7a1a8886c180a95a0150e2ab283
318f157d16 2020-04-02 00:31:01 +00:00
mike@920d668f9cacd7a1a8886c180a95a0150e2ab283
ae3d84e0b2 2020-04-02 00:30:13 +00:00
mike@920d668f9cacd7a1a8886c180a95a0150e2ab283
a92892bb87 2020-04-02 00:22:34 +00:00
mike@920d668f9cacd7a1a8886c180a95a0150e2ab283
df8c5b942b removed 2020-04-02 00:06:54 +00:00
mike@920d668f9cacd7a1a8886c180a95a0150e2ab283
76693bceda removed 2020-04-02 00:06:22 +00:00
mike@920d668f9cacd7a1a8886c180a95a0150e2ab283
78b6264a0a Added a comment 2020-04-01 23:37:55 +00:00
Joey Hess
8f297cb64f
remove old dead link 2020-04-01 15:44:15 -04:00
Joey Hess
acb356d75d
reorg more 2020-04-01 15:42:59 -04:00
Joey Hess
7d196c3e0d
move to right place and remove debian and hackage matrix embeds which have stopped working 2020-04-01 15:40:44 -04:00
Joey Hess
43d3948e52
added the datalad standalone build CI status badge 2020-04-01 15:38:40 -04:00
xloem
ad483f5e23 2020-03-31 23:40:12 +00:00
thk
f4890ae642 2020-03-31 06:43:39 +00:00
thk
5df80188be Added a comment: Also problem with USB drives 2020-03-31 06:36:14 +00:00
yarikoptic
a180418843 Added a comment 2020-03-31 01:22:54 +00:00
https://openid.jorsn.eu/
8f1a988b43 Added a comment: automatic repository upgrades 2020-03-30 23:24:51 +00:00
https://openid.jorsn.eu/
5341fbc270 removed error 2020-03-30 22:41:59 +00:00
https://openid.jorsn.eu/
8eb4a82569 2020-03-30 22:41:17 +00:00
vinicius.vin@6d4d58c59c394cd744d469c9d7c41e264331dfcd
3f02d0f8ac Added a comment 2020-03-30 21:02:52 +00:00
Joey Hess
9717915635
add news item for git-annex 8.20200330 2020-03-30 13:47:14 -04:00
Joey Hess
9cc1917295
close 2020-03-30 12:35:41 -04:00
yarikoptic
dd898afb40 Added a comment: Let's just close 2020-03-30 16:32:24 +00:00
Joey Hess
0f6251ac6a
followup 2020-03-30 12:03:38 -04:00
Joey Hess
1aabcd1038
moreinfo 2020-03-30 11:51:03 -04:00
Joey Hess
e6adfa1dc1
close per comments 2020-03-30 11:48:44 -04:00
Ilya_Shlyakhter
f7311ffc9d Added a comment: clarification re: upgrades 2020-03-30 15:24:01 +00:00
andrew
c29943f400 Added a comment: spotlight and macOS 2020-03-29 15:27:40 +00:00
erewhon
eec916a733 2020-03-28 17:52:28 +00:00
erewhon
89a056aed6 2020-03-28 16:47:27 +00:00
Soxofaan
ffafed4d82 Fix typo remotes.log -> remote.log 2020-03-28 13:36:45 +00:00
Soxofaan
63e75b71f8 removed duplicate "encryption=none" in initremote command 2020-03-28 10:41:53 +00:00
vinicius.vin@6d4d58c59c394cd744d469c9d7c41e264331dfcd
86bdda710f Added a comment 2020-03-27 23:04:34 +00:00
Ilya_Shlyakhter
fe8fa1a1e0 Added a comment 2020-03-27 21:12:18 +00:00
Ilya_Shlyakhter
2fd97e780b Added a comment 2020-03-27 21:11:14 +00:00
kyle
fd8a9a54e2 Added a comment: comment: resolved by 7.20191024 2020-03-27 20:49:44 +00:00
Ilya_Shlyakhter
de466ed0ad Added a comment: git add behavior 2020-03-27 20:49:19 +00:00
vinicius.vin@6d4d58c59c394cd744d469c9d7c41e264331dfcd
4cf46f56e2 2020-03-27 20:23:15 +00:00
vinicius.vin@6d4d58c59c394cd744d469c9d7c41e264331dfcd
0784136c3c 2020-03-27 20:19:10 +00:00
j@833cff95824930f20b36c340f1217182b6937407
d2621209a9 2020-03-27 12:30:44 +00:00
kyle
dfee97cd56 Added a comment 2020-03-26 23:32:56 +00:00
lykos@d125a37d89b1cfac20829f12911656c40cb70018
d27a94eec0 Added a comment 2020-03-26 20:36:28 +00:00
Joey Hess
c9ac7aa338
patch applied 2020-03-26 15:18:47 -04:00
Joey Hess
78977ce417
correct inaccurate part of comment 2020-03-26 15:08:12 -04:00
Joey Hess
42d73a3e62
comment 2020-03-26 14:48:54 -04:00
Joey Hess
173465592f
changelog for Kyle's other fix, and close bug 2020-03-26 13:18:41 -04:00
Joey Hess
b426ff6825
minimize lenth of path to gpg agent socket 
Considered using the system tmp dir rather than putting it inside .t/,
but then if TEMP were set to a long path, that would be a problem.
Relative path seems the best approach, and will always be nice and
short.

The only downside of it is, if git-annex somehow changes the cwd
while running, it would break. But git-annex does not do that, and
should never do that.
 2020-03-26 13:04:24 -04:00
Joey Hess
40c911e427
analysis 2020-03-26 12:41:38 -04:00
cbaines
9292d6036c Added a comment 2020-03-25 22:40:12 +00:00
Joey Hess
c9dd1de13d
devblog 2020-03-25 13:26:25 -04:00
Joey Hess
c827ddcdb6
typo 2020-03-25 13:20:24 -04:00
Joey Hess
a0d274fed6
Merge branch 'master' of ssh://git-annex.branchable.com 2020-03-25 13:05:47 -04:00
Joey Hess
357f783edf
add priority tags 2020-03-25 13:05:09 -04:00
spwhitton
79ba17946f Added a comment 2020-03-25 16:31:13 +00:00
yarikoptic
0397011792 initial report on failing gpg related tests inside singularity container 2020-03-25 00:01:36 +00:00
kyle
a51a94f616 bug: add --force-small submodule 2020-03-23 20:43:01 +00:00
ps
d23c0b0dd0 Added a comment: Solved 2020-03-23 19:07:54 +00:00
ps
c9e4a3a878 2020-03-23 16:51:48 +00:00
ps
6aa8ef340a 2020-03-23 16:48:57 +00:00
ps
01ad6eb9c3 2020-03-23 16:44:31 +00:00
kyle
4944b1bd13 Added a comment 2020-03-20 17:34:03 +00:00
Joey Hess
bbe977a2b6
fsck: Fix reversion in 8.20200226 that made it incorrectly warn that hashed keys with an extension should be upgraded. 2020-03-20 13:09:16 -04:00
Joey Hess
6222277179
Merge branch 'master' of ssh://git-annex.branchable.com 2020-03-20 12:51:39 -04:00
Joey Hess
4b92bbe8d7
webdav: Made exporttree remotes faster by caching connection to the server 
Followed example of Remote.S3.
 2020-03-20 12:48:43 -04:00
kyle
903b8348c9 Added a comment: comment: introduced by 09df58c4e 2020-03-20 16:20:05 +00:00
Joey Hess
24255b3c96
confirmed, and open todo for something mentioned in this bug 2020-03-20 12:00:07 -04:00
mdemunck@6c26b2316205b7bc1125c6cbd3bc63bdb9e1cfad
42dcf48fbb 2020-03-20 09:08:08 +00:00
thk
677e5f6e12 Added a comment: sponsoring? 2020-03-19 08:40:32 +00:00
kyle
83a5467e93 sync adjusted submodule commit 2020-03-18 02:18:03 +00:00
thk
6eacb3e170 2020-03-17 20:45:59 +00:00
kyle
e19d2d75c5 Added a comment 2020-03-17 02:38:16 +00:00
kyle
ed4d4e5d6f Added a comment 2020-03-17 02:35:49 +00:00
lasitus
abb027a269 Added a comment 2020-03-17 02:15:13 +00:00
lasitus
fee3203723 Added a comment 2020-03-16 22:29:31 +00:00
thk
fb60296885 2020-03-16 20:47:16 +00:00