Commit graph

26361 commits

Author SHA1 Message Date
Joey Hess
4fbce10df1
typo 2019-09-13 12:58:58 -04:00
Joey Hess
542ed05a05
fix omission 2019-09-13 12:57:31 -04:00
Joey Hess
49f4a13c03
add news item for git-annex 7.20190912 2019-09-13 12:54:10 -04:00
Joey Hess
7ca8941b3f
comment 2019-09-13 12:52:46 -04:00
Joey Hess
01b9f33c86
mention annex.autoupgraderepository 2019-09-13 12:26:26 -04:00
Joey Hess
a8fea1644d
docs for git-annex-standalone rpm 2019-09-13 12:18:36 -04:00
oliv5
05bc379104 2019-09-12 21:15:05 +00:00
Joey Hess
42bdaaa5d7
improve docs for v7 unlock 2019-09-12 13:58:12 -04:00
Joey Hess
eae5e96473
Merge branch 'v7-default' 2019-09-12 13:47:55 -04:00
Joey Hess
5ba16c06ed
re-investigated sqlite encoding issues
It's really persistent causing the problem, and BLOB really seems the
only way around it.
2019-09-12 13:06:39 -04:00
Joey Hess
23ca1bcd99
close 2019-09-12 11:52:22 -04:00
Joey Hess
f41c5fa4ae
comment 2019-09-11 15:50:57 -04:00
Joey Hess
99b509572d
post-receive hook updateInstead emulation cleanup
The code is only needed because for a long time, git-annex didn't
install hooks in repos on crippled filesystems. Now it does, and they
work at least on FAT (where all files are executable) and Windows.

It would be possible to remove this code in v8 simply by re-installing
the hooks.
2019-09-11 14:41:51 -04:00
yarikoptic
c93021ac44 Added a comment 2019-09-11 18:03:12 +00:00
Joey Hess
9317c4a5b3
close all old direct mode issues
except for one issue that was not really specific to direct mode after
all
2019-09-11 13:44:17 -04:00
Joey Hess
753db08973
fixed in process library 2019-09-11 13:10:31 -04:00
Ilya_Shlyakhter
664897e3bf reinit repo with new uuid 2019-09-10 21:14:55 +00:00
Joey Hess
061231621e
Merge branch 'master' into v7-default 2019-09-10 16:06:43 -04:00
Joey Hess
70f02df599
link to datalad issue that has some data collected 2019-09-10 14:50:58 -04:00
Joey Hess
d72a8ce8b4
better followup 2019-09-10 14:43:46 -04:00
Joey Hess
154cc1630c
comment 2019-09-10 14:35:13 -04:00
Joey Hess
890d8eb279
response 2019-09-10 14:28:16 -04:00
Joey Hess
d0077cc62b
Merge branch 'master' of ssh://git-annex.branchable.com 2019-09-10 13:37:25 -04:00
Joey Hess
94c75d2bd9
init: Fix a reversion that broke initialization on systems that need to use pid locking
This brings back .git/annex/misctmp, but only for init. If an init
is interrupted while probing using that temp directory, the files it left
will get deleted 1 week later by a subsequent git-annex run.
2019-09-10 13:37:07 -04:00
SophiaKelly
8d1ca3c91a Added a comment: Change AOL Password 2019-09-10 09:59:03 +00:00
SophiaKelly
4653c7e95e removed 2019-09-10 09:57:09 +00:00
SophiaKelly
1be970e097 Added a comment: Change AOL Password 2019-09-10 09:56:05 +00:00
Joey Hess
f9f9215d2c
Merge branch 'master' of ssh://git-annex.branchable.com 2019-09-09 15:12:37 -04:00
Joey Hess
f51ebe20aa
forwarded 2019-09-09 15:11:53 -04:00
Ilya_Shlyakhter
1d9bea3c3f question about people's experience with parallel git-annex operations 2019-09-09 19:01:05 +00:00
Ilya_Shlyakhter
267cc39402 Added a comment: git and submodule configs 2019-09-09 18:47:41 +00:00
Joey Hess
63e37b0beb
analysis 2019-09-09 09:44:47 -04:00
Joey Hess
5197a222aa
analysis 2019-09-09 09:43:25 -04:00
yarikoptic
029a952726 Added a comment: archaeological expedition summary 2019-09-09 12:53:17 +00:00
https://tribut.de/
fad7f3096b Added a comment 2019-09-09 09:01:26 +00:00
flixh
ecae180dfe 2019-09-07 12:45:38 +00:00
flixh
d5b5f31107 Added a comment 2019-09-07 11:44:47 +00:00
Joey Hess
796a49a8c7
followup 2019-09-06 14:20:39 -04:00
Joey Hess
f70da1b359
Merge branch 'master' of ssh://git-annex.branchable.com 2019-09-06 13:51:47 -04:00
Joey Hess
e78050c808
followup 2019-09-06 12:31:01 -04:00
Joey Hess
218afb9c0f
comment 2019-09-06 12:05:55 -04:00
TroisSinges
0532e9740f Added a comment 2019-09-05 19:12:30 +00:00
Ilya_Shlyakhter
0461e850a0 Added a comment: directories on S3 2019-09-05 18:40:20 +00:00
Joey Hess
e11c324605
followup; correct misleading comment 2019-09-05 11:31:56 -04:00
Joey Hess
c99526dd41
Merge branch 'master' of ssh://git-annex.branchable.com 2019-09-05 11:26:25 -04:00
Joey Hess
99894ea789
update 2019-09-05 11:25:30 -04:00
Ilya_Shlyakhter
37274b6853 Added a comment: another trace of concurrent copy failure 2019-09-05 06:09:13 +00:00
Ilya_Shlyakhter
661502e905 Added a comment: buffering chunks in memory when uploading to remote 2019-09-04 19:50:42 +00:00
Ilya_Shlyakhter
eeaa2b44cd added issue re: output of error messages with --json-error-messages 2019-09-03 18:20:34 +00:00
ginquistador@86f226616ead98d2733e249429918f241f928064
95468047d6 Added a comment: Disappointed with git add 2019-09-03 07:30:28 +00:00
TroisSinges
2eb7e338b6 Added a comment 2019-09-02 22:19:04 +00:00
Ilya_Shlyakhter
8acd01334c bug report where git-annex-copy fails with "thread blocked indefinitely in an STM transaction" 2019-09-02 18:26:28 +00:00
Ilya_Shlyakhter
1a7c06ea9d added suggestion for S3 export remote redirecting to key-value store 2019-09-02 17:41:46 +00:00
Ilya_Shlyakhter
62723b7c45 Added a comment 2019-09-02 15:49:57 +00:00
yarikoptic
c83526fed7 Added a comment: the issue persists in master 2019-09-02 14:17:14 +00:00
yarikoptic
8bc27a5cd7 removed 2019-09-02 14:14:11 +00:00
yarikoptic
3e93585ccc Added a comment: the issue remains (if there were any fixed introduced) 2019-09-02 14:13:07 +00:00
yarikoptic
f951a62210 initial report on problems with unicode directories 2019-09-02 11:52:27 +00:00
TroisSinges
4c1af28371 2019-09-02 07:52:08 +00:00
johnmario.itec19@69a7b742534851b36216e0f951f1a00dbb9067cd
564256614e Added a comment: commenting on git-annex-add 2019-09-02 06:21:27 +00:00
Joey Hess
f845195354
Added annex.autoupgraderepository configuration
Can be set to false to prevent any automatic repository upgrades.

Also, removed direct mode specific upgrade code in Annex.Init, and made
needsUpgrade always include the name/path of the repo, so if
there's a problem it's clear what repo has the problem.

And, made needsUpgrade catch any exceptions that might occur during the
upgrade, so it can display a more useful error message than just the
exception.
2019-09-01 13:42:26 -04:00
lykos@d125a37d89b1cfac20829f12911656c40cb70018
bc2cfe2483 2019-09-01 17:10:32 +00:00
Joey Hess
b421004d75
reorg gitconfig settings and break out several large sections 2019-09-01 12:56:28 -04:00
Joey Hess
8865041834
rename page 2019-09-01 12:25:46 -04:00
Joey Hess
63314a9188
link to other install methods as EPEL has an ancient git-annex 2019-09-01 12:22:04 -04:00
Joey Hess
29eb2c2d9a
remove SL5 instructions
Those were from 2013, and the link to the repo no longer works.
2019-09-01 12:17:25 -04:00
marek@33e8ba4fbc201af14a2badcc0656024401f5c916
cdb679818e 2019-09-01 10:57:57 +00:00
yarikoptic
8859e785c3 Added a comment 2019-08-31 13:00:57 +00:00
Joey Hess
31a6086a9a
v7-default branch 2019-08-30 14:14:42 -04:00
Joey Hess
3f0eef4baa
v7 for all repositories
* Default to v7 for new repositories.
* Automatically upgrade v5 repositories to v7.
2019-08-30 14:09:14 -04:00
Joey Hess
1558e03014
Refuse to upgrade direct mode repositories when git is older than 2.22
That git fixed a memory leak that could cause an OOM during the upgrade.

Most git-annex builds have a new enough git already.
OSX git was upgraded with brew.

Linux i386ancient build's git was too old. Upgrading it to a fixed
git didn't work (due to the newer git not working with the old ssh,
https://bugs.chromium.org/p/git/issues/detail?id=7 )

Choices to deal with that were:

* Somehow make direct mode upgrade work with the old git, avoiding its
  OOM problem. One way would be to switch the repo to indirect mode
  first, and so upgrade to a repo with locked files. Not good when
  the filesystem does not support symlinks.
* backport the OOM fix from git 2.22
  (And do what about the version number so git-annex knows it's fixed?)
* backport openssh (and possibly more stuff)
* move the i386ancient build to at least Debian stretch (still backporting git)
  But this will make it no longer work with some of the ancient kernels it
  targets.

Of those, backporting the OOM fix seemed the best approach. Put "oomfix"
in the git version number to indicate it.

I have not automated building the git backport, so here's the patch I
used:

diff -ur orig/git-2.1.4/convert.c git-2.1.4/convert.c
--- orig/git-2.1.4/convert.c	2014-12-18 18:42:18.000000000 +0000
+++ git-2.1.4/convert.c	2019-08-29 20:05:04.371872338 +0100
@@ -404,7 +404,7 @@
 	if (start_async(&async))
 		return 0;	/* error was already reported */

-	if (strbuf_read(&nbuf, async.out, len) < 0) {
+	if (strbuf_read(&nbuf, async.out, 0) < 0) {
 		error("read from external filter %s failed", cmd);
 		ret = 0;
 	}
diff -ur orig/git-2.1.4/GIT-VERSION-GEN git-2.1.4/GIT-VERSION-GEN
--- orig/git-2.1.4/GIT-VERSION-GEN	2014-12-18 18:42:18.000000000 +0000
+++ git-2.1.4/GIT-VERSION-GEN	2019-08-29 20:06:39.132743228 +0100
@@ -1,7 +1,7 @@
 #!/bin/sh

 GVF=GIT-VERSION-FILE
-DEF_VER=v2.1.4
+DEF_VER=v2.1.4.oomfix

 LF='
 '
diff -ur orig/git-2.1.4/configure git-2.1.4/configure
--- orig/git-2.1.4/configure	2014-12-18 18:42:19.000000000 +0000
+++ git-2.1.4/configure	2019-08-29 20:27:45.896380015 +0100
@@ -580,8 +580,8 @@
 # Identity of this package.
 PACKAGE_NAME='git'
 PACKAGE_TARNAME='git'
-PACKAGE_VERSION='2.1.4'
-PACKAGE_STRING='git 2.1.4'
+PACKAGE_VERSION='2.1.4.oomfix'
+PACKAGE_STRING='git 2.1.4.oomfix'
 PACKAGE_BUGREPORT='git@vger.kernel.org'
 PACKAGE_URL=''

diff -ur orig/git-2.1.4/version git-2.1.4/version
--- orig/git-2.1.4/version	2014-12-18 18:42:19.000000000 +0000
+++ git-2.1.4/version	2019-08-29 20:06:17.572545210 +0100
@@ -1 +1 @@
-2.1.4
+2.1.4.oomfix
2019-08-29 15:24:41 -04:00
Joey Hess
c83c82a9c4
followup 2019-08-29 13:25:22 -04:00
Joey Hess
d6e1f09ed2
init: Catch more exceptions when testing locking. 2019-08-29 12:19:07 -04:00
Joey Hess
dc19fa8b04
comment 2019-08-29 12:06:46 -04:00
Joey Hess
f5a63e5a81
devblog 2019-08-28 15:18:41 -04:00
Joey Hess
6b27fc58d0
v7 bug review and cleanup 2019-08-28 12:20:30 -04:00
Joey Hess
a648c22b9b
clarification 2019-08-27 16:18:29 -04:00
Joey Hess
c21c0cd885
update with WSL findings 2019-08-27 15:45:43 -04:00
Joey Hess
7f2bf5a802
followup 2019-08-27 15:41:31 -04:00
Joey Hess
56370c009c
Merge branch 'master' of ssh://git-annex.branchable.com 2019-08-27 14:14:52 -04:00
Joey Hess
45663f6f35
planning 2019-08-27 14:14:16 -04:00
Joey Hess
11e3b2397c
update location log for missing content during direct mode conversion
If a direct mode file is deleted or modified, and there are no other
files containing the content, the content was lost. That's a normal
thing that can happen in direct mode, but not in v7, so the upgrade
code has to notice it in order for the location log to be accurate.
2019-08-27 13:54:21 -04:00
Joey Hess
3a0842d9f8
fix bug introduced in direct mode conversion
oops, the code was "if direct && not present" and I removed the direct
which made the wrong path be taken.
2019-08-27 12:29:05 -04:00
Joey Hess
6b56c3ae11
close 2019-08-27 11:39:52 -04:00
Joey Hess
0b10d10753
add 2019-08-26 17:00:06 -04:00
Ilya_Shlyakhter
637ced91b9 Added a comment 2019-08-26 20:58:14 +00:00
Joey Hess
867f0b7442
Merge branch 'master' of ssh://git-annex.branchable.com 2019-08-26 16:46:32 -04:00
Joey Hess
99ac4c0cb8
devblog 2019-08-26 16:46:13 -04:00
Joey Hess
af8a73d539
noticed a problem 2019-08-26 16:41:24 -04:00
Joey Hess
20741b1eb4
Automatically convert direct mode repositories to v7 with adjusted unlocked branches
* Automatically convert direct mode repositories to v7 with adjusted
  unlocked branches and set annex.thin.
* init: When run on a crippled filesystem with --version=5,
  will error out, since version 7 is needed for adjusted unlocked branch.
* direct: This command always errors out as direct mode is no longer
  supported.
* indirect: This command has become a deprecated noop.
* proxy: This command is deprecated because it was only needed in direct
  mode. (But it continues to work.)

Also removed mentions of direct mode throughough the documentation.

I have not removed all the direct mode code yet.
2019-08-26 15:05:25 -04:00
Joey Hess
2fd27c6df5
assistant: When creating a new repository use v7 adjusted branches with annex.thin
Rather than direct mode, which this is a small step on the path to
removing.

Init on a crippled filesystem already used v7 adjusted branches,
and like that, this doesn't pose any interoperability issues with old
versions of git-annex that clone the same repo, because files are only
unlocked on the adjusted branch.
2019-08-26 12:54:14 -04:00
Joey Hess
0c718763fd
planning
several entangled things
2019-08-26 12:29:43 -04:00
Joey Hess
9bf3a5c405
close as probably fixed in recent test suite improvements 2019-08-26 12:27:27 -04:00
Joey Hess
b627c5b4d0
followup 2019-08-26 12:20:57 -04:00
ronald@bfae3dfd3105df06e4cc44c37b3e8dc430bd137a
04a928eccc fix git:// url for repo 2019-08-25 19:12:58 +00:00
Joey Hess
8012d61874
Merge branch 'master' of ssh://git-annex.branchable.com 2019-08-23 16:52:23 -04:00
Joey Hess
cb318d4404
todo 2019-08-23 16:52:08 -04:00
giuly
1eb2a87147 Datalad/Git annex/unkown archive format 2019-08-23 19:40:04 +00:00
yarikoptic
9531f5b6d4 initial report about regression failing to detect need for pidlock 2019-08-23 14:16:11 +00:00
Joey Hess
246ec97338
update 2019-08-22 21:04:19 -04:00