From e35f688d511231905e443ddcf292d75612b2908a Mon Sep 17 00:00:00 2001 From: "https://www.google.com/accounts/o8/id?id=AItOawknHkJJRE0K7_G4sG3YgOkAaihnw0eg9Ao" Date: Fri, 7 Nov 2014 23:44:46 +0000 Subject: [PATCH 1/8] --- doc/forum/possible_gpg_issue.mdwn | 28 ++++++++++++++++++++++++++++ 1 file changed, 28 insertions(+) create mode 100644 doc/forum/possible_gpg_issue.mdwn diff --git a/doc/forum/possible_gpg_issue.mdwn b/doc/forum/possible_gpg_issue.mdwn new file mode 100644 index 0000000000..afab2eb1cb --- /dev/null +++ b/doc/forum/possible_gpg_issue.mdwn @@ -0,0 +1,28 @@ +Hi, + +I'm having an issue and not sure if it's to do with git-annex or something external. I'm on Ubuntu 14.04, and have been using git-annex for several months without this issue, but it suddenly started (possibly) after several packages were updated via apt-get upgrade. + +We have two remotes configured, one is a local (LAN) smb share, the other is on Amazon S3. We're using shared encryption on the S3 remote, and no encryption on the smb remote. + +The problem that started happening recently is when copying to the smb remote. There is no problem copying from the remote, and no problem reading or writing to the drive outside of git-annex. However, copying to the remote fails after it seems to copy most or all of the file and then hang on a gpg step. Again, there is no encryption on this remote. The other S3 remote with shared encryption has no issues. Other devices on the LAN, all OS X, have no issues writing to the remote. + +I don't have enough info to necessarily claim this is a bug in git-annex, but I'm not sure what to poke at next to try to figure it out. Any help or advice would be greatly appreciated. + +Below is the debug output from a failed git annex copy command. + + cw@ubuntu$ git annex copy annexedfile --to smbremote --debug + [2014-11-07 15:35:13 PST] read: git ["--git-dir=/repobase/.git","--work-tree=/repobase","show-ref","git-annex"] + [2014-11-07 15:35:13 PST] read: git ["--git-dir=/repobase/.git","--work-tree=/repobase","show-ref","--hash","refs/heads/git-annex"] + [2014-11-07 15:35:13 PST] read: git ["--git-dir=/repobase.git","--work-tree=/repobase","log","refs/heads/git-annex..aa8813d486939544701359dc28fa7b0916917961","--oneline","-n1"] + [2014-11-07 15:35:13 PST] read: git ["--git-dir=/repobase/.git","--work-tree=/repobase","log","refs/heads/git-annex..097d5b482d6856ce22814a0c2c5eee43e3e030e4","--oneline","-n1"] + [2014-11-07 15:35:13 PST] chat: git ["--git-dir=/repobase/.git","--work-tree=/repobase","cat-file","--batch"] + [2014-11-07 15:35:13 PST] read: git ["--git-dir=/repobase/.git","--work-tree=/repobase","ls-files","--cached","-z","--","annexedfile"] + copy annexedfile (gpg) (to smbremote...) + [2014-11-07 15:35:13 PST] chat: gpg ["--quiet","--trust-model","always","--batch","--passphrase-fd","11","--symmetric","--force-mdc","--no-textmode"] + 95% 0.0 B/s 0s/mnt/annex/tmp/GPGHMACSHA1--a097a9b653d1facbe7d37d0e8f9f580261d9adef/GPGHMACSHA1--a097a9b653d1facbe7d37d0e8f9f580261d9adef: hClose: does not exist (Host is down) + failed + git-annex: copy: 1 failed + cw@ubuntu$ + +Thanks, +cw From 84a4b34ecf729c2d9addcd22ac2f8ecf591a029a Mon Sep 17 00:00:00 2001 From: "https://www.google.com/accounts/o8/id?id=AItOawknHkJJRE0K7_G4sG3YgOkAaihnw0eg9Ao" Date: Fri, 7 Nov 2014 23:51:56 +0000 Subject: [PATCH 2/8] --- doc/forum/possible_gpg_issue.mdwn | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/doc/forum/possible_gpg_issue.mdwn b/doc/forum/possible_gpg_issue.mdwn index afab2eb1cb..5a3d9390b7 100644 --- a/doc/forum/possible_gpg_issue.mdwn +++ b/doc/forum/possible_gpg_issue.mdwn @@ -13,7 +13,7 @@ Below is the debug output from a failed git annex copy command. cw@ubuntu$ git annex copy annexedfile --to smbremote --debug [2014-11-07 15:35:13 PST] read: git ["--git-dir=/repobase/.git","--work-tree=/repobase","show-ref","git-annex"] [2014-11-07 15:35:13 PST] read: git ["--git-dir=/repobase/.git","--work-tree=/repobase","show-ref","--hash","refs/heads/git-annex"] - [2014-11-07 15:35:13 PST] read: git ["--git-dir=/repobase.git","--work-tree=/repobase","log","refs/heads/git-annex..aa8813d486939544701359dc28fa7b0916917961","--oneline","-n1"] + [2014-11-07 15:35:13 PST] read: git ["--git-dir=/repobase/.git","--work-tree=/repobase","log","refs/heads/git-annex..aa8813d486939544701359dc28fa7b0916917961","--oneline","-n1"] [2014-11-07 15:35:13 PST] read: git ["--git-dir=/repobase/.git","--work-tree=/repobase","log","refs/heads/git-annex..097d5b482d6856ce22814a0c2c5eee43e3e030e4","--oneline","-n1"] [2014-11-07 15:35:13 PST] chat: git ["--git-dir=/repobase/.git","--work-tree=/repobase","cat-file","--batch"] [2014-11-07 15:35:13 PST] read: git ["--git-dir=/repobase/.git","--work-tree=/repobase","ls-files","--cached","-z","--","annexedfile"] From 047337764deb384ff453771e34f945391c15f689 Mon Sep 17 00:00:00 2001 From: "https://renaud.casenave.fr/" Date: Sat, 8 Nov 2014 07:18:48 +0000 Subject: [PATCH 3/8] Added a comment --- ...ent_2_e9dca04e0456ca7356996365a4b87d59._comment | 14 ++++++++++++++ 1 file changed, 14 insertions(+) create mode 100644 doc/bugs/git_annex_assistant_leaks_a_lot_of_memory/comment_2_e9dca04e0456ca7356996365a4b87d59._comment diff --git a/doc/bugs/git_annex_assistant_leaks_a_lot_of_memory/comment_2_e9dca04e0456ca7356996365a4b87d59._comment b/doc/bugs/git_annex_assistant_leaks_a_lot_of_memory/comment_2_e9dca04e0456ca7356996365a4b87d59._comment new file mode 100644 index 0000000000..d7d4dec394 --- /dev/null +++ b/doc/bugs/git_annex_assistant_leaks_a_lot_of_memory/comment_2_e9dca04e0456ca7356996365a4b87d59._comment @@ -0,0 +1,14 @@ +[[!comment format=mdwn + username="https://renaud.casenave.fr/" + subject="comment 2" + date="2014-11-08T07:18:48Z" + content=""" +Hi, + +Yes, the assistant memory goes back to normal when I do `git annex assistant --stop && git annex assistant`. But when I look at htop the next day, it has already taken 1Gb. + +There are quite a lot of files in `.git/annex/transfer`… wc reports more than 200 entries, mainly in the upload folder, although the repository only manages 10 or so files. + +I tried building git-annex using cabal but `cabal configure -fEKG` exits with the code 9 and even without `-fEKG` cabal refuses to install some of the dependencies. I'll try again some other time… + +"""]] From 74bf33cf8ac55f265123c7b0deee3f897a9372c3 Mon Sep 17 00:00:00 2001 From: "https://renaud.casenave.fr/" Date: Sat, 8 Nov 2014 07:26:00 +0000 Subject: [PATCH 4/8] --- ...ant_crashes_when_parsing_lsof_output_for_version_4.88-1.mdwn | 2 ++ 1 file changed, 2 insertions(+) create mode 100644 doc/bugs/git_annex_assistant_crashes_when_parsing_lsof_output_for_version_4.88-1.mdwn diff --git a/doc/bugs/git_annex_assistant_crashes_when_parsing_lsof_output_for_version_4.88-1.mdwn b/doc/bugs/git_annex_assistant_crashes_when_parsing_lsof_output_for_version_4.88-1.mdwn new file mode 100644 index 0000000000..32f5257254 --- /dev/null +++ b/doc/bugs/git_annex_assistant_crashes_when_parsing_lsof_output_for_version_4.88-1.mdwn @@ -0,0 +1,2 @@ +lsof got updated to version 4.88 some days ago (in archlinux) and since then the assistant reports the Committer crashed while parsing lsof output. +After reverting to the previous version (4.87), it's working fine. From 87e66557223236ef4a7498cef5d2af75756b78dd Mon Sep 17 00:00:00 2001 From: "https://renaud.casenave.fr/" Date: Sat, 8 Nov 2014 07:26:27 +0000 Subject: [PATCH 5/8] --- ...tant_crashes_when_parsing_lsof_output_for_version_4.88-1.mdwn | 1 + 1 file changed, 1 insertion(+) diff --git a/doc/bugs/git_annex_assistant_crashes_when_parsing_lsof_output_for_version_4.88-1.mdwn b/doc/bugs/git_annex_assistant_crashes_when_parsing_lsof_output_for_version_4.88-1.mdwn index 32f5257254..b914e7fc05 100644 --- a/doc/bugs/git_annex_assistant_crashes_when_parsing_lsof_output_for_version_4.88-1.mdwn +++ b/doc/bugs/git_annex_assistant_crashes_when_parsing_lsof_output_for_version_4.88-1.mdwn @@ -1,2 +1,3 @@ lsof got updated to version 4.88 some days ago (in archlinux) and since then the assistant reports the Committer crashed while parsing lsof output. + After reverting to the previous version (4.87), it's working fine. From 4ff332919701c42558d4c2f54edfc18b25ce5655 Mon Sep 17 00:00:00 2001 From: "https://renaud.casenave.fr/" Date: Sat, 8 Nov 2014 07:26:48 +0000 Subject: [PATCH 6/8] rename bugs/git_annex_assistant_crashes_when_parsing_lsof_output_for_version_4.88-1.mdwn to bugs/git_annex_assistant_crashes_when_parsing_lsof_output_for_version_4.88.mdwn --- ...istant_crashes_when_parsing_lsof_output_for_version_4.88.mdwn} | 0 1 file changed, 0 insertions(+), 0 deletions(-) rename doc/bugs/{git_annex_assistant_crashes_when_parsing_lsof_output_for_version_4.88-1.mdwn => git_annex_assistant_crashes_when_parsing_lsof_output_for_version_4.88.mdwn} (100%) diff --git a/doc/bugs/git_annex_assistant_crashes_when_parsing_lsof_output_for_version_4.88-1.mdwn b/doc/bugs/git_annex_assistant_crashes_when_parsing_lsof_output_for_version_4.88.mdwn similarity index 100% rename from doc/bugs/git_annex_assistant_crashes_when_parsing_lsof_output_for_version_4.88-1.mdwn rename to doc/bugs/git_annex_assistant_crashes_when_parsing_lsof_output_for_version_4.88.mdwn From f2357222f04a8e455b09e5ede1f01c2d9e80953b Mon Sep 17 00:00:00 2001 From: "2003:51:4f3b:6200:b00d:4d41:366d:5b54" <2003:51:4f3b:6200:b00d:4d41:366d:5b54@web> Date: Sat, 8 Nov 2014 23:33:52 +0000 Subject: [PATCH 7/8] poll vote (/sdcard/annex) --- doc/design/assistant/polls/Android_default_directory.mdwn | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/doc/design/assistant/polls/Android_default_directory.mdwn b/doc/design/assistant/polls/Android_default_directory.mdwn index 6060dd64c6..4822d26464 100644 --- a/doc/design/assistant/polls/Android_default_directory.mdwn +++ b/doc/design/assistant/polls/Android_default_directory.mdwn @@ -4,4 +4,4 @@ Same as the desktop webapp, users will be able to enter a directory they want the first time they run it, but to save typing on android, anything that gets enough votes will be included in a list of choices as well. -[[!poll open=yes expandable=yes 69 "/sdcard/annex" 6 "Whole /sdcard" 7 "DCIM directory (photos and videos only)" 2 "Same as for regular git-annex. ~/annex/"]] +[[!poll open=yes expandable=yes 70 "/sdcard/annex" 6 "Whole /sdcard" 7 "DCIM directory (photos and videos only)" 2 "Same as for regular git-annex. ~/annex/"]] From 5469f7d21dcf2415177115a0bef5ed7400f49ab2 Mon Sep 17 00:00:00 2001 From: "2001:41d0:fe61:2600:96de:80ff:feb2:56d" <2001:41d0:fe61:2600:96de:80ff:feb2:56d@web> Date: Sun, 9 Nov 2014 00:35:20 +0000 Subject: [PATCH 8/8] poll vote (/sdcard/annex) --- doc/design/assistant/polls/Android_default_directory.mdwn | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/doc/design/assistant/polls/Android_default_directory.mdwn b/doc/design/assistant/polls/Android_default_directory.mdwn index 4822d26464..e557ba2533 100644 --- a/doc/design/assistant/polls/Android_default_directory.mdwn +++ b/doc/design/assistant/polls/Android_default_directory.mdwn @@ -4,4 +4,4 @@ Same as the desktop webapp, users will be able to enter a directory they want the first time they run it, but to save typing on android, anything that gets enough votes will be included in a list of choices as well. -[[!poll open=yes expandable=yes 70 "/sdcard/annex" 6 "Whole /sdcard" 7 "DCIM directory (photos and videos only)" 2 "Same as for regular git-annex. ~/annex/"]] +[[!poll open=yes expandable=yes 71 "/sdcard/annex" 6 "Whole /sdcard" 7 "DCIM directory (photos and videos only)" 2 "Same as for regular git-annex. ~/annex/"]]