From 93773b57884603055a8f81d60039645c7532f7a0 Mon Sep 17 00:00:00 2001 From: "jason.dixon.email@aa0e536a2ec2877d6f666108dbbc6e39bbe87ac0" Date: Sun, 20 Oct 2019 19:42:04 +0000 Subject: [PATCH 01/13] Added a comment: a case for request routing --- ...omment_4_b228914d2a3d7838ebc8f1cae4d8b59a._comment | 11 +++++++++++ 1 file changed, 11 insertions(+) create mode 100644 doc/forum/Sending_requests_across_the_network/comment_4_b228914d2a3d7838ebc8f1cae4d8b59a._comment diff --git a/doc/forum/Sending_requests_across_the_network/comment_4_b228914d2a3d7838ebc8f1cae4d8b59a._comment b/doc/forum/Sending_requests_across_the_network/comment_4_b228914d2a3d7838ebc8f1cae4d8b59a._comment new file mode 100644 index 0000000000..3577a7e0b0 --- /dev/null +++ b/doc/forum/Sending_requests_across_the_network/comment_4_b228914d2a3d7838ebc8f1cae4d8b59a._comment @@ -0,0 +1,11 @@ +[[!comment format=mdwn + username="jason.dixon.email@aa0e536a2ec2877d6f666108dbbc6e39bbe87ac0" + nickname="jason.dixon.email" + avatar="http://cdn.libravatar.org/avatar/fbe9050fc83bbd536d307d87ea14d4bc" + subject="a case for request routing" + date="2019-10-20T19:42:03Z" + content=""" +This could also be what you're after (just a design)? https://git-annex.branchable.com/design/requests_routing/ + +This is something I would love to see implemented too. Especially as an addition to get / drop / fsck commands. +"""]] From 951ef838189b4e6b3c78118df4bcf7e45f3e90c9 Mon Sep 17 00:00:00 2001 From: Ilya_Shlyakhter Date: Mon, 21 Oct 2019 01:59:34 +0000 Subject: [PATCH 02/13] Added a comment --- .../comment_5_504e2bfb8924b1721ede438122ec0532._comment | 8 ++++++++ 1 file changed, 8 insertions(+) create mode 100644 doc/forum/Sending_requests_across_the_network/comment_5_504e2bfb8924b1721ede438122ec0532._comment diff --git a/doc/forum/Sending_requests_across_the_network/comment_5_504e2bfb8924b1721ede438122ec0532._comment b/doc/forum/Sending_requests_across_the_network/comment_5_504e2bfb8924b1721ede438122ec0532._comment new file mode 100644 index 0000000000..09c6afa08c --- /dev/null +++ b/doc/forum/Sending_requests_across_the_network/comment_5_504e2bfb8924b1721ede438122ec0532._comment @@ -0,0 +1,8 @@ +[[!comment format=mdwn + username="Ilya_Shlyakhter" + avatar="http://cdn.libravatar.org/avatar/1647044369aa7747829c38b9dcc84df0" + subject="comment 5" + date="2019-10-21T01:59:33Z" + content=""" +Possibly related: [[todo/speculate-can-get___58___extension_of_speculate-present]] +"""]] From ba30c816dc7d78e04f2c00c67f01587dc0761386 Mon Sep 17 00:00:00 2001 From: Ilya_Shlyakhter Date: Mon, 21 Oct 2019 02:00:28 +0000 Subject: [PATCH 03/13] removed --- .../comment_5_504e2bfb8924b1721ede438122ec0532._comment | 8 -------- 1 file changed, 8 deletions(-) delete mode 100644 doc/forum/Sending_requests_across_the_network/comment_5_504e2bfb8924b1721ede438122ec0532._comment diff --git a/doc/forum/Sending_requests_across_the_network/comment_5_504e2bfb8924b1721ede438122ec0532._comment b/doc/forum/Sending_requests_across_the_network/comment_5_504e2bfb8924b1721ede438122ec0532._comment deleted file mode 100644 index 09c6afa08c..0000000000 --- a/doc/forum/Sending_requests_across_the_network/comment_5_504e2bfb8924b1721ede438122ec0532._comment +++ /dev/null @@ -1,8 +0,0 @@ -[[!comment format=mdwn - username="Ilya_Shlyakhter" - avatar="http://cdn.libravatar.org/avatar/1647044369aa7747829c38b9dcc84df0" - subject="comment 5" - date="2019-10-21T01:59:33Z" - content=""" -Possibly related: [[todo/speculate-can-get___58___extension_of_speculate-present]] -"""]] From a9dbcd96aebcf05a5235031e31479cfd804862fa Mon Sep 17 00:00:00 2001 From: Ilya_Shlyakhter Date: Mon, 21 Oct 2019 02:02:31 +0000 Subject: [PATCH 04/13] Added a comment --- .../comment_5_3dba5baa95b43f542fe3737397b8c7a8._comment | 8 ++++++++ 1 file changed, 8 insertions(+) create mode 100644 doc/forum/Sending_requests_across_the_network/comment_5_3dba5baa95b43f542fe3737397b8c7a8._comment diff --git a/doc/forum/Sending_requests_across_the_network/comment_5_3dba5baa95b43f542fe3737397b8c7a8._comment b/doc/forum/Sending_requests_across_the_network/comment_5_3dba5baa95b43f542fe3737397b8c7a8._comment new file mode 100644 index 0000000000..f81d4968fb --- /dev/null +++ b/doc/forum/Sending_requests_across_the_network/comment_5_3dba5baa95b43f542fe3737397b8c7a8._comment @@ -0,0 +1,8 @@ +[[!comment format=mdwn + username="Ilya_Shlyakhter" + avatar="http://cdn.libravatar.org/avatar/1647044369aa7747829c38b9dcc84df0" + subject="comment 5" + date="2019-10-21T02:02:31Z" + content=""" +Possibly related: [speculate-can-get: extension of speculate-present](https://git-annex.branchable.com/todo/speculate-can-get___58___extension_of_speculate-present/) +"""]] From 43127e7ad44e4181a10d8ceb2d4ddbfd0d4a08f6 Mon Sep 17 00:00:00 2001 From: Ilya_Shlyakhter Date: Mon, 21 Oct 2019 02:02:47 +0000 Subject: [PATCH 05/13] Added a comment --- .../comment_6_6ef44abc1c279abf315b949d2f947fa4._comment | 8 ++++++++ 1 file changed, 8 insertions(+) create mode 100644 doc/forum/Sending_requests_across_the_network/comment_6_6ef44abc1c279abf315b949d2f947fa4._comment diff --git a/doc/forum/Sending_requests_across_the_network/comment_6_6ef44abc1c279abf315b949d2f947fa4._comment b/doc/forum/Sending_requests_across_the_network/comment_6_6ef44abc1c279abf315b949d2f947fa4._comment new file mode 100644 index 0000000000..6954f666a7 --- /dev/null +++ b/doc/forum/Sending_requests_across_the_network/comment_6_6ef44abc1c279abf315b949d2f947fa4._comment @@ -0,0 +1,8 @@ +[[!comment format=mdwn + username="Ilya_Shlyakhter" + avatar="http://cdn.libravatar.org/avatar/1647044369aa7747829c38b9dcc84df0" + subject="comment 6" + date="2019-10-21T02:02:47Z" + content=""" +Possibly related: [speculate-can-get: extension of speculate-present](https://git-annex.branchable.com/todo/speculate-can-get___58___extension_of_speculate-present/) +"""]] From 7c788c1f950ac257edf3ca13e9aa3de77303ee78 Mon Sep 17 00:00:00 2001 From: Ilya_Shlyakhter Date: Mon, 21 Oct 2019 02:43:48 +0000 Subject: [PATCH 06/13] added bug report about unexpectedly ignoring dotfiles --- doc/bugs/dotfiles_handled_differently.mdwn | 32 ++++++++++++++++++++++ 1 file changed, 32 insertions(+) create mode 100644 doc/bugs/dotfiles_handled_differently.mdwn diff --git a/doc/bugs/dotfiles_handled_differently.mdwn b/doc/bugs/dotfiles_handled_differently.mdwn new file mode 100644 index 0000000000..2ef57c1368 --- /dev/null +++ b/doc/bugs/dotfiles_handled_differently.mdwn @@ -0,0 +1,32 @@ +For most files, whether they get annexed is controlled by `annex.largefiles`. But dotfiles are configured to *never* be annexed regardless of `annex.largefiles`. This is unexpected and confusing. More oddly, `git-annex-add` doesn't seem to add them to regular git, either. + +I'm guessing this flows from the new default of `git add` adding files to the annex, which [[I hope gets reversed|forum/lets_discuss_git_add_behavior]]. But separately, I'm not sure why `git-annex-add` does not add the dotfiles to regular git: + +[[!format sh """ +# If you can, paste a complete transcript of the problem occurring here. +# If the problem is with the git-annex assistant, paste in .git/annex/daemon.log + +(master_env_v163_py36) 22:32 [newtree02] $ git status +On branch newtree02 +Untracked files: + (use "git add ..." to include in what will be committed) + + mydir/ + +nothing added to commit but untracked files present (use "git add" to track) +(master_env_v163_py36) 22:32 [newtree02] $ ls -al mydir +total 12 +drwxrwxr-x 2 ilya ilya 4096 Oct 20 22:31 . +drwxrwxr-x 3 ilya ilya 4096 Oct 20 22:31 .. +-rw-rw-r-- 1 ilya ilya 9 Oct 20 22:31 .mynewdot +(master_env_v163_py36) 22:32 [newtree02] $ git annex add mydir +(master_env_v163_py36) 22:32 [newtree02] $ git status +On branch newtree02 +Untracked files: + (use "git add ..." to include in what will be committed) + + mydir/ + + +# End of transcript or log. +"""]] From 2e53c679ccb01557cd2d53340dc8af61464f298b Mon Sep 17 00:00:00 2001 From: Ilya_Shlyakhter Date: Mon, 21 Oct 2019 02:51:16 +0000 Subject: [PATCH 07/13] Added a comment: different handling of dotfiles --- ...ment_19_c1d6b7ae3b7cc0f7f0dc8d55cf629508._comment | 12 ++++++++++++ 1 file changed, 12 insertions(+) create mode 100644 doc/forum/lets_discuss_git_add_behavior/comment_19_c1d6b7ae3b7cc0f7f0dc8d55cf629508._comment diff --git a/doc/forum/lets_discuss_git_add_behavior/comment_19_c1d6b7ae3b7cc0f7f0dc8d55cf629508._comment b/doc/forum/lets_discuss_git_add_behavior/comment_19_c1d6b7ae3b7cc0f7f0dc8d55cf629508._comment new file mode 100644 index 0000000000..30b97461d5 --- /dev/null +++ b/doc/forum/lets_discuss_git_add_behavior/comment_19_c1d6b7ae3b7cc0f7f0dc8d55cf629508._comment @@ -0,0 +1,12 @@ +[[!comment format=mdwn + username="Ilya_Shlyakhter" + avatar="http://cdn.libravatar.org/avatar/1647044369aa7747829c38b9dcc84df0" + subject="different handling of dotfiles" + date="2019-10-21T02:51:16Z" + content=""" +Related: [[bugs/dotfiles_handled_differently]] + +For most files, whether they get annexed is controlled by `annex.largefiles`. But dotfiles are configured to never be annexed regardless of `annex.largefiles`. This special-casing (in `.git/info/attributes`) is unexpected and confusing. It is probably a consequence of making `git add` annex files by default, but it's better to change that default than to have the special case. Also, `git-annex-add` seems to ignore the dotfiles, as in the bug report above. + +I thought of reverting to an earlier version of git-annex until these and other issues can get worked out, but realized I can't, since the repos got irreversibly auto-upgraded to v7... +"""]] From 1f8e6bf2de40e8dc77e3ec03b886adba91b9ce9b Mon Sep 17 00:00:00 2001 From: nordmagnus999 Date: Mon, 21 Oct 2019 08:58:10 +0000 Subject: [PATCH 08/13] --- doc/forum/git-annex_tor_remote_not_working.mdwn | 7 +++++++ 1 file changed, 7 insertions(+) create mode 100644 doc/forum/git-annex_tor_remote_not_working.mdwn diff --git a/doc/forum/git-annex_tor_remote_not_working.mdwn b/doc/forum/git-annex_tor_remote_not_working.mdwn new file mode 100644 index 0000000000..103da501e8 --- /dev/null +++ b/doc/forum/git-annex_tor_remote_not_working.mdwn @@ -0,0 +1,7 @@ +So i wanted to try local pairing for a while, but since i wanted to sync between local host and a remote server (which is heavily secured, firewall, block port except one available for ssh etc). +Although, i could have used the ssh remote, but i couldn't found a flag to specify a private key file (might need to search more), since i'm using a separate private key + password to ssh into the remote server. +Anyway, tor installed fine on both host and server, but even though tor was working fine by itself (tried it using sock5 and curl to test), git-annex couldn't initialize it, and was stuck on `Unable to connect to hidden service. It may not yet have propigated to the Tor network. (SocksErrorHostUnreachable) Will retry..` when using `git annex enable-tor` +I tried it on the assistant too with the same error in the logs. +I'm using default setting on the torrc, I'm on ubuntu 19.04 x86_64 using 7.20190129 version of git-annex. + +P.S:I used this one liner to test if tor was working ` curl --socks5 localhost:9050 --socks5-hostname localhost:9050 -s https://check.torproject.org/ | cat | grep -m 1 Congratulations | xargs`, not sure if there better way/other to test it. From 82b34a3364e1b6d047310abe96301f65200ccdbf Mon Sep 17 00:00:00 2001 From: nordmagnus999 Date: Mon, 21 Oct 2019 09:01:53 +0000 Subject: [PATCH 09/13] --- doc/forum/git-annex_tor_remote_not_working.mdwn | 2 ++ 1 file changed, 2 insertions(+) diff --git a/doc/forum/git-annex_tor_remote_not_working.mdwn b/doc/forum/git-annex_tor_remote_not_working.mdwn index 103da501e8..396b725422 100644 --- a/doc/forum/git-annex_tor_remote_not_working.mdwn +++ b/doc/forum/git-annex_tor_remote_not_working.mdwn @@ -1,7 +1,9 @@ So i wanted to try local pairing for a while, but since i wanted to sync between local host and a remote server (which is heavily secured, firewall, block port except one available for ssh etc). Although, i could have used the ssh remote, but i couldn't found a flag to specify a private key file (might need to search more), since i'm using a separate private key + password to ssh into the remote server. + Anyway, tor installed fine on both host and server, but even though tor was working fine by itself (tried it using sock5 and curl to test), git-annex couldn't initialize it, and was stuck on `Unable to connect to hidden service. It may not yet have propigated to the Tor network. (SocksErrorHostUnreachable) Will retry..` when using `git annex enable-tor` I tried it on the assistant too with the same error in the logs. + I'm using default setting on the torrc, I'm on ubuntu 19.04 x86_64 using 7.20190129 version of git-annex. P.S:I used this one liner to test if tor was working ` curl --socks5 localhost:9050 --socks5-hostname localhost:9050 -s https://check.torproject.org/ | cat | grep -m 1 Congratulations | xargs`, not sure if there better way/other to test it. From 7ed2631d5bc31ca3b2846b40a5183abcd4ee0a9c Mon Sep 17 00:00:00 2001 From: nordmagnus999 Date: Mon, 21 Oct 2019 10:42:15 +0000 Subject: [PATCH 10/13] --- doc/forum/git-annex_tor_remote_not_working.mdwn | 4 ++++ 1 file changed, 4 insertions(+) diff --git a/doc/forum/git-annex_tor_remote_not_working.mdwn b/doc/forum/git-annex_tor_remote_not_working.mdwn index 396b725422..284701cb38 100644 --- a/doc/forum/git-annex_tor_remote_not_working.mdwn +++ b/doc/forum/git-annex_tor_remote_not_working.mdwn @@ -7,3 +7,7 @@ I tried it on the assistant too with the same error in the logs. I'm using default setting on the torrc, I'm on ubuntu 19.04 x86_64 using 7.20190129 version of git-annex. P.S:I used this one liner to test if tor was working ` curl --socks5 localhost:9050 --socks5-hostname localhost:9050 -s https://check.torproject.org/ | cat | grep -m 1 Congratulations | xargs`, not sure if there better way/other to test it. + +EDIT: I updated the git-annex version on both the host and server, as i only now noticed they were old (and also since i tried a lot of other things and that was the last thing that could work). +Using 7.20190819+git2-g908476a9b-1~ndall+1 from neuron's repo. +Still not working and now stuck at `git-annex: tor failed to create hidden service, perhaps the tor service is not running` when doing `sudo git-annex enable-tor $(id -u)` From f09784f85183a6c34be2c8ce530c0ea8da75703c Mon Sep 17 00:00:00 2001 From: nordmagnus999 Date: Mon, 21 Oct 2019 10:43:16 +0000 Subject: [PATCH 11/13] --- doc/forum/git-annex_tor_remote_not_working.mdwn | 1 + 1 file changed, 1 insertion(+) diff --git a/doc/forum/git-annex_tor_remote_not_working.mdwn b/doc/forum/git-annex_tor_remote_not_working.mdwn index 284701cb38..7a5a7f4b28 100644 --- a/doc/forum/git-annex_tor_remote_not_working.mdwn +++ b/doc/forum/git-annex_tor_remote_not_working.mdwn @@ -11,3 +11,4 @@ P.S:I used this one liner to test if tor was working ` curl --socks5 localhost:9 EDIT: I updated the git-annex version on both the host and server, as i only now noticed they were old (and also since i tried a lot of other things and that was the last thing that could work). Using 7.20190819+git2-g908476a9b-1~ndall+1 from neuron's repo. Still not working and now stuck at `git-annex: tor failed to create hidden service, perhaps the tor service is not running` when doing `sudo git-annex enable-tor $(id -u)` +(and yes, the tor service is indeed running, which make that weird) From 219a5844909cffe5172d546f37aaf5fdd749905b Mon Sep 17 00:00:00 2001 From: nordmagnus999 Date: Mon, 21 Oct 2019 10:48:36 +0000 Subject: [PATCH 12/13] --- doc/forum/git-annex_tor_remote_not_working.mdwn | 1 + 1 file changed, 1 insertion(+) diff --git a/doc/forum/git-annex_tor_remote_not_working.mdwn b/doc/forum/git-annex_tor_remote_not_working.mdwn index 7a5a7f4b28..e93236fe7e 100644 --- a/doc/forum/git-annex_tor_remote_not_working.mdwn +++ b/doc/forum/git-annex_tor_remote_not_working.mdwn @@ -12,3 +12,4 @@ EDIT: I updated the git-annex version on both the host and server, as i only now Using 7.20190819+git2-g908476a9b-1~ndall+1 from neuron's repo. Still not working and now stuck at `git-annex: tor failed to create hidden service, perhaps the tor service is not running` when doing `sudo git-annex enable-tor $(id -u)` (and yes, the tor service is indeed running, which make that weird) +Obvious, but i also made sure to restart both tor and git-annex before and after upgrading in my consecutive attempts. From a2bc387c6b1759cd44b93b8125857e83d0010b7f Mon Sep 17 00:00:00 2001 From: anarcat Date: Mon, 21 Oct 2019 15:40:56 +0000 Subject: [PATCH 13/13] i always have trouble finding this --- doc/tips/finding_which_file_matches_a_key.mdwn | 14 ++++++++++++++ 1 file changed, 14 insertions(+) create mode 100644 doc/tips/finding_which_file_matches_a_key.mdwn diff --git a/doc/tips/finding_which_file_matches_a_key.mdwn b/doc/tips/finding_which_file_matches_a_key.mdwn new file mode 100644 index 0000000000..165bf7e902 --- /dev/null +++ b/doc/tips/finding_which_file_matches_a_key.mdwn @@ -0,0 +1,14 @@ +I have a music file which makes my music player unhappy. unfortunately, it (the music player) only shows me the target of the symlink, the "key" of the file, e.g. `SHA256E-s16279847--ce02487cd9f78f5944cbc1acb6622d270f7c16172d0fa12ae1330a4d9c3144a0.mp3`. There's a way to find which remotes have that key: + + $ git annex whereis --key=SHA256E-s16279847--ce02487cd9f78f5944cbc1acb6622d270f7c16172d0fa12ae1330a4d9c3144a0.mp3 + whereis SHA256E-s16279847--ce02487cd9f78f5944cbc1acb6622d270f7c16172d0fa12ae1330a4d9c3144a0.mp3 (7 copies) + 059b8bdb-2716-4ac9-b06e-9b1176af361d -- anarcat@curie:~/mp3 [here] + ok + +But that doesn't show me which file(s) actually point to it. [[git-annex-list]] and [[git-annex-find]] don't have the `--key` parameter and [[git-annex-matching-options]] doesn't have it either, so it makes it difficult to find which file points to that key. + +The only way I found to do this was to use the `find` command, like this: + + find -lname '*SHA256E-s16279847--ce02487cd9f78f5944cbc1acb6622d270f7c16172d0fa12ae1330a4d9c3144a0.mp3' + +I would love to have a way to use `git-annex`'s knowledge of its own repo here instead... Could this be improved? --[[anarcat]]