From 4cfa979d3689346b297824ad672095ff6c005680 Mon Sep 17 00:00:00 2001 From: Lukey Date: Mon, 20 Mar 2023 17:59:11 +0000 Subject: [PATCH 1/6] Added a comment --- ...mment_1_a9028f00461ec1eddbeb699dadcbab72._comment | 12 ++++++++++++ 1 file changed, 12 insertions(+) create mode 100644 doc/forum/Lost_git_repository._Recovery_from_S3_remote__63__/comment_1_a9028f00461ec1eddbeb699dadcbab72._comment diff --git a/doc/forum/Lost_git_repository._Recovery_from_S3_remote__63__/comment_1_a9028f00461ec1eddbeb699dadcbab72._comment b/doc/forum/Lost_git_repository._Recovery_from_S3_remote__63__/comment_1_a9028f00461ec1eddbeb699dadcbab72._comment new file mode 100644 index 0000000000..6dae8e786d --- /dev/null +++ b/doc/forum/Lost_git_repository._Recovery_from_S3_remote__63__/comment_1_a9028f00461ec1eddbeb699dadcbab72._comment @@ -0,0 +1,12 @@ +[[!comment format=mdwn + username="Lukey" + avatar="http://cdn.libravatar.org/avatar/c7c08e2efd29c692cc017c4a4ca3406b" + subject="comment 1" + date="2023-03-20T17:59:11Z" + content=""" +Not a chance. git-annex uses symetric encryption, storing the key in the git-annex branch. See [[design/encryption/]]. + +Are you sure you don't have other clones of the repo? + +How exactly did you loose the repo? Maybe its possible to recover it? +"""]] From 2c5e11360dacf7f46a4885b79c3dd8466032cf72 Mon Sep 17 00:00:00 2001 From: "carlos@4c213b52601d57b650b22d9a246c59aea2c8f859" Date: Mon, 20 Mar 2023 20:13:03 +0000 Subject: [PATCH 2/6] --- .../git_annex_copy_to_google_drive_is_very_slow.mdwn | 9 +++++++++ 1 file changed, 9 insertions(+) create mode 100644 doc/forum/git_annex_copy_to_google_drive_is_very_slow.mdwn diff --git a/doc/forum/git_annex_copy_to_google_drive_is_very_slow.mdwn b/doc/forum/git_annex_copy_to_google_drive_is_very_slow.mdwn new file mode 100644 index 0000000000..c67176c7fd --- /dev/null +++ b/doc/forum/git_annex_copy_to_google_drive_is_very_slow.mdwn @@ -0,0 +1,9 @@ +I'm trying to use datalad (http://www.datalad.org) to manage some scientific data repositories. Datalad uses git annex. + +I've set up an annex for my datalad/git repository using `git-annex-remote-rclone` [website](https://github.com/git-annex-remote-rclone/git-annex-remote-rclone). The setup went fine, but the transfers with a Gigabit connection are of the order of 50-100 kbs. I'm trying to troubleshoot the issue. I'm a new user of git annex. The repository has about 10 GB of stuff. + +I'm focusing on `git annex` because I sidestep datalad by using `git annex copy --to=gdrive2`, this is as slow as using `datalad push --to=gdrive2`, which makes sense as the latter is a thin wrapper around `git-annex-copy`. + +Using an external drive instead of Google Drive was a little better, but it still took hours to copy the 10 GB. Not sure what's going on. + +Any ideas on how to troubeshoot this? From 2473b83bc131d221c141929e582c9d98a0fb7e81 Mon Sep 17 00:00:00 2001 From: "carlos@4c213b52601d57b650b22d9a246c59aea2c8f859" Date: Mon, 20 Mar 2023 20:13:46 +0000 Subject: [PATCH 3/6] --- doc/forum/git_annex_copy_to_google_drive_is_very_slow.mdwn | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/doc/forum/git_annex_copy_to_google_drive_is_very_slow.mdwn b/doc/forum/git_annex_copy_to_google_drive_is_very_slow.mdwn index c67176c7fd..9db7a7e65f 100644 --- a/doc/forum/git_annex_copy_to_google_drive_is_very_slow.mdwn +++ b/doc/forum/git_annex_copy_to_google_drive_is_very_slow.mdwn @@ -1,4 +1,4 @@ -I'm trying to use datalad (http://www.datalad.org) to manage some scientific data repositories. Datalad uses git annex. +I'm trying to use [datalad](http://www.datalad.org) to manage some scientific data repositories. Datalad uses git annex. I've set up an annex for my datalad/git repository using `git-annex-remote-rclone` [website](https://github.com/git-annex-remote-rclone/git-annex-remote-rclone). The setup went fine, but the transfers with a Gigabit connection are of the order of 50-100 kbs. I'm trying to troubleshoot the issue. I'm a new user of git annex. The repository has about 10 GB of stuff. From 8497023f0e7652d3a66ca2917b88488fab8bb7cc Mon Sep 17 00:00:00 2001 From: "carlos@4c213b52601d57b650b22d9a246c59aea2c8f859" Date: Mon, 20 Mar 2023 20:14:19 +0000 Subject: [PATCH 4/6] --- doc/forum/git_annex_copy_to_google_drive_is_very_slow.mdwn | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/doc/forum/git_annex_copy_to_google_drive_is_very_slow.mdwn b/doc/forum/git_annex_copy_to_google_drive_is_very_slow.mdwn index 9db7a7e65f..d15cf46bd5 100644 --- a/doc/forum/git_annex_copy_to_google_drive_is_very_slow.mdwn +++ b/doc/forum/git_annex_copy_to_google_drive_is_very_slow.mdwn @@ -1,6 +1,6 @@ I'm trying to use [datalad](http://www.datalad.org) to manage some scientific data repositories. Datalad uses git annex. -I've set up an annex for my datalad/git repository using `git-annex-remote-rclone` [website](https://github.com/git-annex-remote-rclone/git-annex-remote-rclone). The setup went fine, but the transfers with a Gigabit connection are of the order of 50-100 kbs. I'm trying to troubleshoot the issue. I'm a new user of git annex. The repository has about 10 GB of stuff. +I've set up an annex for my datalad/git repository using [`git-annex-remote-rclone`](https://github.com/git-annex-remote-rclone/git-annex-remote-rclone). The setup went fine, but the transfers with a Gigabit connection are of the order of 50-100 kbs. I'm trying to troubleshoot the issue. I'm a new user of git annex. The repository has about 10 GB of stuff. I'm focusing on `git annex` because I sidestep datalad by using `git annex copy --to=gdrive2`, this is as slow as using `datalad push --to=gdrive2`, which makes sense as the latter is a thin wrapper around `git-annex-copy`. From 8967f1a92dfa44858bcda848cf2327c248adf0e6 Mon Sep 17 00:00:00 2001 From: "carlos@4c213b52601d57b650b22d9a246c59aea2c8f859" Date: Mon, 20 Mar 2023 20:22:50 +0000 Subject: [PATCH 5/6] --- doc/forum/git_annex_copy_to_google_drive_is_very_slow.mdwn | 2 ++ 1 file changed, 2 insertions(+) diff --git a/doc/forum/git_annex_copy_to_google_drive_is_very_slow.mdwn b/doc/forum/git_annex_copy_to_google_drive_is_very_slow.mdwn index d15cf46bd5..90bdea14d7 100644 --- a/doc/forum/git_annex_copy_to_google_drive_is_very_slow.mdwn +++ b/doc/forum/git_annex_copy_to_google_drive_is_very_slow.mdwn @@ -6,4 +6,6 @@ I'm focusing on `git annex` because I sidestep datalad by using `git annex copy Using an external drive instead of Google Drive was a little better, but it still took hours to copy the 10 GB. Not sure what's going on. +I'm running this on a M1 MacBook Pro. + Any ideas on how to troubeshoot this? From 696e75699d4f4fde04c804d78cfd9efec8a543fb Mon Sep 17 00:00:00 2001 From: "nobody314159@bfdeb297f68ed26fdff650d52fcdbb7746533591" Date: Tue, 21 Mar 2023 14:32:16 +0000 Subject: [PATCH 6/6] --- doc/forum/git_clone_over_ssh_hangs.mdwn | 17 +++++++++++++++++ 1 file changed, 17 insertions(+) create mode 100644 doc/forum/git_clone_over_ssh_hangs.mdwn diff --git a/doc/forum/git_clone_over_ssh_hangs.mdwn b/doc/forum/git_clone_over_ssh_hangs.mdwn new file mode 100644 index 0000000000..f385937d2e --- /dev/null +++ b/doc/forum/git_clone_over_ssh_hangs.mdwn @@ -0,0 +1,17 @@ +I am trying to use git-annex to sync a folder with a backup drive over the network. +I have followed the walkthrough and run a git annex init in a TrueNAS jail and now I am trying to use git clone through ssh to link the drive and the jail together. +The problem is that the clone in the backup drive just hangs. It will enumerate the files and count them and then it just seems to do nothing. + + +Command: git clone ssh://user@ip/mnt/dir ./driveBackup +Output: +Cloning into './repo'... +remote: Enumerating objects: 1543, done. +remote: Counting objects: 100% (1543/1543), done. + +...Hangs here nothing obvious happens... + +Running it in verbose mode reveals nothing. When you stop the clone it will complain about some sideband packet. + +I don't know if it helps, but I have set up passwordless ssh login and I have verified that it works by running ssh user@ip successfully from the backup system. +Can someone help me please?