From f6af30a7aff6dd1b87a4d808ae9a79d326124185 Mon Sep 17 00:00:00 2001 From: Ilya_Shlyakhter Date: Fri, 3 Jul 2020 19:55:36 +0000 Subject: [PATCH 1/5] Added a comment --- .../comment_10_255a74838d9d88fe75095c4824cdbc9b._comment | 8 ++++++++ 1 file changed, 8 insertions(+) create mode 100644 doc/todo/importing_from_special_remote_without_downloading/comment_10_255a74838d9d88fe75095c4824cdbc9b._comment diff --git a/doc/todo/importing_from_special_remote_without_downloading/comment_10_255a74838d9d88fe75095c4824cdbc9b._comment b/doc/todo/importing_from_special_remote_without_downloading/comment_10_255a74838d9d88fe75095c4824cdbc9b._comment new file mode 100644 index 0000000000..44752cc46c --- /dev/null +++ b/doc/todo/importing_from_special_remote_without_downloading/comment_10_255a74838d9d88fe75095c4824cdbc9b._comment @@ -0,0 +1,8 @@ +[[!comment format=mdwn + username="Ilya_Shlyakhter" + avatar="http://cdn.libravatar.org/avatar/1647044369aa7747829c38b9dcc84df0" + subject="comment 10" + date="2020-07-03T19:55:36Z" + content=""" +\"the key generated by import --fast is probably not be the same one generated by a regular import\" -- but that happens already with addurl; is the problem worse here? +"""]] From e40ba939245d07447a0009e0687b483b038391a7 Mon Sep 17 00:00:00 2001 From: "jenkin.schibel@286264d9ceb79998aecff0d5d1a4ffe34f8b8421" Date: Sat, 4 Jul 2020 03:27:59 +0000 Subject: [PATCH 2/5] Added a comment: problem fixed itself --- .../comment_1_a3d68cc1af06c54d29818644a9943cc4._comment | 9 +++++++++ 1 file changed, 9 insertions(+) create mode 100644 doc/forum/ssl_errors_with_special_remote/comment_1_a3d68cc1af06c54d29818644a9943cc4._comment diff --git a/doc/forum/ssl_errors_with_special_remote/comment_1_a3d68cc1af06c54d29818644a9943cc4._comment b/doc/forum/ssl_errors_with_special_remote/comment_1_a3d68cc1af06c54d29818644a9943cc4._comment new file mode 100644 index 0000000000..5f2a293ff2 --- /dev/null +++ b/doc/forum/ssl_errors_with_special_remote/comment_1_a3d68cc1af06c54d29818644a9943cc4._comment @@ -0,0 +1,9 @@ +[[!comment format=mdwn + username="jenkin.schibel@286264d9ceb79998aecff0d5d1a4ffe34f8b8421" + nickname="jenkin.schibel" + avatar="http://cdn.libravatar.org/avatar/692d82fb5c42fc86d97cc44ae0fb61ca" + subject="problem fixed itself" + date="2020-07-04T03:27:58Z" + content=""" +so for some reason the problem fixed itself. chances are that I am just a noob at how SSL stuff works. If anyone could provide some possible insights as to why this might have happened so that I can learn from it, that would be much appreciated. +"""]] From 151efb9c3ceffb7305ff6a1c825a2727566a387c Mon Sep 17 00:00:00 2001 From: "jenkin.schibel@286264d9ceb79998aecff0d5d1a4ffe34f8b8421" Date: Sat, 4 Jul 2020 03:28:26 +0000 Subject: [PATCH 3/5] Added a comment: problem fixed itself --- .../comment_2_6ef51ec4daa0c4d3abae22dafe6f068b._comment | 9 +++++++++ 1 file changed, 9 insertions(+) create mode 100644 doc/forum/ssl_errors_with_special_remote/comment_2_6ef51ec4daa0c4d3abae22dafe6f068b._comment diff --git a/doc/forum/ssl_errors_with_special_remote/comment_2_6ef51ec4daa0c4d3abae22dafe6f068b._comment b/doc/forum/ssl_errors_with_special_remote/comment_2_6ef51ec4daa0c4d3abae22dafe6f068b._comment new file mode 100644 index 0000000000..fa6e9e7023 --- /dev/null +++ b/doc/forum/ssl_errors_with_special_remote/comment_2_6ef51ec4daa0c4d3abae22dafe6f068b._comment @@ -0,0 +1,9 @@ +[[!comment format=mdwn + username="jenkin.schibel@286264d9ceb79998aecff0d5d1a4ffe34f8b8421" + nickname="jenkin.schibel" + avatar="http://cdn.libravatar.org/avatar/692d82fb5c42fc86d97cc44ae0fb61ca" + subject="problem fixed itself" + date="2020-07-04T03:28:26Z" + content=""" +so for some reason the problem fixed itself. chances are that I am just a noob at how SSL stuff works. If anyone could provide some possible insights as to why this might have happened so that I can learn from it, that would be much appreciated. +"""]] From bbd5d1503d475e7396f6f9c9707be4378f09bd01 Mon Sep 17 00:00:00 2001 From: "flpgdt@f64318f00d9e1c9535e11f5d27c80c1d799cce00" Date: Sat, 4 Jul 2020 23:47:54 +0000 Subject: [PATCH 4/5] --- ...etup_a_git-annex_Glacier_gatway__63__.mdwn | 25 +++++++++++++++++++ 1 file changed, 25 insertions(+) create mode 100644 doc/forum/Is_it_possible_to_setup_a_git-annex_Glacier_gatway__63__.mdwn diff --git a/doc/forum/Is_it_possible_to_setup_a_git-annex_Glacier_gatway__63__.mdwn b/doc/forum/Is_it_possible_to_setup_a_git-annex_Glacier_gatway__63__.mdwn new file mode 100644 index 0000000000..155e78c4b5 --- /dev/null +++ b/doc/forum/Is_it_possible_to_setup_a_git-annex_Glacier_gatway__63__.mdwn @@ -0,0 +1,25 @@ +I have a server on a network (```SRV1```), several clients (```CLI-N```) on another and a ```archive``` repo on AWS Glacier. ```CLI```s can access ```SRV1```, but ```SRV1``` cannot access ```CLI```s network. I'd like to use git-annex to synchronize files between clients and archival on Glacier. + +My current setup: + +- ```SRV1``` contains: + - ```transfer``` repository (```T1```) + - glacier ```archive``` repo (```G1```) +- ```CLI-01``` contains: + - ```user files``` repo (```U1```) + - ```transfer``` repository (```T1```) +- ```CLI-02``` contains: + - ```user files``` repo (```U1```) + - ```transfer``` repository (```T1```) +- ```CLI-N``` (...) + +- **OBS**: + - ```SRV1``` uses ```aws tools``` and ```glacier-cli``` to access Glacier + - *I would rather not to have to install ```aws tools``` & ```glacier-cli``` on client machines* + - ```CLI```s use *ssh/rsync* with secret key to access ```SRV1``` + +I would like that ```T1```would serve as a gateway for *a)* synchronizing ```user files``` amongst clients; *a.1)* including moving and dropping files moved to ```archive``` by other clients; *b)* send ```archive``` files to ```G1```; and *c)* get files from ```G1``` and deliver to clients when content is moved out of ```archive```. + +As is seem close to working, but when a ```CLI``` pulls a file out of ```archive``` the recovery processes *(c)* fails. I expected ```transfer``` to fetch the file and then ```CLI``` would sync eventually, but does not seem to happen. + +Is this even possible with this setup? If not, what changes would you recommend for the scenario above to work? From 48a6978d553649e47f49ad45b62c8dcf9a1c83da Mon Sep 17 00:00:00 2001 From: andrew Date: Sun, 5 Jul 2020 17:25:49 +0000 Subject: [PATCH 5/5] Added a comment: transfer repos --- ...ent_1_a35571c77eaab5bcc0d841543a13162f._comment | 14 ++++++++++++++ 1 file changed, 14 insertions(+) create mode 100644 doc/forum/Is_it_possible_to_setup_a_git-annex_Glacier_gatway__63__/comment_1_a35571c77eaab5bcc0d841543a13162f._comment diff --git a/doc/forum/Is_it_possible_to_setup_a_git-annex_Glacier_gatway__63__/comment_1_a35571c77eaab5bcc0d841543a13162f._comment b/doc/forum/Is_it_possible_to_setup_a_git-annex_Glacier_gatway__63__/comment_1_a35571c77eaab5bcc0d841543a13162f._comment new file mode 100644 index 0000000000..d4755acb02 --- /dev/null +++ b/doc/forum/Is_it_possible_to_setup_a_git-annex_Glacier_gatway__63__/comment_1_a35571c77eaab5bcc0d841543a13162f._comment @@ -0,0 +1,14 @@ +[[!comment format=mdwn + username="andrew" + avatar="http://cdn.libravatar.org/avatar/acc0ece1eedf07dd9631e7d7d343c435" + subject="transfer repos" + date="2020-07-05T17:25:49Z" + content=""" +[Transfer](https://git-annex.branchable.com/preferred_content/standard_groups/) repositories unfortunately do not behave that way. You can setup G1 to get content sitting in T1 since T1 will store content until G1 has it. But, in terms of the other direction, doing a `git annex get` from T1 won't ask SRV1 to get a file from G1 (I don't think). + +The easiest way I can think of to achieve what you are looking for would be to create your own special remote on SRV1 (lets call it P1) that proxies the requests the way you need. Using [hook](https://git-annex.branchable.com/special_remotes/hook/) you could create a special remote that when asked for a file, ssh-es into SRV1 and then runs a script on SRV1 that does a `git annex get` on G1. Then, a few hours later, you can do a get again to get the file. + +I think a reasonable workaround, that ensures some measure of safety would be to just create some read-only credentials for your Glacier. Then add your Glacier repo to all the clients, so you can at least do gets from your clients. + +—Andrew +"""]]