From 186696865be9e2e66d0ce59d2b55b6e593c68405 Mon Sep 17 00:00:00 2001 From: "basile.pinsard@f1a7fae9f3bd9d5282fca11f62ad53b45a8eb317" Date: Thu, 3 Oct 2019 15:36:37 +0000 Subject: [PATCH] --- doc/forum/slow_s3_transfer.mdwn | 20 ++++++++++++++++++++ 1 file changed, 20 insertions(+) create mode 100644 doc/forum/slow_s3_transfer.mdwn diff --git a/doc/forum/slow_s3_transfer.mdwn b/doc/forum/slow_s3_transfer.mdwn new file mode 100644 index 0000000000..072043f5c9 --- /dev/null +++ b/doc/forum/slow_s3_transfer.mdwn @@ -0,0 +1,20 @@ +Hi, + +I am experiencing slow transfer (UL/DL) speed with an S3-compatible remote. +Here is the configuration: + +-Minio server for S3 storage in docker. + +-Nginx for https in docker. + +-git-annex (and datalad) with the S3 set as a remote, without public URL to control access. + +I tried to get files directly from the server to remove all the network factors. + +When downloading from the Minio server through nginx with wget, I have transfer rates of about 50-60MB/s. + +When running `git annex get` on the same file, the transfer rate is about 6-7MB/s. + +Any idea why git-annex would slow the transfer? + +Thanks