From 0baa722c720003a631cb42b0f8e59fc41e094595 Mon Sep 17 00:00:00 2001 From: Lukey Date: Fri, 12 Mar 2021 14:06:11 +0000 Subject: [PATCH] Added a comment --- ..._e102345b520423eafb4c202a0d6e276d._comment | 19 +++++++++++++++++++ 1 file changed, 19 insertions(+) create mode 100644 doc/forum/Git-annex_sync_very_slow._Why__63___How_to_fix_this__63__/comment_1_e102345b520423eafb4c202a0d6e276d._comment diff --git a/doc/forum/Git-annex_sync_very_slow._Why__63___How_to_fix_this__63__/comment_1_e102345b520423eafb4c202a0d6e276d._comment b/doc/forum/Git-annex_sync_very_slow._Why__63___How_to_fix_this__63__/comment_1_e102345b520423eafb4c202a0d6e276d._comment new file mode 100644 index 0000000000..80f4c41bf3 --- /dev/null +++ b/doc/forum/Git-annex_sync_very_slow._Why__63___How_to_fix_this__63__/comment_1_e102345b520423eafb4c202a0d6e276d._comment @@ -0,0 +1,19 @@ +[[!comment format=mdwn + username="Lukey" + avatar="http://cdn.libravatar.org/avatar/c7c08e2efd29c692cc017c4a4ca3406b" + subject="comment 1" + date="2021-03-12T14:06:08Z" + content=""" +Hi,
+Are you using the latest version? There have been large performance improvements in version 8.20200720. + +How many files do you have in the repository? + +The problem is that git-annex-sync has to check the location log for each key/file from the git-annex branch every time. Because whether a file needs to be copied and where might change depending on a lot of factors (See [[git-annex-preferred-content]]). + +But there is a solution: [[todo/Incremental_git_annex_sync\_--content_--all]]. This is not yet implemented in git-annex itself, so I wrote a [bash script](https://gist.github.com/Lukey3332/203ea6f30d48323e7bd1d05c16b5da9c) to do this. To get the speedup, you have to run `incremental-sync.sh --fast`. Beware that in the `--fast` mode `include=` and `exclude=` in your preferred-content expression won't work correctly. And, while the scripts works fine for me so far, it still is experimental. + +Also, [ZFS doesn't seem to perform too well with git-annex.](https://www.datalad.org/test_fs_analysis.html) + +The \"Your branch is ahead ...\" is normal if you didn't run git-annex-sync on the remote in the meantime. git-annex-sync doesn't push to `master` directly, but to `synced/master` and when you run sync on the remote it will pick up the changes. +"""]]