mirrors/git-annex
2
0
Fork 0
Code Issues Pull requests Projects Releases Packages 1 Wiki Activity Actions

Merge branch 'master' of ssh://git-annex.branchable.com

Browse source
This commit is contained in:
Joey Hess 2021-02-19 19:43:21 -04:00
commit e5ca188544
No known key found for this signature in database
GPG key ID: DB12DB0FF05F8F38
11 changed files with 131 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

1
doc/forum/Help_with_get.mdwn Normal file
View file

@ -0,0 +1 @@
I'm new to git annex, but I couldn't find any other posts describing this error. I just set up repositories on two external 1TB, NTFS formatted hard drives and I'm working on a windows 10 os. I followed the walkthrough, setting the repository up on one drive, then cloning it on the other, and now I'm syncing the content (I first sync then get, but the problem occurs when I use the --content flag on sync as well). After a few files are successfully transferred, the process stalls part way through a file saying an "scp error writing 'file': Permission denied"??? Git annex and git processes don't end and I need to forcefully close the terminal and unplug and replug the drive back in before I can resume. I don't know if it is something with using git annex on Windows(I was automatically put on an adjusted branch, which I don't fully understand), or the NTFS drives, or maybe the hard drive is failing. Any advice people can give would be appreciated as this issue is persistent enough (every ~3 files) that it is making git annex unusable.

9
doc/forum/Help_with_get/comment_1_439c7562d94a969fd841cc44628abedd._comment Normal file
View file

@ -0,0 +1,9 @@
[[!comment format=mdwn
username="Lukey"
avatar="http://cdn.libravatar.org/avatar/c7c08e2efd29c692cc017c4a4ca3406b"
subject="comment 1"
date="2021-02-19T15:43:46Z"
content="""
Hi,
What version of git-annex are you using (Output of `git annex version`)? And since you are on windows, did you follow the install instructions [[here|install/Windows/]] or are you using wsl or something else? Finally, can you run the failing command with `--debug` and post the output here?
"""]]

8
doc/forum/Help_with_get/comment_2_137f89ea9c381cdbf57da78308a46078._comment Normal file
View file

@ -0,0 +1,8 @@
[[!comment format=mdwn
username="jwrauch"
avatar="http://cdn.libravatar.org/avatar/0e83010187ef0c8c587e0c99e2ca5474"
subject="comment 2"
date="2021-02-19T16:10:00Z"
content="""
I'm using git annex version: 8.20200815-g335aae266. And I followed the instructions the link provided. I looked into wls but decided to try this first. Is that a better approach?
"""]]

16
doc/forum/Help_with_get/comment_3_f523e44daca53b3d99350e0d3f7a8874._comment Normal file
View file

@ -0,0 +1,16 @@
[[!comment format=mdwn
username="jwrauch"
avatar="http://cdn.libravatar.org/avatar/0e83010187ef0c8c587e0c99e2ca5474"
subject="comment 3"
date="2021-02-19T16:17:33Z"
content="""
I ran the get command with the debug flag and the output is pretty extensive. It successfully transferred two files before it failed, so I'm posting from the 'ok' of the last success. Here is the command and output:
$ git annex get . --debug
...
ok
get recorder/2020-philippines/20200906_165152.mp4 (from avi...)
[2021-02-19 11:11:22.1489056] call: cp [\"--reflink=auto\",\"--preserve=timestamps\",\"E:\\video\\.git\\annex\\objects\\d88\\080\\SHA256E-s493726419--95dd6a377dce064935ab2e8c0dda2f3c4d9d2b33e0efaca34fceda200cbee249.mp4\\SHA256E-s493726419--95dd6a377dce064935ab2e8c0dda2f3c4d9d2b33e0efaca34fceda200cbee249.mp4\",\".git\\annex\\tmp\\SHA256E-s493726419--95dd6a377dce064935ab2e8c0dda2f3c4d9d2b33e0efaca34fceda200cbee249.mp4\"]
10% 46.12 MiB 87 MiB/s 4scp: error writing '.git\annex\tmp\SHA256E-s493726419--95dd6a377dce064935ab2e8c0dda2f3c4d9d2b33e0efaca34fceda200cbee249.mp4': Permission denied
"""]]

15
doc/forum/Help_with_get/comment_4_863d03a8e52335d8a210320d8a02c553._comment Normal file
View file

@ -0,0 +1,15 @@
[[!comment format=mdwn
username="jwrauch"
avatar="http://cdn.libravatar.org/avatar/0e83010187ef0c8c587e0c99e2ca5474"
subject="comment 4"
date="2021-02-19T16:19:52Z"
content="""
Sorry, formatting:
$ git annex get . --debug
ok
get recorder/2020-philippines/20200906_165152.mp4 (from avi...)
[2021-02-19 11:11:22.1489056] call: cp [\"--reflink=auto\",\"--preserve=timestamps\",\"E:\\video\\.git\\annex\\objects\\d88\\080\\SHA256E-s493726419--95dd6a377dce064935ab2e8c0dda2f3c4d9d2b33e0efaca34fceda200cbee249.mp4\\SHA256E- s493726419--95dd6a377dce064935ab2e8c0dda2f3c4d9d2b33e0efaca34fceda200cbee249.mp4\",\".git\\annex\\tmp\\SHA256E-s493726419--95dd6a377dce064935ab2e8c0dda2f3c4d9d2b33e0efaca34fceda200cbee249.mp4\"]
10% 46.12 MiB 87 MiB/s 4scp: error writing '.git\annex\tmp\SHA256E-s493726419--95dd6a377dce064935ab2e8c0dda2f3c4d9d2b33e0efaca34fceda200cbee249.mp4': Permission denied
"""]]

8
doc/forum/Help_with_get/comment_5_92e48d21fd83c0f7e69a5bb7b4c4f4ee._comment Normal file
View file

@ -0,0 +1,8 @@
[[!comment format=mdwn
username="jwrauch"
avatar="http://cdn.libravatar.org/avatar/0e83010187ef0c8c587e0c99e2ca5474"
subject="comment 5"
date="2021-02-19T18:58:14Z"
content="""
Okay, so it seems like it was my usb port. I tried plugging the drive into a different port and the whole repository copied over. I'd love to know more if anyone has more information about what was happening, but I think the issue is resolved for now.
"""]]

21
doc/forum/Rename_local_repository_for_git-annex-info/comment_2_a13ef241d6d24b4abee3eedff18032a8._comment Normal file
View file

@ -0,0 +1,21 @@
[[!comment format=mdwn
username="jodumont"
avatar="http://cdn.libravatar.org/avatar/343b334cbc4b2bff019ab6b525a2c9ed"
subject="how to rename/remove the [here] ??"
date="2021-02-19T04:56:46Z"
content="""
I'm able to change the description of my repo but not the name, which is by default and in that case **[here]**
> user@machine:/srv/data$ git-annex info
trusted repositories: 0
semitrusted repositories: 3
00000000-0000-0000-0000-000000000001 -- web
00000000-0000-0000-0000-000000000002 -- bittorrent
xxxxxxxx-xxx-xxxx-xxxx-xxxxxxxxxxxx -- sub.domain.tld:/srv/data **[here]**
untrusted repositories: xxx
transfers in progress: xxxx
available local disk space: 2.03 petabytes (+1 gigabyte reserved)
## How I could edit the name and/or name it properly when I init it ?
"""]]

8
doc/forum/Rename_local_repository_for_git-annex-info/comment_3_c75652b23bc4554d43593d1984c9c5d9._comment Normal file
View file

@ -0,0 +1,8 @@
[[!comment format=mdwn
username="Lukey"
avatar="http://cdn.libravatar.org/avatar/c7c08e2efd29c692cc017c4a4ca3406b"
subject="comment 3"
date="2021-02-19T07:28:12Z"
content="""
AFAIK, the `[here]` can't be changed, it just means \"it is this local repository\". Now, if you add another repository as a git remote, then it'll show `<description>[<name of git remote>]` for the git remote.
"""]]

15
doc/forum/Starting_assistant_from_CLI/comment_5_8d657646080bf2b99b7792993b877502._comment Normal file
View file

@ -0,0 +1,15 @@
[[!comment format=mdwn
username="jodumont"
avatar="http://cdn.libravatar.org/avatar/343b334cbc4b2bff019ab6b525a2c9ed"
subject="Explanation for a noGUI usage"
date="2021-02-19T04:39:34Z"
content="""
I had that issue, git-annex is installed on a noGUI remote machine so the directory and the file **~/.config/git-annex/autostart** didn't exist.
I think it worth to mention than you could create by hand **~/.config/git-annex/autostart**
> mkdir ~/.config/git-annex/; touch ~/.config/git-annex/autostart
and in simply add the path of your git-annex you want to start such as **/srv/data** for this example (*which contain a .git/annex/ directory*) then you are ready to go
> cd /srv/data; git annex assistant --autostart
"""]]

8
doc/git-annex-import/comment_2_e62b59d5c9cee04a77c51799624a3357._comment Normal file
View file

@ -0,0 +1,8 @@
[[!comment format=mdwn
username="Lukey"
avatar="http://cdn.libravatar.org/avatar/c7c08e2efd29c692cc017c4a4ca3406b"
subject="comment 2"
date="2021-02-19T07:16:25Z"
content="""
Yes, just `cp` or `mv` the files inside the repo and `git annex add` them as usual.
"""]]

22
doc/todo/optimization_needed__58___slow_uninit.mdwn Normal file
View file

@ -0,0 +1,22 @@
I am running `git annex uninit` on a quite heavy in number of annexed (text) files repository (can share a tarball if needed -- the product of https://github.com/con/tinuous/ to please those hating CI log navigation UIs ;-) ).
the box on which it runs is very IO busy ATM, but the fact that I saw no progress from `uninit` for almost 10 minutes made me look into:
```
$> px | grep -A7 git-anne[x]
yoh 30339 0.2 0.0 1074123060 38060 pts/4 Sl+ 11:49 0:01 | \_ /home/yoh/miniconda3/envs/tinuous/bin/git-annex uninit
yoh 30396 0.0 0.0 13892 5492 pts/4 S+ 11:49 0:00 | \_ git --git-dir=.git --work-tree=. --literal-pathspecs ls-files --stage -z --
yoh 30398 0.0 0.0 14720 2988 pts/4 S+ 11:49 0:00 | \_ git --git-dir=.git --work-tree=. --literal-pathspecs cat-file --batch-check=%(objectname) %(objecttype) %(objectsize) --buffer
yoh 30399 0.0 0.0 14848 4108 pts/4 S+ 11:49 0:00 | \_ git --git-dir=.git --work-tree=. --literal-pathspecs cat-file --batch=%(objectname) %(objecttype) %(objectsize) --buffer
yoh 30417 0.0 0.0 0 0 pts/4 Z+ 11:49 0:00 | \_ [git] <defunct>
yoh 30421 0.0 0.0 0 0 pts/4 Z+ 11:49 0:00 | \_ [git] <defunct>
yoh 27761 0.0 0.0 112028 6892 pts/4 D+ 11:51 0:00 | \_ git --git-dir=.git --work-tree=. --literal-pathspecs rm --cached --force --quiet -- 01/21/github/pr/UNK/5f6fe634a863281742c0eb7d238c111da6e2e52e/Test on macOS/758/test (brew)/5_Set up Python 3.6.txt
```
so `git annex` invokes separate `git rm` on each file. Having thousands of those is doomed to make it slow. Unfortunately I have not spotted a `--batch` mode in `git rm --help` but I wondered if may be at least multiple files could be requested to be removed in a single call instead of running that rm per each file?
git annex 8.20210127-g42239bc
[[!meta author=yoh]]
[[!tag projects/datalad]]