Merge branch 'master' of ssh://git-annex.branchable.com
This commit is contained in:
Joey Hess
commit
437402a8f2
6 changed files with 222 additions and 0 deletions
|
|
@ -0,0 +1,63 @@
|
|||
[[!comment format=mdwn
|
||||
username="https://www.google.com/accounts/o8/id?id=AItOawnSenxKyE_2Z6Wb-EBMO8FciyRywjx1ZiQ"
|
||||
nickname="Walter"
|
||||
subject="comment 2"
|
||||
date="2015-04-21T22:53:21Z"
|
||||
content="""
|
||||
It's in bucket ap-southeast-2, which conflicts with the info in the log below. I'm not sure why they disagree.
|
||||
|
||||
This was a new file, which I also \"uploaded\" with a ``git annex copy --to cloud test_file``, and ``git annex whereis`` says is in cloud. However, using ``s3cmd`` to retrieve it (using the info from the log below), it claims it doesn't exist (404). So, I don't think it got uploaded correctly. I don't seem to get any useful logs when forcing an upload with ``--debug`` (as in no S3-related logs, but I've included that at the very bottom).
|
||||
|
||||
[[!format sh \"\"\"
|
||||
> git annex get test_file
|
||||
get test_file (from cloud...)
|
||||
|
||||
Unable to access these remotes: cloud
|
||||
|
||||
Try making some of these repositories available:
|
||||
be992080-b1db-11e1-8f79-1b10bb4092ef -- [cloud]
|
||||
|
||||
(Note that these git remotes have annex-ignore set: origin)
|
||||
failed
|
||||
git-annex: get: 1 failed
|
||||
walter@kronos:~/NewPics$ git annex get test_file --debug
|
||||
[2015-04-21 23:39:57 BST] read: git [\"--git-dir=.git\",\"--work-tree=.\",\"--literal-pathspecs\",\"ls-files\",\"--cached\",\"-z\",\"--\",\"test_file\"]
|
||||
get test_file [2015-04-21 23:39:57 BST] read: git [\"--git-dir=.git\",\"--work-tree=.\",\"--literal-pathspecs\",\"show-ref\",\"git-annex\"]
|
||||
[2015-04-21 23:39:57 BST] read: git [\"--git-dir=.git\",\"--work-tree=.\",\"--literal-pathspecs\",\"show-ref\",\"--hash\",\"refs/heads/git-annex\"]
|
||||
[2015-04-21 23:39:57 BST] read: git [\"--git-dir=.git\",\"--work-tree=.\",\"--literal-pathspecs\",\"log\",\"refs/heads/git-annex..347f154f5dfa9e41dc459eda328421741e1e90a6\",\"-n1\",\"--pretty=%H\"]
|
||||
[2015-04-21 23:39:57 BST] read: git [\"--git-dir=.git\",\"--work-tree=.\",\"--literal-pathspecs\",\"log\",\"refs/heads/git-annex..83793925a571a3228cc64e204598f8c54203b1f7\",\"-n1\",\"--pretty=%H\"]
|
||||
[2015-04-21 23:39:57 BST] chat: git [\"--git-dir=.git\",\"--work-tree=.\",\"--literal-pathspecs\",\"cat-file\",\"--batch\"]
|
||||
(from cloud...) [2015-04-21 23:39:57 BST] chat: gpg [\"--batch\",\"--no-tty\",\"--use-agent\",\"--quiet\",\"--trust-model\",\"always\",\"--decrypt\"]
|
||||
|
||||
[2015-04-21 23:39:57 BST] String to sign: \"GET\n\n\nTue, 21 Apr 2015 22:39:57 GMT\n/BUCKETID/GPGHMACSHA1--417830f4c50a2887674917abd2c18c522853255a\"
|
||||
[2015-04-21 23:39:57 BST] Host: \"BUCKETID.s3-ap-southeast-1.amazonaws.com\"
|
||||
[2015-04-21 23:39:57 BST] Path: \"/GPGHMACSHA1--417830f4c50a2887674917abd2c18c522853255a\"
|
||||
[2015-04-21 23:39:57 BST] Query string: \"\"
|
||||
[2015-04-21 23:39:57 BST] Response status: Status {statusCode = 301, statusMessage = \"Moved Permanently\"}
|
||||
[2015-04-21 23:39:57 BST] Response header 'x-amz-request-id': 'C2825FBB20ED22B4'
|
||||
[2015-04-21 23:39:57 BST] Response header 'x-amz-id-2': 'I93feDTHOrPR+bwVqoMBuEEwYQAN7ZfjOq0jdIJ6ywzOPYYxTfqZg9OR+M0L+MFdilHKRJ+CEv8='
|
||||
[2015-04-21 23:39:57 BST] Response header 'Content-Type': 'application/xml'
|
||||
[2015-04-21 23:39:57 BST] Response header 'Transfer-Encoding': 'chunked'
|
||||
[2015-04-21 23:39:57 BST] Response header 'Date': 'Tue, 21 Apr 2015 22:39:56 GMT'
|
||||
[2015-04-21 23:39:57 BST] Response header 'Server': 'AmazonS3'
|
||||
[2015-04-21 23:39:57 BST] Response metadata: S3: request ID=C2825FBB20ED22B4, x-amz-id-2=I93feDTHOrPR+bwVqoMBuEEwYQAN7ZfjOq0jdIJ6ywzOPYYxTfqZg9OR+M0L+MFdilHKRJ+CEv8=
|
||||
|
||||
Unable to access these remotes: cloud
|
||||
|
||||
Try making some of these repositories available:
|
||||
be992080-b1db-11e1-8f79-1b10bb4092ef -- [cloud]
|
||||
|
||||
(Note that these git remotes have annex-ignore set: origin)
|
||||
failed
|
||||
git-annex: get: 1 failed
|
||||
|
||||
> git annex copy --to cloud --force --debug test_file
|
||||
[2015-04-21 23:47:24 BST] read: git [\"--git-dir=.git\",\"--work-tree=.\",\"--literal-pathspecs\",\"show-ref\",\"git-annex\"]
|
||||
[2015-04-21 23:47:24 BST] read: git [\"--git-dir=.git\",\"--work-tree=.\",\"--literal-pathspecs\",\"show-ref\",\"--hash\",\"refs/heads/git-annex\"]
|
||||
[2015-04-21 23:47:24 BST] read: git [\"--git-dir=.git\",\"--work-tree=.\",\"--literal-pathspecs\",\"log\",\"refs/heads/git-annex..347f154f5dfa9e41dc459eda328421741e1e90a6\",\"-n1\",\"--pretty=%H\"]
|
||||
[2015-04-21 23:47:24 BST] read: git [\"--git-dir=.git\",\"--work-tree=.\",\"--literal-pathspecs\",\"log\",\"refs/heads/git-annex..83793925a571a3228cc64e204598f8c54203b1f7\",\"-n1\",\"--pretty=%H\"]
|
||||
[2015-04-21 23:47:24 BST] chat: git [\"--git-dir=.git\",\"--work-tree=.\",\"--literal-pathspecs\",\"cat-file\",\"--batch\"]
|
||||
[2015-04-21 23:47:24 BST] read: git [\"--git-dir=.git\",\"--work-tree=.\",\"--literal-pathspecs\",\"ls-files\",\"--cached\",\"-z\",\"--\",\"test_file\"]
|
||||
|
||||
\"\"\"]]
|
||||
"""]]
|
||||
|
|
@ -0,0 +1,101 @@
|
|||
### Please describe the problem.
|
||||
|
||||
When adding a list of files, where some exist and some don't, annex claims to add some of the files until it encounters the first missing file. Then it bails out, leaving files hashed but not added.
|
||||
|
||||
### What steps will reproduce the problem?
|
||||
|
||||
Create a file, ask annex to add the file and a non-existant file
|
||||
|
||||
Expected and historic behavior: annex adds the file
|
||||
|
||||
Actual behavior: annex hashes but does not add the file
|
||||
|
||||
### What version of git-annex are you using? On what operating system?
|
||||
|
||||
git-annex version: 5.20150420-gb0ebb23
|
||||
standalone linux amd64
|
||||
|
||||
### Please provide any additional information below.
|
||||
|
||||
[[!format sh """
|
||||
# If you can, paste a complete transcript of the problem occurring here.
|
||||
# If the problem is with the git-annex assistant, paste in .git/annex/daemon.log
|
||||
|
||||
$ git annex version
|
||||
git-annex version: 5.20150420-gb0ebb23
|
||||
[ . . . ]
|
||||
|
||||
$ git init asdf
|
||||
Initialized empty Git repository in /tmp/asdf/.git/
|
||||
|
||||
$ cd asdf
|
||||
|
||||
$ git annex init
|
||||
init ok
|
||||
(recording state in git...)
|
||||
|
||||
$ touch asdf
|
||||
|
||||
$ git add asdf qwer
|
||||
fatal: pathspec 'qwer' did not match any files
|
||||
|
||||
$ git annex add asdf qwer
|
||||
add asdf ok
|
||||
git-annex: qwer not found
|
||||
|
||||
$ file * | sed -e 's/`.*//'
|
||||
asdf: symbolic link to
|
||||
|
||||
$ git status
|
||||
On branch master
|
||||
|
||||
Initial commit
|
||||
|
||||
Untracked files:
|
||||
(use "git add <file>..." to include in what will be committed)
|
||||
|
||||
asdf
|
||||
|
||||
nothing added to commit but untracked files present (use "git add" to track)
|
||||
|
||||
|
||||
# End of transcript or log.
|
||||
"""]]
|
||||
|
||||
Older version of git-annex:
|
||||
|
||||
[[!format sh """
|
||||
|
||||
$ git annex version
|
||||
git-annex version: 5.20140412ubuntu1
|
||||
[ . . . ]
|
||||
|
||||
$ git init asdf
|
||||
Initialized empty Git repository in /tmp/asdf/.git/
|
||||
|
||||
$ cd asdf
|
||||
|
||||
$ git annex init asdf
|
||||
init asdf ok
|
||||
(Recording state in git...)
|
||||
|
||||
$ touch asdf
|
||||
|
||||
$ git annex add asdf qwer
|
||||
add asdf ok
|
||||
git-annex: qwer not found
|
||||
(Recording state in git...)
|
||||
|
||||
$ file * | sed -e 's/`.*//'
|
||||
asdf: symbolic link to
|
||||
|
||||
$ git status
|
||||
On branch master
|
||||
|
||||
Initial commit
|
||||
|
||||
Changes to be committed:
|
||||
(use "git rm --cached <file>..." to unstage)
|
||||
|
||||
new file: asdf
|
||||
"""]]
|
||||
|
|
@ -0,0 +1,30 @@
|
|||
[[!comment format=mdwn
|
||||
username="clacke"
|
||||
subject="Inconsistent between batches of files"
|
||||
date="2015-04-22T12:56:42Z"
|
||||
content="""
|
||||
If you add enough files, annex gets past the first `(Recording state in git...)` and then breaks on only the last portion, so some files are added and some are only hashed:
|
||||
|
||||
[[!format sh \"\"\"
|
||||
$ touch {10000..20240} 20242
|
||||
|
||||
$ git annex add {10000..20242}
|
||||
[ . . . ]
|
||||
add 20240 ok
|
||||
(recording state in git...)
|
||||
add 20242 ok
|
||||
git-annex: 20241 not found
|
||||
|
||||
$ file 20240 20242 | sed -e 's/`.*//'
|
||||
20240: symbolic link to
|
||||
20242: symbolic link to
|
||||
|
||||
$ git status | tail -n 7
|
||||
new file: 20240
|
||||
|
||||
Untracked files:
|
||||
(use \"git add <file>...\" to include in what will be committed)
|
||||
|
||||
20242
|
||||
\"\"\"]]
|
||||
"""]]
|
||||
|
|
@ -0,0 +1,9 @@
|
|||
[[!comment format=mdwn
|
||||
username="clacke"
|
||||
subject="regression"
|
||||
date="2015-04-22T11:39:19Z"
|
||||
content="""
|
||||
The fix is a regression compared to previous behavior.
|
||||
|
||||
Being able to do `git annex add '*'.{JPG,jp{,e}g,AVI,avi,MOV,mov,3GP,3gp,mp4,tif,pdf,PDF,doc,pps,bmp,png,mp{,e}g,MP{,E}G,wav,WAV,nef,NEF,thm,THM,key.gz,ogg,OGG,ppt,GIF,gif,m4a}` in the root of my binary files archive to catch any newly copied files was a real feature. This worked until recently. I was just about to add a bug report stating the same problem as the OP for the OSX homebrew version, but I verified with the latest Linux standalone and there wildcards were completely turned off.
|
||||
"""]]
|
||||
|
|
@ -0,0 +1,11 @@
|
|||
[[!comment format=mdwn
|
||||
username="clacke"
|
||||
subject="workaround"
|
||||
date="2015-04-22T13:31:10Z"
|
||||
content="""
|
||||
This is a workaround to the missing functionality, generating an `--include` expression:
|
||||
|
||||
[[!format sh \"\"\"
|
||||
git annex add $(printf -- '--include=*.%s --or ' jp{,e}g avi mov 3gp mp4 tif pdf doc pps bmp png mp{,e}g wav nef thm key.gz ogg ppt gif) --include='*.m4a'
|
||||
\"\"\"]]
|
||||
"""]]
|
||||
|
|
@ -0,0 +1,8 @@
|
|||
[[!comment format=mdwn
|
||||
username="https://me.yahoo.com/a/wS4b1K9kooKjDS5nqjBuZsN4Czwko0ECcg--#2eff3"
|
||||
nickname="Markus"
|
||||
subject="comment 2"
|
||||
date="2015-04-22T10:47:26Z"
|
||||
content="""
|
||||
Thank you. I settled on using `present or (not inallgroup=backup) or (exclude=pictures/* and exclude=video/*)`, which seems to be doing what I want. The most important thing to me is that files are transferred to the backup group. Some files might be left in pictures/ or video/ on \"neon\", but I can drop those from time to time if disk space is low.
|
||||
"""]]
|
||||
Loading…
Reference in a new issue