Merge branch 'master' of ssh://git-annex.branchable.com

This commit is contained in:
Joey Hess 2015-04-20 11:08:54 -04:00
commit 1ca7fd481b
4 changed files with 88 additions and 0 deletions

View file

@ -0,0 +1,57 @@
### Please describe the problem.
I have lots of content stored in Amazon S3. Using git-annex from before commit 911ba8d972e4e7b151385d30c198598e1a0dfaca, I am able to ``git annex get`` from S3 and files are downloaded.
Using a more recent version (eg that commit, or the current master, or release 20150409), I am unable to download the content.
I'm not sure if my repo or remote is somehow misconfigured, or if there's something else going on here.
--Walter
### What steps will reproduce the problem?
Use a version of git-annex with s3-aws
### What version of git-annex are you using? On what operating system?
Debian, versions as above
### Please provide any additional information below.
[[!format sh """
# If you can, paste a complete transcript of the problem occurring here.
# If the problem is with the git-annex assistant, paste in .git/annex/daemon.log
git annex get . --from cloud --debug
[2015-04-19 22:23:37 BST] read: git ["--git-dir=../../../.git","--work-tree=../../..","--literal-pathspecs","show-ref","git-annex"]
[2015-04-19 22:23:37 BST] read: git ["--git-dir=../../../.git","--work-tree=../../..","--literal-pathspecs","show-ref","--hash","refs/heads/git-annex"]
[2015-04-19 22:23:37 BST] read: git ["--git-dir=../../../.git","--work-tree=../../..","--literal-pathspecs","log","refs/heads/git-annex..a51a912223d3d86f19762e387e3eae23c3024d2c","-n1","--pretty=%H"]
[2015-04-19 22:23:37 BST] chat: git ["--git-dir=../../../.git","--work-tree=../../..","--literal-pathspecs","cat-file","--batch"]
[2015-04-19 22:23:37 BST] read: git ["--git-dir=../../../.git","--work-tree=../../..","--literal-pathspecs","ls-files","--cached","-z","--","."]
get IMG_7079.JPG (from cloud...) [2015-04-19 22:23:37 BST] chat: gpg ["--batch","--no-tty","--use-agent","--quiet","--trust-model","always","--decrypt"]
failed
get IMG_7080.JPG (from cloud...)
failed
git annex info cloud
remote: cloud
description: [cloud]
uuid: be992080-b1db-11e1-8f79-1b10bb4092ef
trust: semitrusted
cost: 250.0
type: S3
creds: embedded in git repository (gpg encrypted)
bucket: ffffffffffffffffffffffffff
partsize: unlimited
encryption: encrypted (to gpg keys: FFFFFFFFFFFF) (hybrid mode)
chunking: none
remote annex keys: 0
remote annex size: 0 bytes
git annex fsck -f cloud
fsck IMG_6876.JPG (checking cloud...) (StatusCodeException (Status {statusCode = 301, statusMessage = "Moved Permanently"}) [("x-amz-request-id","275ADF5B1B77D514"),("x-amz-id-2","flWGBHOZYEZAohygAzBIZAYd7nBGkm3HpSMfJuhgRp3txXx20yJz7S4yRlNLwCs1cHUMyWc9JbA="),("Content-Type","application/xml"),("Transfer-Encoding","chunked"),("Date","Sun, 19 Apr 2015 22:23:15 GMT"),("Server","AmazonS3")] (CJ {expose = []})) failed
# End of transcript or log.
"""]]

View file

@ -0,0 +1,13 @@
[[!comment format=mdwn
username="CandyAngel"
subject="comment 3"
date="2015-04-19T15:51:45Z"
content="""
Have you tried checking out a commit which it was present in and then using whereis?
Not sure if you can do:
git annex whereis --key $KEY
But if not, may be worth a feature request!
"""]]

View file

@ -0,0 +1,6 @@
Given [this tip](https://git-annex.branchable.com/forum/__34__git_annex_sync__34___synced_after_8_hours/#comment-890ca1381d800ac833ccbb8c5db175ea), [this comment](https://git-annex.branchable.com/todo/wishlist:_rsync_efficiency/#comment-870ae805efd35343edefdbed792dac04) and possibly others, it would be nice if git-annex could look at any given repo and make suggestions for improvements. As a second step, it could look at remotes as well. And as a third, maybe even change repo settings and not just make suggestions.
Having a few old repos with terabytes of data on various disks, I would just toss this stanza into my mr templates to eventually optimize all my repos to current best practices.
-- Richard

View file

@ -0,0 +1,12 @@
[[!comment format=mdwn
username="https://www.google.com/accounts/o8/id?id=AItOawl9sYlePmv1xK-VvjBdN-5doOa_Xw-jH4U"
nickname="Richard"
subject="comment 2"
date="2015-04-20T14:37:03Z"
content="""
I read the blog after my time abroad and chuckled about the timing of my request, yah :)
Could git-annex reasonably detach generating the list of files to transfer from the actual transfer? That way, there is never a delay while git-annex looks for the next file.
Richard
"""]]