Merge branch 'master' of ssh://git-annex.branchable.com
This commit is contained in:
commit
1ca7fd481b
4 changed files with 88 additions and 0 deletions
|
@ -0,0 +1,57 @@
|
||||||
|
### Please describe the problem.
|
||||||
|
I have lots of content stored in Amazon S3. Using git-annex from before commit 911ba8d972e4e7b151385d30c198598e1a0dfaca, I am able to ``git annex get`` from S3 and files are downloaded.
|
||||||
|
Using a more recent version (eg that commit, or the current master, or release 20150409), I am unable to download the content.
|
||||||
|
|
||||||
|
I'm not sure if my repo or remote is somehow misconfigured, or if there's something else going on here.
|
||||||
|
|
||||||
|
--Walter
|
||||||
|
|
||||||
|
### What steps will reproduce the problem?
|
||||||
|
Use a version of git-annex with s3-aws
|
||||||
|
|
||||||
|
### What version of git-annex are you using? On what operating system?
|
||||||
|
Debian, versions as above
|
||||||
|
|
||||||
|
### Please provide any additional information below.
|
||||||
|
|
||||||
|
[[!format sh """
|
||||||
|
# If you can, paste a complete transcript of the problem occurring here.
|
||||||
|
# If the problem is with the git-annex assistant, paste in .git/annex/daemon.log
|
||||||
|
|
||||||
|
git annex get . --from cloud --debug
|
||||||
|
[2015-04-19 22:23:37 BST] read: git ["--git-dir=../../../.git","--work-tree=../../..","--literal-pathspecs","show-ref","git-annex"]
|
||||||
|
[2015-04-19 22:23:37 BST] read: git ["--git-dir=../../../.git","--work-tree=../../..","--literal-pathspecs","show-ref","--hash","refs/heads/git-annex"]
|
||||||
|
[2015-04-19 22:23:37 BST] read: git ["--git-dir=../../../.git","--work-tree=../../..","--literal-pathspecs","log","refs/heads/git-annex..a51a912223d3d86f19762e387e3eae23c3024d2c","-n1","--pretty=%H"]
|
||||||
|
[2015-04-19 22:23:37 BST] chat: git ["--git-dir=../../../.git","--work-tree=../../..","--literal-pathspecs","cat-file","--batch"]
|
||||||
|
[2015-04-19 22:23:37 BST] read: git ["--git-dir=../../../.git","--work-tree=../../..","--literal-pathspecs","ls-files","--cached","-z","--","."]
|
||||||
|
get IMG_7079.JPG (from cloud...) [2015-04-19 22:23:37 BST] chat: gpg ["--batch","--no-tty","--use-agent","--quiet","--trust-model","always","--decrypt"]
|
||||||
|
|
||||||
|
failed
|
||||||
|
get IMG_7080.JPG (from cloud...)
|
||||||
|
failed
|
||||||
|
|
||||||
|
|
||||||
|
|
||||||
|
git annex info cloud
|
||||||
|
remote: cloud
|
||||||
|
description: [cloud]
|
||||||
|
uuid: be992080-b1db-11e1-8f79-1b10bb4092ef
|
||||||
|
trust: semitrusted
|
||||||
|
cost: 250.0
|
||||||
|
type: S3
|
||||||
|
creds: embedded in git repository (gpg encrypted)
|
||||||
|
bucket: ffffffffffffffffffffffffff
|
||||||
|
partsize: unlimited
|
||||||
|
encryption: encrypted (to gpg keys: FFFFFFFFFFFF) (hybrid mode)
|
||||||
|
chunking: none
|
||||||
|
remote annex keys: 0
|
||||||
|
remote annex size: 0 bytes
|
||||||
|
|
||||||
|
|
||||||
|
git annex fsck -f cloud
|
||||||
|
fsck IMG_6876.JPG (checking cloud...) (StatusCodeException (Status {statusCode = 301, statusMessage = "Moved Permanently"}) [("x-amz-request-id","275ADF5B1B77D514"),("x-amz-id-2","flWGBHOZYEZAohygAzBIZAYd7nBGkm3HpSMfJuhgRp3txXx20yJz7S4yRlNLwCs1cHUMyWc9JbA="),("Content-Type","application/xml"),("Transfer-Encoding","chunked"),("Date","Sun, 19 Apr 2015 22:23:15 GMT"),("Server","AmazonS3")] (CJ {expose = []})) failed
|
||||||
|
|
||||||
|
|
||||||
|
|
||||||
|
# End of transcript or log.
|
||||||
|
"""]]
|
|
@ -0,0 +1,13 @@
|
||||||
|
[[!comment format=mdwn
|
||||||
|
username="CandyAngel"
|
||||||
|
subject="comment 3"
|
||||||
|
date="2015-04-19T15:51:45Z"
|
||||||
|
content="""
|
||||||
|
Have you tried checking out a commit which it was present in and then using whereis?
|
||||||
|
|
||||||
|
Not sure if you can do:
|
||||||
|
|
||||||
|
git annex whereis --key $KEY
|
||||||
|
|
||||||
|
But if not, may be worth a feature request!
|
||||||
|
"""]]
|
6
doc/todo/wishlist:___96__git_annex_optimize__96__.mdwn
Normal file
6
doc/todo/wishlist:___96__git_annex_optimize__96__.mdwn
Normal file
|
@ -0,0 +1,6 @@
|
||||||
|
Given [this tip](https://git-annex.branchable.com/forum/__34__git_annex_sync__34___synced_after_8_hours/#comment-890ca1381d800ac833ccbb8c5db175ea), [this comment](https://git-annex.branchable.com/todo/wishlist:_rsync_efficiency/#comment-870ae805efd35343edefdbed792dac04) and possibly others, it would be nice if git-annex could look at any given repo and make suggestions for improvements. As a second step, it could look at remotes as well. And as a third, maybe even change repo settings and not just make suggestions.
|
||||||
|
|
||||||
|
Having a few old repos with terabytes of data on various disks, I would just toss this stanza into my mr templates to eventually optimize all my repos to current best practices.
|
||||||
|
|
||||||
|
|
||||||
|
-- Richard
|
|
@ -0,0 +1,12 @@
|
||||||
|
[[!comment format=mdwn
|
||||||
|
username="https://www.google.com/accounts/o8/id?id=AItOawl9sYlePmv1xK-VvjBdN-5doOa_Xw-jH4U"
|
||||||
|
nickname="Richard"
|
||||||
|
subject="comment 2"
|
||||||
|
date="2015-04-20T14:37:03Z"
|
||||||
|
content="""
|
||||||
|
I read the blog after my time abroad and chuckled about the timing of my request, yah :)
|
||||||
|
|
||||||
|
Could git-annex reasonably detach generating the list of files to transfer from the actual transfer? That way, there is never a delay while git-annex looks for the next file.
|
||||||
|
|
||||||
|
Richard
|
||||||
|
"""]]
|
Loading…
Reference in a new issue