Merge branch 'master' of ssh://git-annex.branchable.com

This commit is contained in:
Joey Hess 2013-07-27 20:56:19 -04:00
commit 55bd5a81ad
19 changed files with 204 additions and 0 deletions

View file

@ -0,0 +1,9 @@
[[!comment format=mdwn
username="http://joeyh.name/"
ip="4.152.246.110"
subject="I can't reproduce this problem, but I see several people have reported it."
date="2013-07-27T22:11:15Z"
content="""
It would be helpful for anyone who can reproduce this problem to do so with debugging enabled on both sides
(run with --debug or turn it on in the Configuration page in webapp), and then send the `.git/annex/daemon.log`
"""]]

View file

@ -0,0 +1,10 @@
[[!comment format=mdwn
username="http://joeyh.name/"
ip="4.152.246.110"
subject="comment 2"
date="2013-07-28T00:27:23Z"
content="""
Remote mythbuntuserver.local_annex does not have git-annex installed; setting remote.mythbuntuserver.local_annex.annex-ignore
So, how did you install git-annex on mythbuntuserver? What does the `.ssh/authorized_keys` on mythbuntuserver look like? (In particular the key that git-annex adds to it, which should be set to run git-annex-shell.)
"""]]

View file

@ -0,0 +1,10 @@
[[!comment format=mdwn
username="http://joeyh.name/"
ip="4.152.246.110"
subject="comment 4"
date="2013-07-28T00:23:08Z"
content="""
Hmm, Adam your version is older than the bug reporter's version. OTOH, while there were several FD leak fixes after your version, none of them were to Annex.LockPool, which is what's used for the ssh lock files.
I can't reproduce it with `git annex get` and the current release.. can you?
"""]]

View file

@ -0,0 +1,17 @@
[[!comment format=mdwn
username="http://joeyh.name/"
ip="4.152.246.110"
subject="comment 3"
date="2013-07-27T22:39:12Z"
content="""
The --from is the missing piece to reproduce:
[[!format sh \"\"\"
joey@gnu:~/tmp/old/mydir2>git annex get disk2 --from origin
joey@gnu:~/tmp/old/mydir2>
\"\"\"]]
What's going on here is that `get --from` is essentially an alias to `copy --from`, and that skips copying files that it knows are not present on the remote. Since the remote is a local directory, it's inexpensive for it to check if the file is really there, rather than relying on the location log.
This seems suboptimal, but I'm not sure which part of the behavior it makes sense to change. It seems nice for `copy --from` to silently skip files that the remote does not have, to avoid much unnecessary output when processing a lot of files. Maybe `get --from` should behave differently?
"""]]

View file

@ -0,0 +1,8 @@
[[!comment format=mdwn
username="http://joeyh.name/"
ip="4.152.246.110"
subject="comment 4"
date="2013-07-27T22:40:58Z"
content="""
I should add that it also seems to make sense to stat the file to see if it's present, like it does now. The location log can be out of date, and when more accurate info is right there, it should use it. And nor is the location log being out of date something that it should complain about, because it can easily happen eg when `git annex sync` has not been run recently.
"""]]

View file

@ -0,0 +1,18 @@
[[!comment format=mdwn
username="http://joeyh.name/"
ip="4.152.246.110"
subject="comment 11"
date="2013-07-28T00:06:53Z"
content="""
From the log on bang:
<pre>
[2013-07-27 00:33:15 PDT] read: ssh [\"-S\",\"/home/drewp/annex2/.git/annex/ssh/drewp@git-annex-dash.local-drewp_annex2\",\"-o\",\"ControlMaster=auto\",\"-o\",\"ControlPersist=yes\",\"-T\",\"drewp@git-annex-dash.local-drewp_annex2\",\"git-annex-shell 'configlist' '/~/annex2/'\"]
zsh:1: command not found: git-annex-shell
Remote dash.local_annex2 does not have git-annex installed; setting remote.dash.local_annex2.annex-ignore
</pre>
You said you're running from the standalone tarball. I think that's the problem, probably if you get git-annex-shell into your path it'll just work.
Can you paste the line git-annex added to \"dash\"'s .ssh/authorized_keys?
"""]]

View file

@ -0,0 +1,10 @@
[[!comment format=mdwn
username="http://joeyh.name/"
ip="4.152.246.110"
subject="comment 3"
date="2013-07-27T23:51:38Z"
content="""
uninit does not do this. Nor does unannex --fast FWIW.
"""]]

View file

@ -0,0 +1,8 @@
[[!comment format=mdwn
username="http://joeyh.name/"
ip="4.152.246.110"
subject="comment 2"
date="2013-07-28T00:21:39Z"
content="""
A few people have suggested that idea. I don't know if I want to get into the HW business.
"""]]

View file

@ -0,0 +1,8 @@
[[!comment format=mdwn
username="http://joeyh.name/"
ip="4.152.246.110"
subject="comment 1"
date="2013-07-27T22:13:49Z"
content="""
Since 2012 git-annex has had massive improvements to its Jabber support. See [[/install/Ubuntu]] to get a current version.
"""]]

View file

@ -0,0 +1,13 @@
[[!comment format=mdwn
username="http://joeyh.name/"
ip="4.152.246.110"
subject="comment 1"
date="2013-07-28T00:09:45Z"
content="""
Run:
`git annex get $file`
`git annex unannex $file`
$file will now be back how it was before you used git-annex. Can also run above on whole directories.
"""]]

View file

@ -0,0 +1,14 @@
I have an encrypted S3 remote with which I recently ran:
$> git annex move . --from cloud
which moved all my files to the local repo. When I looked at my S3 bucket, I saw some files left. I then ran:
$> git annex unused --from cloud
to get all the unused data. I dropped each unused data from cloud so that now I think git annex believes it has nothing on the cloud remote.
However there is still one file left on the bucket. Is this normal? (if not I'll create a bug report)
More importantly, how can I decrypt this file so I can run git log -S'KEY' to figure out what it is (I want to make sure I haven't lost any data).
To be clear, when I currently run 'git annex move . --from cloud' it moves nothing and when I run 'git annex unused --from cloud' it reports no unused data.

View file

@ -0,0 +1,8 @@
[[!comment format=mdwn
username="https://www.google.com/accounts/o8/id?id=AItOawkiAsTXFXZbLE8iyy6yDtvz4MPFbzsk3c0"
nickname="Tony"
subject="comment 1"
date="2013-07-27T22:14:11Z"
content="""
one more thing, I forgot to mention I use gpg keys for encryption on the remote and not a shared key.
"""]]

View file

@ -0,0 +1,14 @@
[[!comment format=mdwn
username="http://joeyh.name/"
ip="4.152.246.110"
subject="comment 2"
date="2013-07-27T22:30:50Z"
content="""
I suppose this could happen if you have a tag or a branch or another repository that still refers to the file that's stored in S3. It would then not be found by `unused`.
git-annex 4.20130709 has a nice new --all switch you can use: `git annex move --all --from cloud`
If that doesn't move the file, nothing in the entire history of the git repository refers to it. The question then would be how did that file get there.
It's by [[design|design/encryption]] not possible to get from the name of an encrypted file back to the key, unless you already know all the possible keys that the file could be. It's possible to decrypt the content if you have the gpg key and the git repository, but this space is a bit too small to explain every step in doing so, and I have some nice code that explains how in detail. ;)
"""]]

View file

@ -0,0 +1,12 @@
[[!comment format=mdwn
username="https://www.google.com/accounts/o8/id?id=AItOawkiAsTXFXZbLE8iyy6yDtvz4MPFbzsk3c0"
nickname="Tony"
subject="comment 3"
date="2013-07-27T22:47:14Z"
content="""
thanks, running
'git annex move --all --from cloud'
grabbed the one remaining file from the bucket.
"""]]

View file

@ -0,0 +1,8 @@
[[!comment format=mdwn
username="http://joeyh.name/"
ip="4.152.246.110"
subject="comment 4"
date="2013-07-27T22:52:00Z"
content="""
Great! And it should have also printed out the key it downloaded, if you're curious about looking where that file is used in your git repository.
"""]]

View file

@ -0,0 +1,8 @@
[[!comment format=mdwn
username="https://www.google.com/accounts/o8/id?id=AItOawkiAsTXFXZbLE8iyy6yDtvz4MPFbzsk3c0"
nickname="Tony"
subject="comment 5"
date="2013-07-27T23:02:19Z"
content="""
yeah it did print out the name of the file so I was able to verify that it was nothing I was worried about losing. thanks again :D
"""]]

View file

@ -0,0 +1,8 @@
[[!comment format=mdwn
username="http://joeyh.name/"
ip="4.152.246.110"
subject="comment 6"
date="2013-07-27T23:06:38Z"
content="""
I'm curious, why didn't `git annex unused --from cloud` show the file? Was it a tag/branch/etc still referring to it?
"""]]

View file

@ -0,0 +1,13 @@
[[!comment format=mdwn
username="https://www.google.com/accounts/o8/id?id=AItOawnljkMF1zhScDfvJYMhXXubnar_DakLoas"
nickname="Tony"
subject="broken under 4.3?"
date="2013-07-28T00:36:51Z"
content="""
Things seem broken under the recently released 4.3 release for nexus devices:
>Falling back to hardcoded app location; cannot find expected files in /data/app-lib
>u0_a33@mako:/sdcard/git-annex.home $ git annex webapp
>CANNOT LINK EXECUTABLE: git-annex invalid R_ARM_COPY relocation against DT_SYMBOLIC shared library libc.so (built. with -Bsymbolic?)
>1|u0_a33@mako:/sdcard/git-annex.home $
"""]]

View file

@ -0,0 +1,8 @@
[[!comment format=mdwn
username="http://joeyh.name/"
ip="4.152.246.110"
subject="comment 6"
date="2013-07-28T00:11:38Z"
content="""
The first example on this page shows using rsync:// to store files on a system using the rsync daemon.
"""]]