Merge branch 'master' of ssh://git-annex.branchable.com
This commit is contained in:
Joey Hess
commit
39a479fc8d
21 changed files with 260 additions and 0 deletions
|
|
@ -0,0 +1,22 @@
|
|||
### Please describe the problem.
|
||||
When I try to add a box.com cloud repository with the encryption option selected, I get an error that says "internal server error".
|
||||
|
||||
### What steps will reproduce the problem?
|
||||
Anytime I try to set up a cloud repository with box.com (and presumably others, since this seems to be a problem with gpg (see log)) that is encrypted, I get this error.
|
||||
|
||||
|
||||
### What version of git-annex are you using? On what operating system?
|
||||
The operating system is Mac OS X 10.8.4, and the version of git-annex is 4.20130801-gc88bbc4.
|
||||
|
||||
|
||||
### Please provide any additional information below.
|
||||
|
||||
[[!format sh """
|
||||
# If you can, paste a complete transcript of the problem occurring here.
|
||||
# If the problem is with the git-annex assistant, paste in .git/annex/daemon.log
|
||||
|
||||
(encryption setup) gpg: /Users/adamliter/.gnupg/gpg.conf:233: invalid auto-key-locate list
|
||||
30/Aug/2013:02:27:11 -0400 [Error#yesod-core] user error (gpg ["--quiet","--trust-model","always","--gen-random","--armor","1","512"] exited 2) @(yesod-core-1.1.8.3:Yesod.Internal.Core ./Yesod/Internal/Core.hs:550:5)
|
||||
|
||||
# End of transcript or log.
|
||||
"""]]
|
||||
|
|
@ -0,0 +1,10 @@
|
|||
[[!comment format=mdwn
|
||||
username="guilhem"
|
||||
ip="129.16.20.209"
|
||||
subject="comment 1"
|
||||
date="2013-08-30T11:39:51Z"
|
||||
content="""
|
||||
gpg complains about an invalid parameter for the `auto-key-locate` option, which is not passed by git-annex but found in your gpg.conf.
|
||||
|
||||
What is on line 233 of `/Users/adamliter/.gnupg/gpg.conf`?
|
||||
"""]]
|
||||
|
|
@ -0,0 +1,8 @@
|
|||
[[!comment format=mdwn
|
||||
username="https://www.google.com/accounts/o8/id?id=AItOawkgH7oNEqNbh3g-N1-UHXuqleXaRYDgj1U"
|
||||
nickname="Adam"
|
||||
subject="comment 2"
|
||||
date="2013-08-30T15:39:16Z"
|
||||
content="""
|
||||
\"auto-key-locate cert pka ldap hkp://keys.gnupg.net\" is on line 233
|
||||
"""]]
|
||||
|
|
@ -0,0 +1,16 @@
|
|||
[[!comment format=mdwn
|
||||
username="guilhem"
|
||||
ip="129.16.20.209"
|
||||
subject="comment 3"
|
||||
date="2013-08-30T16:09:58Z"
|
||||
content="""
|
||||
Hmm, it looks like a perfectly valid list. Interesting.
|
||||
But regardless, gpg doesn't seem to like that line; what gpg version
|
||||
are you using? Also, does it work directly on the command-line
|
||||
(`gpg -a --gen-random 1 1`)?
|
||||
|
||||
Have you tried to setup the remote without that line in the gpg.conf? Of
|
||||
course it wouldn't solve the core of the issue, but it's irrelevant for
|
||||
random data generation anyway (the same goes for `--trust-model`);
|
||||
perhaps this very command should be run with `--no-options`.
|
||||
"""]]
|
||||
|
|
@ -0,0 +1,12 @@
|
|||
[[!comment format=mdwn
|
||||
username="https://www.google.com/accounts/o8/id?id=AItOawkgH7oNEqNbh3g-N1-UHXuqleXaRYDgj1U"
|
||||
nickname="Adam"
|
||||
subject="comment 4"
|
||||
date="2013-08-30T21:39:26Z"
|
||||
content="""
|
||||
`gpg -a --gen-random 1 1` on the command line seems to work. At least, when I just ran it it returned `Xg==`. I'm not super familiar with running gpg on the command line, so I'm not sure if that is the desired result when running that.
|
||||
|
||||
The version of gpg is GnuPG/MacGPG2 version 2.0.20.
|
||||
|
||||
I just tried deleting that line from the config file, and now it worked. Would I be able to replace the line after setting up the repository, or is that going to create problems? I'm not entirely sure what that line does, and I'm a little wary about messing with it in case it breaks the functionality of any of the other things that I use gpg for, like email encryption.
|
||||
"""]]
|
||||
|
|
@ -0,0 +1,13 @@
|
|||
[[!comment format=mdwn
|
||||
username="guilhem"
|
||||
ip="129.16.20.209"
|
||||
subject="comment 5"
|
||||
date="2013-08-30T22:51:56Z"
|
||||
content="""
|
||||
OK (you just generated 1 byte of base64-encoded random data).
|
||||
No, I'm afraid git-annex will croak for each operation using gpg on your remote (which includes get, push, fsck, ...).
|
||||
|
||||
This lines specifies how gpg automatically retrieves public keys when you get a signed message for instance. If you don't want to mix configurations, it is easy to create a git-annex-specific GnuPG home directory, but it requires you to point the `GNUPGHOME` to this alternative directory before starting git-annex.
|
||||
|
||||
That said, other MacOSX users have encountered the same problem, and it was [[reported_to_be_solved_recently|/bugs/internal_server_error_when_choosing_encrypted_rsync_repo_option/]].
|
||||
"""]]
|
||||
|
|
@ -0,0 +1,10 @@
|
|||
[[!comment format=mdwn
|
||||
username="https://me.yahoo.com/a/2grhJvAC049fJnvALDXek.6MRZMTlg--#eec89"
|
||||
nickname="John"
|
||||
subject="comment 9"
|
||||
date="2013-08-30T05:59:28Z"
|
||||
content="""
|
||||
I'll chime in and say that the non-fast behavior being the default seems wrong, and making hard-link invisibly seems wrong. What Joey proposed -- copying a file if there are multiple hard-links -- seems like the right solution.
|
||||
|
||||
Just recently I tried to unannex a large repository and was bitten by now-dangling symlinks to files that I couldn't locate anymore. The fact is that the current unannex operation is too dangerous to be useful.
|
||||
"""]]
|
||||
|
|
@ -0,0 +1,8 @@
|
|||
[[!comment format=mdwn
|
||||
username="https://me.yahoo.com/a/2grhJvAC049fJnvALDXek.6MRZMTlg--#eec89"
|
||||
nickname="John"
|
||||
subject="comment 6"
|
||||
date="2013-08-30T04:19:57Z"
|
||||
content="""
|
||||
Just saw it happen again today, in a repository that passed \"fsck -A\" multiple times just yesterday. What is going on?
|
||||
"""]]
|
||||
|
|
@ -0,0 +1,14 @@
|
|||
[[!comment format=mdwn
|
||||
username="https://me.yahoo.com/a/2grhJvAC049fJnvALDXek.6MRZMTlg--#eec89"
|
||||
nickname="John"
|
||||
subject="comment 7"
|
||||
date="2013-08-30T04:25:45Z"
|
||||
content="""
|
||||
I tried your suggestion of cloning the repository and moving `.git/config` and `.git/annex`, and got this:
|
||||
|
||||
fsck Astronomy/12_ATM_2.jpg error: invalid object 100644 06f8fe222f052100101e5c2e77640f2ec3efff98 for '002/0a6/SHA256E-s427690--03aeabcde841b66168b72de80098d74e047f3ffc832d4bbefa1f2f70ee6c92f8.jpg.log'
|
||||
fatal: git-write-tree: error building trees
|
||||
git-annex: failed to read sha from git write-tree
|
||||
|
||||
What else can I try? Note that I can't even find this `.log` anywhere under my `.git` directory for this repository.
|
||||
"""]]
|
||||
|
|
@ -0,0 +1,8 @@
|
|||
[[!comment format=mdwn
|
||||
username="https://me.yahoo.com/a/2grhJvAC049fJnvALDXek.6MRZMTlg--#eec89"
|
||||
nickname="John"
|
||||
subject="comment 8"
|
||||
date="2013-08-30T04:30:14Z"
|
||||
content="""
|
||||
The only thing that worked was nuking `.git/annex/index` and letting `git-annex sync` rebuild it.
|
||||
"""]]
|
||||
|
|
@ -0,0 +1,14 @@
|
|||
[[!comment format=mdwn
|
||||
username="https://me.yahoo.com/a/2grhJvAC049fJnvALDXek.6MRZMTlg--#eec89"
|
||||
nickname="John"
|
||||
subject="comment 9"
|
||||
date="2013-08-30T06:20:58Z"
|
||||
content="""
|
||||
And yet again it happens:
|
||||
|
||||
error: invalid object 100644 3edb1d4a44ffba1ea1491693ae7d9faa82aad717 for '000/4ce/SHA256E-s175006724--a0edc4f880223028b3fa3a27b142c8e027ddf66db973b8272ca845a4a9e01d3e.mp4.log' fatal: git-write-tree: error building trees
|
||||
|
||||
This was in a repository that was working perfectly well until I tried to `git-annex get`. The weird thing is that I don't even have any `SHA256E` files anymore.
|
||||
|
||||
I think that after my recent migration, none of my repositories can be trusted. This is just happening too often (more than 10 times in the last week, across many repositories on many machines). I will just rebuild them all. But I do wish git-annex was more resilient about this.
|
||||
"""]]
|
||||
|
|
@ -0,0 +1,8 @@
|
|||
[[!comment format=mdwn
|
||||
username="https://www.google.com/accounts/o8/id?id=AItOawlYsjf5dcZnzs0b9EPxnjVddx1rnrpZASs"
|
||||
nickname="Duarte"
|
||||
subject="Any news?"
|
||||
date="2013-08-31T15:48:39Z"
|
||||
content="""
|
||||
Has anyone made any progress on this? Just wondering...
|
||||
"""]]
|
||||
|
|
@ -0,0 +1,8 @@
|
|||
[[!comment format=mdwn
|
||||
username="http://pnijjar.livejournal.com/"
|
||||
ip="99.236.22.229"
|
||||
subject="comment 1"
|
||||
date="2013-08-31T00:05:16Z"
|
||||
content="""
|
||||
Do we need to update our RSS feeds? I appear to be getting your devblog posts in my old feed, but I do not know whether that will continue working.
|
||||
"""]]
|
||||
|
|
@ -0,0 +1,10 @@
|
|||
[[!comment format=mdwn
|
||||
username="https://www.google.com/accounts/o8/id?id=AItOawmkBwMWvNKZZCge_YqobCSILPMeK6xbFw8"
|
||||
nickname="develop"
|
||||
subject="comment 2"
|
||||
date="2013-08-31T10:03:04Z"
|
||||
content="""
|
||||
The old RSS feed will continue working.
|
||||
|
||||
So sit back, relax, and enjoy the show.
|
||||
"""]]
|
||||
|
|
@ -0,0 +1,10 @@
|
|||
[[!comment format=mdwn
|
||||
username="https://me.yahoo.com/a/2grhJvAC049fJnvALDXek.6MRZMTlg--#eec89"
|
||||
nickname="John"
|
||||
subject="comment 4"
|
||||
date="2013-08-30T06:06:16Z"
|
||||
content="""
|
||||
Just to confirm, this wasn't a git-annex problem at all, but just a misstep during migration as you suggested.
|
||||
|
||||
I think what I'm going to do now is to just wipe the slate clean and start over again, by using `unannex -fast` on all the files, wiping `.git`, and then adding everything back in using my new default backend of SHA512E. The bigger pain is doing the same thing on all the servers where I have this data (to avoid having to upload it again), but in such a way that I'm not replicating file history. I think I should be able to just clone, `mv $OLDREPO/.git/annex/objects objects`, `git annex add objects`, `git rm -r --cached objects`, and then everything should be good without even needing a new commit on the remote machine, just a git-annex sync.
|
||||
"""]]
|
||||
|
|
@ -0,0 +1,14 @@
|
|||
Hello,
|
||||
|
||||
I want to be safe and have two copies of my files on two different backend. Currently I only have a SSH backend, that stores all my data. I have full(root) access to that machine/backend. On my laptop I have only a few bytes of data, because all is moved/copied to that SSH backend. Now, I want to duplicate the data on the SSH backend to a Google Drive account (or any other). How could I do that (without downloading all data from the SSH backend)??? Encryption is not a must.
|
||||
|
||||
I looked into the annex/objects folder on the SSH backend, but there are 3 char length directories compared to what I see on a test Google Drive backend, where only 2 char length directory names are.
|
||||
|
||||
Example SSH backend: [git-annex root]/annex/objects/c10/90a/SHA256E-s445227--14c3f85d6dd3464f116f6a5bbd411012781d36794549d136b18d1914c4158820.jpg/SHA256E-s445227--14c3f85d6dd3464f116f6a5bbd411012781d36794549d136b18d1914c4158820.jpg
|
||||
|
||||
Example Google Drive: [Google Drive root]/annex/W7/xQ/SHA256E-s913904--29f9800b0dd34d4200c4e9ee152b79c3556a9a473848720be7cf83d20eff65a4.JPG
|
||||
|
||||
Is there a way to convert these directory names and do a simpe copy???
|
||||
|
||||
Thank you,
|
||||
Bence
|
||||
|
|
@ -0,0 +1,8 @@
|
|||
[[!comment format=mdwn
|
||||
username="https://me.yahoo.com/a/2grhJvAC049fJnvALDXek.6MRZMTlg--#eec89"
|
||||
nickname="John"
|
||||
subject="comment 2"
|
||||
date="2013-08-30T06:18:42Z"
|
||||
content="""
|
||||
This was answered quite thoroughly in:http://git-annex.branchable.com/forum/safely_dropping_git-annex_history/
|
||||
"""]]
|
||||
|
|
@ -0,0 +1,39 @@
|
|||
[[!comment format=mdwn
|
||||
username="http://sunny256.sunbase.org/"
|
||||
nickname="sunny256"
|
||||
subject="comment 3"
|
||||
date="2013-08-30T11:43:44Z"
|
||||
content="""
|
||||
Hm, commit 82de1ed1a3 doesn't exist here after git-annex sync. This is the output from another computer, running Linux Mint 15:
|
||||
|
||||
$ ga sync
|
||||
commit
|
||||
ok
|
||||
pull linode
|
||||
ok
|
||||
pull kitenet
|
||||
WARNING: gnome-keyring:: couldn't connect to: /run/user/sunny/keyring-WSsS6N/pkcs11: No such file or directory
|
||||
ok
|
||||
push linode
|
||||
Everything up-to-date
|
||||
ok
|
||||
push kitenet
|
||||
WARNING: gnome-keyring:: couldn't connect to: /run/user/sunny/keyring-WSsS6N/pkcs11: No such file or directory
|
||||
WARNING: gnome-keyring:: couldn't connect to: /run/user/sunny/keyring-WSsS6N/pkcs11: No such file or directory
|
||||
error: Cannot access URL http://downloads.kitenet.net/.git/, return code 22
|
||||
fatal: git-http-push failed
|
||||
failed
|
||||
git-annex: sync: 1 failed
|
||||
$ git log -1
|
||||
commit e4d2f03d9b37b2fac9508bf755ff7619bf46590c (HEAD, linode/synced/master, linode/master, linode/HEAD, kitenet/synced/master, kitenet/master, synced/master, master)
|
||||
Author: Joey Hess <joey@kitenet.net>
|
||||
Date: 3 weeks ago
|
||||
|
||||
update
|
||||
2013-08-30 13:36:37 sunny@passp:~/src/other/annex/downloads.kitenet.net/git-annex (master u=)
|
||||
$ git log 82de1ed1a354e389bc71a15af1a3e67b5bd56f23
|
||||
fatal: bad object 82de1ed1a354e389bc71a15af1a3e67b5bd56f23
|
||||
|
||||
There's some warnings from gnome-keyring and a failed push (sorry about that, happens automatically), but the fetch from kitenet seems to succeed.
|
||||
|
||||
"""]]
|
||||
|
|
@ -0,0 +1,8 @@
|
|||
[[!comment format=mdwn
|
||||
username="http://sunny256.sunbase.org/"
|
||||
nickname="sunny256"
|
||||
subject="comment 4"
|
||||
date="2013-08-30T11:49:20Z"
|
||||
content="""
|
||||
And some additional info, I'm using `http://downloads.kitenet.net/.git/` as the address to your annex. Maybe this repo is missing a `git update-server-info` in the `post-update` hook or something.
|
||||
"""]]
|
||||
|
|
@ -0,0 +1,12 @@
|
|||
[[!comment format=mdwn
|
||||
username="https://www.google.com/accounts/o8/id?id=AItOawmTNrhkVQ26GBLaLD5-zNuEiR8syTj4mI8"
|
||||
nickname="Juan"
|
||||
subject="comment 10"
|
||||
date="2013-08-31T18:20:58Z"
|
||||
content="""
|
||||
I'm already spreading the word. Handling scientific papers, data, simulations and code has been quite a challenge during my academic career. While code was solved long ago, the three first items remained a huge problem.
|
||||
I'm sure many of my colleagues will be happy to use it.
|
||||
Is there any hashtag or twitter account? I've seen that you collected some of my tweets, but I don't know how you did it. Did you search for git-annex?
|
||||
Best,
|
||||
Juan
|
||||
"""]]
|
||||
|
|
@ -0,0 +1,8 @@
|
|||
[[!comment format=mdwn
|
||||
username="https://me.yahoo.com/a/2grhJvAC049fJnvALDXek.6MRZMTlg--#eec89"
|
||||
nickname="John"
|
||||
subject="comment 2"
|
||||
date="2013-08-30T06:09:29Z"
|
||||
content="""
|
||||
You may want to try my `sizes` tool on Hackage. Just pass `-A` and it will be aware of the annex and report sizes as if no files were annexed. The only downside is that it reports file usage for replicated content multiple times, as if you'd copied the data out of the annex rather than hardlinked all duplicate copies (although, this may be exactly the behavior some people want).
|
||||
"""]]
|
||||
Loading…
Reference in a new issue