Merge branch 'master' of ssh://git-annex.branchable.com

This commit is contained in:
Joey Hess 2013-08-25 21:04:50 -04:00
commit b1f8e89c05
9 changed files with 101 additions and 1 deletions

View file

@ -0,0 +1,8 @@
[[!comment format=mdwn
username="https://me.yahoo.com/a/2grhJvAC049fJnvALDXek.6MRZMTlg--#eec89"
nickname="John"
subject="comment 4"
date="2013-08-25T05:27:57Z"
content="""
Do you have any thoughts on why it may have gotten corrupted, or why it seems to happen so commonly with large git-annex repositories? I've seen this exact same sort of error while processing log files maybe 5 or 6 times now.
"""]]

View file

@ -0,0 +1,8 @@
[[!comment format=mdwn
username="https://me.yahoo.com/a/2grhJvAC049fJnvALDXek.6MRZMTlg--#eec89"
nickname="John"
subject="comment 5"
date="2013-08-25T05:50:35Z"
content="""
I meant to say, in 5 or 6 different repositories. Further, when I see it happen the next time, how do you recommend I track down the real problem, instead of always just cloning and starting over?
"""]]

View file

@ -0,0 +1,21 @@
[[!comment format=mdwn
username="https://www.google.com/accounts/o8/id?id=AItOawnSenxKyE_2Z6Wb-EBMO8FciyRywjx1ZiQ"
nickname="Walter"
subject="comment 3"
date="2013-08-24T21:59:12Z"
content="""
I have all of my repositories set to either manual (all the computers), or full backup (the usb drive and s3).
So, this is happening in a manual repository.
Also, I still don't understand why it would be confused over the annex.numcopies setting (why does it claim it needs 2 copies, when numcopies is 1?)
I just tested between desktop and laptop. File is also present in s3.
File on desktop. Copy to laptop --> desktop drops (why? both are set to manual, and both have the other set as manual as well)
Get on desktop. Works, it gets it from laptop. But then, desktop makes laptop drop it (why? again, both are manual repositories)
"""]]

View file

@ -0,0 +1,8 @@
[[!comment format=mdwn
username="http://olivier.berger.myopenid.com/"
nickname="obergix"
subject="See also section on backups in walthroug"
date="2013-08-25T05:37:04Z"
content="""
See also [walthrough/backups](/walkthrough/backups/) for some details about copies.
"""]]

View file

@ -0,0 +1,11 @@
[[!comment format=mdwn
username="https://www.google.com/accounts/o8/id?id=AItOawmTNrhkVQ26GBLaLD5-zNuEiR8syTj4mI8"
nickname="Juan"
subject="comment 3"
date="2013-08-25T13:00:04Z"
content="""
Thanks. It is very clear now. I think I got it running. I have 2 direct mode copies in my ubuntu box and in the USB drive and one indirect in my ultrabook (small SSD).
What I meant is that even in direct mode, after sync ended, the set I indexed first ended with the contents of a folder in the .git dir using symlinks. But it might have been a leftover of previous attempts.
I think I got confused by the great amount of flexibility it provides.
Thanks.
"""]]

View file

@ -0,0 +1,8 @@
[[!comment format=mdwn
username="http://cstork.org/"
nickname="Chris Stork"
subject="comment 10"
date="2013-08-25T20:59:41Z"
content="""
@joey I don't understand you last comment where you state that special remotes can act as transfer repositories \"to transfer the files between computers that do not communicate directly\". If there's no communication, ie git pushes or pulls, between the computers then they don't know what file names the files on the special remote map to. They need to somehow communicate the git repo too, don't they?
"""]]

View file

@ -1,4 +1,4 @@
git-annex has a powerful syntax for making it act on only certian files. git-annex has a powerful syntax for making it act on only certain files.
The simplest thing is to exclude some files, using wild cards: The simplest thing is to exclude some files, using wild cards:

View file

@ -0,0 +1,13 @@
[[!comment format=mdwn
username="https://www.google.com/accounts/o8/id?id=AItOawm5iosFbL2By7UFeViqkc6v-hoAtqILeDA"
nickname="Laszlo"
subject="comment 5"
date="2013-08-25T07:48:18Z"
content="""
What is the problem with bittorrent protocol in general?
It is some technicality or purely philosophical?
Best,
Laszlo
"""]]

View file

@ -0,0 +1,23 @@
[[!comment format=mdwn
username="https://www.google.com/accounts/o8/id?id=AItOawmkBwMWvNKZZCge_YqobCSILPMeK6xbFw8"
nickname="develop"
subject="comment 6"
date="2013-08-25T08:39:15Z"
content="""
I just did a cursory search on haskell torrent support. And the required pieces do seem to be be there.
https://github.com/jlouis/combinatorrent or https://github.com/astro/haskell-torrent for downloading. i'm not sure if either supports DHT, but that exists here https://github.com/aninhumer/haskell-dht
That said, i think implementing this would require some quite major overhauls in the system. It probably won't be trivial to implement.
Note: This is for straight \"bittorrent\", not for \"bittorrent sync\". Bittorrent sync is closed source, and while an API might come at some point, it doesn't currently exist.
I do seem to recall joeyh talking about supporting further transport protocols(perhaps through hooks). So I'm adding the above links for future reference if this does get implemented.
But IMHO, this doesn't seem like a trivial feature to add. It might have to take some refactoring of some core git-annex parts. Certain things have to be changed quite a bit.
Currently a git-annex client doesn't really require anything(except rsync) to sync from a remote. With bittorrent with DHT support to share between clients, suddenly git-annex will have to maintain a constant bittorrent thread(maybe multiple) that constantly seeds all the files in the git-annex repository, while waiting for a potential remote to request data.
So even if this happens, it is probably gonna take some time.
Just my 2cents.
"""]]