Commit graph

5572 commits

Author SHA1 Message Date
http://www.davidhaslem.com/
f4b9afd33a Added a comment 2012-09-21 04:05:20 +00:00
Joey Hess
a12f43c0d4 Merge branch 'master' of ssh://git-annex.branchable.com 2012-09-20 23:46:17 -04:00
Joey Hess
d0681f7e45 alernate, less crazy idea 2012-09-20 23:44:46 -04:00
Joey Hess
f49c0f22bf a much crazier, but also more feasable idea 2012-09-20 23:42:34 -04:00
http://joeyh.name/
f896a447b8 Added a comment 2012-09-20 21:55:57 +00:00
Joey Hess
a6202ffe1b idea 2012-09-20 17:48:10 -04:00
Joey Hess
7456e9f68c Merge branch 'master' of ssh://git-annex.branchable.com 2012-09-20 17:40:08 -04:00
Joey Hess
d7c8b60e6b blog for the day 2012-09-20 17:39:09 -04:00
Joey Hess
99e62f2bb8 avoid calling the progress callback when the bytes sent have not changed
Does rsync stall and update its progress display? Dunno, but this was an
easy optimisation to throw in.
2012-09-20 17:30:38 -04:00
Joey Hess
68ad7de4d0 watch for changes to transfer info files, to update progress bars on upload
This is handled differently for inotify, which can track modifications of
existing files, and kqueue, which cannot (TTBOMK). On the inotify side,
the TransferWatcher just waits for the file to be updated and reads the new
bytesComplete. On the kqueue side, the TransferPoller has to re-read the
file every update (currently 0.5 seconds, might need to increase that).

I did think about working around kqueue's limitations by somehow creating
a new file each time the size changed. But cleaning up all the files that
would result seemed difficult. And really, this is not a lot worse than
the TransferWatcher's behavior for downloads, which stats a file every 0.5
seconds. As long as the OS has decent file caching behavior..
2012-09-20 17:24:40 -04:00
https://www.google.com/accounts/o8/id?id=AItOawlc1og3PqIGudOMkFNrCCNg66vB7s-jLpc
66e6ffe3d3 Added a comment: can addurl use hashing once the file is downloaded? 2012-09-20 21:01:30 +00:00
Joey Hess
06ed6ceac4 fix reading of transfer info files with a bytesComplete value 2012-09-20 16:40:48 -04:00
Joey Hess
a6504e4192 optimised rsync output reader to read whole blocks at a time 2012-09-20 16:01:31 -04:00
Joey Hess
2ae38325d5 hook rsync special remote up to the progress reporting
Easy!

Note that with an encrypted remote, rsync will be sending a little more
data than the key size, so displayed progress may get to 100% slightly
quicker than it should. I doubt this is a big enough effect to worry about.
2012-09-20 13:51:51 -04:00
Joey Hess
66d092dc7c update 2012-09-20 13:46:07 -04:00
Joey Hess
19e35f7f0d upload progress bar for git remote on same filesystem
cp is used here, but we can just watch the size of the destination file

This commit made from within the ruins of an old mill, overlooking a
beautiful waterfall.
2012-09-20 13:35:53 -04:00
http://joeyh.name/
d67e322184 Added a comment 2012-09-20 16:21:12 +00:00
https://www.google.com/accounts/o8/id?id=AItOawlu-fdXIt_RF9ggvg4zP0yBbtjWQwHAMS4
7bb0ee9d85 Added a comment: Multiple annexes? 2012-09-20 16:10:29 +00:00
193.22.163.2
b8979793fa poll vote (Amazon S3) 2012-09-20 14:17:29 +00:00
193.22.163.2
b8b4388c80 poll vote (Amazon Glacier) 2012-09-20 14:17:12 +00:00
193.22.163.2
30f387e396 poll vote (Google Drive) 2012-09-20 14:17:05 +00:00
193.22.163.2
1c865472eb poll vote (My phone (or MP3 player)) 2012-09-20 14:16:58 +00:00
193.22.163.2
ba7d784ccd poll vote (Amazon S3) 2012-09-20 14:16:49 +00:00
https://www.google.com/accounts/o8/id?id=AItOawmBUR4O9mofxVbpb8JV9mEbVfIYv670uJo
9f102331ef Added a comment 2012-09-20 14:11:57 +00:00
92.207.74.149
084863251c poll vote (My phone (or MP3 player)) 2012-09-20 03:26:53 +00:00
https://www.google.com/accounts/o8/id?id=AItOawlup4hyZo4eCjF8T85vfRXMKBxGj9bMdl0
bddeaa6416 Added a comment 2012-09-19 23:32:35 +00:00
Joey Hess
0cb4382880 typo 2012-09-19 17:10:22 -04:00
Joey Hess
77938a7d62 better parameter name 2012-09-19 17:10:13 -04:00
Joey Hess
3d98326763 Merge branch 'master' of ssh://git-annex.branchable.com 2012-09-19 17:06:49 -04:00
Joey Hess
3d62a09e53 blog for the day 2012-09-19 17:05:42 -04:00
Joey Hess
f542701620 recvkey is not an upload, so ignore the progress callback 2012-09-19 17:02:33 -04:00
Joey Hess
e1037adebc rsync progress interception
Current implementation parses rsync's output a character a time, which
is hardly efficient. It could be sped up a lot by using hGetBufSome,
but that would require going really lowlevel, down to raw C style buffers
(good example of that here: http://users.aber.ac.uk/afc/stricthaskell.html)
But rsync doesn't output very much, so currently it seems ok.
2012-09-19 16:55:08 -04:00
https://www.google.com/accounts/o8/id?id=AItOawkSq2FDpK2n66QRUxtqqdbyDuwgbQmUWus
fbfc42ed03 Added a comment 2012-09-19 20:17:00 +00:00
Joey Hess
aff09a1f33 add a progress callback to storeKey, and threaded it all the way through
Transfer info files are updated when the callback is called, updating
the number of bytes transferred.

Left unused p variables at every place the callback should be used.
Which is rather a lot..
2012-09-19 16:08:37 -04:00
Joey Hess
3c81d70c1b parser for rsync progress output 2012-09-19 15:23:59 -04:00
Joey Hess
0608a2e748 reorg 2012-09-19 14:28:57 -04:00
Joey Hess
45a26175d6 renamed RsyncFile -> Rsync 2012-09-19 14:28:32 -04:00
http://joeyh.name/
ab1a0c0656 Added a comment 2012-09-19 17:33:20 +00:00
http://joeyh.name/
08d61295a8 Added a comment 2012-09-19 17:32:13 +00:00
Joey Hess
355ef8f3ea add annex.delayadd configuration 2012-09-19 13:30:25 -04:00
http://joeyh.name/
da8c8c3ccd Added a comment 2012-09-19 17:02:47 +00:00
Joey Hess
d50d89eb6f support old versions of git that do not have --allow-empty-message 2012-09-19 12:58:53 -04:00
Joey Hess
c4e8591351 add missing --no-verify to prevent the pre-commit hook's git annex fix 2012-09-19 12:48:32 -04:00
Joey Hess
08fa128c2a Merge branch 'master' of ssh://git-annex.branchable.com 2012-09-19 12:01:26 -04:00
Joey Hess
e79890664d idea 2012-09-19 12:00:06 -04:00
https://www.google.com/accounts/o8/id?id=AItOawn-KDr_Z4CMkjS0v_TxQ08SzAB5ecHG3K0
e79cd19c4c 2012-09-19 14:36:31 +00:00
https://www.google.com/accounts/o8/id?id=AItOawn-KDr_Z4CMkjS0v_TxQ08SzAB5ecHG3K0
123bd31a6c 2012-09-19 14:34:47 +00:00
https://www.google.com/accounts/o8/id?id=AItOawn-KDr_Z4CMkjS0v_TxQ08SzAB5ecHG3K0
481adaaffe Added a comment: Modifying files in a folder watched by assistant 2012-09-19 14:18:55 +00:00
79.97.135.214
d95c4cff8a poll vote (Tahoe-LAFS) 2012-09-19 08:24:09 +00:00
98.108.200.80
efe26d2919 poll vote (Google Drive) 2012-09-19 06:46:40 +00:00