Commit graph

5584 commits

Author SHA1 Message Date
Joey Hess
34ca1d698c avoid updating transfer info file until another 1% of the total has been transferred 2012-09-21 15:11:45 -04:00
Joey Hess
ff32ee5152 upload progress tracking for the directory special remote 2012-09-21 14:54:24 -04:00
Joey Hess
226781c047 unify types 2012-09-21 14:50:14 -04:00
24.52.233.135
6873d785f0 poll vote (Tahoe-LAFS) 2012-09-21 14:34:33 +00:00
http://www.davidhaslem.com/
1cd96c120a Added a comment 2012-09-21 14:06:45 +00:00
https://www.google.com/accounts/o8/id?id=AItOawlu-fdXIt_RF9ggvg4zP0yBbtjWQwHAMS4
f78957ebb5 Added a comment: Mount detection 2012-09-21 09:23:34 +00:00
http://joeyh.name/
29a5424344 Added a comment 2012-09-21 05:25:53 +00:00
Joey Hess
86214edc98 update 2012-09-21 01:25:02 -04:00
Joey Hess
36982cdc9a Merge branch 'master' of ssh://git-annex.branchable.com 2012-09-21 00:51:46 -04:00
Joey Hess
084aba8aaf fix breakage caught by test suite
Can't use show-ref --tags --branches, as that omits remote branches.
Instead, filter out the synced refs directly.
2012-09-21 00:49:48 -04:00
https://id.koumbit.net/anarcat
d8d608fa6e Added a comment: you rock! & roadmap update? 2012-09-21 04:25:59 +00:00
http://joeyh.name/
240711d1ae Added a comment 2012-09-21 04:12:54 +00:00
http://www.davidhaslem.com/
f4b9afd33a Added a comment 2012-09-21 04:05:20 +00:00
Joey Hess
a12f43c0d4 Merge branch 'master' of ssh://git-annex.branchable.com 2012-09-20 23:46:17 -04:00
Joey Hess
d0681f7e45 alernate, less crazy idea 2012-09-20 23:44:46 -04:00
Joey Hess
f49c0f22bf a much crazier, but also more feasable idea 2012-09-20 23:42:34 -04:00
http://joeyh.name/
f896a447b8 Added a comment 2012-09-20 21:55:57 +00:00
Joey Hess
a6202ffe1b idea 2012-09-20 17:48:10 -04:00
Joey Hess
7456e9f68c Merge branch 'master' of ssh://git-annex.branchable.com 2012-09-20 17:40:08 -04:00
Joey Hess
d7c8b60e6b blog for the day 2012-09-20 17:39:09 -04:00
Joey Hess
99e62f2bb8 avoid calling the progress callback when the bytes sent have not changed
Does rsync stall and update its progress display? Dunno, but this was an
easy optimisation to throw in.
2012-09-20 17:30:38 -04:00
Joey Hess
68ad7de4d0 watch for changes to transfer info files, to update progress bars on upload
This is handled differently for inotify, which can track modifications of
existing files, and kqueue, which cannot (TTBOMK). On the inotify side,
the TransferWatcher just waits for the file to be updated and reads the new
bytesComplete. On the kqueue side, the TransferPoller has to re-read the
file every update (currently 0.5 seconds, might need to increase that).

I did think about working around kqueue's limitations by somehow creating
a new file each time the size changed. But cleaning up all the files that
would result seemed difficult. And really, this is not a lot worse than
the TransferWatcher's behavior for downloads, which stats a file every 0.5
seconds. As long as the OS has decent file caching behavior..
2012-09-20 17:24:40 -04:00
https://www.google.com/accounts/o8/id?id=AItOawlc1og3PqIGudOMkFNrCCNg66vB7s-jLpc
66e6ffe3d3 Added a comment: can addurl use hashing once the file is downloaded? 2012-09-20 21:01:30 +00:00
Joey Hess
06ed6ceac4 fix reading of transfer info files with a bytesComplete value 2012-09-20 16:40:48 -04:00
Joey Hess
a6504e4192 optimised rsync output reader to read whole blocks at a time 2012-09-20 16:01:31 -04:00
Joey Hess
2ae38325d5 hook rsync special remote up to the progress reporting
Easy!

Note that with an encrypted remote, rsync will be sending a little more
data than the key size, so displayed progress may get to 100% slightly
quicker than it should. I doubt this is a big enough effect to worry about.
2012-09-20 13:51:51 -04:00
Joey Hess
66d092dc7c update 2012-09-20 13:46:07 -04:00
Joey Hess
19e35f7f0d upload progress bar for git remote on same filesystem
cp is used here, but we can just watch the size of the destination file

This commit made from within the ruins of an old mill, overlooking a
beautiful waterfall.
2012-09-20 13:35:53 -04:00
http://joeyh.name/
d67e322184 Added a comment 2012-09-20 16:21:12 +00:00
https://www.google.com/accounts/o8/id?id=AItOawlu-fdXIt_RF9ggvg4zP0yBbtjWQwHAMS4
7bb0ee9d85 Added a comment: Multiple annexes? 2012-09-20 16:10:29 +00:00
193.22.163.2
b8979793fa poll vote (Amazon S3) 2012-09-20 14:17:29 +00:00
193.22.163.2
b8b4388c80 poll vote (Amazon Glacier) 2012-09-20 14:17:12 +00:00
193.22.163.2
30f387e396 poll vote (Google Drive) 2012-09-20 14:17:05 +00:00
193.22.163.2
1c865472eb poll vote (My phone (or MP3 player)) 2012-09-20 14:16:58 +00:00
193.22.163.2
ba7d784ccd poll vote (Amazon S3) 2012-09-20 14:16:49 +00:00
https://www.google.com/accounts/o8/id?id=AItOawmBUR4O9mofxVbpb8JV9mEbVfIYv670uJo
9f102331ef Added a comment 2012-09-20 14:11:57 +00:00
92.207.74.149
084863251c poll vote (My phone (or MP3 player)) 2012-09-20 03:26:53 +00:00
https://www.google.com/accounts/o8/id?id=AItOawlup4hyZo4eCjF8T85vfRXMKBxGj9bMdl0
bddeaa6416 Added a comment 2012-09-19 23:32:35 +00:00
Joey Hess
0cb4382880 typo 2012-09-19 17:10:22 -04:00
Joey Hess
77938a7d62 better parameter name 2012-09-19 17:10:13 -04:00
Joey Hess
3d98326763 Merge branch 'master' of ssh://git-annex.branchable.com 2012-09-19 17:06:49 -04:00
Joey Hess
3d62a09e53 blog for the day 2012-09-19 17:05:42 -04:00
Joey Hess
f542701620 recvkey is not an upload, so ignore the progress callback 2012-09-19 17:02:33 -04:00
Joey Hess
e1037adebc rsync progress interception
Current implementation parses rsync's output a character a time, which
is hardly efficient. It could be sped up a lot by using hGetBufSome,
but that would require going really lowlevel, down to raw C style buffers
(good example of that here: http://users.aber.ac.uk/afc/stricthaskell.html)
But rsync doesn't output very much, so currently it seems ok.
2012-09-19 16:55:08 -04:00
https://www.google.com/accounts/o8/id?id=AItOawkSq2FDpK2n66QRUxtqqdbyDuwgbQmUWus
fbfc42ed03 Added a comment 2012-09-19 20:17:00 +00:00
Joey Hess
aff09a1f33 add a progress callback to storeKey, and threaded it all the way through
Transfer info files are updated when the callback is called, updating
the number of bytes transferred.

Left unused p variables at every place the callback should be used.
Which is rather a lot..
2012-09-19 16:08:37 -04:00
Joey Hess
3c81d70c1b parser for rsync progress output 2012-09-19 15:23:59 -04:00
Joey Hess
0608a2e748 reorg 2012-09-19 14:28:57 -04:00
Joey Hess
45a26175d6 renamed RsyncFile -> Rsync 2012-09-19 14:28:32 -04:00
http://joeyh.name/
ab1a0c0656 Added a comment 2012-09-19 17:33:20 +00:00