Commit graph

794 commits

Author SHA1 Message Date
Joey Hess
dea125e1b7 split 2012-10-18 15:22:28 -04:00
Joey Hess
f7f34d2072 drop unwanted content in the transfer scan
This was complicated quite a bit by needing to check numcopies. I optimised
that, so it only looks up numcopies once per file, no matter how many
remotes it checks to drop from. Although it did just occur to me that
it might be better to first check if it wants to drop content, and only
then check numcopies..
2012-10-18 15:07:11 -04:00
Joey Hess
dbe8de40ab minor transfer scanner code reworking
Also a small optimisation using a Set
2012-10-18 13:42:17 -04:00
84.204.75.2
9026ed9c3f poll vote (Google Drive) 2012-10-18 11:48:11 +00:00
84.204.75.2
dfc6d8a38a poll vote (My phone (or MP3 player)) 2012-10-18 11:47:33 +00:00
Joey Hess
9762d26f81 blog for the day 2012-10-17 16:21:34 -04:00
Joey Hess
7d4f1358f9 blog for the day 2012-10-16 16:49:29 -04:00
Joey Hess
634b870240 releasing version 3.20121016 2012-10-16 16:47:59 -04:00
Joey Hess
5feadb4df4 blog for the day 2012-10-16 00:20:13 -04:00
188.226.51.71
7f3138dd20 poll vote (Tahoe-LAFS) 2012-10-16 00:12:17 +00:00
Joey Hess
c504f4025f Merge branch 'master' of ssh://git-annex.branchable.com 2012-10-14 17:49:16 -04:00
Joey Hess
ae53da8615 blog for the day 2012-10-14 17:48:09 -04:00
84.112.131.62
7910ca770d poll vote (OpenStack SWIFT) 2012-10-14 19:54:39 +00:00
Joey Hess
04a69b22b1 update 2012-10-14 15:15:24 -04:00
Joey Hess
592d55ef7c fix display of transfers for remotes not in syncRemotes list 2012-10-14 14:51:11 -04:00
Joey Hess
b2d266267f avoid queuing transfers for remotes after syncing to them is paused
This avoids the expensive transfer scan relying on its list of remotes
to scan being accurate throughout, which it will not be when the user
pauses syncing to a remote.

I feel it's ok to queue transfers to *any* known remote, not just the ones
being scanned.

Note that there are still small races where after syncing to a remote is
paused, a transfer can be queued for it. Not just in the expensive transfer
scan, but in the cheap failed transfer scan, and elsewhere.
2012-10-14 14:34:05 -04:00
79.243.245.244
649d322fa5 poll vote (Google Drive) 2012-10-14 14:02:28 +00:00
79.243.245.244
44b3cecf71 poll vote (My phone (or MP3 player)) 2012-10-14 14:02:19 +00:00
https://www.google.com/accounts/o8/id?id=AItOawmubB1Sj2rwFoVdZYvGV0ACaQUJQyiJXJI
6b74a6ed7a Added a comment: Thank you for stickers 2012-10-14 13:59:56 +00:00
68.113.110.158
50e1aee940 poll vote (Tahoe-LAFS) 2012-10-14 03:55:52 +00:00
Joey Hess
902ef88266 Merge branch 'master' of ssh://git-annex.branchable.com 2012-10-13 13:22:59 -04:00
Joey Hess
9c3e1ca3c9 full analysis of ways content could stop being preferred and need to be dropped 2012-10-13 13:21:43 -04:00
89.0.176.236
de1789e9d3 poll vote (My phone (or MP3 player)) 2012-10-13 08:41:33 +00:00
122.110.137.225
1bab21a3fb poll vote (My phone (or MP3 player)) 2012-10-13 07:27:37 +00:00
Joey Hess
ab9c032deb blog for the day 2012-10-12 19:43:16 -04:00
99.52.196.7
f6ebd9fdb6 poll vote (Tahoe-LAFS) 2012-10-12 21:38:30 +00:00
93.71.131.82
971823ba37 poll vote (Tahoe-LAFS) 2012-10-12 21:20:05 +00:00
98.207.29.118
fedcac50a3 poll vote (Tahoe-LAFS) 2012-10-12 20:49:53 +00:00
75.101.56.72
1ecc3d7310 poll vote (Tahoe-LAFS) 2012-10-12 18:50:00 +00:00
Joey Hess
e2e084e0ab Merge branch 'master' of ssh://git-annex.branchable.com 2012-10-12 14:18:17 -04:00
https://www.google.com/accounts/o8/id?id=AItOawmsz4weoPXV2oEtv3zpo9dOxn_SEPz-7Iw
5fc706a896 Added a comment: reasons to like Tahoe-LAFS as a special remote 2012-10-12 18:17:43 +00:00
Joey Hess
195707e023 Merge branch 'master' of ssh://git-annex.branchable.com 2012-10-12 14:17:05 -04:00
97.118.99.24
564f3b8b05 poll vote (Tahoe-LAFS) 2012-10-12 18:06:28 +00:00
50.56.129.169
17225cfac5 poll vote (Tahoe-LAFS) 2012-10-12 18:06:05 +00:00
Joey Hess
75dccc57ba note infelicities with syncing disabling 2012-10-12 12:49:22 -04:00
74.71.57.26
5c2f74898d poll vote (My phone (or MP3 player)) 2012-10-11 23:17:20 +00:00
Joey Hess
1591245f88 blog for the day 2012-10-11 17:36:24 -04:00
https://www.google.com/accounts/o8/id?id=AItOawlVwbp82f-7rNOyEpvqc9A8FEfn7wl2Akw
ec97cd8ec7 Added a comment: Works for me 2012-10-11 13:40:08 +00:00
87.193.165.87
11ff4c437e poll vote (OpenStack SWIFT) 2012-10-11 12:13:09 +00:00
Joey Hess
b044dc2952 blog for the day 2012-10-10 16:40:15 -04:00
130.195.163.116
5806e391b6 poll vote (Amazon S3 (done)) 2012-10-09 20:18:23 +00:00
Joey Hess
a5781fd9ba webapp automatic grouping
webapp: Adds newly created repositories to one of these groups:
clients, drives, servers

This is heuristic, but it's a pretty good heuristic, and can always be
configured.
2012-10-09 14:24:17 -04:00
Joey Hess
5ac15149cc assistant: Now honors preferred content settings when deciding what to transfer.
Both when queueing downloads, and uploads, consults the preferred content
settings.

I didn't make it check yet when requeing failed transfers or queuing
deferred downloads; dealing with the preferred content settings (or indeed,
other settings) changing while the assistant is running still needs work.
2012-10-09 12:18:41 -04:00
124.170.69.248
96e40282c7 poll vote (Box.com) 2012-10-09 11:17:10 +00:00
124.170.69.248
2bb7f29b2b poll vote (My phone (or MP3 player)) 2012-10-09 11:17:03 +00:00
124.170.69.248
d5da0d4171 poll vote (Google Drive) 2012-10-09 11:16:53 +00:00
124.170.69.248
f59ba96a14 poll vote (Tahoe-LAFS) 2012-10-09 11:16:38 +00:00
65.9.174.186
13eaf9dea8 poll vote (Google Drive) 2012-10-08 21:18:14 +00:00
Joey Hess
2db572546a Merge branch 'master' of ssh://git-annex.branchable.com 2012-10-08 17:16:22 -04:00
Joey Hess
acb8721072 blog for the day 2012-10-08 17:13:21 -04:00
Joey Hess
e375b931c0 add --ingroup limit 2012-10-08 15:18:58 -04:00
Joey Hess
7cd81bd978 Added --smallerthan and --largerthan limits 2012-10-08 13:39:18 -04:00
79.194.195.87
35b6222fac poll vote (My phone (or MP3 player)) 2012-10-08 07:02:08 +00:00
178.83.201.90
2baa36230c poll vote (My phone (or MP3 player)) 2012-10-07 20:27:08 +00:00
93.90.47.114
e36b4bc454 poll vote (Google Drive) 2012-10-07 18:20:07 +00:00
http://meep.pl/
45f408bc3c Added a comment: Include/exclude 2012-10-06 08:40:23 +00:00
Joey Hess
12d1f71e9d really fix link.. 2012-10-05 17:59:34 -04:00
Joey Hess
5e1ff4263a fix link 2012-10-05 17:58:04 -04:00
Joey Hess
b577ec4a5c response 2012-10-05 17:56:15 -04:00
Joey Hess
d5348efeb0 blog for the day 2012-10-05 17:09:17 -04:00
Joey Hess
51f41bad63 Merge branch 'master' of ssh://git-annex.branchable.com 2012-10-05 11:57:54 -04:00
Joey Hess
b1c28ab87e update 2012-10-05 11:57:48 -04:00
http://joeyh.name/
4c5443329a Added a comment 2012-10-05 15:08:26 +00:00
http://meep.pl/
492d62ce20 Added a comment: Ah, the barber paradox 2012-10-05 06:51:12 +00:00
http://joeyh.name/
a4ffc7d155 Added a comment 2012-10-05 00:43:12 +00:00
84.186.117.8
f782c6948d poll vote (My phone (or MP3 player)) 2012-10-05 00:40:28 +00:00
Joey Hess
2faa2cdf00 update 2012-10-04 20:38:39 -04:00
Joey Hess
3567643e2a blog for the day 2012-10-04 16:55:50 -04:00
Joey Hess
e138a514a9 Merge branch 'master' of ssh://git-annex.branchable.com 2012-10-03 19:41:26 -04:00
Joey Hess
d7898605e3 blog for the day 2012-10-03 19:39:53 -04:00
https://www.google.com/accounts/o8/id?id=AItOawknpbpx4uDElXRzJ4kPXuJU1KdcslOI6go
dc5dd9f22a Added a comment: I strongly agree with Glen 2012-10-03 14:07:41 +00:00
62.93.122.86
377330f2c1 poll vote (My phone (or MP3 player)) 2012-10-03 09:35:07 +00:00
http://wiggy.net/
e7fe412a6d Added a comment: symlinks? 2012-10-03 07:15:22 +00:00
65.12.145.136
58a2e4175e poll vote (My phone (or MP3 player)) 2012-10-03 00:55:16 +00:00
65.12.145.136
ff676a1670 poll vote (Google Drive) 2012-10-03 00:54:54 +00:00
65.12.145.136
c537490c32 poll vote (Amazon Glacier) 2012-10-03 00:54:41 +00:00
Joey Hess
c696db7dd4 blog for the day 2012-10-02 18:16:58 -04:00
Joey Hess
9aab70de66 always check with ls-files before adding new files
Makes it safe to use git annex unlock with the watcher/assistant.
And also to mix use of the watcher/assistant with regular files stored in git.

Long ago, I had avoided doing this check, except during the startup scan,
because it would be slow to run ls-files repeatedly.

But then I added the lsof check, and to make that fast, got it to detect
batch file adds. So let's move the ls-files check to also occur when it'll
have a batch, and can check them all with one call.

This does slow down adding a single file by just a bit, but really only
a little bit. (The lsof check is probably more expensive.) It also
speeds up the startup scan, especially when there are lots of new files
found by the scan.

Also, fixed the sleep for annex.delayadd to not run while the threadstate
lock is held, so it doesn't unnecessarily freeze everything else.

Also, --force no longer makes it skip the lsof check, which was not
documented, and seems never a good idea.
2012-10-02 17:41:23 -04:00
Joey Hess
adec96ba03 blog for the day 2012-10-01 18:39:54 -04:00
Joey Hess
3846c7ae5e terminology 2012-10-01 18:26:47 -04:00
Joey Hess
bd1d9b52b4 Merge branch 'master' of ssh://git-annex.branchable.com 2012-10-01 14:13:06 -04:00
Joey Hess
f5022e77be notes on possibilities 2012-10-01 11:30:51 -04:00
http://joeyh.name/
659855efef Added a comment 2012-09-30 17:11:13 +00:00
http://rjc.pip.verisignlabs.com/
4e69098f52 Added a comment: assistant in Debian 2012-09-30 09:10:18 +00:00
199.180.99.38
8f7c1daefe poll vote (My phone (or MP3 player)) 2012-09-29 03:05:36 +00:00
Joey Hess
b98de9391b fix link 2012-09-28 19:35:54 -04:00
Joey Hess
6e182a9f09 blog for the day 2012-09-28 19:18:32 -04:00
Joey Hess
1f67d9c0e3 update 2012-09-28 12:16:25 -04:00
82.74.121.83
8fdbbf3a38 poll vote (My phone (or MP3 player)) 2012-09-28 13:42:45 +00:00
83.175.83.68
fc76fd1962 poll vote (My phone (or MP3 player)) 2012-09-28 12:45:32 +00:00
Joey Hess
796ec5c9da blog for the day 2012-09-27 16:55:48 -04:00
130.226.70.142
aecda85df0 poll vote (Amazon Glacier) 2012-09-27 20:07:56 +00:00
http://joeyh.name/
a41210ece6 Added a comment 2012-09-27 18:44:11 +00:00
https://launchpad.net/~gdr-go2
9681797213 Added a comment: Maybe a DEB?2 2012-09-27 09:44:14 +00:00
89.70.2.165
74a7524a76 poll vote (Tahoe-LAFS) 2012-09-27 09:36:50 +00:00
https://www.google.com/accounts/o8/id?id=AItOawlFd2EbAmGD0FjHmuoerXfT0GO_jPcgvQA
0d6bd1c142 Added a comment: Single bucket for S3 2012-09-27 09:17:24 +00:00
152.66.253.77
b35b4c0310 poll vote (Google Drive) 2012-09-27 08:56:30 +00:00
84.194.180.65
bd53aa0302 poll vote (Google Drive) 2012-09-27 08:10:03 +00:00
https://www.google.com/accounts/o8/id?id=AItOawl9sYlePmv1xK-VvjBdN-5doOa_Xw-jH4U
ec389704a8 Added a comment 2012-09-26 23:52:50 +00:00
90.197.190.56
48cadc21a6 poll vote (My phone (or MP3 player)) 2012-09-26 22:07:09 +00:00