Commit graph

17032 commits

Author SHA1 Message Date
https://www.google.com/accounts/o8/id?id=AItOawmi5n3M8NMWsDYth_TGGRuJ4_CM2tPQfwg
c6781748e8 2014-01-07 02:52:20 +00:00
https://www.google.com/accounts/o8/id?id=AItOawnmF_9CAtfqdZkC4e-_dCX-rK5bqh4RWkw
17ca10eec8 Added a comment 2014-01-06 22:19:58 +00:00
Joey Hess
869943a96d Merge branch 'master' of ssh://git-annex.branchable.com 2014-01-06 17:16:08 -04:00
Joey Hess
e52e209cc8 devblog 2014-01-06 17:15:28 -04:00
Joey Hess
5279c4d1df tested transferkeys restarting; fix some bugs 2014-01-06 17:07:08 -04:00
Joey Hess
375842aee8 notes on long-running network connections 2014-01-06 17:06:55 -04:00
Joey Hess
22d6019bae add back sha commands on OSX; SIGILL problem fixed 2014-01-06 16:11:21 -04:00
Joey Hess
d356069f3e use strict version of map 2014-01-06 16:04:09 -04:00
Joey Hess
e5b4d447b6 assistant: Start a new git-annex transferkeys process after a network connection change
So that remotes that use a persistent network connection are restarted.

A remote might keep open a long duration network connection, and could
fail to deal well with losing the connection. This is particularly a
concern now that we have external special reotes. An external
special remote that is implemented naively might open the connection only
when PREPARE is sent, and if it loses connection, throw errors on each
request that is made.

(Note that the ssh connection caching should not have this problem; if the
long-duration ssh process loses connection, the named pipe is disconnected
and the next ssh attempt will reconnect. Also, XMPP already deals with
disconnection robustly in its own way.)

There's no way for git-annex to know if a lost network connection actually
affects a given remote, which might have a transfer in process. It does not
make sense to force kill the transferkeys process every time the NetWatcher
detects a change. (Especially because the NetWatcher sometimes polls 1
change per hour.)

In any case, the NetWatcher only detects connection to a network, not
disconnection. So if a transfer is in progress over the network, and the
network goes down, that will need to time out on its own.

An alternate approch that was considered is to use a separate transferkeys
process for each remote, and detect when a request fails, and assume that
means that process is in a failing state and restart it. The problem with
that approach is that if a resource is not available and a remote fails
every time, it degrades to starting a new transferkeys process for every
file transfer, which is too expensive.

Instead, this commit only handles the network reconnection case, and restarts
transferkeys only once the network has reconnected and another transfer needs
to be made. So, a transferkeys process will be reused for 1 hour, or until the
next network connection.

----

The NotificationBroadcaster was rewritten to use TMVars rather than MSampleVars,
to allow checking without blocking if a notification has been received.

----

This commit was sponsored by Tobias Brunner.
2014-01-06 16:03:39 -04:00
https://www.google.com/accounts/o8/id?id=AItOawkipQLNyt8RHREHpg2k5wdYeRSCCvSNSBg
a5bc0d6c95 Added a comment: Formatting! 2014-01-06 19:22:36 +00:00
https://www.google.com/accounts/o8/id?id=AItOawkipQLNyt8RHREHpg2k5wdYeRSCCvSNSBg
23bdcc4d57 Added a comment: git log for workspace.xml 2014-01-06 19:17:14 +00:00
http://joeyh.name/
27093d99ab Added a comment 2014-01-06 18:38:51 +00:00
Joey Hess
db2da1a033 format 2014-01-06 14:33:47 -04:00
Joey Hess
6f4baa892f Merge branch 'master' of ssh://git-annex.branchable.com 2014-01-06 14:31:40 -04:00
Joey Hess
7378f2898c close old tracking bug 2014-01-06 14:25:18 -04:00
https://www.google.com/accounts/o8/id?id=AItOawkipQLNyt8RHREHpg2k5wdYeRSCCvSNSBg
20028d7b2b 2014-01-06 18:23:53 +00:00
Joey Hess
7a79870e27 close 2014-01-06 14:22:57 -04:00
Joey Hess
823910b920 title 2014-01-06 14:21:14 -04:00
Joey Hess
32deb984c1 close 2014-01-06 14:20:34 -04:00
Joey Hess
71dea8d173 move wishlist item out out of bug list 2014-01-06 14:19:42 -04:00
Joey Hess
b865b457ff Merge branch 'master' of ssh://git-annex.branchable.com 2014-01-06 14:19:04 -04:00
Joey Hess
507d63e2e6 close bug aboug defunct OSX Lion build 2014-01-06 14:18:33 -04:00
https://www.google.com/accounts/o8/id?id=AItOawkipQLNyt8RHREHpg2k5wdYeRSCCvSNSBg
ae4d8a66b1 Added a comment: I'll start another thread 2014-01-06 18:17:44 +00:00
http://joeyh.name/
9480022dce Added a comment 2014-01-06 18:01:44 +00:00
http://joeyh.name/
cb3351b67d Added a comment 2014-01-06 16:47:49 +00:00
http://joeyh.name/
fcc566c734 Added a comment 2014-01-06 16:26:17 +00:00
http://joeyh.name/
2283d5191f Added a comment 2014-01-06 16:22:55 +00:00
http://joeyh.name/
a8d1513a88 Added a comment 2014-01-06 16:16:08 +00:00
Joey Hess
23ac21f4ed tag moreinfo since an example of such a repository is needed 2014-01-06 12:14:52 -04:00
http://joeyh.name/
2d3ccd4e4d Added a comment 2014-01-06 16:14:30 +00:00
http://joeyh.name/
953ac5eb56 Added a comment 2014-01-06 16:02:45 +00:00
http://joeyh.name/
2eb326cc8c Added a comment 2014-01-06 15:48:36 +00:00
http://joeyh.name/
94149c88f4 Added a comment 2014-01-06 15:44:15 +00:00
Joey Hess
169f84bcbb no more OSX lion builds 2014-01-06 11:32:23 -04:00
https://www.google.com/accounts/o8/id?id=AItOawkWQXo7MLYIDa-ep04UTbdz8KuvfjwLDCQ
1aea48aa7d typos 2014-01-06 15:12:23 +00:00
https://www.google.com/accounts/o8/id?id=AItOawkWQXo7MLYIDa-ep04UTbdz8KuvfjwLDCQ
06077b402c added link to Dropbox file naming limitations 2014-01-06 15:10:52 +00:00
https://www.google.com/accounts/o8/id?id=AItOawkWQXo7MLYIDa-ep04UTbdz8KuvfjwLDCQ
fd5c9cd6b7 2014-01-06 15:05:28 +00:00
http://joeyh.name/
33b8f9b474 Added a comment 2014-01-06 15:04:34 +00:00
https://www.google.com/accounts/o8/id?id=AItOawkbuIwySiJbYqXEP3w9vfHGAnE3SDv3C9s
dce2de9216 2014-01-06 13:40:15 +00:00
Joey Hess
cec0b8746f devblog 2014-01-05 21:38:44 -04:00
Joey Hess
ac3cdb693f Merge branch 'master' of ssh://git-annex.branchable.com 2014-01-05 21:33:05 -04:00
Joey Hess
59ba42777f Merge branch 'master' of ssh://git-annex.branchable.com 2014-01-05 21:31:20 -04:00
https://launchpad.net/~psycojoker
86bda196ee Added a comment 2014-01-06 01:31:15 +00:00
Joey Hess
b92b54bd42 assistant: Fixed several minor memory leaks that manifested when adding a large number of files. 2014-01-05 21:30:48 -04:00
https://www.google.com/accounts/o8/id?id=AItOawnRRUUZo3W7pAoRoST8P_l0PtUBhvYuzDg
281fd02329 Added a comment: exactly this use case: cloud remotes too small 2014-01-06 00:31:36 +00:00
Joey Hess
404c750489 add notes on full profiling 2014-01-05 19:53:41 -04:00
http://grossmeier.net/
171bca2179 Added a comment 2014-01-05 22:50:33 +00:00
http://joeyh.name/
0895caafdc Added a comment 2014-01-05 20:41:42 +00:00
http://joeyh.name/
53e5cd1a54 Added a comment 2014-01-05 18:52:08 +00:00
http://joeyh.name/
3d64d8e9e0 Added a comment 2014-01-05 18:26:10 +00:00