mirrors/git-annex
2
0
Fork 0
Code Issues Pull requests Projects Releases Packages 1 Wiki Activity Actions

add exporter thread to assistant

Browse source 
This is similar to the pusher thread, but a separate thread because git
pushes can be done in parallel with exports, and updating a big export
should not prevent other git pushes going out in the meantime.

The exportThread only runs at most every 30 seconds, since updating an
export is more expensive than pushing. This may need to be tuned.

Added a separate channel for export commits; the committer records a
commit in that channel.

Also, reconnectRemotes records a dummy commit, to make the exporter
thread wake up and make sure all exports are up-to-date. So,
connecting a drive with a directory special remote export will
immediately update it, and getting online will automatically
update S3 and WebDAV exports.

The transfer queue is not involved in exports. Instead, failed
exports are retried much like failed pushes.

This commit was sponsored by Ewen McNeill.
This commit is contained in:
Joey Hess 2017-09-20 14:37:20 -04:00
parent 46d19648ee
commit d71c65ca0a
No known key found for this signature in database
GPG key ID: DB12DB0FF05F8F38
13 changed files with 124 additions and 22 deletions
Download patch file Download diff file Expand all files Collapse all files

2
doc/todo/export.mdwn
View file

@ -17,8 +17,6 @@ there need to be a new interface in supported remotes?
Work is in progress. Todo list:
* Make assistant update tracking exports.
* Support configuring export in the assistant
(when eg setting up a S3 special remote).