git-annex/Assistant/Threads/Transferrer.hs

{- git-annex assistant data transferrer thread
 -
 - Copyright 2012 Joey Hess <id@joeyh.name>
 -
 - Licensed under the GNU AGPL version 3 or higher.
 -}

module Assistant.Threads.Transferrer where

import Assistant.Common
import Assistant.TransferQueue
import Assistant.TransferSlots
import Types.Transfer
import Annex.TransferrerPool
import Utility.Batch

{- Dispatches transfers from the queue. -}
transfererThread :: NamedThread
transfererThread = namedThread "Transferrer" $ do
	rt <- liftAnnex . mkRunTransferrer
		=<< liftIO getBatchCommandMaker
	forever $ inTransferSlot rt $
		maybe (return Nothing) (uncurry genTransfer)
			=<< getNextTransfer notrunning
  where
	{- Skip transfers that are already running. -}
	notrunning = isNothing . startedTime
wrote transfer thread finally! 2012-07-05 20:34:20 +00:00			`{- git-annex assistant data transferrer thread`
			`-`
update my email address and homepage url 2015-01-21 16:50:09 +00:00			`- Copyright 2012 Joey Hess <id@joeyh.name>`
wrote transfer thread finally! 2012-07-05 20:34:20 +00:00			`-`
update licenses from GPL to AGPL This does not change the overall license of the git-annex program, which was already AGPL due to a number of sources files being AGPL already. Legally speaking, I'm adding a new license under which these files are now available; I already released their current contents under the GPL license. Now they're dual licensed GPL and AGPL. However, I intend for all my future changes to these files to only be released under the AGPL license, and I won't be tracking the dual licensing status, so I'm simply changing the license statement to say it's AGPL. (In some cases, others wrote parts of the code of a file and released it under the GPL; but in all cases I have contributed a significant portion of the code in each file and it's that code that is getting the AGPL license; the GPL license of other contributors allows combining with AGPL code.) 2019-03-13 19:48:14 +00:00			`- Licensed under the GNU AGPL version 3 or higher.`
wrote transfer thread finally! 2012-07-05 20:34:20 +00:00			`-}`

			`module Assistant.Threads.Transferrer where`

debugging improvements add timestamps to debug messages Add lots of debug output in the assistant's threads. 2012-07-20 23:29:59 +00:00			`import Assistant.Common`
wrote transfer thread finally! 2012-07-05 20:34:20 +00:00			`import Assistant.TransferQueue`
it builds again Currently nothing waits on transfer processes. (Second drive of the day fried. Not concentrating very well.) 2012-07-06 20:39:07 +00:00			`import Assistant.TransferSlots`
get, move, copy, mirror: Added --failed switch which retries failed copies/moves Note that get --from foo --failed will get things that a previous get --from bar tried and failed to get, etc. I considered making --failed only retry transfers from the same remote, but it was easier, and seems more useful, to not have the same remote requirement. Noisy due to some refactoring into Types/ 2016-08-03 16:37:12 +00:00			`import Types.Transfer`
propagate git-annex -c on to transferrer child process git -c was already propagated via environment, but need this for consistency. Also, notice it does not use gitAnnexChildProcess to run the transferrer. So nothing is done about avoid it taking the pid lock. It's possible that the caller is already doing something that took the pid lock, and if so, the transferrer will certianly fail, since it needs to take the pid lock too. This may prevent combining annex.stalldetection with annex.pidlock, but I have not verified it's really a problem. If it was, it seems git-annex would have to take the pid lock when starting a transferrer, and hold it until shutdown, or would need to take pid lock when starting to use a transferrer, and hold it until done with a transfer and then drop it. The latter would require starting the transferrer with pid locking disabled for the child process, so assumes that the transferrer does not do anyting that needs locking when not running a transfer. 2020-12-15 15:36:25 +00:00			`import Annex.TransferrerPool`
avoid repeatedly searching path to make batch command when running transferkeys 2013-12-01 19:37:51 +00:00			`import Utility.Batch`
wrote transfer thread finally! 2012-07-05 20:34:20 +00:00
unfinished (and unbuildable) work toward separate transfer processes 2012-07-06 00:57:06 +00:00			`{- Dispatches transfers from the queue. -}`
Assistant monad, stage 3 All toplevel named threads are converted to the Assistant monad. Some utility functions still need to be converted. 2012-10-29 18:07:12 +00:00			`transfererThread :: NamedThread`
webapp: Now allows restarting any threads that crash. 2013-01-26 06:09:33 +00:00			`transfererThread = namedThread "Transferrer" $ do`
propagate git-annex -c on to transferrer child process git -c was already propagated via environment, but need this for consistency. Also, notice it does not use gitAnnexChildProcess to run the transferrer. So nothing is done about avoid it taking the pid lock. It's possible that the caller is already doing something that took the pid lock, and if so, the transferrer will certianly fail, since it needs to take the pid lock too. This may prevent combining annex.stalldetection with annex.pidlock, but I have not verified it's really a problem. If it was, it seems git-annex would have to take the pid lock when starting a transferrer, and hold it until shutdown, or would need to take pid lock when starting to use a transferrer, and hold it until done with a transfer and then drop it. The latter would require starting the transferrer with pid locking disabled for the child process, so assumes that the transferrer does not do anyting that needs locking when not running a transfer. 2020-12-15 15:36:25 +00:00			`rt <- liftAnnex . mkRunTransferrer`
			`=<< liftIO getBatchCommandMaker`
			`forever $ inTransferSlot rt $`
hlint 2013-10-03 02:59:07 +00:00			`maybe (return Nothing) (uncurry genTransfer)`
finished pushing Assistant monad into all relevant files All temporary and old functions are removed. 2012-10-30 21:14:26 +00:00			`=<< getNextTransfer notrunning`
Assistant monad, stage 3 All toplevel named threads are converted to the Assistant monad. Some utility functions still need to be converted. 2012-10-29 18:07:12 +00:00			`where`
			`{- Skip transfers that are already running. -}`
			`notrunning = isNothing . startedTime`