git-annex/doc/bugs/encrypted_S3_stalls.mdwn

Sending large-ish (few megabytes) files to encrypted S3 remotes stalls out.
It works for the tiny files I was using to test while developing it, on
dialup.

There was a similar issue with bup, which I fixed by forking a process
rather than using a thread to do some IO. Probably need the same here.
--[[Joey]]

[[done]] --[[Joey]]
bug 2011-04-19 17:45:32 +00:00			`Sending large-ish (few megabytes) files to encrypted S3 remotes stalls out.`
			`It works for the tiny files I was using to test while developing it, on`
			`dialup.`

			`There was a similar issue with bup, which I fixed by forking a process`
			`rather than using a thread to do some IO. Probably need the same here.`
			`--[[Joey]]`
Fix stalls in S3 when transferring encrypted data. Stalls were caused by code that did approximatly: content' <- liftIO $ withEncryptedContent cipher content return store content' The return evaluated without actually reading content from S3, and so the cleanup code began waiting on gpg to exit before gpg could send all its data. Fixing it involved moving the `store` type action into the IO monad: liftIO $ withEncryptedContent cipher content store Which was a bit of a pain to do, thank you type system, but avoids the problem as now the whole content is consumed, and stored, before cleanup. 2011-04-19 18:45:19 +00:00
			`[[done]] --[[Joey]]`