mirrors/git-annex
2
0
Fork 0
Code Issues Pull requests Projects Releases Packages 1 Wiki Activity Actions

devblog

Browse source
This commit is contained in:
Joey Hess 2014-11-04 17:02:22 -04:00
parent 6130a51aa1
commit 46f1337882
1 changed files with 13 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

13
doc/devblog/day_231__S3_multipart_wrapped_up.mdwn Normal file
View file

@ -0,0 +1,13 @@
S3 multipart is finally completely working. I still don't understand the
memory issue that stumped me yesterday, but rewrote the code to use a
simpler approach, which avoids the problem. Various other issues, and
testing it with large files, took all day.
This is now merged into the `s3-aws` branch, so when that branch lands, S3
support will massively improve, from the current situation of using a buggy
library that buffers uploaded files in memory, and cannot support very
large file uploads at all, to being able to support hopefully files of
arbitrary hugeness (at least up to a few terabytes).
BTW, thanks to Aristid Breitkreuz and Junji Hashimoto for working on the
multipart support in the `aws` library.