divB
a8b0311d8a
2014-08-02 20:23:10 +00:00
divB
84b5d1241c
2014-08-02 20:17:05 +00:00
divB
7d015c8eef
2014-08-02 20:12:42 +00:00
divB
49db204da4
2014-08-02 20:10:12 +00:00
Joey Hess
32e4368377
S3: support chunking
...
The assistant defaults to 1MiB chunk size for new S3 special remotes.
Which will work around a couple of bugs:
http://git-annex.branchable.com/bugs/S3_memory_leaks/
http://git-annex.branchable.com/bugs/S3_upload_not_using_multipart/
2014-08-02 15:51:58 -04:00
Joey Hess
c3750901d8
specialize Preparer a bit, so resourcePrepare can be added
...
The forall a. in Preparer made resourcePrepare not seem to be usable, so
I specialized a to Bool. Which works for both Preparer Storer and
Preparer Retriever, but wouldn't let the Preparer be used for hasKey
as it currently stands.
2014-08-02 15:34:09 -04:00
zardoz
5e2dd2ea86
Added a comment
2014-08-02 14:29:26 +00:00
zardoz
670f4d43e3
2014-08-02 12:21:38 +00:00
https://id.koumbit.net/anarcat
25ac3a4c4a
some progress. maybe.
2014-08-02 02:46:07 +00:00
Joey Hess
0f7b8de91b
update roadmap
2014-08-01 18:22:13 -04:00
Joey Hess
dabf0bc501
typography
2014-08-01 18:18:52 -04:00
http://joeyh.name/
195c403ae3
removed
2014-08-01 22:16:29 +00:00
Joey Hess
b978adb503
document testremote
2014-08-01 18:10:02 -04:00
Joey Hess
5aa2286e7b
Merge branch 'newchunks'
...
I am happy enough with this to make it live!
2014-08-01 18:00:47 -04:00
Joey Hess
370c01811f
Merge branch 'master' of ssh://git-annex.branchable.com
2014-08-01 17:56:57 -04:00
Joey Hess
85ec4130bc
devblog
2014-08-01 17:56:31 -04:00
Joey Hess
1ee24a0366
testremote now tests with and without encryption
2014-08-01 17:52:40 -04:00
Joey Hess
50a1cac24f
fix example external remote script to write files atomically
2014-08-01 17:52:09 -04:00
Joey Hess
de0da0aece
minor optimisation
2014-08-01 17:18:39 -04:00
Joey Hess
3991327d09
testremote: Test retrieveKeyFile resume
...
And fixed a bug found by these tests; retrieveKeyFile would fail
when the dest file was already complete.
This commit was sponsored by Bradley Unterrheiner.
2014-08-01 17:16:20 -04:00
Joey Hess
20d7295386
improve testremote command, adding chunk size testing
...
And also a --size parameter to configure the basic object size.
2014-08-01 16:50:24 -04:00
Joey Hess
f4f82e2741
deriving Show
2014-08-01 16:30:33 -04:00
Joey Hess
9636cfd9e1
fix a fenchpost bug when resuming chunked store at end
...
Discovered thanks to testremote command!
2014-08-01 16:29:39 -04:00
Joey Hess
8fce4e4bd7
fix chunk=0
...
Found by testremote
2014-08-01 15:36:11 -04:00
Joey Hess
9720ee9e56
testremote: New command to test uploads/downloads to a remote.
...
This only performs some basic tests so far; no testing of chunking or
resuming. Also, the existing encryption type of the remote is used; it
would be good later to derive an encrypted and a non-encrypted version of
the remote and test them both.
This commit was sponsored by Joseph Liu.
2014-08-01 15:10:01 -04:00
gernot
0b078b2d37
2014-08-01 17:57:44 +00:00
Joey Hess
c03e1c5648
add new section for testing commands
2014-08-01 12:49:26 -04:00
https://www.google.com/accounts/o8/id?id=AItOawmAINLSovhWM_4_KrbngOcxduIbBuKv8ZA
0d5fe783e4
Added a comment
2014-08-01 09:28:21 +00:00
Xyem
4e9e700548
Added a comment
2014-08-01 09:05:45 +00:00
https://www.google.com/accounts/o8/id?id=AItOawmAINLSovhWM_4_KrbngOcxduIbBuKv8ZA
532231a748
2014-08-01 08:56:23 +00:00
zardoz
b100938c37
Added a comment
2014-07-31 11:43:16 +00:00
zardoz
044dc0252d
Add tip to make Firefox behave as expected when opening annexed HTML documents.
2014-07-31 10:48:11 +00:00
https://www.google.com/accounts/o8/id?id=AItOawm8BAEUyzYhORZmMuocRTk4M-3IumDm5VU
e1713220bc
Added a comment: Bug still valid
2014-07-31 08:35:30 +00:00
http://olivier.mehani.name/
b9ddecac7a
typo
2014-07-31 05:09:33 +00:00
https://www.google.com/accounts/o8/id?id=AItOawn-TDneVW-8kwb1fyTRAJfH3l1xs2VSEmk
a5eeefedd2
Added a comment
2014-07-30 20:37:27 +00:00
https://www.google.com/accounts/o8/id?id=AItOawmwjQzWgiD7_I3zw-_91rMRf_6qoThupis
76d546adac
Added a comment
2014-07-30 20:33:44 +00:00
Joey Hess
76d894f2e5
Display exception message when a transfer fails due to an exception.
...
For example, I had a copy to a remote that was failing for an unknown
reason. This let me see the exception was createDirectory: permission
denied; the underlying problem being a permissions issue.
2014-07-30 15:57:19 -04:00
Joey Hess
5848793d6b
chunk size advice
2014-07-30 12:06:59 -04:00
Joey Hess
97f60ac140
Merge branch 'master' of ssh://git-annex.branchable.com
2014-07-30 11:58:17 -04:00
Joey Hess
f3e457a195
add missing Ord constraint (fixes android build)
...
Probably the new ghc used on android is the root cause of needing this
constraint.
2014-07-30 11:57:40 -04:00
Joey Hess
b5ac627fee
WebDAV: Dropped support for DAV before 0.6.1.
...
0.6.1 is in testing, and stable does not have DAV at all, so I can dispense
with this compatability code
2014-07-30 11:20:35 -04:00
http://joeyh.name/
64db37a974
Added a comment: interesting idea
2014-07-30 15:03:46 +00:00
http://joeyh.name/
1defbdb10c
Added a comment
2014-07-30 14:55:16 +00:00
Joey Hess
83c58f17e0
mention possibility of parallel chunk upload/download
2014-07-30 10:43:21 -04:00
Joey Hess
89416ba2d9
only chunk stable keys
...
The content of unstable keys can potentially be different in different
repos, so eg, resuming a chunked upload started by another repo would
corrupt data.
2014-07-30 10:34:39 -04:00
Joey Hess
58f8b8f250
devblog
2014-07-29 20:44:26 -04:00
Joey Hess
a963d790d3
update progress after each chunk, at least
...
This way, when the remote implementation neglects to update progress,
there will still be a somewhat useful progress display, as long as chunks
are used.
2014-07-29 20:31:16 -04:00
Joey Hess
444944c7a9
fix cleanup of FileContents once done when them when retrieving
2014-07-29 20:27:13 -04:00
Joey Hess
53b87a859e
optimise case of remote that retrieves FileContent, when chunks and encryption are not being used
...
No need to read whole FileContent only to write it back out to a file in
this case. Can just rename! Yay.
Also indidentially, fixed an attempt to open a file for write that was
already opened for write, which caused a crash and deadlock.
2014-07-29 20:10:14 -04:00
Joey Hess
c0dc134cde
support chunking for all external special remotes!
...
Removing code and at the same time adding great features, including
upload/download resuming.
This commit was sponsored by Romain Lenglet.
2014-07-29 18:50:20 -04:00
