Commit graph

550 commits

Author SHA1 Message Date
Joey Hess
44cd5ae313
S3 export (untested)
It opens a http connection per file exported, but then so does git
annex copy --to s3.

Decided not to munge exported filenames for IA. Too large a chance of
the munging having confusing results. Instead, export of files not
supported by IA, eg with spaces in their name, will fail.

This commit was supported by the NSF-funded DataLad project.
2017-09-08 15:46:24 -04:00
Joey Hess
a1b195d84c
External special remote protocol extended to support export.
Also updated example.sh to support export.

This commit was supported by the NSF-funded DataLad project.
2017-09-08 14:24:05 -04:00
Joey Hess
28e2cad849
implement exporttree=yes configuration
* Only export to remotes that were initialized to support it.
* Prevent storing key/value on export remotes.
* Prevent enabling exporttree=yes and encryption in the same remote.

SetupStage Enable was changed to take the old RemoteConfig.
This allowed only setting exporttree when initially setting up a
remote, and not configuring it later after stuff might already be stored
in the remote.

Went with =yes rather than =true for consistency with other parts of
git-annex. Changed docs accordingly.

This commit was supported by the NSF-funded DataLad project.
2017-09-04 13:09:38 -04:00
Joey Hess
8f35c6584d
documentation for export
This commit was sponsored by Ole-Morten Duesund on Patreon.
2017-08-29 13:25:48 -04:00
Joey Hess
fdbfe88168
fix external script for filenames with spaces from protocol
Fix the external special remotes git-annex-remote-ipfs,
git-annex-remote-torrent and the example.sh template to correctly support
filenames with spaces.

This commit was sponsored by John Peloquin on Patreon.
2017-08-17 16:20:09 -04:00
fiatjaf
64ab727a10 Added a comment 2017-07-10 13:08:53 +00:00
http://xgm.de/oid/
61f362b4ff 2017-02-14 18:14:24 +00:00
Edward Betts
0750913136
correct spelling mistakes 2017-02-12 17:30:23 -04:00
victorsavu3@d059e0a74888923e70a555ce8ab75e8ba00b6eb7
72311753b3 Added a comment: RequestTimeoutException when uploading to glacier 2017-02-09 20:45:42 +00:00
mca@8789632e0b00e8efb984c948c13d9de28665f534
f1dd43d1b5 Added a comment: https-only access, type=S3 port=443 2017-01-05 13:10:44 +00:00
Joey Hess
794babf35a
add back share_with_a_friend_walkthrough, adapted for tor pairing
and some other xmpp to tor related changes
2016-12-24 15:46:02 -04:00
Joey Hess
ab66bbfeb6
Merge branch 'master' into no-xmpp 2016-12-24 15:01:55 -04:00
Joey Hess
1d82cf39ca
response 2016-12-13 12:48:11 -04:00
Joey Hess
46cbd65808
add page for tor special remote 2016-12-07 15:44:52 -04:00
davidriod@e75b369a4b1cced29c14354bce7493c61f00b1c7
d1ad4f1c00 Added a comment: Sharing rsync special remote between repository 2016-11-24 19:23:43 +00:00
David_K
057ee30429 removed 2016-11-16 01:28:32 +00:00
David_K
08ca407e67 Added a comment 2016-11-16 01:28:14 +00:00
David_K
6c1f0c6b02 Added a comment 2016-11-16 01:28:04 +00:00
Joey Hess
d58148031b
remove xmpp support
I've long considered the XMPP support in git-annex a wart.
It's nice to remove it.

(This also removes the NetMessager, which was only used for XMPP, and the
daemonstatus's desynced list (likewise).)

Existing XMPP remotes should be ignored by git-annex.

This commit was sponsored by Brock Spratlen on Patreon.
2016-11-14 14:53:08 -04:00
Joey Hess
2f15753cd3
response 2016-11-07 13:41:21 -04:00
Joey Hess
5343544822
S3: Support the special case endpoint needed for the cn-north-1 region.
* S3: Support the special case endpoint needed for the cn-north-1 region.
* Webapp: Don't list the Frankfurt region, as this (and some other new
  regions) need V4 authorization which the aws library does not yet use.

This commit was sponsored by Nick Daly on Patreon.
2016-11-07 11:49:34 -04:00
Joey Hess
1a11ae9da0
comment 2016-11-07 10:43:23 -04:00
spiderbit
91ba3b804e Added a comment: update 2016-11-05 17:38:26 +00:00
spiderbit
91c7f61961 Added a comment: dont have success with other download commands 2016-11-05 17:00:54 +00:00
bec.watson@8b5998670cf3d60f88e6297923d1391706e0d15b
a1e3cf83f7 Added a comment 2016-11-05 01:04:47 +00:00
bec.watson@8b5998670cf3d60f88e6297923d1391706e0d15b
1d7beaefbb removed 2016-11-05 00:56:48 +00:00
bec.watson@8b5998670cf3d60f88e6297923d1391706e0d15b
4b2ff58996 Added a comment: china cn-north-1 s3 remote issue 2016-11-05 00:55:31 +00:00
davidriod@e75b369a4b1cced29c14354bce7493c61f00b1c7
102a143bb8 Added a comment: ssh and encryption 2016-11-03 06:50:26 +00:00
Joey Hess
2adf273976
response 2016-11-01 14:31:10 -04:00
justin.lebar@7a36fcafc322d9a381e89f08ab6289033c6dde91
ef3ca02fc3 Added a comment 2016-11-01 04:10:25 +00:00
Marco
b9f51cc4a2 Added a comment: 1und1 Online Speicher 2016-10-19 03:42:42 +00:00
barthalion@8758f91921f1def00205716519c57234f128c328
e2dcbe656d Added a comment 2016-10-11 21:00:53 +00:00
barthalion@8758f91921f1def00205716519c57234f128c328
846e5a100e Added a comment: Compression level 2016-10-08 18:31:00 +00:00
http://christian.amsuess.com/chrysn
36d68a8f0a Added a comment: Re: attaching a torrent file to a downloaded and annexed directory 2016-10-07 09:11:56 +00:00
Joey Hess
f3f6dfcf35
New url for git-remote-gcrypt, now maintained by spwhitton. 2016-07-05 11:30:58 -04:00
Dilyin
456fe90b25 Added a comment: Special remote's annex cost 2016-06-01 18:44:15 +00:00
Joey Hess
010dc21f00
response 2016-05-31 12:21:13 -04:00
uwe.nagler@9f80ad68e498fcdb09e20b17ff4539f94ef73ea9
49f538712f Added a comment: subdirectories above FILEKEY directory 2016-05-31 11:51:56 +00:00
Joey Hess
27000d8af6
comment 2016-05-16 17:35:30 -04:00
aslkdjasd@656d48eb766881455ee14c8cd4adabdd14aad892
4b870861b1 Added a comment: layout reasoning 2016-05-14 01:23:42 +00:00
Joey Hess
412e89ecaa
response 2016-05-03 13:19:36 -04:00
grawity@2ea26be48562f66fcb9b66307da72b1e2e37453f
28af7c4b8a Added a comment 2016-05-02 18:43:33 +00:00
grawity@2ea26be48562f66fcb9b66307da72b1e2e37453f
02fea5bce5 Added a comment 2016-05-02 18:41:54 +00:00
Joey Hess
e462f9a34e
response 2016-04-13 15:23:11 -04:00
tim@5431dd39464df207b7d46d3cf1bc74c82123ac68
ea803d1554 Added a comment: Sharing S3 bucket without fileprefix 2016-04-13 19:02:24 +00:00
anarcat
e16ba65caf Added a comment: git remote 2016-03-24 14:15:06 +00:00
Joey Hess
5d05aad74c
S3: Allow configuring with requeststyle=path to use path-style bucket access instead of the default DNS-style access.
untested
2016-02-09 15:36:36 -04:00
wzhd
a3399a363f Added a comment: attaching a torrent file to a downloaded and annexed directory 2016-01-19 10:07:28 +00:00
Joey Hess
d283fa4fe9
comment 2015-12-10 11:22:28 -04:00
Joey Hess
79dd48546a
response 2015-12-10 11:20:01 -04:00
openmedi
ef664f089f Added a comment 2015-12-09 20:18:48 +00:00
https://me.yahoo.com/a/EbvxpTI_xP9Aod7Mg4cwGhgjrCrdM5s-#7c0f4
5ef6ed8b9a Added a comment: anyone saw/worked on backend for watchdox service? (not free one but needed :-/) 2015-12-08 19:45:03 +00:00
cantora@432fae6be728a32ac472387df86a8922f059d4a6
c71a6e3a0d Added a comment: How to view configuration of special remotes? 2015-12-08 08:29:12 +00:00
encryptio@2557a3f5b4ef0cddf8f011d7dbb3e76d46ed9c79
9ca5fe58e7 Added a comment: git-annex-remote-b2 2015-12-04 03:19:29 +00:00
Joey Hess
602f392e6d
comment 2015-11-30 15:38:39 -04:00
vvghadge@ec0c34f6cadf7a32fc6cf0b2bee34c3ce9c568f2
80cc59bc8a removed 2015-11-26 00:35:30 +00:00
vvghadge@ec0c34f6cadf7a32fc6cf0b2bee34c3ce9c568f2
674a86750f Added a comment: location of Mapping of file to tahoe uri? 2015-11-26 00:35:11 +00:00
vvghadge@ec0c34f6cadf7a32fc6cf0b2bee34c3ce9c568f2
29adb9a8d6 Added a comment: location of Mapping of file to tahoe uri? 2015-11-26 00:35:00 +00:00
rob.syme@92895c98b16fd7a88bed5f10913c522ebfd76c31
436ef08492 Added a comment: git-annex-remote-ipfs 2015-11-19 14:46:04 +00:00
Joey Hess
1b541ec71a
remove badly offtopic comment 2015-11-18 15:49:53 -04:00
Joey Hess
a9a10ee0a9
improve error message when special remote program cannot be run 2015-11-18 12:30:01 -04:00
rob.syme@92895c98b16fd7a88bed5f10913c522ebfd76c31
0040e5a733 Added a comment: Finding IPFS hash 2015-11-18 14:55:33 +00:00
craig@6ddb6e2c94325e18a0d631a06e63fdc111ab1f12
f9369a0b69 Added a comment: Thanks 2015-11-16 05:34:35 +00:00
https://woid.cryptobitch.de/foobar
36918f26e5 Added a comment: obnam 2015-11-12 11:50:52 +00:00
Joey Hess
8c0c376650
response 2015-11-10 14:58:38 -04:00
vvghadge@ec0c34f6cadf7a32fc6cf0b2bee34c3ce9c568f2
34491b5748 Added a comment: location of Mapping of file to tahoe uri? 2015-11-06 02:28:04 +00:00
vvghadge@ec0c34f6cadf7a32fc6cf0b2bee34c3ce9c568f2
9c597a9135 removed 2015-11-06 02:27:26 +00:00
vvghadge@ec0c34f6cadf7a32fc6cf0b2bee34c3ce9c568f2
e0832b4c8d Added a comment: location of Mapping of file to tahoe uri? 2015-11-06 02:27:10 +00:00
vvghadge@ec0c34f6cadf7a32fc6cf0b2bee34c3ce9c568f2
f95c0398ab removed 2015-11-06 02:26:01 +00:00
vvghadge@ec0c34f6cadf7a32fc6cf0b2bee34c3ce9c568f2
19c6fdc6cb Added a comment: location of Mapping of file to tahoe uri? 2015-11-06 02:24:39 +00:00
alex@7ca398785b94de08e4386b708f32ff9f1af381c7
3f0a1ef495 Added a comment: backblaze support 2015-11-04 19:58:35 +00:00
Joey Hess
4153507864
Fix failure to build with aws-0.13.0 and finish nearline support.
* Fix failure to build with aws-0.13.0.
* When built with aws-0.13.0, the S3 special remote can be used to create
  google nearline buckets, by setting storageclass=NEARLINE.
2015-11-02 11:14:03 -04:00
Joey Hess
640dba43b6
enableremote: List uuids and descriptions of remotes that can be enabled, and accept either the uuid or the description in leu if the name. 2015-10-26 14:55:40 -04:00
craig@6ddb6e2c94325e18a0d631a06e63fdc111ab1f12
cfff8f9f73 Added a comment: Replicating my key for encrypted special remotes 2015-10-25 19:00:57 +00:00
Joey Hess
033e4da5a7
response 2015-10-19 13:36:24 -04:00
craig@6ddb6e2c94325e18a0d631a06e63fdc111ab1f12
177231a557 Added a comment: Replicating my key for encrypted special remotes 2015-10-17 16:29:24 +00:00
Joey Hess
c84a5d39b1
response 2015-10-12 13:13:27 -04:00
darkfeline
c3df43e92c Added a comment: Sharing S3 bucket between repos 2015-10-09 01:16:25 +00:00
Joey Hess
26d6566307 S3 storage classes expansion
Added support for storageclass=STANDARD_IA to use Amazon's
new Infrequently Accessed storage.

Also allows using storageclass=NEARLINE to use Google's NearLine storage.

The necessary changes to aws to support this are in
https://github.com/aristidb/aws/pull/176
2015-09-17 17:20:01 -04:00
dave@2ab82f485adf7e2ce787066e35f5f9789bff430b
e0116db92f Added a comment: re: UnicodeDecodeError 2015-08-26 21:54:08 +00:00
git-annex,branchable.com@1fa4b21c7ece2d61d4730de8e83329049126cedc
87972f5a33 Added a comment: Glacier-cli works, thanks, some encode / decode error now... 2015-08-26 08:30:53 +00:00
Joey Hess
2b01e61774 response 2015-08-19 14:44:26 -04:00
Joey Hess
99b242c253 response 2015-08-19 14:29:22 -04:00
forbesmyester@2cec261fa984ee168bdbad63665c58953963c10e
7257e6c9b8 Added a comment: Not sure what is wrong... looks like glacier might be called wrongly. 2015-08-18 07:42:38 +00:00
darkfeline@e6d098788a13ce41f3141a2dfc1bd31b401e83f0
88b5a5ae7b Added a comment: buprepo doesn't work properly 2015-08-17 12:59:25 +00:00
Joey Hess
7be948f6d4 response 2015-08-14 14:05:46 -04:00
sanket
a39ae9ec3e Added a comment: Integrating Tahoe and Git annex using special remote 2015-08-12 00:00:09 +00:00
Joey Hess
6ded6fd19a promote comment to todo 2015-08-06 13:33:25 -04:00
Joey Hess
1c2c086d51 response 2015-07-06 15:02:46 -04:00
dmitry.olyenyov@6d65bb07071e5517960a647c097dd453b91773dd
c16e66ef48 Added a comment: Limit max size of remote 2015-06-17 11:24:54 +00:00
Joey Hess
52934c48ba Merge branch 'master' of ssh://git-annex.branchable.com 2015-06-05 16:28:08 -04:00
Joey Hess
5f0f063a7a S3: Publically accessible buckets can be used without creds. 2015-06-05 16:23:35 -04:00
Joey Hess
4acd28bf21 public=yes config to send AclPublicRead
In my tests, this has to be set when uploading a file to the bucket
and then the file can be accessed using the bucketname.s3.amazonaws.com
url.

Setting it when creating the bucket didn't seem to make the whole bucket
public, or allow accessing files stored in it. But I have gone ahead and
also sent it when creating the bucket just in case that is needed in some
case.
2015-06-05 14:38:01 -04:00
junk@5e3eeba2290e8a3fcf938d9f93b0dfa2565dc7b1
1e2ad7fd28 Added a comment: Tahoe-LAFS helper: multiple FURLs for the same grid 2015-06-05 09:19:19 +00:00
Joey Hess
4536bf8431 comment 2015-06-02 15:09:31 -04:00
Øyvind A. Holm
3d643a5707 doc/*.mdwn: Various typo fixes 2015-05-30 16:54:14 +02:00
Joey Hess
eddb9daa69 followup 2015-05-27 15:09:56 -04:00
rob.syme@92895c98b16fd7a88bed5f10913c522ebfd76c31
db17e9d329 Added a comment: Finding IPFS hash 2015-05-26 05:08:38 +00:00
rob.syme@92895c98b16fd7a88bed5f10913c522ebfd76c31
9e7cbd17ff Added a comment: Finding IPFS hash 2015-05-26 04:55:32 +00:00
junk@5e3eeba2290e8a3fcf938d9f93b0dfa2565dc7b1
97cad76916 Added a comment: Tahoe-LAFS helper: multiple FURLs for the same grid 2015-05-24 13:48:33 +00:00
anarcat
abe4181067 remove too much time 2015-05-20 22:19:37 +00:00
https://www.google.com/accounts/o8/id?id=AItOawnWvnTWY6LrcPB4BzYEBn5mRTpNhg5EtEg
4972ec4f62 Added a comment: Amazon Cloud Drive support 2015-03-28 10:35:47 +00:00
https://id.koumbit.net/anarcat
0e9f9019d1 Added a comment: about copying to the local store 2015-03-07 13:16:02 +00:00
Joey Hess
7a327f8f7f fix whereis output example 2015-03-05 13:56:49 -04:00
Joey Hess
6045406deb Added SETURIPRESENT and SETURIMISSING to external special remote protocol
Useful for things like ipfs that don't use regular urls.

An external special remote can add a regular url to a key, and then
git-annex get will download it from the web. But for ipfs, we want to
instead tell git-annex that the uri uses OtherDownloader. Before this
change, the external special remote protocol lacked a way to do that.
2015-03-05 13:50:15 -04:00
Joey Hess
9b4b190739 fix heading 2015-03-05 12:11:38 -04:00
Joey Hess
ea74b1d568 experimental ipfs special remote, with addurl support 2015-03-05 12:08:50 -04:00
https://www.google.com/accounts/o8/id?id=AItOawlc-3pdibcizrdz4WmZooECL0k6AvM1cWc
3fc8d834e8 Added a comment: S3 file/folder names 2015-02-19 22:22:26 +00:00
https://id.koumbit.net/anarcat
02b49f9d60 fix link 2015-02-16 20:33:03 +00:00
https://id.koumbit.net/anarcat
9fa6841e55 2015-02-13 00:27:31 +00:00
https://id.koumbit.net/anarcat
c5c7bf2dab note when this was introduced, it confused me to not see this in jessie! 2015-02-10 02:57:44 +00:00
Joey Hess
2b138f684e add link to google cloud storage tip 2015-02-04 14:54:16 -04:00
Joey Hess
afc5153157 update my email address and homepage url 2015-01-21 12:50:09 -04:00
Joey Hess
bc633954e4 remove obsolete note; s3-aws was merged already 2015-01-05 16:45:22 -04:00
Joey Hess
f5fdeba45b note about trust and checking copies 2014-12-18 15:58:28 -04:00
Joey Hess
ef12386924 When possible, build with the haskell torrent library for parsing torrent files. 2014-12-18 14:26:10 -04:00
Joey Hess
b302d4207c make checkKey always return unknown 2014-12-17 15:39:35 -04:00
Joey Hess
e2214f6ac8 remove default untrusted hack for bittorrent
This is better handled by checkPresent always failing.
2014-12-17 15:38:00 -04:00
Joey Hess
eb8c842666 addurl with #n doesn't work, remove from docs
Doesn't really seem worth making it work; addurl --fast can be used to
get a tree of files in the torrent and then the user can rm the ones they
don't want.
2014-12-17 14:43:36 -04:00
Joey Hess
a7690de016 Added bittorrent special remote
addurl behavior change: When downloading an url ending in .torrent,
it will download files from bittorrent, instead of the old behavior
of adding the torrent file to the repository.

Added Recommends on aria2 and bittornado | bittorrent.

This commit was sponsored by Asbjørn Sloth Tønnesen.
2014-12-16 23:22:46 -04:00
Joey Hess
b0ca0985ce fix support for single-file torrents 2014-12-11 19:48:00 -04:00
Joey Hess
29a6431582 move error message to return value 2014-12-11 18:26:29 -04:00
Joey Hess
fabc3863d5 add working external special remote for torrents
Not IMHO good enough quality to be more than an example, but it does work!
2014-12-11 18:09:44 -04:00
https://www.google.com/accounts/o8/id?id=AItOawnWvnTWY6LrcPB4BzYEBn5mRTpNhg5EtEg
4136300f64 2014-12-08 17:24:31 +00:00
https://www.google.com/accounts/o8/id?id=AItOawkEYZEqLf3Aj_FGV7S0FvsMplmGqqb555M
898212fa9e Added a comment: bup-join local-arch/2014-12-03-235617 2014-12-04 19:38:07 +00:00
Joey Hess
911ba8d972 Merge branch 's3-aws' 2014-12-03 14:10:52 -04:00
https://www.google.com/accounts/o8/id?id=AItOawn6NYODTE1Sy9YZoi2pvb6i-lcq3dYBxZI
ad4dcded70 Added a comment: android client 2014-11-17 18:34:12 +00:00
Joey Hess
2fbaf6d89c reorder 2014-11-06 14:26:01 -04:00
https://olivier.mehani.name/
eac8047dad Added a comment 2014-11-05 22:57:21 +00:00
Joey Hess
83901c6c17 better partsize docs
The minimum allowsed size actually refers to the part size!
2014-11-04 16:38:46 -04:00
Joey Hess
93feefae05 Revert "work around minimum part size problem"
This reverts commit a42022d8ff.

I misunderstood the cause of the problem.
2014-11-04 16:21:55 -04:00
Joey Hess
a42022d8ff work around minimum part size problem
When uploading the last part of a file, which was 640229 bytes, S3 rejected
that part: "Your proposed upload is smaller than the minimum allowed size"

I don't know what the minimum is, but the fix is just to include the last
part into the previous part. Since this can result in a part that's
double-sized, use half-sized parts normally.
2014-11-04 16:06:13 -04:00
Joey Hess
6e89d070bc WIP multipart S3 upload
I'm a little stuck on getting the list of etags of the parts.
This seems to require taking the md5 of each part locally,
which doesn't get along well with lazily streaming in the part from the
file. It would need to read the file twice, or lose laziness and buffer a
whole part -- but parts might be quite large.

This seems to be a problem with the API provided; S3 is supposed to return
an etag, but that is not exposed. I have filed a bug:
https://github.com/aristidb/aws/issues/141
2014-10-28 14:17:30 -04:00
Joey Hess
35551d0ed0 Merge branch 'master' into s3-aws
Conflicts:
	Remote/S3.hs
2014-10-22 17:14:38 -04:00
Joey Hess
deddbf8a66 add encryption setting to examples 2014-10-02 11:30:19 -04:00
Joey Hess
ef01ff1e77 Merge branch 'master' into s3-aws
Conflicts:
	git-annex.cabal
2014-08-15 17:30:40 -04:00
Joey Hess
0d54b7b341 clarify config option name 2014-08-15 12:02:40 -04:00
Joey Hess
57872b457b pass metadata headers and storage class to S3 when putting objects 2014-08-09 14:44:53 -04:00
Joey Hess
6fcca2f13e WIP converting S3 special remote from hS3 to aws library
Currently, initremote works, but not the other operations. They should be
fairly easy to add from this base.

Also, https://github.com/aristidb/aws/issues/119 blocks internet archive
support.

Note that since http-conduit is used, this also adds https support to S3.
Although git-annex encrypts everything anyway, so that may not be extremely
useful. It is not enabled by default, because existing S3 special remotes
have port=80 in their config. Setting port=443 will enable it.

This commit was sponsored by Daniel Brockman.
2014-08-08 19:00:53 -04:00
Joey Hess
aacb0b2823 convert WebDAV to new special remote interface, adding new-style chunking support
Reusing http connection when operating on chunks is not done yet,
I had to submit some patches to DAV to support that. However, this is no
slower than old-style chunking was.

Note that it's a fileRetriever and a fileStorer, despite DAV using
bytestrings that would allow streaming. As a result, upload/download of
encrypted files is made a bit more expensive, since it spools them to temp
files. This was needed to get the progress meters to work.

There are probably ways to avoid that.. But it turns out that the current
DAV interface buffers the whole file content in memory, and I have
sent in a patch to DAV to improve its interfaces. Using the new interfaces,
it's certainly going to need to be a fileStorer, in order to read the file
size from the file (getting the size of a bytestring would destroy
laziness). It should be possible to use the new interface to make it be a
byteRetriever, so I'll change that when I get to it.

This commit was sponsored by Andreas Olsson.
2014-08-06 16:57:06 -04:00
Joey Hess
b35f7983ff convert gcrypt to new regime, including chunking
Some reorg of Remote.Rsync code to export the things gcrypt needs.
2014-08-03 17:31:10 -04:00
Joey Hess
e1e5853c94 rsync: support chunking
Chunking does not speed up rsync at all, so it's only useful for
interop with the directory special remote.
2014-08-03 15:07:43 -04:00
Joey Hess
c653e80829 Merge branch 'master' into newchunks 2014-08-03 15:04:10 -04:00
Joey Hess
7f5cd868d7 hook: use ChunkedEncryptable 2014-08-02 17:25:16 -04:00
Joey Hess
d4dc1bce75 document that encryption + bup = inneficient 2014-08-02 17:04:40 -04:00
Joey Hess
32e4368377 S3: support chunking
The assistant defaults to 1MiB chunk size for new S3 special remotes.
Which will work around a couple of bugs:
  http://git-annex.branchable.com/bugs/S3_memory_leaks/
  http://git-annex.branchable.com/bugs/S3_upload_not_using_multipart/
2014-08-02 15:51:58 -04:00
http://joeyh.name/
195c403ae3 removed 2014-08-01 22:16:29 +00:00
Joey Hess
50a1cac24f fix example external remote script to write files atomically 2014-08-01 17:52:09 -04:00
Joey Hess
7db60269eb update does for chunking 2014-07-26 23:39:51 -04:00
Joey Hess
275e284dda doc update for new chunking 2014-07-26 20:21:49 -04:00
Joey Hess
5262e6a372 recommend users not change the chunksize
Suppose A is 10 mb, and B is 20 mb, and the upload speed is the same. If B
starts first, when A will overwrite the file it is uploading for the 1st chunk.
Then A uploads the second chunk, and once A is done, B finishes the 1st chunk
and uploads its second. We now have 1(from A), 2(from B), so data loss.
2014-07-23 16:46:15 -04:00
Joey Hess
ec5ed2af9d Set gcrypt-publish-participants when setting up a gcrypt repository, to avoid unncessary passphrase prompts.
This is a security/usability tradeoff. To avoid exposing the gpg key ids
who can decrypt the repository, users can unset
gcrypt-publish-participants.

The gcrypt-publish-participants option is available in my fork of
git-remote-gcrypt.

This commit was sponsored by Christopher Kernahan.
2014-07-15 17:33:14 -04:00
https://www.google.com/accounts/o8/id?id=AItOawndSPd52H_L7hcYsJjLQ4kR1LopprHy7Xw
3700fb00af 2014-07-10 22:37:59 +00:00
http://joeyh.name/
c50872cd6b Added a comment: that is an ancient version of git-annex, Shane 2014-07-02 17:11:24 +00:00
https://www.google.com/accounts/o8/id?id=AItOawlhaXbLZQ5uQ6fM2kV0n8bj6IwZjx2CLeM
6bca9849cf Added a comment: Annex can't find Glacier remote 2014-06-26 05:50:38 +00:00
https://www.google.com/accounts/o8/id?id=AItOawmZilYULa6CDEGfuagoDlesyakBgnf-dF8
9f9499bcff removed 2014-05-21 04:07:59 +00:00
https://www.google.com/accounts/o8/id?id=AItOawmZilYULa6CDEGfuagoDlesyakBgnf-dF8
74c04de41b Added a comment: Box.com and unknown CA? 2014-05-21 04:07:36 +00:00
https://www.google.com/accounts/o8/id?id=AItOawmZilYULa6CDEGfuagoDlesyakBgnf-dF8
461555e33e Added a comment: Box.com and unknown CA? 2014-05-21 04:07:30 +00:00
https://www.google.com/accounts/o8/id?id=AItOawnmF_9CAtfqdZkC4e-_dCX-rK5bqh4RWkw
aee63eaa84 Changing to box.com's current webdav server adress. 2014-05-18 05:29:06 +00:00
https://www.google.com/accounts/o8/id?id=AItOawnmF_9CAtfqdZkC4e-_dCX-rK5bqh4RWkw
40c9aa1506 Added a comment 2014-05-17 20:47:01 +00:00
http://joeyh.name/
36a04427db Added a comment 2014-05-16 19:11:02 +00:00
http://joeyh.name/
185413e77b Added a comment 2014-05-16 18:19:22 +00:00
Robie Basak
4184566627 ddar special remote 2014-05-15 16:32:44 -04:00
https://www.google.com/accounts/o8/id?id=AItOawnq-RfkVpFN15SWvQ2lpSGAi0XpNQuLxKM
68a62b337d Added a comment: re: Change Password 2014-05-04 19:09:56 +00:00
https://www.google.com/accounts/o8/id?id=AItOawnmF_9CAtfqdZkC4e-_dCX-rK5bqh4RWkw
e232f59375 Added a comment: Change Password 2014-05-02 12:31:02 +00:00
https://www.google.com/accounts/o8/id?id=AItOawmp1ThsNNAbSn46ju-gwFELfStlhl8usJo
d2b72686c8 Added a comment: Enhancing special remotes as backup spaces 2014-04-22 21:08:49 +00:00
https://www.google.com/accounts/o8/id?id=AItOawl64jV2rE8GMogJ6XuqESSkz78RVBgVdGw
cdc3874c56 removed 2014-04-07 11:32:46 +00:00
https://www.google.com/accounts/o8/id?id=AItOawl64jV2rE8GMogJ6XuqESSkz78RVBgVdGw
1705215388 Added a comment: I can't add special remotes 2014-04-07 11:29:28 +00:00
https://www.google.com/accounts/o8/id?id=AItOawl64jV2rE8GMogJ6XuqESSkz78RVBgVdGw
53f94bbcfc removed 2014-04-07 11:27:57 +00:00
https://www.google.com/accounts/o8/id?id=AItOawl64jV2rE8GMogJ6XuqESSkz78RVBgVdGw
bdea0964e2 removed 2014-04-07 11:26:18 +00:00
https://www.google.com/accounts/o8/id?id=AItOawl64jV2rE8GMogJ6XuqESSkz78RVBgVdGw
3db1ca5d57 Added a comment: I can't add special remotes 2014-04-07 11:25:46 +00:00
https://www.google.com/accounts/o8/id?id=AItOawl64jV2rE8GMogJ6XuqESSkz78RVBgVdGw
eefaa6eaab Added a comment: I can't add special remotes 2014-04-07 11:25:34 +00:00
Joey Hess
2940fa1ba2 respond; improve docs 2014-03-26 13:11:49 -04:00
Joey Hess
18c98c8cfa improve directory special remote docs 2014-02-02 15:26:33 -04:00
https://www.google.com/accounts/o8/id?id=AItOawm-19QERTsjJSB-m6dWvOa1w9SOxyhFqDM
a0cacffebf 2014-01-29 17:35:17 +00:00
Joey Hess
aafef31ecd format 2014-01-08 16:33:23 -04:00
Joey Hess
85272d8a98 Added tahoe special remote.
Known problems:

1. Tries to tahoe start when daemon is already running.

2. If multiple tahoe remotes are set up on the same computer,
   they will have the same node.url configured by default,
   and this confuses tahoe commands.

This commit was sponsored by LeastAuthority.com
2014-01-08 16:14:41 -04:00
Joey Hess
054e4f17e2 implement PREPARE-FAILURE for Tobias 2013-12-29 13:39:25 -04:00
https://www.google.com/accounts/o8/id?id=AItOawm0yDI6AsAuXPDHIDXm5H9EGDXkuwb1efA
bd1bdcb619 Added a comment: XMPP not working in Raspberry PI build 2013-12-27 23:16:38 +00:00
Joey Hess
445b7b41b9 add credential storage support for external special remotes & update example 2013-12-27 16:01:43 -04:00
Joey Hess
6de3bc2ab6 make directory absolute (mostly as an example of using SETCONFIG) 2013-12-27 14:30:00 -04:00
Joey Hess
dc7681b2bb emphasize link to protocol 2013-12-27 14:15:35 -04:00
Joey Hess
9b944e71e1 fix link 2013-12-27 14:15:01 -04:00
Joey Hess
5972ee50fa external special remotes working 2013-12-27 14:13:52 -04:00
Joey Hess
4d94e40ddd de-verbose cp 2013-12-27 14:06:56 -04:00
Joey Hess
e9cb88ca38 another bug in shell code. haskell has ruined me 2013-12-27 14:06:33 -04:00
Joey Hess
53b0228077 fix 3 more bugs in these measly 150 lines of shell code. sheesh 2013-12-27 14:04:51 -04:00
Joey Hess
5d8ff64dc1 make --debug show transcript of special remote protocol messages 2013-12-27 03:10:00 -04:00
Joey Hess
526a7bb2b4 improve comments 2013-12-27 02:56:52 -04:00
Joey Hess
5b7c38c90a improve code, seems to work well now 2013-12-27 02:49:00 -04:00
Joey Hess
5d00fa523c fix bug (no type safe protocol stuff here, alas..) 2013-12-27 02:12:33 -04:00
Joey Hess
6d504b57e7 make some requests optional, simplify and future-proof protocol more 2013-12-27 02:11:06 -04:00
Joey Hess
cfcc1c13a0 fix format of sample program 2013-12-26 18:36:57 -04:00
Joey Hess
409a85b264 update 2013-12-26 18:20:32 -04:00
Joey Hess
0de9135bc0 external special remote documentation and example script 2013-12-26 18:15:18 -04:00
https://www.google.com/accounts/o8/id?id=AItOawmZilYULa6CDEGfuagoDlesyakBgnf-dF8
736ce5e669 Google Apps just needs good SRV records 2013-11-27 18:18:12 +00:00
https://www.google.com/accounts/o8/id?id=AItOawmZilYULa6CDEGfuagoDlesyakBgnf-dF8
279416939b Added a comment: Google Apps & SRV 2013-11-27 18:13:18 +00:00
https://www.google.com/accounts/o8/id?id=AItOawlq4ClC5EMN1Vq1DpWXAqP5TiDnCK1mSfk
dc18398f7d Added a comment: Expected cost for a repository 2013-11-24 22:32:16 +00:00
http://joeyh.name/
4ad39330a3 Added a comment 2013-11-24 15:58:31 +00:00
https://www.google.com/accounts/o8/id?id=AItOawnWvnTWY6LrcPB4BzYEBn5mRTpNhg5EtEg
f3d12e7449 Added a comment: Testing a special remote 2013-11-24 08:24:38 +00:00