Commit graph

2297 commits

Author SHA1 Message Date
Joey Hess
585e6b39aa
comment 2018-10-04 12:45:48 -04:00
Ilya_Shlyakhter
b0b69f1819 suggestion - dockerized external special remotes 2018-10-04 01:23:53 +00:00
Ilya_Shlyakhter
0783f0afcf Added a comment 2018-10-04 01:11:11 +00:00
Joey Hess
9d0e274b07
Merge branch 'master' of ssh://git-annex.branchable.com 2018-10-03 14:04:39 -04:00
Joey Hess
aa69796121
simplify 2018-10-03 14:04:19 -04:00
Joey Hess
acc1dc37b0
followup 2018-10-03 14:04:14 -04:00
yarikoptic
273a9053cd Added a comment 2018-10-03 18:03:56 +00:00
yarikoptic
807884f3d1 Added a comment 2018-10-03 17:55:04 +00:00
Ilya_Shlyakhter
441a018e3a suggested config flag to use all available cores 2018-10-03 17:50:08 +00:00
Joey Hess
50b885ffd6
close, implemented already 2018-10-03 13:42:56 -04:00
yarikoptic
fe8cbc447b Added a comment 2018-10-03 17:39:48 +00:00
Joey Hess
4ea33ecadd
close, probably git annex inprogress was it 2018-10-03 13:26:49 -04:00
Joey Hess
a62c94e811
retitle 2018-10-03 13:25:00 -04:00
Joey Hess
233a45994b
retitle 2018-10-03 13:22:52 -04:00
Joey Hess
8ac762414c
close, fixed long ago 2018-10-03 13:15:36 -04:00
Joey Hess
acbb21f89b
close 2018-10-03 13:12:12 -04:00
Joey Hess
0fe258b6e1
close 2018-10-03 13:10:00 -04:00
Joey Hess
7d1d233ba9
close 2018-10-03 13:08:08 -04:00
Joey Hess
3693d11d7d
close obsolete request 2018-10-03 12:55:20 -04:00
Joey Hess
746db2e276
close old todo and add freenet special remote to list 2018-10-03 12:54:34 -04:00
Joey Hess
ebde4bd94b
close, fixed by p2p for ssh 2018-10-03 12:52:01 -04:00
Joey Hess
590f67461a
close, git annex inprogress does this 2018-10-03 12:48:09 -04:00
Joey Hess
c007d53978
followup 2018-10-03 12:40:27 -04:00
Joey Hess
a8c133b20e
Merge branch 'master' of ssh://git-annex.branchable.com 2018-10-03 12:36:29 -04:00
Joey Hess
43dc8ed703
followup 2018-10-03 12:36:11 -04:00
Joey Hess
303d10cee6
Improve display when git config download from a http remote fails.
The error message displayed used to only come from curl/wget and perhaps
was clearer than the one displayed now that http-client is used. In any
case, it does make sense to hide it because git-annex prints its own
warning message.

This commit was sponsored by Jake Vosloo on Patreon.
2018-10-03 12:31:09 -04:00
Joey Hess
9aeffde4cb
followup 2018-10-03 12:29:21 -04:00
Ilya_Shlyakhter
e32b54f490 Added a comment 2018-10-02 17:38:11 +00:00
Joey Hess
2797bf851a
thoughts 2018-10-02 10:16:57 -04:00
Joey Hess
95aafbfdc2
Merge branch 'master' of ssh://git-annex.branchable.com 2018-10-01 16:17:55 -04:00
Joey Hess
cd7a31069a
thought 2018-10-01 16:15:42 -04:00
Joey Hess
2a5e60d9fe
status update
(cherry picked from commit 480bc61fcf)
2018-10-01 16:11:53 -04:00
yarikoptic
366f7f81ef Added a comment 2018-10-01 16:29:19 +00:00
Joey Hess
47707608b1
followup 2018-10-01 12:21:34 -04:00
Joey Hess
a7309549ad
response 2018-10-01 11:59:05 -04:00
yarikoptic
53c8e3e0f8 initial report on download failed msg 2018-09-28 16:57:59 +00:00
yarikoptic
43d777f0ab initial idea on --progress for git calls 2018-09-28 16:14:57 +00:00
Joey Hess
5798786205
Merge branch 'master' of ssh://git-annex.branchable.com 2018-09-28 10:49:28 -04:00
yarikoptic
c487d46a36 initial recommendation about config for mode on crippled systems 2018-09-27 20:00:01 +00:00
Joey Hess
9adee3f2fb
sync: Warn when a remote's export is not updated to the current tree because export tracking is not configured.
Only display the warning when the current branch has a tree that is not
the same as the tree in the export.

Note that it doesn't check to see if the current tree is
in incompleteExportedTreeish; it might be worth checking that and reminding
the user about an incomplete export, but when export tracking is not
configured, they are probably not in the right clone of the repository to
resolve the incomplete export.

This commit was sponsored by Ethan Aubin.
2018-09-27 15:41:18 -04:00
Ilya_Shlyakhter
f35ba87ea6 Added a comment 2018-09-27 11:09:04 +00:00
CandyAngel
0b6123bbec Added a comment 2018-09-27 07:39:58 +00:00
Ilya_Shlyakhter
acfc49ae6e fixed suggested encoding 2018-09-26 18:11:35 +00:00
Ilya_Shlyakhter
b15747978d added todo re: shorter keys through better encoding 2018-09-26 16:58:53 +00:00
Ilya_Shlyakhter
97ef9e1c4a added todo re: creating option to add user-specified string to key 2018-09-26 03:02:23 +00:00
Ilya_Shlyakhter
3e84a055ea Added a comment 2018-09-26 00:51:30 +00:00
Ilya_Shlyakhter
a51c819868 removed 2018-09-26 00:15:23 +00:00
Ilya_Shlyakhter
7440560361 Added a comment 2018-09-26 00:15:04 +00:00
Ilya_Shlyakhter
0bb0bb3c39 Added a comment 2018-09-26 00:14:53 +00:00
Joey Hess
5ce9080d41
forgot to add this comment 2018-09-25 16:51:54 -04:00
Joey Hess
2ebf4c3ec2
close another report of same bug 2018-09-25 15:36:20 -04:00
Joey Hess
bc31b93c77
remote.name.annex-security-allow-unverified-downloads
Added remote.name.annex-security-allow-unverified-downloads, a per-remote
setting for annex.security.allow-unverified-downloads.

This commit was sponsored by Brock Spratlen on Patreon.
2018-09-25 15:34:47 -04:00
Joey Hess
d95f682d87
todo 2018-09-24 15:46:49 -04:00
Ilya_Shlyakhter
e28ae667a4 Added a comment 2018-09-24 18:50:46 +00:00
Joey Hess
4ecba916a1
annex.maxextensionlength
Added annex.maxextensionlength for use cases where extensions longer than 4
characters are needed.

This commit was sponsored by Henrik Riomar on Patreon.
2018-09-24 12:10:18 -04:00
Joey Hess
0f9eafc157
comment 2018-09-24 11:50:40 -04:00
Joey Hess
8873cf0789
Merge branch 'master' of ssh://git-annex.branchable.com 2018-09-22 11:29:29 -04:00
Joey Hess
09ce2cf012
new ghc fixes windows filename length issue 2018-09-22 11:28:59 -04:00
Ilya_Shlyakhter
1cc0de995c added a todo suggestion about supporting longer file extensions and full filenames in symlink targets 2018-09-21 00:36:08 +00:00
Ilya_Shlyakhter
ea51ac3f59 better exceptions to annex.security.allow-unverified-downloads 2018-09-19 15:49:57 +00:00
yarikoptic
4528bbab43 initial idea on s3 2018-09-19 13:17:41 +00:00
spwhitton
c98e383ffd intentional->unintentional 2018-09-18 22:13:09 +00:00
spwhitton
c517b3132d report bug 2018-09-18 22:12:47 +00:00
https://christian.amsuess.com/chrysn
8f0d61ed9f Added a comment: symlinks into git-annex 2018-09-18 19:15:11 +00:00
Ilya_Shlyakhter
295be65c3e Added a comment 2018-09-18 18:48:06 +00:00
Ilya_Shlyakhter
1f1d1a6c6e Added a comment 2018-09-18 18:41:02 +00:00
Joey Hess
cd3f231d21
retitle 2018-09-12 14:21:39 -04:00
Joey Hess
e01903efc5
response 2018-09-11 13:13:27 -04:00
https://me.yahoo.com/a/iOGTltEpmOTQ.xZ99NFP5c7Zdcc-#6a7ba
cf2cc6f7fc Added a comment 2018-09-07 18:04:51 +00:00
https://me.yahoo.com/a/iOGTltEpmOTQ.xZ99NFP5c7Zdcc-#6a7ba
1f0ab538fc 2018-09-07 17:01:04 +00:00
Joey Hess
19e91d5ee3
Merge branch 'master' of ssh://git-annex.branchable.com 2018-09-06 14:37:42 -04:00
Joey Hess
b7daf2685f
support public versioned S3 access
Makes git annex whereis display the versionId urls.

And, when a s3 remote is enabled without creds, git-annex will use the
versionId urls to access its contents.

This commit was sponsored by Fernando Jimenez on Patreon.
2018-09-06 14:31:41 -04:00
Joey Hess
0630ef166b
thought 2018-09-06 13:21:46 -04:00
Joey Hess
256669a85d
close as I don't want to do this 2018-09-06 13:16:13 -04:00
Joey Hess
1c86ba8ee8
close, these seem done already 2018-09-06 13:15:21 -04:00
Joey Hess
50fb6a86f9
thoughts 2018-09-06 13:09:18 -04:00
anarcat
694f612fba Added a comment: added as a special remote 2018-09-06 00:58:52 +00:00
Joey Hess
0a7c5a9982
dropdead per-remote metadata
Had to refactor pure code into separate modules so it is accessible
inside Annex.Branch.Transitions.

This commit was sponsored by Peter on Patreon.
2018-09-05 13:52:46 -04:00
Joey Hess
f1e5dfb7c7
close 2018-09-05 12:21:52 -04:00
Joey Hess
8eb944ea11
close todo, open todo 2018-08-31 14:01:24 -04:00
Joey Hess
308f49e9ae
update 2018-08-31 13:56:32 -04:00
Joey Hess
b3d42283ad
use per-remote metadata storage for S3 version ID
Since the same key can be stored in a versioned S3 bucket multiple times
with different version IDs, this allows tracking them all. Not currently
needed, but if we ever want to drop from a versioned S3 bucket, we'll
need to know them all.

This commit was supported by the NSF-funded DataLad project.
2018-08-31 13:27:29 -04:00
Joey Hess
5c99f6247e
per-remote metadata storage
Actually very straightforward reuse of the metadata log file code.
Although I had to add a todo item as git-annex forget won't clean up
dead remote's metadata yet.

This would be worth adding to the external special remote interface
sometime. Have not opened a todo though, guess I'll wait until something
needs it.

This commit was supported by the NSF-funded DataLad project.
2018-08-31 12:23:22 -04:00
Joey Hess
9d78a4387f
update 2018-08-31 12:23:04 -04:00
Joey Hess
3a5d0402ba
update 2018-08-30 15:49:21 -04:00
Joey Hess
19dcff2b71
use S3 version ID for retrieval
Have to store the S3 object along with the version ID, so retrieval can
use the same object.

This commit was supported by the NSF-funded DataLad project.
2018-08-30 15:37:08 -04:00
Joey Hess
794e9a7a44
store S3 version IDs
Only done when versioning=yes is configured. It could always do it when
S3 sends back a version id, but there may be buckets that have
versioning enabled by accident, so it seemed better to honor the
configuration.

S3's docs say version IDs are "randomly generated", so presumably
storing the same content twice gets two different ones not the same one.
So I considered storing a list of version IDs for a key. That would
allow removing the key completely. But.. The way Logs.RemoteState works,
when there are multiple writers, the last writer wins. So storing a list
would need a different log format that merges, which seemed overkill to support
removing a key from an append-only remote.

Note that Logs.RemoteState for S3 is now dedicated to version IDs.
If something else needs to be stored, a new log will be needed to do it.

This commit was supported by the NSF-funded DataLad project.
2018-08-30 14:30:56 -04:00
Joey Hess
0ff5a41311
S3 versioning=yes config
Not yet used.

This commit was supported by the NSF-funded DataLad project.
2018-08-30 13:45:28 -04:00
Joey Hess
358178fbfb
don't untrust appendonly exports
Make exporttree=yes remotes that are appendonly not be untrusted, and not force
verification of content, since the usual concerns about losing data when an
export is updated by someone else don't apply.

Note that all the remote operations on keys are left as usual for
appendonly export remotes, except for storing content.

This commit was supported by the NSF-funded DataLad project.
2018-08-30 11:48:04 -04:00
Joey Hess
8b39db20b5
export appendonly support
Make `git annex export` check appendonly when removing a file from an
export, and not update the location log, since the remote still contains
the content.

This commit was supported by the NSF-funded DataLad project.
2018-08-30 11:18:20 -04:00
Joey Hess
dad627fa9e
remove false starts, simplify 2018-08-29 14:12:18 -04:00
Joey Hess
5b78952f78
misunderstood some code; simplify 2018-08-29 14:09:18 -04:00
Joey Hess
e216c18318
new much improved plan 2018-08-29 13:59:52 -04:00
Joey Hess
3874c5c88d
further thoughts 2018-08-29 10:56:02 -04:00
Joey Hess
b1280eb252
new todo (requested by yoh) 2018-08-28 12:14:06 -04:00
Joey Hess
6adc0d2b3f
bug triage 2018-08-27 15:10:05 -04:00
Joey Hess
2c9f21e987
todo 2018-08-26 20:59:20 -04:00
anarcat
af727108b0 update status to mention tor 2018-08-24 21:35:11 +00:00
anarcat
bfab1da5a7 mention that dat thing 2018-08-24 21:30:20 +00:00
Joey Hess
98fd7ec6c9
recover from race between git mv+commit and git-annex get
Last of the known v6 races.

This also makes git add of a pointer file populate it when its content
is present in the annex. Which makes sense to do, I think.

This commit was supported by the NSF-funded DataLad project.
2018-08-22 16:01:50 -04:00