Commit graph

34023 commits

Author SHA1 Message Date
Joey Hess
720e5fda5c
export retrieval fallback to handle S3 remote with partially missing version IDs
When key-based retrieval from a S3 remote with exporttree=yes
appendonly=yes fails, fall back to trying to retrieve from the exported
tree. This allows downloads of files that were exported to such a remote
before versioning was enabled on it.

This is useful at least for a transition for users who got into that
situation, so they can download content from their S3 remote. May want to
remove this in the future though, since normally trying to download the
second time is only extra work.

This commit was sponsored by Brock Spratlen on Patreon.
2019-01-30 13:23:03 -04:00
Joey Hess
9216718fa0
fix one more export conflict false positive
Somehow forgot about the case where the current export db tree is the
same one in the export log, and it warned about an export conflict when
getting a file in that situation. Of course it's no conflict at all!

This commit was sponsored by Jochen Bartl on Patreon.
2019-01-30 13:18:42 -04:00
Joey Hess
3b9b6c965d
Merge branch 'master' of ssh://git-annex.branchable.com 2019-01-30 12:50:00 -04:00
Joey Hess
ad1d422dd7
fix false positive in export conflict detection
Like the earlier fixed one in Command.Export, it occurred when the same
tree was exported by multiple clones. Previous fix was incomplete since
several other places looked at the list of exported trees to detect when
there was an export conflict. Added a single unified function to avoid
missing any places it needed to be fixed.

This commit was sponsored by mo on Patreon.
2019-01-30 12:36:30 -04:00
aaron@784fd85903b38afc8a44d117ba95e3dcce0bd230
d7fe32d1f8 Added a comment: Ah, ok. 2019-01-30 16:36:13 +00:00
Joey Hess
e3dce20cf5
devblog 2019-01-29 15:27:13 -04:00
Joey Hess
3b646f9b3c
add news item for git-annex 7.20190129 2019-01-29 15:22:30 -04:00
Joey Hess
4cf7deb57e
releasing package git-annex version 7.20190129 2019-01-29 15:21:44 -04:00
Joey Hess
8fc6c11cf1
couple fixes 2019-01-29 15:20:22 -04:00
Kyle Meyer
62edb7bee0
doc/git-annex-export: fix a typo 2019-01-29 15:10:12 -04:00
Joey Hess
a8f1add4d1
S3: Detect when version=yes but an exported file lacks versioning, and refuse to delete it, to avoid data loss.
This commit was sponsored by Denis Dzyubenko on Patreon.
2019-01-29 15:07:27 -04:00
Joey Hess
a4f71aa1e8
update 2019-01-29 14:27:32 -04:00
Joey Hess
7dd2672bd2
remove manual versioning mention from here
git-annex will tell the user if they need to manually enable versioning
2019-01-29 14:13:14 -04:00
Joey Hess
94bd598973
Merge branch 'master' of ssh://git-annex.branchable.com 2019-01-29 14:12:57 -04:00
Joey Hess
bb9817ceae
enableremote S3: Do not let versioning=yes be set on existing remote
Because when git-annex lacks S3 version IDs for files stored in the bucket,
deleting them would cause data loss.

Also because git-annex is not able to download unversioned objects from a bucket
when versioning=yes.

This also prevents setting versioning=no. While that would perhaps be
possible to do safely, it would add complexity, and would mean that if
the user accidentially did enableremote versioning=no, they would not be
able to undo it.

This commit was sponsored by Trenton Cronholm on Patreon.
2019-01-29 14:09:50 -04:00
Joey Hess
ee011b3cbb
initremote S3: Automatically enable versioning in S3 buckets when configured with versioning=yes.
Needs not yet released version 0.22 of aws library; with older versions
asks the user to configure the bucket versioning themselves.

Note that S3 endpoints that don't support versioning will cause putBucketVersioning
to throw an exception, so initremote will fail.

This commit was sponsored by Jake Vosloo on Patreon.
2019-01-29 13:46:04 -04:00
Joey Hess
c4977ec1ff
refactoring 2019-01-29 13:42:32 -04:00
kyle
64ae689f21 2019-01-29 16:26:06 +00:00
Joey Hess
365c9767af
Merge branch 'master' of ssh://git-annex.branchable.com 2019-01-28 12:08:21 -04:00
Joey Hess
139611331a
plan 2019-01-28 12:07:48 -04:00
Ilya_Shlyakhter
4682f95b5a request for help with building git-annex on conda-forge 2019-01-27 20:31:17 +00:00
aleritty@6e05a9f3af45614edd920392381d4e4d83e11f62
3e25cd7915 2019-01-27 17:56:07 +00:00
Joey Hess
40daf7f1dc
Merge branch 'master' of ssh://git-annex.branchable.com 2019-01-26 13:19:54 -04:00
Joey Hess
f08912a062
bug 2019-01-26 13:19:30 -04:00
Joey Hess
a9593a43e9
explain why numcopies is not checked in performUnexport 2019-01-26 12:52:56 -04:00
yarikoptic
76652f0907 Added a comment 2019-01-26 00:46:04 +00:00
Ilya_Shlyakhter
973034eb6d Added a comment 2019-01-25 21:34:15 +00:00
Lukey
e8266673f8 Presenting my Workarounds 2019-01-25 20:07:28 +00:00
yarikoptic
fd5bf09cd5 initial plea for publicurl for all special remotes 2019-01-25 03:08:39 +00:00
yarikoptic
55376d0a28 initial whining about absent way to get supported configuration options for a special remote 2019-01-25 02:58:52 +00:00
Joey Hess
f21d692535
Merge branch 'master' of ssh://git-annex.branchable.com 2019-01-24 16:39:32 -04:00
Joey Hess
e06c0d92cd
git patch available 2019-01-24 16:39:12 -04:00
gueux
f4dd33d33b Added a comment 2019-01-24 10:34:09 +00:00
Joey Hess
2e9becf989
typo 2019-01-24 00:10:16 -04:00
Joey Hess
6db0970001
Merge branch 'master' of ssh://git-annex.branchable.com 2019-01-23 13:09:14 -04:00
Joey Hess
669b305de2
S3: Send a Content-Type header when storing objects in S3
So exports to public buckets can be linked to from web pages.

(When git-annex is built with MagicMime support.)

Thanks to Jared Cosulich for the idea.
2019-01-23 13:08:47 -04:00
Joey Hess
467c3b393d
refactor magic 2019-01-23 12:40:59 -04:00
pthomasdelaney@9b04608ad7e837fde64ab60a285a7b7254b5bb26
49b31f7c00 Added a comment 2019-01-23 02:26:33 +00:00
Joey Hess
fbe7db74af
remove unused import 2019-01-22 20:14:08 -04:00
Joey Hess
c62d2ce5c5
avoid strictness problem 2019-01-22 19:37:49 -04:00
Joey Hess
016ebde0d5
followup 2019-01-22 18:07:40 -04:00
Joey Hess
9c30b358a7
close bug the right way 2019-01-22 17:44:08 -04:00
Joey Hess
17eb4b9b60
response 2019-01-22 17:43:03 -04:00
Joey Hess
f7adb81445
followup 2019-01-22 17:27:28 -04:00
Joey Hess
eb06fd36c0
followup 2019-01-22 17:20:43 -04:00
Joey Hess
0f2a9abb8a
response 2019-01-22 17:11:21 -04:00
Joey Hess
5f91ac12bc
Merge branch 'master' of ssh://git-annex.branchable.com 2019-01-22 16:55:49 -04:00
Joey Hess
5d58c54a8b
avoid writing to Build/Version when it already contains the same version
This will hopefully avoid ghc unncessarily rebuilding everything that
depends on it due to the file's timestamp changing.
2019-01-22 16:54:17 -04:00
lukasstraub2@bbbb2ef261a0994edda5f5f55999dfac5998d4e5
3de15d094e rename done/Unable_to_initialize_v5_Repository_on_a_Crippled_Filesystem.mdwn to bugs/done/Unable_to_initialize_v5_Repository_on_a_Crippled_Filesystem.mdwn 2019-01-22 20:47:23 +00:00
lukasstraub2@bbbb2ef261a0994edda5f5f55999dfac5998d4e5
df7ccacff0 Fixed in Version 7.20190122 2019-01-22 20:44:46 +00:00