Commit graph

37246 commits

Author SHA1 Message Date
Joey Hess
c108fa16f1
improve error message when download from non-chunked remote fails
Avoid "chunk retrieval failed" in this case, when it tries to fall back
to using chunks.

This commit was sponsored by Ethan Aubin.
2020-05-21 14:44:40 -04:00
Joey Hess
e63dcbf36c
fix embedcreds=yes reversion
Fix bug that made enableremote of S3 and webdav remotes, that have
embedcreds=yes, fail to set up the embedded creds, so accessing the remotes
failed.

(Regression introduced in version 7.20200202.7 in when reworking all the
remote configs to be parsed.)

Root problem is that parseEncryptionConfig excludes all other config keys
except encryption ones, so it is then unable to find the
credPairRemoteField. And since that field is not required to be
present, it proceeds as if it's not, rather than failing in any visible
way.

This causes it to not find any creds, and so it does not cache
them. When when the S3 remote tries to make a S3 connection, it finds no
creds, so assumes it's being used in no-creds mode, and tries to find a
public url. With no public url available, it fails, but the failure doesn't
say a lack of creds is the problem.

Fix is to provide setRemoteCredPair with a ParsedRemoteConfig, so the full
set of configs of the remote can be parsed. A bit annoying to need to
parse the remote config before the full config (as returned by
setRemoteCredPair) is available, but this avoids the problem.

I assume webdav also had the problem by inspection, but didn't try to
reproduce it with it.

Also, getRemoteCredPair used getRemoteConfigValue to get a ProposedAccepted
String, but that does not seem right. Now that it runs that code, it
crashed saying it had just a String.

Remotes that have already been enableremoted, and so lack the cached creds
file will work after this fix, because getRemoteCredPair will extract
the creds from the remote config, writing the missing file.

This commit was sponsored by Ilya Shlyakhter on Patreon.
2020-05-21 14:35:30 -04:00
codelix
0f3dba8be8 Added a comment 2020-05-21 18:00:58 +00:00
codelix
9ae7eb023f Added a comment: SO frustrating 2020-05-21 17:55:09 +00:00
Joey Hess
0ae63d5eec
comment 2020-05-21 13:06:46 -04:00
kyle
9aa1c525e6 Added a comment 2020-05-21 17:06:12 +00:00
codelix
fa50b31ea5 2020-05-21 16:42:58 +00:00
Joey Hess
d5b7d2a473
followup and close 2020-05-21 12:30:51 -04:00
Joey Hess
2de40ba4da
improve docs around uri claiming 2020-05-21 11:58:57 -04:00
basile.pinsard@f1a7fae9f3bd9d5282fca11f62ad53b45a8eb317
5cd0b7f204 Added a comment: reverting metadata 2020-05-21 13:39:37 +00:00
braun.markus89@51b521a42cc994db864df308627bd6454f9c309d
50357aa48b Added a comment 2020-05-20 13:54:23 +00:00
Joey Hess
d7c7245438
whereis: Added --format option.
One way this can be used is to remove all urls for some website that went
away:

git-annex whereis --format '${file} ${url}\0' | \
	grep -z whatever.com | git-annex rmurl --batch -z

Combining ${url} and ${uuid} is a bit of a combinatorial explosion.
It didn't seem worth only outputting a uuid alongside an url belonging
to it, so each uuid is output beside each url.
2020-05-19 16:20:56 -04:00
Joey Hess
30ac015b79
add a formatContainsVar function
Also, the format function gets faster because it checks for "escaped_"
at gen time instead of every time format is called.
2020-05-19 15:35:00 -04:00
Joey Hess
224208a657
comment 2020-05-19 13:18:34 -04:00
Joey Hess
f46006a9c1
Merge branch 'master' of ssh://git-annex.branchable.com 2020-05-19 13:01:08 -04:00
Joey Hess
f407df11b4
document tags vs TAGS
ridiculous that these editors use such similar names and different file
formats

(actually, if you force vim to read TAGS, it seems able to parse it, but
I can't find much documentation about that)
2020-05-19 12:59:38 -04:00
Joey Hess
ac347f82cc
ignore and clean the TAGS file 2020-05-19 12:58:25 -04:00
Joey Hess
ca9f7361e8
remove wrapping
Seems unncessary and was a bit weird.
2020-05-19 12:57:57 -04:00
Joey Hess
43b149849f
Merge /home/joey/thk_create_emacs_etags.bundle 2020-05-19 12:49:45 -04:00
tobias@900fabbc7137f1974fb072b778e826e3dd931e5f
223941e1fb 2020-05-19 09:58:07 +00:00
tobias@900fabbc7137f1974fb072b778e826e3dd931e5f
92ede0970f 2020-05-19 07:44:07 +00:00
tobias@900fabbc7137f1974fb072b778e826e3dd931e5f
a76899b11f 2020-05-19 00:09:42 +00:00
arseni.lapunov@34f437c25a6a8c6d317dce0bb7c5b44d568fa595
de86a8d579 2020-05-18 15:07:35 +00:00
braun.markus89@51b521a42cc994db864df308627bd6454f9c309d
1259b73c39 2020-05-18 08:00:16 +00:00
braun.markus89@51b521a42cc994db864df308627bd6454f9c309d
b4e94b2a41 2020-05-18 07:59:55 +00:00
braun.markus89@51b521a42cc994db864df308627bd6454f9c309d
7ab8b9a451 2020-05-18 07:58:43 +00:00
braun.markus89@51b521a42cc994db864df308627bd6454f9c309d
b0bfb1e0e5 2020-05-17 08:13:41 +00:00
braun.markus89@51b521a42cc994db864df308627bd6454f9c309d
0b1e94074e 2020-05-16 15:08:34 +00:00
braun.markus89@51b521a42cc994db864df308627bd6454f9c309d
42072fe9ad 2020-05-16 15:07:41 +00:00
braun.markus89@51b521a42cc994db864df308627bd6454f9c309d
fc7caa5b2b 2020-05-16 15:06:42 +00:00
jeanpmbox-456@7222359de8d1f37a7cf25a519e8faf90a9517b50
99c4eb020e Added a comment 2020-05-15 21:21:30 +00:00
jeanpmbox-456@7222359de8d1f37a7cf25a519e8faf90a9517b50
2db70d70d1 Added a comment 2020-05-15 21:14:53 +00:00
Thomas Koch
a47ba1e612 make TAGS to create emacs etags
I tried the --recursive option of hothasktags but the vi tags file grew
by some orders of magnitude and also the emacs TAGS file contained many
wrong entries.

I deleted trailing whitespace in the Makefile since emacs warns about it
on save.
2020-05-15 21:32:59 +02:00
Joey Hess
9dfcd60b8e
Merge branch 'master' of ssh://git-annex.branchable.com 2020-05-15 15:12:49 -04:00
Joey Hess
6361074174
convert renameExport to throw exception
Finishes the transition to make remote methods throw exceptions, rather
than silently hide them.

A bit on the fence about this one, because when renameExport fails,
it falls back to deleting instead, and so does the user care why it failed?

However, it did let me clean up several places in the code.

This commit was sponsored by Ethan Aubin.
2020-05-15 15:08:09 -04:00
Joey Hess
00448349de
devblog 2020-05-15 14:53:41 -04:00
Joey Hess
037440ef36
convert removeExportDirectory to throw exception
Part of ongoing transition to make remote methods
throw exceptions, rather than silently hide them.

This commit was sponsored by Ilya Shlyakhter on Patreon.
2020-05-15 14:43:18 -04:00
Joey Hess
0a9a3ed1c3
left an unhandled case in previous commit 2020-05-15 14:31:50 -04:00
Joey Hess
cdbfaae706
change removeExport to throw exception
Part of ongoing transition to make remote methods
throw exceptions, rather than silently hide them.

This commit was sponsored by Graham Spencer on Patreon.
2020-05-15 14:15:14 -04:00
Joey Hess
3334d3831b
change retrieveExport and getKey to throw exception
retrieveExport is part of ongoing transition to make remote methods
throw exceptions, rather than silently hide them.

getKey very rarely fails, and when it does it's always for the same reason
(user configured annex.backend to url for some reason). So, this will
avoid dealing with Nothing everywhere it's used.

This commit was sponsored by Ilya Shlyakhter on Patreon.
2020-05-15 13:45:53 -04:00
Joey Hess
4814b444dd
make storeExport throw exceptions 2020-05-15 12:20:02 -04:00
https://christian.amsuess.com/chrysn
112d2f8e7b Added a comment: Re: Usefulness of batch key processing 2020-05-15 09:33:22 +00:00
https://christian.amsuess.com/chrysn
340287ef94 Added a comment: Usefulness of batch key processing 2020-05-15 09:21:15 +00:00
globallyunique@da2274b36ca296fe35912b9fd7387e3a5bd17c7c
acec8e3c89 Added a comment: GCS using S3: removeKey when not present: FAIL 2020-05-14 20:39:21 +00:00
Joey Hess
dc7dc1e179
refactor 2020-05-14 14:21:58 -04:00
Joey Hess
4be94c67c7
make removeKey throw exceptions 2020-05-14 14:11:05 -04:00
globallyunique@da2274b36ca296fe35912b9fd7387e3a5bd17c7c
e6937e7643 2020-05-14 01:52:30 +00:00
Joey Hess
b5ee97f32a
Merge branch 'master' of ssh://git-annex.branchable.com 2020-05-13 17:09:13 -04:00
Joey Hess
d9c7f81ba4
make retrieveKeyFile and retrieveKeyFileCheap throw exceptions
Converted retrieveKeyFileCheap to a Maybe, to avoid needing to throw a
exception when a remote doesn't support it.
2020-05-13 17:07:07 -04:00
https://launchpad.net/~felixonmars
f246e78fd7 2020-05-13 20:35:29 +00:00