mirrors/git-annex
2
0
Fork 0
Code Issues Pull requests Projects Releases Packages 1 Wiki Activity Actions
git-annex/Remote
History
Joey Hess 4b87669ae2
S3 use last Key when there is no Marker element 
Fix infinite loop and memory blowup when importing from an unversioned S3
bucket that is large enough to need pagination.

I don't think there actually ever will be a Marker element, a delimiter is
not set.

Probably this code path was never tested with pagination! Also the aws
library's lack of any docs made it easy to mess up.

Versioned buckets seem to not have the same problem. The API docs for
ListObjectVersions say that NextKeyMarker will always be provided when
paginating.
2024-11-14 16:12:37 -04:00
..
Directory stream through proxy when using fileRetriever 2024-10-15 14:29:06 -04:00
External added retrieveKeyFileInOrder and ORDERED to external special remote protocol 2024-10-15 15:40:14 -04:00
Helper fix reversion in getting from unchunked encrypted special remotes 2024-10-28 12:20:10 -04:00
List auto-init autoenable=yes 2020-05-27 12:40:35 -04:00
Rsync use NonEmpty for dirHashes 2024-09-26 18:15:00 -04:00
WebDAV Apply codespell -w throughout 2023-03-17 15:14:58 -04:00
Adb.hs added retrieveKeyFileInOrder and ORDERED to external special remote protocol 2024-10-15 15:40:14 -04:00
BitTorrent.hs added retrieveKeyFileInOrder and ORDERED to external special remote protocol 2024-10-15 15:40:14 -04:00
Borg.hs added retrieveKeyFileInOrder and ORDERED to external special remote protocol 2024-10-15 15:40:14 -04:00
Bup.hs added retrieveKeyFileInOrder and ORDERED to external special remote protocol 2024-10-15 15:40:14 -04:00
Ddar.hs added retrieveKeyFileInOrder and ORDERED to external special remote protocol 2024-10-15 15:40:14 -04:00
Directory.hs added retrieveKeyFileInOrder and ORDERED to external special remote protocol 2024-10-15 15:40:14 -04:00
External.hs added retrieveKeyFileInOrder and ORDERED to external special remote protocol 2024-10-15 15:40:14 -04:00
GCrypt.hs added retrieveKeyFileInOrder and ORDERED to external special remote protocol 2024-10-15 15:40:14 -04:00
Git.hs implement put data-present parameter in http servant 2024-10-29 13:32:43 -04:00
GitLFS.hs added retrieveKeyFileInOrder and ORDERED to external special remote protocol 2024-10-15 15:40:14 -04:00
Glacier.hs added retrieveKeyFileInOrder and ORDERED to external special remote protocol 2024-10-15 15:40:14 -04:00
Hook.hs added retrieveKeyFileInOrder and ORDERED to external special remote protocol 2024-10-15 15:40:14 -04:00
HttpAlso.hs added retrieveKeyFileInOrder and ORDERED to external special remote protocol 2024-10-15 15:40:14 -04:00
List.hs clarify comment 2024-06-04 14:29:24 -04:00
P2P.hs added retrieveKeyFileInOrder and ORDERED to external special remote protocol 2024-10-15 15:40:14 -04:00
Rclone.hs rclone special remote 2024-04-17 15:20:37 -04:00
Rsync.hs added retrieveKeyFileInOrder and ORDERED to external special remote protocol 2024-10-15 15:40:14 -04:00
S3.hs S3 use last Key when there is no Marker element 2024-11-14 16:12:37 -04:00
Tahoe.hs added retrieveKeyFileInOrder and ORDERED to external special remote protocol 2024-10-15 15:40:14 -04:00
Web.hs added retrieveKeyFileInOrder and ORDERED to external special remote protocol 2024-10-15 15:40:14 -04:00
WebDAV.hs added retrieveKeyFileInOrder and ORDERED to external special remote protocol 2024-10-15 15:40:14 -04:00