Commit graph

21102 commits

Author SHA1 Message Date
Joey Hess
74db77886f
comment 2016-10-05 16:57:10 -04:00
Joey Hess
933bc5c917
Support using v3 repositories without upgrading them to v5.
An easy change now that supportedVersions is a list. Since v3 and v5 are
identical other than version number, just add v3 to the list.

This commit was sponsored by andrea rota.
2016-10-05 16:53:09 -04:00
Joey Hess
f23446b60e
verified fix on OSX 2016-10-05 16:08:49 -04:00
Joey Hess
658b6ce835
comment 2016-10-05 16:02:29 -04:00
Joey Hess
5416fd21a1
moreinfo 2016-10-05 15:51:42 -04:00
Joey Hess
3a019c5050
response 2016-10-05 15:50:50 -04:00
Joey Hess
34530e59d9
Avoid using a lot of memory when large objects are present in the git repository
.. and have to be checked to see if they are a pointed to an annexed file.

Cases where such memory use could occur included, but were not limited to:
  - git commit -a of a large unlocked file (in v5 mode)
  - git-annex adjust when a large file was checked into git directly
Generally, any use of catKey was a potential problem.

Fix by using git cat-file --batch-check to check size before catting.
This adds another git batch process, which is included in the CatFileHandle
for simplicity.

There could be performance impact, anywhere catKey is used. Particularly
likely to affect adjusted branch generation speed, and operations on
unlocked files in v6 mode. Hopefully since the --batch-check and
--batch read the same data, disk buffering will avoid most overhead.
Leaving only the overhead of talking to the process over the pipe and
whatever computation --batch-check needs to do.

This commit was sponsored by Bruno BEAUFILS on Patreon.
2016-10-05 15:24:13 -04:00
Joey Hess
a747373b40
comment 2016-10-05 13:30:46 -04:00
Joey Hess
90eec318bf
moreinfo 2016-10-05 13:01:35 -04:00
Joey Hess
43c45ac5fc
comments 2016-10-05 11:33:08 -04:00
evilmoo@0c9697a666c2853b3b3229b6646d3a4e849f7ec8
301b852fd7 Added a comment: bittorrent 2016-10-05 03:53:05 +00:00
Adam
686907ea2f Added a comment 2016-10-04 21:24:50 +00:00
Joey Hess
c079811226
Linux standalone: Add back the LOCPATH=/dev/null hack to avoid the system locale-archive being read.
Version mismatches between the system locale-archive and the glibc in the
bundle have been observed to cause git crashes.

Unfortunately, this causes locales to not be used in the linux standalone
bundle, as was the case until version 6.20160419.

glibc hardcodes the path to /usr/lib/locale/locale-archive and does not
let an environment variable cause a different locale-archive file to be used.

The only other option to include locales in the bundle would be to include
exploded locale definition directories in the bundle for a number of
locales, generated by localedef. But these take at least 300 kb per locale,
and there are a great many locales; it would be hundreds of megabytes to
include them all.

(Hmm, we could include localdef in the bundle, and check LANG in runshell
and compile the locale directories on the fly. This would need
/usr/share/i18n/ and /usr/lib/locale-archive to be included in the bundle.
It's.. doable.)

I know this is going to once again cause users of the bundle to complain
that eg, ls doesn't show their unicode filenames right. Better than strange
crashes though.
2016-10-04 12:53:09 -04:00
Joey Hess
9c35905bbe
comment 2016-10-04 11:30:41 -04:00
Joey Hess
4d491f514d
response 2016-10-04 11:16:39 -04:00
2a01:cb04:422:dd00:75bc:9129:cb49:31be
39a7045a81 poll vote (OpenStack SWIFT) 2016-10-04 11:57:43 +00:00
Adam
9ea55def4c Added a comment: Question 2016-10-04 05:27:31 +00:00
https://launchpad.net/~stephane-gourichon-lpad
ade6ab4037 Added a comment: Sketch of implementation, request for comment 2016-10-01 17:25:47 +00:00
https://launchpad.net/~stephane-gourichon-lpad
745e58167e How to deal with files that change status from "precious, please keep n copies" to "junk, please delete it from everywhere you find it, now and forever". 2016-10-01 13:36:52 +00:00
pot
2629850fdf 2016-10-01 11:41:01 +00:00
Joey Hess
c075b58d40
Merge branch 'master' of ssh://git-annex.branchable.com 2016-09-30 19:52:14 -04:00
ddenis
455de2fb1b 2016-09-30 22:06:49 +00:00
pot
5a076dcf04 Added a comment: inodes.... 2016-09-30 22:00:31 +00:00
ztl8702
dac65af9a9 Added a comment: Bash on Windows 2016-09-30 19:14:34 +00:00
Joey Hess
b025500352
devblog 2016-09-30 15:02:27 -04:00
Joey Hess
5bf4623a1d
allow multiple concurrent external special remote processes
Multiple external special remote processes for the same remote will be
started as needed when using -J.

This should not beak any existing external special remotes, because running
multiple git-annex commands at the same time could already start multiple
processes for the same external special remotes.
2016-09-30 14:29:02 -04:00
Joey Hess
7373866968
devblog 2016-09-29 17:17:14 -04:00
Joey Hess
28c6209f55
Make --json-progress output be shown even when the size of a object is not known. 2016-09-29 16:59:48 -04:00
Joey Hess
7cd6a6a39c
Merge branch 'master' of ssh://git-annex.branchable.com 2016-09-29 16:58:09 -04:00
Joey Hess
5ed050c152
summary of progress 2016-09-29 16:52:35 -04:00
https://me.yahoo.com/a/EbvxpTI_xP9Aod7Mg4cwGhgjrCrdM5s-#7c0f4
69e41f3943 Added a comment 2016-09-29 20:45:48 +00:00
Joey Hess
161d891508
Add "total-size" field to --json-progress output. 2016-09-29 16:29:54 -04:00
Joey Hess
3e7218b220
Merge branch 'master' of ssh://git-annex.branchable.com 2016-09-29 13:37:11 -04:00
Joey Hess
35446d3c3a
followup 2016-09-29 11:33:42 -04:00
yomguy
f22edfebab 2016-09-29 14:29:24 +00:00
yomguy
a962f341bd 2016-09-29 14:26:12 +00:00
yomguy
942095d7ca 2016-09-29 14:24:49 +00:00
git-annex@5b470e1f6ed6d30997d729f0a8b1c841dea886f1
2f91b3677c Added a comment: Using gitolite 3.6.6 mirror not working with annex 2016-09-28 18:12:56 +00:00
Joey Hess
3416cd8148
remove incorrect bit about multiple concurrent transfers, and improve description of protocol flow 2016-09-26 19:19:32 -04:00
Joey Hess
410b1c2b1f
todo 2016-09-26 19:06:56 -04:00
Joey Hess
6bdb6d4570
devblog 2016-09-26 16:53:42 -04:00
Joey Hess
76e5d8bf8a
comment 2016-09-26 16:53:27 -04:00
Joey Hess
f3b84f4603
Merge branch 'master' of ssh://git-annex.branchable.com 2016-09-26 16:49:21 -04:00
Joey Hess
a8734698eb
more profiling 2016-09-26 16:39:18 -04:00
Joey Hess
a197cf743d
profiling 2016-09-26 15:49:42 -04:00
sven.rieke@2bfe1de15de1bb402f962e41f9e5bfc1be1cf8d1
a1c7b514e7 2016-09-25 15:01:28 +00:00
sven.rieke@2bfe1de15de1bb402f962e41f9e5bfc1be1cf8d1
d8a714a881 2016-09-25 15:00:18 +00:00
madduck
40f41c3c4d 2016-09-25 13:25:03 +00:00
PaulK
ad5c60414e Added a comment 2016-09-25 03:08:41 +00:00
erics
348be33161 2016-09-25 02:28:19 +00:00