git-annex/Backend
Joey Hess c565340adc
stop using external hash programs, since cryptonite is faster
In 2013, I wrote "Cryptohash benchmarks 90 to 101% faster than external
hashers". Re-benchmarking today, I found cryptonite's sha256 consistently
outperformed coreutils by 10% for large files. Tested 10 mb, 100 mb, 1 gb
files with both sha256 and sha512. And for smaller files, the external
process startup time swamps the hash time.

Perhaps cryptonite has improved. Or it could just do better on my
current CPU Intel(R) Pentium(R) CPU 4410Y @ 1.50GHz). Anyway, even if cryptonite
is slower in some situations, seems likely it would only be marginally slower;
it's got the same class of highly optimised C code under the hood as coreutils.
The main difference between the two sha256 implementations seems to be
how much of the inner loop they unroll..

This commit was sponsored by Henrik Riomar on Patreon.
2018-08-28 18:10:58 -04:00
..
Hash.hs stop using external hash programs, since cryptonite is faster 2018-08-28 18:10:58 -04:00
URL.hs add KeyVariety type 2017-02-24 15:16:56 -04:00
Utilities.hs stop using MissingH for MD5 2017-05-15 21:36:03 -04:00
WORM.hs migrate: WORM keys containing spaces will be migrated to not contain spaces anymore 2017-08-17 15:09:38 -04:00