git-annex/Utility
Joey Hess 7298123520
build git trees using ContentIdentifier to speed up import
This gets the trees built, but it does not use them. Next step will be
to remember the tree for next time an import is done, and diff between
old and new trees to find the files that have changed.

Added --missing to the mktree parameters. That only disables a check, so
it's ok to do everywhere mktree is used. It probably also speeds up
mktree to disable the check.

Note that git fsck does not complain about the resulting tree objects
that point to shas that are not in the repository. Even with --strict.

A quick benchmark, importing 10000 files, this slowed it down
from 2:04.06 to 2:04.28. So it will more than pay for itself.

Sponsored-by: Luke Shumaker on Patreon
2023-05-31 12:46:54 -04:00
..
Directory improve createDirectoryUnder to allow alternate top directories 2022-08-12 12:52:37 -04:00
DirWatcher fix build warnings on windows 2023-03-21 18:41:23 -04:00
Env
LockFile avoid annexFileMode special case 2023-04-27 15:58:37 -04:00
LockPool avoid annexFileMode special case 2023-04-27 15:58:37 -04:00
Path Apply codespell -w throughout 2023-03-17 15:14:58 -04:00
Process fix missing new lines in processTranscript 2021-08-02 13:42:27 -04:00
Scheduled Typo: recurrance -> recurrence 2023-03-17 15:14:54 -04:00
Tmp avoid using removePathForcibly everywhere, it is unsafe 2022-05-02 14:06:20 -04:00
Aeson.hs support aeson for Map 2023-05-10 13:51:37 -04:00
Android.hs
Applicative.hs
Attoparsec.hs
AuthToken.hs filter out control characters in error messages 2023-04-10 13:50:51 -04:00
Base64.hs filter out control characters in error messages 2023-04-10 13:50:51 -04:00
Batch.hs
Bloom.hs Apply codespell -w throughout 2023-03-17 15:14:58 -04:00
CoProcess.hs
CopyFile.hs fix comment 2023-03-28 12:40:08 -04:00
Daemon.hs Apply codespell -w throughout 2023-03-17 15:14:58 -04:00
Data.hs simplify and speed up Utility.FileSystemEncoding 2021-08-11 12:13:31 -04:00
DataUnits.hs Apply codespell -w throughout 2023-03-17 15:14:58 -04:00
DBus.hs
Debug.hs simplify and speed up Utility.FileSystemEncoding 2021-08-11 12:13:31 -04:00
DebugLocks.hs
Directory.hs Windows: Support long filenames in more (possibly all) of the code 2023-03-01 15:55:58 -04:00
DirWatcher.hs
DiskFree.hs
Dot.hs
DottedVersion.hs
Env.hs
Exception.hs avoid displaying ExitCode exceptions 2023-04-12 17:04:57 -04:00
FileMode.hs avoid annexFileMode special case 2023-04-27 15:58:37 -04:00
FileSize.hs fix build warnings on windows 2023-03-21 18:41:23 -04:00
FileSystemEncoding.hs improve comments 2021-12-08 18:59:22 -04:00
Format.hs find, findkeys, examinekey: escape output to terminal when --format is not used 2023-04-11 15:27:07 -04:00
FreeDesktop.hs
GitLFS.hs Revert "Removed the vendored git-lfs and the GitLfs build flag" 2023-01-04 17:33:29 -04:00
Glob.hs Typo: sansative -> sensitive 2023-03-17 15:14:50 -04:00
Gpg.hs initremote: Avoid creating a remote that is not encrypted when gpg is broken 2023-05-01 13:00:05 -04:00
Hash.hs build git trees using ContentIdentifier to speed up import 2023-05-31 12:46:54 -04:00
HtmlDetect.hs Apply codespell -w throughout 2023-03-17 15:14:58 -04:00
HumanNumber.hs Fix a rounding bug in display of data sizes 2021-07-30 09:56:04 -04:00
HumanTime.hs
InodeCache.hs fix build warnings on windows 2023-03-21 18:41:23 -04:00
IPAddress.hs Apply codespell -w throughout 2023-03-17 15:14:58 -04:00
libkqueue.c
libkqueue.h
LinuxMkLibs.hs work around ldd crash on arm64 autobuilder 2023-01-28 14:26:01 -04:00
LockFile.hs
LockPool.hs
LogFile.hs avoid unix-compat's rename 2022-07-12 14:55:02 -04:00
Lsof.hs filter out control characters in error messages 2023-04-10 13:50:51 -04:00
MagicWormhole.hs fix breakage in wormhole's sendFile 2022-09-26 15:26:29 -04:00
Matcher.hs Apply codespell -w throughout 2023-03-17 15:14:58 -04:00
MD5.hs
Metered.hs filter out control characters and quote filenames 2023-04-11 14:27:22 -04:00
Misc.hs Apply codespell -w throughout 2023-03-17 15:14:58 -04:00
Monad.hs
Mounts.hs
MoveFile.hs fix build warnings on windows 2023-03-21 18:41:23 -04:00
Network.hs
NotificationBroadcaster.hs
OptParse.hs
OSX.hs
PartialPrelude.hs
Path.hs annex.maxextensionlength for view 2023-03-24 14:01:38 -04:00
Percentage.hs
PID.hs
Process.hs add git config debugging 2023-05-15 15:35:29 -04:00
QuickCheck.hs Windows: Support long filenames in more (possibly all) of the code 2023-03-01 15:55:58 -04:00
RawFilePath.hs Windows: Support long filenames in more (possibly all) of the code 2023-03-01 15:55:58 -04:00
ResourcePool.hs use ResourcePool for hash-object handles 2022-07-25 17:32:39 -04:00
Rsync.hs
SafeCommand.hs
SafeOutput.hs remove unused imports 2023-04-12 16:48:18 -04:00
Scheduled.hs Typo: recurrance -> recurrence 2023-03-17 15:14:54 -04:00
Shell.hs
ShellEscape.hs
SimpleProtocol.hs
Split.hs
SshConfig.hs Windows: Support long filenames in more (possibly all) of the code 2023-03-01 15:55:58 -04:00
SshHost.hs
Su.hs fix build warning 2022-10-27 10:21:24 -04:00
SystemDirectory.hs small RawFilePath optimisation 2023-03-02 10:53:12 -04:00
Tense.hs
Terminal.hs fix windows build 2023-04-12 19:33:19 -04:00
ThreadLock.hs
ThreadScheduler.hs avoid displaying the scanning annexed files message when repo is not large 2021-06-04 13:16:48 -04:00
TimeStamp.hs
TList.hs
Tmp.hs Windows: Support long filenames in more (possibly all) of the code 2023-03-01 15:55:58 -04:00
Tor.hs Windows: Support long filenames in more (possibly all) of the code 2023-03-01 15:55:58 -04:00
Touch.hs
Tuple.hs
Url.hs Windows: Support urls like "file:///c:/path" 2023-03-27 13:38:02 -04:00
UserInfo.hs avoid unix-compat's rename 2022-07-12 14:55:02 -04:00
Verifiable.hs
WebApp.hs filter out control characters in error messages 2023-04-10 13:50:51 -04:00
Yesod.hs Apply codespell -w throughout 2023-03-17 15:14:58 -04:00