f9c5aa84e0
The benchmark shows that the database access is quite fast indeed!
And, it scales linearly to the number of keys, with one exception,
getAssociatedKey.
Based on this benchmark, I don't think I need worry about optimising
for cases where all files are locked and the database is mostly empty.
In those cases, database access will be misses, and according to this
benchmark, should add only 50 milliseconds to runtime.
(NB: There may be some overhead to getting the database opened and locking
the handle that this benchmark doesn't see.)
joey@darkstar:~/src/git-annex>./git-annex benchmark
setting up database with 1000
setting up database with 10000
benchmarking keys database/getAssociatedFiles from 1000 (hit)
time 62.77 μs (62.70 μs .. 62.85 μs)
1.000 R² (1.000 R² .. 1.000 R²)
mean 62.81 μs (62.76 μs .. 62.88 μs)
std dev 201.6 ns (157.5 ns .. 259.5 ns)
benchmarking keys database/getAssociatedFiles from 1000 (miss)
time 50.02 μs (49.97 μs .. 50.07 μs)
1.000 R² (1.000 R² .. 1.000 R²)
mean 50.09 μs (50.04 μs .. 50.17 μs)
std dev 206.7 ns (133.8 ns .. 295.3 ns)
benchmarking keys database/getAssociatedKey from 1000 (hit)
time 211.2 μs (210.5 μs .. 212.3 μs)
1.000 R² (0.999 R² .. 1.000 R²)
mean 211.0 μs (210.7 μs .. 212.0 μs)
std dev 1.685 μs (334.4 ns .. 3.517 μs)
benchmarking keys database/getAssociatedKey from 1000 (miss)
time 173.5 μs (172.7 μs .. 174.2 μs)
1.000 R² (0.999 R² .. 1.000 R²)
mean 173.7 μs (173.0 μs .. 175.5 μs)
std dev 3.833 μs (1.858 μs .. 6.617 μs)
variance introduced by outliers: 16% (moderately inflated)
benchmarking keys database/getAssociatedFiles from 10000 (hit)
time 64.01 μs (63.84 μs .. 64.18 μs)
1.000 R² (1.000 R² .. 1.000 R²)
mean 64.85 μs (64.34 μs .. 66.02 μs)
std dev 2.433 μs (547.6 ns .. 4.652 μs)
variance introduced by outliers: 40% (moderately inflated)
benchmarking keys database/getAssociatedFiles from 10000 (miss)
time 50.33 μs (50.28 μs .. 50.39 μs)
1.000 R² (1.000 R² .. 1.000 R²)
mean 50.32 μs (50.26 μs .. 50.38 μs)
std dev 202.7 ns (167.6 ns .. 252.0 ns)
benchmarking keys database/getAssociatedKey from 10000 (hit)
time 1.142 ms (1.139 ms .. 1.146 ms)
1.000 R² (1.000 R² .. 1.000 R²)
mean 1.142 ms (1.140 ms .. 1.144 ms)
std dev 7.142 μs (4.994 μs .. 10.98 μs)
benchmarking keys database/getAssociatedKey from 10000 (miss)
time 1.094 ms (1.092 ms .. 1.096 ms)
1.000 R² (1.000 R² .. 1.000 R²)
mean 1.095 ms (1.095 ms .. 1.097 ms)
std dev 4.277 μs (2.591 μs .. 7.228 μs)
274 lines
7.4 KiB
Text
274 lines
7.4 KiB
Text
Name: git-annex
|
|
Version: 5.20151218
|
|
Cabal-Version: >= 1.8
|
|
License: GPL-3
|
|
Maintainer: Joey Hess <id@joeyh.name>
|
|
Author: Joey Hess
|
|
Stability: Stable
|
|
Copyright: 2010-2014 Joey Hess
|
|
License-File: COPYRIGHT
|
|
Extra-Source-Files: CHANGELOG
|
|
Homepage: http://git-annex.branchable.com/
|
|
Build-type: Custom
|
|
Category: Utility
|
|
Synopsis: manage files with git, without checking their contents into git
|
|
Description:
|
|
git-annex allows managing files with git, without checking the file
|
|
contents into git. While that may seem paradoxical, it is useful when
|
|
dealing with files larger than git can currently easily handle, whether due
|
|
to limitations in memory, time, or disk space.
|
|
.
|
|
It can store large files in many places, from local hard drives, to a
|
|
large number of cloud storage services, including S3, WebDAV,
|
|
and rsync, with a dozen cloud storage providers usable via plugins.
|
|
Files can be stored encrypted with gpg, so that the cloud storage
|
|
provider cannot see your data. git-annex keeps track of where each file
|
|
is stored, so it knows how many copies are available, and has many
|
|
facilities to ensure your data is preserved.
|
|
.
|
|
git-annex can also be used to keep a folder in sync between computers,
|
|
noticing when files are changed, and automatically committing them
|
|
to git and transferring them to other computers. The git-annex webapp
|
|
makes it easy to set up and use git-annex this way.
|
|
|
|
Flag S3
|
|
Description: Enable S3 support
|
|
|
|
Flag WebDAV
|
|
Description: Enable WebDAV support
|
|
|
|
Flag Assistant
|
|
Description: Enable git-annex assistant and watch command
|
|
|
|
Flag Webapp
|
|
Description: Enable git-annex webapp
|
|
|
|
Flag Webapp-secure
|
|
Description: Secure webapp
|
|
|
|
Flag Pairing
|
|
Description: Enable pairing
|
|
|
|
Flag DNS
|
|
Description: Enable the haskell DNS library for DNS lookup
|
|
|
|
Flag Production
|
|
Description: Enable production build (slower build; faster binary)
|
|
|
|
Flag Android
|
|
Description: Cross building for Android
|
|
Default: False
|
|
|
|
Flag AndroidSplice
|
|
Description: Building to get TH splices for Android
|
|
Default: False
|
|
|
|
Flag TestSuite
|
|
Description: Embed the test suite into git-annex
|
|
|
|
Flag TDFA
|
|
Description: Use regex-tdfa for wildcards
|
|
|
|
Flag Feed
|
|
Description: Enable podcast feed support
|
|
|
|
Flag Quvi
|
|
Description: Enable use of quvi to download videos
|
|
|
|
Flag Tahoe
|
|
Description: Enable the tahoe special remote
|
|
|
|
Flag TorrentParser
|
|
Description: Use haskell torrent library to parse torrent files
|
|
|
|
Flag ConcurrentOutput
|
|
Description: Use concurrent-output library
|
|
|
|
Flag EKG
|
|
Description: Enable use of EKG to monitor git-annex as it runs (at http://localhost:4242/)
|
|
Default: False
|
|
|
|
Flag Benchmark
|
|
Description: Enable benchmarking
|
|
Default: False
|
|
|
|
Flag network-uri
|
|
Description: Get Network.URI from the network-uri package
|
|
Default: True
|
|
|
|
Flag Cryptonite
|
|
Description: Use the cryptonite library, instead of the older cryptohash
|
|
|
|
Executable git-annex
|
|
Main-Is: git-annex.hs
|
|
Build-Depends:
|
|
base (>= 4.5 && < 4.9),
|
|
optparse-applicative (>= 0.11.0),
|
|
containers (>= 0.5.0.0),
|
|
exceptions (>= 0.6),
|
|
QuickCheck (>= 2.1),
|
|
stm (>= 2.3),
|
|
mtl (>= 2),
|
|
process, data-default, case-insensitive, uuid, random, dlist,
|
|
unix-compat, SafeSemaphore, async, directory, filepath, IfElse,
|
|
MissingH, hslogger, monad-logger,
|
|
utf8-string, bytestring, text, sandi, json,
|
|
monad-control, transformers,
|
|
bloomfilter, edit-distance,
|
|
resourcet, http-conduit, http-client, http-types,
|
|
time, old-locale,
|
|
esqueleto, persistent-sqlite, persistent, persistent-template
|
|
CC-Options: -Wall
|
|
GHC-Options: -Wall -fno-warn-tabs
|
|
Extensions: PackageImports
|
|
-- Some things don't work with the non-threaded RTS.
|
|
GHC-Options: -threaded
|
|
|
|
-- Avoid linking with unused dynamic libaries.
|
|
-- (Only tested on Linux).
|
|
if os(Linux)
|
|
GHC-Options: -optl-Wl,--as-needed
|
|
|
|
if flag(network-uri)
|
|
Build-Depends: network-uri (>= 2.6), network (>= 2.6)
|
|
else
|
|
Build-Depends: network (< 2.6), network (>= 2.0)
|
|
|
|
if flag(Cryptonite)
|
|
Build-Depends: cryptonite
|
|
CPP-Options: -DWITH_CRYPTONITE
|
|
else
|
|
Build-Depends: cryptohash (>= 0.11.0)
|
|
|
|
-- Fully optimize for production.
|
|
if flag(Production)
|
|
GHC-Options: -O2
|
|
|
|
if (os(windows))
|
|
Build-Depends: Win32, Win32-extras, unix-compat (>= 0.4.1.3), setenv,
|
|
process (>= 1.3.0.0)
|
|
else
|
|
Build-Depends: unix
|
|
-- Need to list these because they're generated from .hsc files.
|
|
Other-Modules: Utility.Touch Utility.Mounts
|
|
Include-Dirs: Utility
|
|
C-Sources: Utility/libdiskfree.c Utility/libmounts.c
|
|
CPP-Options: -DWITH_CLIBS
|
|
|
|
if flag(TestSuite)
|
|
Build-Depends: tasty (>= 0.7), tasty-hunit, tasty-quickcheck, tasty-rerun,
|
|
crypto-api
|
|
CPP-Options: -DWITH_TESTSUITE
|
|
|
|
if flag(TDFA)
|
|
Build-Depends: regex-tdfa
|
|
CPP-Options: -DWITH_TDFA
|
|
else
|
|
Build-Depends: regex-compat
|
|
|
|
if flag(S3)
|
|
Build-Depends: conduit, conduit-extra, aws (>= 0.9.2)
|
|
CPP-Options: -DWITH_S3
|
|
|
|
if flag(WebDAV)
|
|
Build-Depends: DAV (>= 1.0)
|
|
CPP-Options: -DWITH_WEBDAV
|
|
|
|
if flag(Assistant) && ! os(solaris)
|
|
CPP-Options: -DWITH_ASSISTANT
|
|
|
|
if flag(Assistant)
|
|
if os(linux)
|
|
Build-Depends: hinotify
|
|
CPP-Options: -DWITH_INOTIFY
|
|
else
|
|
if os(darwin)
|
|
Build-Depends: hfsevents
|
|
CPP-Options: -DWITH_FSEVENTS
|
|
else
|
|
if os(windows)
|
|
Build-Depends: Win32-notify
|
|
CPP-Options: -DWITH_WIN32NOTIFY
|
|
else
|
|
if (! os(solaris) && ! os(linux))
|
|
if flag(Android)
|
|
Build-Depends: hinotify
|
|
CPP-Options: -DWITH_INOTIFY
|
|
else
|
|
CPP-Options: -DWITH_KQUEUE
|
|
C-Sources: Utility/libkqueue.c
|
|
|
|
if (os(linux))
|
|
Build-Depends: dbus (>= 0.10.7), fdo-notify (>= 0.3)
|
|
CPP-Options: -DWITH_DBUS -DWITH_DESKTOP_NOTIFY -DWITH_DBUS_NOTIFICATIONS
|
|
|
|
if flag(Android)
|
|
Build-Depends: data-endian
|
|
CPP-Options: -D__ANDROID__ -DANDROID_SPLICES -D__NO_TH__
|
|
if flag(AndroidSplice)
|
|
CPP-Options: -DANDROID_SPLICES
|
|
|
|
if flag(Webapp)
|
|
Build-Depends:
|
|
yesod (>= 1.2.6),
|
|
yesod-default (>= 1.2.0),
|
|
yesod-static (>= 1.2.4),
|
|
yesod-form (>= 1.3.15),
|
|
yesod-core (>= 1.2.19),
|
|
path-pieces (>= 0.1.4),
|
|
warp (>= 3.0.0.5),
|
|
warp-tls,
|
|
wai, wai-extra,
|
|
blaze-builder, crypto-api, clientsession,
|
|
template-haskell, aeson,
|
|
shakespeare (>= 2.0.0)
|
|
CPP-Options: -DWITH_WEBAPP
|
|
|
|
if flag(Webapp) && flag (Webapp-secure)
|
|
Build-Depends: warp-tls (>= 1.4), securemem, byteable
|
|
CPP-Options: -DWITH_WEBAPP_SECURE
|
|
|
|
if flag(Pairing)
|
|
Build-Depends: network-multicast, network-info
|
|
CPP-Options: -DWITH_PAIRING
|
|
|
|
if (! os(windows))
|
|
Build-Depends: network-protocol-xmpp, gnutls (>= 0.1.4), xml-types
|
|
CPP-Options: -DWITH_XMPP
|
|
|
|
if flag(DNS)
|
|
Build-Depends: dns
|
|
CPP-Options: -DWITH_DNS
|
|
|
|
if flag(Feed)
|
|
Build-Depends: feed (>= 0.3.4)
|
|
CPP-Options: -DWITH_FEED
|
|
|
|
if flag(Quvi)
|
|
Build-Depends: aeson
|
|
CPP-Options: -DWITH_QUVI
|
|
|
|
if flag(Tahoe)
|
|
Build-Depends: aeson
|
|
CPP-Options: -DWITH_TAHOE
|
|
|
|
if flag(TorrentParser)
|
|
Build-Depends: torrent (>= 10000.0.0)
|
|
CPP-Options: -DWITH_TORRENTPARSER
|
|
|
|
if flag(ConcurrentOutput)
|
|
Build-Depends: concurrent-output (>= 1.6)
|
|
CPP-Options: -DWITH_CONCURRENTOUTPUT
|
|
|
|
if flag(EKG)
|
|
Build-Depends: ekg
|
|
GHC-Options: -with-rtsopts=-T
|
|
CPP-Options: -DWITH_EKG
|
|
|
|
if flag(Benchmark)
|
|
Build-Depends: criterion, deepseq
|
|
CPP-Options: -DWITH_BENCHMARK
|
|
|
|
source-repository head
|
|
type: git
|
|
location: git://git-annex.branchable.com/
|