e213ef310f
* Fix minor FD leak in journal code. Closes: #754608 * direct: Fix handling of case where a work tree subdirectory cannot be written to due to permissions. * migrate: Avoid re-checksumming when migrating from hashE to hash backend. * uninit: Avoid failing final removal in some direct mode repositories due to file modes. * S3: Deal with AWS ACL configurations that do not allow creating or checking the location of a bucket, but only reading and writing content to it. * resolvemerge: New plumbing command that runs the automatic merge conflict resolver. * Deal with change in git 2.0 that made indirect mode merge conflict resolution leave behind old files. * sync: Fix git sync with local git remotes even when they don't have an annex.uuid set. (The assistant already did so.) * Set gcrypt-publish-participants when setting up a gcrypt repository, to avoid unncessary passphrase prompts. This is a security/usability tradeoff. To avoid exposing the gpg key ids who can decrypt the repository, users can unset gcrypt-publish-participants. * Install nautilus hooks even when ~/.local/share/nautilus/ does not yet exist, since it is not automatically created for Gnome 3 users. * Windows: Move .vbs files out of git\bin, to avoid that being in the PATH, which caused some weird breakage. (Thanks, divB) * Windows: Fix locking issue that prevented the webapp starting (since 5.20140707). # imported from the archive
45 lines
2.8 KiB
Markdown
45 lines
2.8 KiB
Markdown
What steps will reproduce the problem?
|
|
My annex dir has 23459 files and uses 749MB disk space.
|
|
Just create a repository put this dir inside, and git-annex will crash.
|
|
|
|
What is the expected output? What do you see instead?
|
|
I expect git-annex handles large number of files, and does not watch every single file of it.
|
|
|
|
What version of git-annex are you using? On what operating system?
|
|
I'm using git-annex linux build, version 2013.04.17.
|
|
|
|
Please provide any additional information below.
|
|
|
|
[2013-04-17 23:52:35 CEST] Transferrer: Downloaded pappas_hu..di_44.jpg
|
|
git-annex: runInteractiveProcess: pipe: Too many open files
|
|
Committer crashed: lsof: createProcess: resource exhausted (Too many open files)
|
|
[2013-04-17 23:53:52 CEST] Committer: warning Committer crashed: lsof: createProcess: resource exhausted (Too many open files)
|
|
git-annex: runInteractiveProcess: pipe: Too many open files
|
|
git: createProcess: resource exhausted (Too many open files)
|
|
DaemonStatus crashed: /home/user/Desktop/down/annex_test/.git/annex/daemon.status.tmp21215: openFile: resource exhausted (Too many open files)
|
|
[2013-04-17 23:57:24 CEST] DaemonStatus: warning DaemonStatus crashed: /home/user/Desktop/down/annex_test/.git/annex/daemon.status.tmp21215: openFile: resource exhausted (Too many open files)
|
|
git-annex: runInteractiveProcess: pipe: Too many open files
|
|
git: createProcess: resource exhausted (Too many open files)
|
|
git-annex: runInteractiveProcess: pipe: Too many open files
|
|
NetWatcherFallback crashed: git: createProcess: resource exhausted (Too many open files)
|
|
[2013-04-18 00:27:17 CEST] NetWatcherFallback: warning NetWatcherFallback crashed: git: createProcess: resource exhausted (Too many open files)
|
|
git-annex: runInteractiveProcess: pipe: Too many open files
|
|
git-annex: git: createProcess: resource exhausted (Too many open files)
|
|
git-annex: accept: resource exhausted (Too many open files)
|
|
|
|
Instead of raising system's limit (which is a neverending story), can we make git-annex only watch a directory and not every file of it?
|
|
|
|
Or could the user specify some directory which he knows it is rarely change, to not be watched only check it once a day?
|
|
|
|
The best would be if git annex could automatically adapt itself.
|
|
Ie. it watches eg. 200 files, and if some of it does not change for three days, then it drops from the watching basket, and those who changed (noticed while sanity checked) it adds to the basket.
|
|
|
|
I don't really want to raise the ulimit, because my ultimate goal is to have git-annex on multiple raspberry pi with external harddrive (one at my home, one at my mom's home, one at my friends home, etc, etc). And raspberry is fairly low on resource.
|
|
|
|
I'm interested in your thoughts.
|
|
|
|
Best,
|
|
Laszlo
|
|
|
|
[[!tag /design/assistant]]
|
|
[[!meta title="assistant can try to add too many files at once in batch add mode"]]
|