Merge branch 'master' of ssh://git-annex.branchable.com

This commit is contained in:
Joey Hess 2012-06-25 20:17:54 -04:00
commit 17a8f60710
9 changed files with 136 additions and 0 deletions

View file

@ -0,0 +1,19 @@
I was dumping ~gigs of files of approximately 3-6megs a pop (my music collection) so I could track the files that I want to listen to when I'm on the go. I had the git watch command running from the assistant branch.
I was getting something along the lines of...
/Users/jtang/annex/.git/annex/tmp/: openTempFile: resource exhausted (Too many open files)
and
git-annex: createPipe: resource exhausted (Too many open files)
I also noticed that I somehow ended up with 256 ssh-agent's running on one of my machines, I'm not sure if the two issues are related or not, I had not noticed this type of behaviour up until recently.
Also this was appearing in the logs
x00:annex jtang$ tail -f .git/annex/daemon.log
(scanning...) Already up-to-date.
kqueue: Too many open files
To be precise, I suspect that the kqueue limit is 256, I had 325 files in the 'queue', I ended up doing a _git annex add_ manually and all was fine.

View file

@ -0,0 +1,12 @@
[[!comment format=mdwn
username="http://joeyh.name/"
ip="4.153.2.25"
subject="comment 1"
date="2012-06-25T15:42:48Z"
content="""
Yes, this is a known problem with kqueue, it has to keep every directory in the tree open. On [[design/assistant/inotify]] I have a note that it may need to fork off extra watcher processes to deal with this. Of course that adds significant complication.
In the meantime, you may be able to increase your system's maximum allowed number of open files per process somehow.
(I doubt that the ssh-agent is related; git-annex does not use ssh-agent directly anyway..)
"""]]

View file

@ -0,0 +1,12 @@
Running the 'assistant' branch, I occassionally get
To myhost1:/Users/jtang/annex
! [rejected] master -> synced/master (non-fast-forward)
error: failed to push some refs to 'myhost1:/Users/jtang/annex'
hint: Updates were rejected because a pushed branch tip is behind its remote
hint: counterpart. Check out this branch and merge the remote changes
hint: (e.g. 'git pull') before pushing again.
hint: See the 'Note about fast-forwards' in 'git push --help' for details.
(Recording state in git...)
manually running a 'git annex sync' usually fixes it, I guess once the sync command runs periodically this problem will go away, is this even OSX specific? I don't quite get the behaviour that is described in [[design/assistant/blog/day_15__its_aliiive]].

View file

@ -0,0 +1,8 @@
[[!comment format=mdwn
username="http://joeyh.name/"
ip="4.153.2.25"
subject="comment 1"
date="2012-06-25T15:45:18Z"
content="""
This is indeed the problem I've planned to work on today, as I see it too when things don't start off perfectly in sync.
"""]]

View file

@ -0,0 +1,10 @@
[[!comment format=mdwn
username="http://joeyh.name/"
ip="4.153.2.25"
subject="comment 10"
date="2012-06-25T15:38:44Z"
content="""
@Agustin you should be able to work around that with: cabal install git-annex --flags=-Inotify
I've fixed it properly for the next release, it should only be using that library on Linux.
"""]]

View file

@ -0,0 +1,39 @@
[[!comment format=mdwn
username="https://www.google.com/accounts/o8/id?id=AItOawkwR9uOA38yi5kEUvcEWNtRiZwpxXskayE"
nickname="Agustin"
subject="Installation not working on OS X 10.6.8"
date="2012-06-25T02:21:40Z"
content="""
I try installing with brew because I already had brew setup in my machine, but all run ok but when I try to run cabal install git-annex I got an error with the hinotify-0.3.2 library complaining about a header file.
Full trace:
~~~
sudo cabal install git-annex
Resolving dependencies...
Configuring hinotify-0.3.2...
Building hinotify-0.3.2...
Preprocessing library hinotify-0.3.2...
INotify.hsc:35:25: error: sys/inotify.h: No such file or directory
INotify.hsc: In function main:
INotify.hsc:259: error: invalid use of undefined type struct inotify_event
INotify.hsc:260: error: invalid use of undefined type struct inotify_event
INotify.hsc:261: error: invalid use of undefined type struct inotify_event
INotify.hsc:262: error: invalid use of undefined type struct inotify_event
INotify.hsc:265: error: invalid use of undefined type struct inotify_event
INotify.hsc:266: error: invalid application of sizeof to incomplete type struct inotify_event
compiling dist/build/System/INotify_hsc_make.c failed (exit code 1)
command was: /usr/bin/gcc -c dist/build/System/INotify_hsc_make.c -o dist/build/System/INotify_hsc_make.o -m64 -fno-stack-protector -m64 -D__GLASGOW_HASKELL__=704 -Ddarwin_BUILD_OS -Ddarwin_HOST_OS -Dx86_64_BUILD_ARCH -Dx86_64_HOST_ARCH -I/usr/local/Cellar/ghc/7.4.1/lib/ghc-7.4.1/directory-1.1.0.2/include -Idist/build/autogen -include dist/build/autogen/cabal_macros.h -I/usr/local/Cellar/ghc/7.4.1/lib/ghc-7.4.1/unix-2.5.1.0/include -Idist/build/autogen -include dist/build/autogen/cabal_macros.h -I/usr/local/Cellar/ghc/7.4.1/lib/ghc-7.4.1/old-time-1.1.0.0/include -Idist/build/autogen -include dist/build/autogen/cabal_macros.h -Idist/build/autogen -include dist/build/autogen/cabal_macros.h -Idist/build/autogen -include dist/build/autogen/cabal_macros.h -Idist/build/autogen -include dist/build/autogen/cabal_macros.h -Idist/build/autogen -include dist/build/autogen/cabal_macros.h -I/usr/local/Cellar/ghc/7.4.1/lib/ghc-7.4.1/bytestring-0.9.2.1/include -Idist/build/autogen -include dist/build/autogen/cabal_macros.h -Idist/build/autogen -include dist/build/autogen/cabal_macros.h -I/usr/local/Cellar/ghc/7.4.1/lib/ghc-7.4.1/base-4.5.0.0/include -Idist/build/autogen -include dist/build/autogen/cabal_macros.h -Idist/build/autogen -include dist/build/autogen/cabal_macros.h -Idist/build/autogen -include dist/build/autogen/cabal_macros.h -I/usr/local/Cellar/ghc/7.4.1/lib/ghc-7.4.1/include -Idist/build/autogen -include dist/build/autogen/cabal_macros.h -I/usr/local/Cellar/ghc/7.4.1/lib/ghc-7.4.1/include/
cabal: Error: some packages failed to install:
git-annex-3.20120624 depends on hinotify-0.3.2 which failed to install.
hinotify-0.3.2 failed during the building phase. The exception was:
ExitFailure 1
~~~
Anyone has an idea how can I solve this.
Thanks for the time!
Agustin
"""]]

View file

@ -0,0 +1,14 @@
[[!comment format=mdwn
username="https://www.google.com/accounts/o8/id?id=AItOawkwR9uOA38yi5kEUvcEWNtRiZwpxXskayE"
nickname="Agustin"
subject="For the moment"
date="2012-06-25T02:51:10Z"
content="""
Hi Joey! I just comment that I could not install it but the issue is with the last version (the one you just release today, so no problem!! man on sunday?? you're awesome!!!) so I installed the previous one and no problem at all
Thanks for all the efford and if you need me to try os whatever, feel free to ask!
Thanks again
Agustin
"""]]

View file

@ -0,0 +1,10 @@
[[!comment format=mdwn
username="http://joeyh.name/"
ip="4.153.2.25"
subject="comment 2"
date="2012-06-25T15:29:29Z"
content="""
The directory and rsync special remotes intentionally use the same layout. So the same directory could be set up as both types of special remotes.
The main reason to use this rather than a bare git repo is that it supports encryption.
"""]]

View file

@ -0,0 +1,12 @@
[[!comment format=mdwn
username="https://www.google.com/accounts/o8/id?id=AItOawkjvjLHW9Omza7x1VEzIFQ8Z5honhRB90I"
nickname="Asheesh"
subject="The fact that the keys changed causes merge conflicts"
date="2012-06-25T00:28:59Z"
content="""
FYI, I have run into a problem where if you 'git annex sync' between various 'git annex v3' repositories, if the different repositories are using different encodings of the SHA1 information (one including size, one not), then the 'git merge' will declare that they conflict.
There's no indication that 'git annex migrate' is the right tool to run, except from perusing the 'git annex' man page. In my opinion this is a major user interface problem.
-- Asheesh.
"""]]