git-annex/doc/todo/smudge/comment_12_a4712d510432931062406c4e256f04b1._comment

[[!comment format=mdwn
 username="joey"
 subject="""re: Git 2.5 allows smudge filters to not read all of stdin"""
 date="2018-08-09T22:11:00Z"
 content="""
@torarnv thanks for pointing that out.. I finally got around to verifying
that, and was able to speed up the smudge filter. Also this avoids the
problem that git for some reason buffers the whole file content in memory
when it sends it to the smudge filter, which is a pretty bad memory leak in git
that no longer affects this.
"""]]
massive v6 add speed/memory improvement v6 add: Take advantage of improved SIGPIPE handler in git 2.5 to speed up the clean filter by not reading the file content from the pipe. This also avoids git buffering the whole file content in memory. When built with an older git, still consumes stdin. If built with a newer git and used with an older one, it breaks, but that's acceptable -- checking the git version every time would make repeated smudge runs slow. This commit was supported by the NSF-funded DataLad project. 2018-08-09 22:17:46 +00:00			`[[!comment format=mdwn`
			`username="joey"`
			`subject="""re: Git 2.5 allows smudge filters to not read all of stdin"""`
			`date="2018-08-09T22:11:00Z"`
			`content="""`
			`@torarnv thanks for pointing that out.. I finally got around to verifying`
			`that, and was able to speed up the smudge filter. Also this avoids the`
			`problem that git for some reason buffers the whole file content in memory`
			`when it sends it to the smudge filter, which is a pretty bad memory leak in git`
			`that no longer affects this.`
			`"""]]`