initial report on breed of children processes by testremote
This commit is contained in:
yarikoptic
admin
parent
4637c5a37e
commit
6491691801
1 changed files with 219 additions and 0 deletions
|
|
@ -0,0 +1,219 @@
|
||||||
|
### Please describe the problem.
|
||||||
|
|
||||||
|
See more information and the initial cause (failing testing on travis with recent git annex) at [datalad/issues/4643](https://github.com/datalad/datalad/issues/4643)
|
||||||
|
|
||||||
|
|
||||||
|
In brief, using git annex 8.20200617-g02765b8 resulted in the following pstree with a simple [custom special remote](https://github.com/datalad/datalad/pull/3727):
|
||||||
|
|
||||||
|
```
|
||||||
|
$> pstree -l -a --compact-not -T -p 625823 | nl
|
||||||
|
1 git,625823 annex testremote go
|
||||||
|
2 `-git-annex,625824 testremote go
|
||||||
|
3 |-git,625833 --git-dir=.git --work-tree=. --literal-pathspecs cat-file --batch
|
||||||
|
4 |-git,625834 --git-dir=.git --work-tree=. --literal-pathspecs cat-file --batch-check=%(objectname) %(objecttype) %(objectsize)
|
||||||
|
5 |-(git-annex-remot,625841)
|
||||||
|
6 |-(git-annex-remot,625847)
|
||||||
|
7 |-git-annex-remot,625853 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
8 |-(git-annex-remot,625869)
|
||||||
|
9 |-(git-annex-remot,625875)
|
||||||
|
10 |-git-annex-remot,625881 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
11 |-(git-annex-remot,625895)
|
||||||
|
12 |-(git-annex-remot,625901)
|
||||||
|
13 |-git-annex-remot,625908 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
14 |-(git-annex-remot,625955)
|
||||||
|
15 |-(git-annex-remot,625961)
|
||||||
|
16 |-git-annex-remot,625967 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
17 |-(git-annex-remot,625981)
|
||||||
|
18 |-(git-annex-remot,625987)
|
||||||
|
19 |-git-annex-remot,625993 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
20 |-(git-annex-remot,626013)
|
||||||
|
21 |-(git-annex-remot,626019)
|
||||||
|
22 |-git-annex-remot,626025 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
23 |-(git-annex-remot,626039)
|
||||||
|
24 |-(git-annex-remot,626045)
|
||||||
|
25 |-git-annex-remot,626053 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
26 |-(git-annex-remot,626075)
|
||||||
|
27 |-(git-annex-remot,626081)
|
||||||
|
28 |-(git-annex-remot,626087)
|
||||||
|
29 |-(git-annex-remot,626096)
|
||||||
|
30 |-git-annex-remot,626102 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
31 |-(git-annex-remot,626124)
|
||||||
|
32 |-(git-annex-remot,626130)
|
||||||
|
33 |-(git-annex-remot,626136)
|
||||||
|
34 |-(git-annex-remot,626142)
|
||||||
|
35 |-git-annex-remot,626148 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
36 |-(git-annex-remot,626170)
|
||||||
|
37 |-(git-annex-remot,626176)
|
||||||
|
38 |-(git-annex-remot,626185)
|
||||||
|
39 |-(git-annex-remot,626191)
|
||||||
|
40 |-git-annex-remot,626198 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
41 |-(git-annex-remot,626220)
|
||||||
|
42 |-(git-annex-remot,626226)
|
||||||
|
43 |-(git-annex-remot,626232)
|
||||||
|
44 |-(git-annex-remot,626238)
|
||||||
|
45 |-git-annex-remot,626244 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
46 |-(git-annex-remot,626276)
|
||||||
|
47 |-(git-annex-remot,626282)
|
||||||
|
48 |-git-annex-remot,626288 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
49 |-(git-annex-remot,626302)
|
||||||
|
50 |-(git-annex-remot,626309)
|
||||||
|
51 |-git-annex-remot,626315 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
52 |-(git-annex-remot,626333)
|
||||||
|
53 |-(git-annex-remot,626340)
|
||||||
|
54 |-git-annex-remot,626346 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
55 |-(git-annex-remot,626360)
|
||||||
|
56 |-(git-annex-remot,626366)
|
||||||
|
57 |-git-annex-remot,626372 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
58 |-(git-annex-remot,626416)
|
||||||
|
59 |-(git-annex-remot,626422)
|
||||||
|
60 |-git-annex-remot,626428 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
61 |-(git-annex-remot,626442)
|
||||||
|
62 |-(git-annex-remot,626448)
|
||||||
|
63 |-git-annex-remot,626454 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
64 |-(git-annex-remot,626475)
|
||||||
|
65 |-(git-annex-remot,626481)
|
||||||
|
66 |-git-annex-remot,626487 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
67 |-(git-annex-remot,626501)
|
||||||
|
68 |-(git-annex-remot,626507)
|
||||||
|
69 |-git-annex-remot,626513 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
70 |-(git-annex-remot,626535)
|
||||||
|
71 |-(git-annex-remot,626549)
|
||||||
|
72 |-(git-annex-remot,626555)
|
||||||
|
73 |-(git-annex-remot,626561)
|
||||||
|
74 |-git-annex-remot,626567 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
75 |-(git-annex-remot,626589)
|
||||||
|
76 |-(git-annex-remot,626595)
|
||||||
|
77 |-(git-annex-remot,626601)
|
||||||
|
78 |-(git-annex-remot,626607)
|
||||||
|
79 |-git-annex-remot,626613 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
80 |-(git-annex-remot,626635)
|
||||||
|
81 |-(git-annex-remot,626641)
|
||||||
|
82 |-(git-annex-remot,626647)
|
||||||
|
83 |-(git-annex-remot,626653)
|
||||||
|
84 |-git-annex-remot,626660 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
85 |-(git-annex-remot,626685)
|
||||||
|
86 |-(git-annex-remot,626691)
|
||||||
|
87 |-(git-annex-remot,626697)
|
||||||
|
88 |-(git-annex-remot,626703)
|
||||||
|
89 |-git-annex-remot,626709 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
90 |-(git-annex-remot,626741)
|
||||||
|
91 |-(git-annex-remot,626747)
|
||||||
|
92 |-git-annex-remot,626753 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
93 |-(git-annex-remot,626767)
|
||||||
|
94 |-(git-annex-remot,626773)
|
||||||
|
95 |-git-annex-remot,626779 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
96 |-(git-annex-remot,626795)
|
||||||
|
97 |-(git-annex-remot,626801)
|
||||||
|
98 |-git-annex-remot,626807 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
99 |-(git-annex-remot,626821)
|
||||||
|
100 |-(git-annex-remot,626828)
|
||||||
|
101 |-git-annex-remot,626834 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
102 |-(git-annex-remot,630376)
|
||||||
|
103 |-(git-annex-remot,630382)
|
||||||
|
104 |-git-annex-remot,630388 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
105 |-(git-annex-remot,630813)
|
||||||
|
106 |-(git-annex-remot,630819)
|
||||||
|
107 |-git-annex-remot,630825 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
108 |-(git-annex-remot,631249)
|
||||||
|
109 |-(git-annex-remot,631255)
|
||||||
|
110 |-git-annex-remot,631261 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
111 |-(git-annex-remot,631679)
|
||||||
|
112 |-(git-annex-remot,631685)
|
||||||
|
113 |-git-annex-remot,631691 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
114 |-(git-annex-remot,632944)
|
||||||
|
115 |-(git-annex-remot,632950)
|
||||||
|
116 |-(git-annex-remot,632956)
|
||||||
|
117 |-(git-annex-remot,632962)
|
||||||
|
118 |-git-annex-remot,632968 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
119 |-(git-annex-remot,633804)
|
||||||
|
120 |-(git-annex-remot,633810)
|
||||||
|
121 |-(git-annex-remot,633816)
|
||||||
|
122 |-(git-annex-remot,633822)
|
||||||
|
123 |-git-annex-remot,633828 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
124 |-(git-annex-remot,635086)
|
||||||
|
125 |-(git-annex-remot,635092)
|
||||||
|
126 |-(git-annex-remot,635098)
|
||||||
|
127 |-(git-annex-remot,635104)
|
||||||
|
128 |-git-annex-remot,635111 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
129 |-(git-annex-remot,635133)
|
||||||
|
130 |-(git-annex-remot,635139)
|
||||||
|
131 |-(git-annex-remot,635145)
|
||||||
|
132 |-(git-annex-remot,635151)
|
||||||
|
133 |-git-annex-remot,635157 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
134 |-(git-annex-remot,637445)
|
||||||
|
135 |-(git-annex-remot,637451)
|
||||||
|
136 |-git-annex-remot,637457 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
137 |-(git-annex-remot,637471)
|
||||||
|
138 |-(git-annex-remot,637477)
|
||||||
|
139 |-git-annex-remot,637484 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
140 |-(git-annex-remot,637500)
|
||||||
|
141 |-(git-annex-remot,637506)
|
||||||
|
142 |-git-annex-remot,637512 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
143 |-(git-annex-remot,637526)
|
||||||
|
144 |-(git-annex-remot,637532)
|
||||||
|
145 |-git-annex-remot,637538 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
146 |-git-annex-remot,641104 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
147 |-(git-annex-remot,641110)
|
||||||
|
148 |-git-annex-remot,641116 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
149 |-git-annex-remot,641541 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
150 |-(git-annex-remot,641547)
|
||||||
|
151 |-git-annex-remot,641553 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
152 |-(git-annex-remot,641971)
|
||||||
|
153 |-(git-annex-remot,641977)
|
||||||
|
154 |-git-annex-remot,641983 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
155 |-git-annex-remot,642411 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
156 |-(git-annex-remot,642417)
|
||||||
|
157 |-git-annex-remot,642423 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
158 |-git-annex-remot,643893 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
159 |-(git-annex-remot,643899)
|
||||||
|
160 |-(git-annex-remot,643905)
|
||||||
|
161 |-(git-annex-remot,643911)
|
||||||
|
162 |-git-annex-remot,643917 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
163 |-git-annex-remot,644770 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
164 |-(git-annex-remot,644776)
|
||||||
|
165 |-(git-annex-remot,644782)
|
||||||
|
166 |-(git-annex-remot,644788)
|
||||||
|
167 `-git-annex-remot,644794 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
168 `-git,645597 -c gc.auto=0 fetch origin refs/annex-gitobjects/SHA256E-s1048576-S10485-C65--09bb4349a75edd87d52a9c0fa7c8962dd5f58b22e3a639924f9b625eda394e47.this-is-a-test-key:refs/annex-gitobjects/SHA256E-s1048576-S10485-C65--09bb4349a75edd87d52a9c0fa7c8962dd5f58b22e3a639924f9b625eda394e47.this-is-a-test-key
|
||||||
|
```
|
||||||
|
|
||||||
|
(pstree is taken at some point in time of `testremote` running)
|
||||||
|
|
||||||
|
even with older version (7.20190819+git2-g908476a9b-1~ndall+1) it is not clear why some older instances linger around:
|
||||||
|
|
||||||
|
```
|
||||||
|
git,586534 annex testremote go
|
||||||
|
`-git-annex,586535 --library-path /usr/lib/git-annex.linux//usr/lib/x86_64-linux-gnu/gconv:/usr/lib/git-annex.linux//usr/lib/x86_64-linux-gnu/audit:/usr/lib/git-annex.linux//etc/ld.so.conf.d:/usr/lib/git-annex.linux//lib64:/u
|
||||||
|
sr/lib/git-annex.linux//usr/lib/x86_64-linux-gnu:/usr/lib/git-annex.linux//lib/x86_64-linux-gnu: /usr/lib/git-annex.linux/shimmed/git-annex/git-annex testremote go
|
||||||
|
|-git,586558 --library-path /usr/lib/git-annex.linux//usr/lib/x86_64-linux-gnu/gconv:/usr/lib/git-annex.linux//usr/lib/x86_64-linux-gnu/audit:/usr/lib/git-annex.linux//etc/ld.so.conf.d:/usr/lib/git-annex.linux//lib64:/usr
|
||||||
|
/lib/git-annex.linux//usr/lib/x86_64-linux-gnu:/usr/lib/git-annex.linux//lib/x86_64-linux-gnu: /usr/lib/git-annex.linux/shimmed/git/git --git-dir=.git --work-tree=. --literal-pathspecs cat-file --batch
|
||||||
|
|-git,586559 --library-path /usr/lib/git-annex.linux//usr/lib/x86_64-linux-gnu/gconv:/usr/lib/git-annex.linux//usr/lib/x86_64-linux-gnu/audit:/usr/lib/git-annex.linux//etc/ld.so.conf.d:/usr/lib/git-annex.linux//lib64:/usr
|
||||||
|
/lib/git-annex.linux//usr/lib/x86_64-linux-gnu:/usr/lib/git-annex.linux//lib/x86_64-linux-gnu: /usr/lib/git-annex.linux/shimmed/git/git --git-dir=.git --work-tree=. --literal-pathspecs cat-file --batch-check=%(objectname) %(obj
|
||||||
|
ecttype) %(objectsize)
|
||||||
|
|-git-annex-remot,586561 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
|-git-annex-remot,586575 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
|-git-annex-remot,586589 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
|-git-annex-remot,586603 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
|-git-annex-remot,586617 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
|-git-annex-remot,586631 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
|-git-annex-remot,586645 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
|-git-annex-remot,586659 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
|-git-annex-remot,586674 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
| `-git,596315 --library-path /usr/lib/git-annex.linux//usr/lib/x86_64-linux-gnu/gconv:/usr/lib/git-annex.linux//usr/lib/x86_64-linux-gnu/audit:/usr/lib/git-annex.linux//etc/ld.so.conf.d:/usr/lib/git-annex.linux//lib64:
|
||||||
|
/usr/lib/git-annex.linux//usr/lib/x86_64-linux-gnu:/usr/lib/git-annex.linux//lib/x86_64-linux-gnu: /usr/lib/git-annex.linux/shimmed/git/git -c gc.auto=0 push origin :refs/annex-gitobjects/SHA256E-s1048576-S10485-C55--f29f024602
|
||||||
|
c6bb2cce66bc08073e2770802707941f06270d03264e574b2b2c0d.this-is-a-test-key
|
||||||
|
| `-sh,596316 -c git-receive-pack '/home/yoh/.tmp/dl-XfXTJ3K/a' git-receive-pack '/home/yoh/.tmp/dl-XfXTJ3K/a'
|
||||||
|
| `-git-receive-pac,596317 --library-path /usr/lib/git-annex.linux//usr/lib/x86_64-linux-gnu/gconv:/usr/lib/git-annex.linux//usr/lib/x86_64-linux-gnu/audit:/usr/lib/git-annex.linux//etc/ld.so.conf.d:/usr/lib/git
|
||||||
|
-annex.linux//lib64:/usr/lib/git-annex.linux//usr/lib/x86_64-linux-gnu:/usr/lib/git-annex.linux//lib/x86_64-linux-gnu: /usr/lib/git-annex.linux/shimmed/git-receive-pack/git-receive-pack /home/yoh/.tmp/dl-XfXTJ3K/a
|
||||||
|
| `-post-receive,596321 hooks/post-receive
|
||||||
|
|-git-annex-remot,586691 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
|-git-annex-remot,586705 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
|-git-annex-remot,586719 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
|-git-annex-remot,586733 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
`-git-annex-remot,586747 /home/yoh/proj/datalad/datalad/sandbox/git-annex-remote-gitobjects
|
||||||
|
```
|
||||||
|
|
||||||
|
I also wonder if there could be some unittest added to test that annex stays "lean" (in terms of child processes) while using external remotes.
|
||||||
|
|
||||||
|
[[!meta author=yoh]]
|
||||||
|
[[!tag projects/yoh]]
|
||||||
Loading…
Add table
Reference in a new issue