initial experimentation/complain about freeze/thawing files
This commit is contained in:
yarikoptic
admin
parent
64ccb4734e
commit
f2331feed1
1 changed files with 174 additions and 0 deletions
174
doc/bugs/can__39__t_make_annex_happy_in_freeze__47__thaw.mdwn
Normal file
174
doc/bugs/can__39__t_make_annex_happy_in_freeze__47__thaw.mdwn
Normal file
|
|
@ -0,0 +1,174 @@
|
||||||
|
### Please describe the problem.
|
||||||
|
|
||||||
|
Finally got to try [https://git-annex.branchable.com/todo/lockdown_hooks/](https://git-annex.branchable.com/todo/lockdown_hooks/) solution to avoid adjusted branches on local HPC which uses ACLs on some (but not all) partitions/etc.
|
||||||
|
|
||||||
|
For the use-case at hands I figured how to "freeze" and "thaw" to be done via `nfs4_{s,g}etfacl`. Here are my two scripts which also dump debug output to stderr
|
||||||
|
|
||||||
|
<details>
|
||||||
|
<summary>freeze-content -- adds "D::EVERYONE@:wadTN" at index 1</summary>
|
||||||
|
|
||||||
|
```shell
|
||||||
|
#!/bin/bash
|
||||||
|
|
||||||
|
set -eu
|
||||||
|
|
||||||
|
{
|
||||||
|
echo "D: freezing [$@] while under `pwd`"
|
||||||
|
ls -ld "$@"
|
||||||
|
# Cumbersome and buggy -- I found no other way to just say "remove write bits"
|
||||||
|
#nfs4_getfacl "$@" | sed -e 's,:r[^:]*$,:rxtncy,g' | nfs4_setfacl -S- "$@"
|
||||||
|
|
||||||
|
# This should be first and thus preventing any changes to that path
|
||||||
|
# 'thaw'ing would just remove that rule
|
||||||
|
nfs4_setfacl -a D::EVERYONE@:wadTN 1 "$@"
|
||||||
|
echo "D: finished freezing ok. Current ACL:"
|
||||||
|
nfs4_getfacl "$@"
|
||||||
|
} >&2
|
||||||
|
```
|
||||||
|
</details>
|
||||||
|
|
||||||
|
|
||||||
|
<details>
|
||||||
|
<summary>thaw-content -- removes that ACL</summary>
|
||||||
|
|
||||||
|
```shell
|
||||||
|
#!/bin/bash
|
||||||
|
|
||||||
|
set -eu
|
||||||
|
|
||||||
|
echo "unlocking [$@] while under `pwd`" >&2
|
||||||
|
#nfs4_getfacl "$@" | sed -e 's,:r[^:]*$,:rxtncy,g' | nfs4_setfacl -S- "$@"
|
||||||
|
nfs4_setfacl -x D::EVERYONE@:wadTN "$@"
|
||||||
|
echo "finished locking ok. ACL:" >&2
|
||||||
|
nfs4_getfacl "$@" >&1
|
||||||
|
```
|
||||||
|
</details>
|
||||||
|
|
||||||
|
|
||||||
|
and I verified that it does work as expected/desired:
|
||||||
|
|
||||||
|
<details>
|
||||||
|
<summary>on a directory</summary>
|
||||||
|
|
||||||
|
```shell
|
||||||
|
(git-annex) [d31548v@discovery7 tmp]$ mkdir testdir && ~/bin-annex/freeze-content testdir
|
||||||
|
D: freezing [testdir] while under /dartfs-hpc/rc/lab/C/CANlab/labdata/data/tmp
|
||||||
|
drwxrwx--- 2 d31548v rc-CANlab-admin 0 Feb 23 15:48 testdir
|
||||||
|
D: finished freezing ok. Current ACL:
|
||||||
|
|
||||||
|
# file: testdir
|
||||||
|
D::EVERYONE@:wadTN
|
||||||
|
A::OWNER@:rwadxtTnNcy
|
||||||
|
A:fdi:OWNER@:rwadxtTnNcy
|
||||||
|
A:fd:GROUP@:rwaDdxtTnNcCoy
|
||||||
|
A:fdg:rc-CANlab@KIEWIT.DARTMOUTH.EDU:rxtncy
|
||||||
|
(git-annex) [d31548v@discovery7 tmp]$ touch testdir/123
|
||||||
|
touch: cannot touch 'testdir/123': Permission denied
|
||||||
|
(git-annex) [d31548v@discovery7 tmp]$ rm -rf testdir
|
||||||
|
rm: cannot remove 'testdir': Permission denied
|
||||||
|
(git-annex) [d31548v@discovery7 tmp]$ ~/bin-annex/thaw-content testdir && rm -rf testdir
|
||||||
|
unlocking [testdir] while under /dartfs-hpc/rc/lab/C/CANlab/labdata/data/tmp
|
||||||
|
finished locking ok. ACL:
|
||||||
|
|
||||||
|
# file: testdir
|
||||||
|
A::OWNER@:rwadxtTnNcy
|
||||||
|
A:fdi:OWNER@:rwadxtTnNcy
|
||||||
|
A:fd:GROUP@:rwaDdxtTnNcCoy
|
||||||
|
A:fdg:rc-CANlab@KIEWIT.DARTMOUTH.EDU:rxtncy
|
||||||
|
(git-annex) [d31548v@discovery7 tmp]$ ls -ld testdir
|
||||||
|
ls: cannot access testdir: No such file or directory
|
||||||
|
|
||||||
|
```
|
||||||
|
</details>
|
||||||
|
|
||||||
|
|
||||||
|
<details>
|
||||||
|
<summary>and a file</summary>
|
||||||
|
|
||||||
|
```shell
|
||||||
|
(git-annex) [d31548v@discovery7 tmp]$ touch testfile && ~/bin-annex/freeze-content testfile
|
||||||
|
D: freezing [testfile] while under /dartfs-hpc/rc/lab/C/CANlab/labdata/data/tmp
|
||||||
|
-rwxrwx--- 1 d31548v rc-CANlab-admin 0 Feb 23 15:49 testfile
|
||||||
|
D: finished freezing ok. Current ACL:
|
||||||
|
|
||||||
|
# file: testfile
|
||||||
|
D::EVERYONE@:wadTN
|
||||||
|
A::OWNER@:rwadxtTnNcy
|
||||||
|
A::GROUP@:rwadxtTnNcCoy
|
||||||
|
A:g:rc-CANlab@KIEWIT.DARTMOUTH.EDU:rxtncy
|
||||||
|
(git-annex) [d31548v@discovery7 tmp]$ echo 123 >> testfile
|
||||||
|
bash: testfile: Permission denied
|
||||||
|
(git-annex) [d31548v@discovery7 tmp]$ rm testfile
|
||||||
|
rm: remove write-protected regular empty file 'testfile'? y
|
||||||
|
rm: cannot remove 'testfile': Permission denied
|
||||||
|
(git-annex) [d31548v@discovery7 tmp]$ ~/bin-annex/thaw-content testfile && rm -rf testfile
|
||||||
|
unlocking [testfile] while under /dartfs-hpc/rc/lab/C/CANlab/labdata/data/tmp
|
||||||
|
finished locking ok. ACL:
|
||||||
|
|
||||||
|
# file: testfile
|
||||||
|
A::OWNER@:rwadxtTnNcy
|
||||||
|
A::GROUP@:rwadxtTnNcCoy
|
||||||
|
A:g:rc-CANlab@KIEWIT.DARTMOUTH.EDU:rxtncy
|
||||||
|
(git-annex) [d31548v@discovery7 tmp]$ ls -ld testfile
|
||||||
|
ls: cannot access testfile: No such file or directory
|
||||||
|
|
||||||
|
```
|
||||||
|
</details>
|
||||||
|
|
||||||
|
|
||||||
|
But that still dissatisfies `git-annex` (10.20220127-gf616630):
|
||||||
|
|
||||||
|
```shell
|
||||||
|
(git-annex) [d31548v@discovery7 tmp]$ d=repo; chmod +r -R "$d" ; rm -rf "$d"; mkdir -p "$d" && cd $d && git init && git -c annex.freezecontent-command="$HOME/bin-annex/freeze-content %path" -c annex.thawcontent-command="$HOME/bin-annex/thaw-content %path" annex init
|
||||||
|
chmod: cannot access 'repo': No such file or directory
|
||||||
|
Initialized empty Git repository in /dartfs-hpc/rc/lab/C/CANlab/labdata/data/tmp/repo/.git/
|
||||||
|
init D: freezing [.git/annex/misctmp/gaprobe] while under /dartfs-hpc/rc/lab/C/CANlab/labdata/data/tmp/repo
|
||||||
|
-rwxrwx--- 1 d31548v rc-CANlab-admin 0 Feb 23 15:51 .git/annex/misctmp/gaprobe
|
||||||
|
D: finished freezing ok. Current ACL:
|
||||||
|
|
||||||
|
# file: .git/annex/misctmp/gaprobe
|
||||||
|
D::EVERYONE@:wadTN
|
||||||
|
A::OWNER@:rwadxtTnNcy
|
||||||
|
A::GROUP@:rwadxtTnNcCoy
|
||||||
|
A:g:rc-CANlab@KIEWIT.DARTMOUTH.EDU:rxtncy
|
||||||
|
unlocking [.git/annex/misctmp/gaprobe] while under /dartfs-hpc/rc/lab/C/CANlab/labdata/data/tmp/repo
|
||||||
|
finished locking ok. ACL:
|
||||||
|
|
||||||
|
# file: .git/annex/misctmp/gaprobe
|
||||||
|
A::OWNER@:rwadxtTnNcy
|
||||||
|
A::GROUP@:rwadxtTnNcCoy
|
||||||
|
A:g:rc-CANlab@KIEWIT.DARTMOUTH.EDU:rxtncy
|
||||||
|
|
||||||
|
Filesystem does not allow removing write bit from files.
|
||||||
|
|
||||||
|
Detected a crippled filesystem.
|
||||||
|
|
||||||
|
Disabling core.symlinks.
|
||||||
|
|
||||||
|
Entering an adjusted branch where files are unlocked as this filesystem does not support locked files.
|
||||||
|
|
||||||
|
Switched to branch 'adjusted/master(unlocked)'
|
||||||
|
ok
|
||||||
|
(recording state in git...)
|
||||||
|
```
|
||||||
|
|
||||||
|
may be it is because at POSIX level write bits are still there? e.g. here is with the file
|
||||||
|
|
||||||
|
```shell
|
||||||
|
(git-annex) [d31548v@discovery7 repo]$ touch testfile && ~/bin-annex/freeze-content testfile && ls -l testfile
|
||||||
|
D: freezing [testfile] while under /dartfs-hpc/rc/lab/C/CANlab/labdata/data/tmp/repo
|
||||||
|
-rwxrwx--- 1 d31548v rc-CANlab-admin 0 Feb 23 15:51 testfile
|
||||||
|
D: finished freezing ok. Current ACL:
|
||||||
|
|
||||||
|
# file: testfile
|
||||||
|
D::EVERYONE@:wadTN
|
||||||
|
A::OWNER@:rwadxtTnNcy
|
||||||
|
A::GROUP@:rwadxtTnNcCoy
|
||||||
|
A:g:rc-CANlab@KIEWIT.DARTMOUTH.EDU:rxtncy
|
||||||
|
-rwxrwx--- 1 d31548v rc-CANlab-admin 0 Feb 23 15:51 testfile
|
||||||
|
```
|
||||||
|
|
||||||
|
filing as a bug since I think I satisfied all desires of git-annex for ensuring that target path is frozen, but it is still not satisfied
|
||||||
|
|
||||||
|
[[!meta author=yoh]]
|
||||||
|
[[!tag projects/datalad]]
|
||||||
Loading…
Add table
Add a link
Reference in a new issue