Commit graph

5006 commits

Author SHA1 Message Date
msz
2662d2de66 Added a comment: Thank you for implementing 2025-04-29 17:00:36 +00:00
Joey Hess
49ee0a2a06
comment 2025-04-22 13:52:29 -04:00
Joey Hess
eafb5b53f0
comment 2025-04-21 13:03:39 -04:00
Joey Hess
78684c6c2e
fix close 2025-04-21 12:10:17 -04:00
Joey Hess
fe2de5dddc
update 2025-04-21 12:08:03 -04:00
kxra@ae0f8ab3caa4ebebe6b1a121dd41b6751182360e
eaf3a55a40 https://github.com/pulsejet/ownly/issues/49 2025-04-16 13:17:06 +00:00
kxra@ae0f8ab3caa4ebebe6b1a121dd41b6751182360e
4d96683f1d Added a comment 2025-04-15 21:23:58 +00:00
kxra@ae0f8ab3caa4ebebe6b1a121dd41b6751182360e
287172f9f5 http://www.lists.cs.ucla.edu/pipermail/ndn-interest/2025-April/003065.html 2025-04-15 21:23:33 +00:00
Joey Hess
af42271d37
comment, delink, close as dup 2025-04-15 09:48:16 -04:00
Kyra
33e21b1414 https://github.com/named-data-mobile/ndn-photo-app/issues/186 2025-04-12 19:01:38 +00:00
Kyra
a9b9911fd0 https://github.com/JonnyKong/GitSync/issues/2 2025-04-12 18:56:32 +00:00
Joey Hess
c5b0ca8982
comment 2025-04-11 13:25:41 -04:00
Joey Hess
5c9a6af5f8
Merge branch 'master' of ssh://git-annex.branchable.com 2025-04-11 13:22:41 -04:00
Joey Hess
f0123ec43a
done 2025-04-11 13:22:20 -04:00
msz
968bac2c14 Added a comment 2025-04-10 16:56:50 +00:00
Joey Hess
ecebdec2c6
update 2025-04-09 13:42:19 -04:00
Joey Hess
edc171bc5f
comment 2025-04-09 12:05:29 -04:00
Joey Hess
a69fc4b04a
comment and close 2025-04-09 11:13:49 -04:00
matrss
f86370693b Spoke with mih and he said this could be useful in the project context 2025-04-08 11:26:29 +00:00
msz
96b4292fb3 Added a comment 2025-04-07 17:06:15 +00:00
cjmarkie
92f8620aff Added a comment 2025-04-04 01:14:55 +00:00
Joey Hess
5f74a45861
comment 2025-04-01 10:36:50 -04:00
cjmarkie
58719f196b Added a comment 2025-03-28 13:49:12 +00:00
cjmarkie
8beea10b4e Added a comment 2025-03-28 13:44:13 +00:00
cjmarkie
043201c4d8 Propose skipping checksums in git-annex get --fast 2025-03-27 20:09:28 +00:00
Joey Hess
0bc1bebe05
todo 2025-03-22 09:23:03 -04:00
Joey Hess
70cb93a66b
checkPresent of compute remote checks inputs are available
If an input file has been lost from all repositories, it is no longer
possible to compute the output. This will avoid dropping content that
was computed in such a situation, as well as making git-annex fsck --from
the compute remote do its usual thing when content has gone missing.

This implementation avoids recursing forever if there is a cycle,
which should not be possible anyway.

Note the use of RemoteStateHandle as a constructor here suggests that
this may not handle sameas remotes right, since usually a
RemoteStateHandle is constructed using the sameas uuid for a sameas
remote. That assumes a compute remote can even have or be a sameas remote.
Which doesn't seem to make sense, so I have not thought through what might
happen here in detail.
2025-03-18 14:13:13 -04:00
Joey Hess
2466677b7b
update 2025-03-18 13:00:54 -04:00
Joey Hess
bcfd554a0f
findcomputed: New command, displays information about computed files. 2025-03-18 12:55:48 -04:00
Joey Hess
1b23823787
update 2025-03-17 16:02:02 -04:00
Joey Hess
2d60ce4803
record fscked files in fsck db by default
Remember the files that are checked, so a later run with --more will
skip them, without needing to use --incremental.
2025-03-17 15:34:08 -04:00
Joey Hess
f775c9643f
Merge branch 'master' of ssh://git-annex.branchable.com 2025-03-17 14:33:11 -04:00
Joey Hess
85fe283c05
decided to leave message as-is
"getting input <file> from <remote>"  is talking about the original
input filename. I think that's ok.
2025-03-17 14:31:43 -04:00
Joey Hess
f835919e40
decided addcomputed will not support annex.smallfiles
If it did, recompute would need to somehow support recomputing
non-annexed files.

And, annex.smallfiles is typically used for configuration files or
source code kind of things, where the user doesn't want it to be an
annexed file. Computed artifacts are not likely that kind of thing.

Also, git-annex importfeed is an example of something that does support
annex.addunlocked, but does not support annex.smallfiles.
2025-03-17 14:27:56 -04:00
Joey Hess
23538ea17b
annex.addunlocked support for git-annex compute
And for git-annex recompute, add the file unlocked when the original is
unlocked.
2025-03-17 14:26:09 -04:00
Atemu
73a066c963 2025-03-14 12:32:04 +00:00
msz
28ca34e182 Added a comment 2025-03-12 19:44:23 +00:00
Joey Hess
a673fc7cfd
recompute: stage new version of file in git
When writing doc/tips/computing_annexed_files.mdwn, I noticed
that a recompute --reproducible followed by a drop and a re-get did not
actually test if the file could be reproducible computed again.

Turns out that get and drop both operate on staged files. If there is an
unstaged modification in the work tree, that's ignored. Somewhat
surprisingly, other commands like info do operate on staged files. So
behavior is inconsistent, and fairly surprising really, when there are
unstaged modifications to files.

Probably this is rarely noticed because `git-annex add` is used to add a
new version of a file, and then it's staged. Or `git mv` is used to move
a file, rather than `mv` of a file over top of an existing file. So it's
uncommon to have an unstaged annexed file in a worktree.

It might be worth making things more consistent, but that's out of scope
for what I'm working on currently.

Also, I anticipate that supporting unlocked files with recompute will
require it to stage changes anyway.

So, make recompute stage the new version of the file.

I considered having recompute refuse to overwrite an existing staged
file. After all, whatever version was staged before will get lost when
the new version is staged over top of it. But, that's no different than
`git-annex addcomputed` being run with the name of an existing staged
file. Or `git-annex add` being run with a new file content when there is
an existing staged file. Or, for that matter, `git add` being ran with a
new content when there is an existing staged file.
2025-03-12 13:42:00 -04:00
Joey Hess
21b45da406
todo 2025-03-12 12:11:39 -04:00
Joey Hess
5f269513af
buffer responses to compute programs in a TQueue
This avoids a potential problem where the program sends several INPUT
before reading responses, so flushing the respose to the pipe could
block. It's unlikely, but seemed worth making sure it can't happen.
2025-03-11 12:40:21 -04:00
Joey Hess
0ee644b417
close off newline injection attacks against compute special remote protocol 2025-03-11 12:04:58 -04:00
Joey Hess
73a8ba5307
update 2025-03-11 11:53:14 -04:00
Joey Hess
0477a8d098
add INPUT-REQUIRED
Used by git-annex-compute-singularity to make addcomputed --fast work.

Also, simplified git-annex-compute-singularity; there is no need to hard
link the container into place. singularity does not care about the
extension of the container, so can just pass it the annex object file.
2025-03-11 11:46:31 -04:00
Joey Hess
e0b7653495
added git-annex-compute-singularity
And implemented SANDBOX, which it needs.
2025-03-10 16:41:26 -04:00
Joey Hess
6a8e57f0e9
remove todo I just added
If a compute program does this, it has a security hole. Not git-annex.
2025-03-07 13:29:57 -04:00
Joey Hess
78045f8e4f
todo 2025-03-07 13:24:11 -04:00
Joey Hess
6f78341fbf
Merge branch 'compute' 2025-03-06 14:23:58 -04:00
Joey Hess
e952753846
preparing to merge compute 2025-03-06 14:22:45 -04:00
bpoldrack
9f045ed494 Added a comment 2025-03-05 14:23:57 +00:00
msz
62ab16aef3 Tag copy_file_range todo with projects/INM7 (came from our cluster) 2025-03-05 13:35:19 +00:00