6821ba8dab
Speeds up sync in an adjusted branch by avoiding re-adjusting the branch unncessarily, particularly when it is adjusted with --hide-missing or --unlock-present. When there are a lot of files, that was the majority of the time of a --no-content sync. Uses a log file, which is updated when content presence changes. This adds a little bit of overhead to every file get/drop when on such an adjusted branch. The overhead is minimal for get of any size of file, but might be noticable for drop in some cases. It seems like a reasonable trade-off. It would be possible to update the log file only at the end, but then it would not happen if the command is interrupted. When not in an adjusted branch, there should be no additional overhead. (getCurrentBranch is an MVar read, and it avoids the MVar read of getGitConfig.) Note that this does not deal with situations such as: git checkout master, git-annex get, git checkout adjusted branch, git-annex sync. The sync won't know that the adjusted branch needs to be updated. Dealing with that would add overhead to operation in non-adjusted branches, which I don't like. Also, there are other situations like having two adjusted branches that both need to be updated like this, and switching between them and sync not updating. This does mean a behavior change to sync, since it did previously deal with those situations. But, the documentation did not say that it did. The man pages only talk about sync updating the adjusted branch after it transfers content. I did consider making sync keep track of content it transferred (and dropped) and only update the adjusted branch then, not to catch up to other changes made previously. That would perform better. But it seemed rather hard to implement, and also it would have problems with races with a concurrent get/drop, which this implementation avoids. And it seemed pretty likely someone had gotten used to get/drop followed by sync updating the branch. It seems much less likely someone is switching branches, doing get/drop, and then switching back and expecting sync to update the branch. Re-running git-annex adjust still does a full re-adjusting of the branch, for anyone who needs that. Sponsored-by: Leon Schuermann on Patreon |
||
---|---|---|
.. | ||
Chunk | ||
ContentIdentifier | ||
Difference | ||
Export | ||
MetaData | ||
PreferredContent | ||
Presence | ||
Remote | ||
SingleValue | ||
Trust | ||
Activity.hs | ||
AdjustedBranchUpdate.hs | ||
Chunk.hs | ||
Config.hs | ||
ContentIdentifier.hs | ||
Difference.hs | ||
Export.hs | ||
File.hs | ||
FsckResults.hs | ||
Group.hs | ||
Import.hs | ||
Line.hs | ||
Location.hs | ||
MapLog.hs | ||
MetaData.hs | ||
Multicast.hs | ||
NumCopies.hs | ||
PreferredContent.hs | ||
Presence.hs | ||
Remote.hs | ||
RemoteState.hs | ||
Restage.hs | ||
Schedule.hs | ||
SingleValue.hs | ||
Smudge.hs | ||
Transfer.hs | ||
Transitions.hs | ||
Trust.hs | ||
Unused.hs | ||
Upgrade.hs | ||
UUID.hs | ||
UUIDBased.hs | ||
View.hs | ||
Web.hs |