implement importChanges optimisaton (not used yet)

For simplicity, I've not tried to make it handle History yet, so when
there is a history, a full import will still be done. Probably the right
way to handle history is to first diff from the current tree to the last
imported tree. Then, diff from the current tree to each of the
historical trees, and recurse through the history diffing from child tree
to parent tree.

I don't think that will need a record of the previously imported
historical trees, and so Logs.Import doesn't store them. Although I did
leave room for future expansion in that log just in case.

Next step will be to change importTree to importChanges and modify
recordImportTree et all to handle it, by using adjustTree.

Sponsored-by: Brett Eisenberg on Patreon
This commit is contained in:
Joey Hess 2023-05-31 15:45:23 -04:00
parent 7298123520
commit c6acf574c7
No known key found for this signature in database
GPG key ID: DB12DB0FF05F8F38
8 changed files with 169 additions and 26 deletions

View file

@ -1,11 +1,11 @@
{- git-annex import types
-
- Copyright 2019-2021 Joey Hess <id@joeyh.name>
- Copyright 2019-2023 Joey Hess <id@joeyh.name>
-
- Licensed under the GNU AGPL version 3 or higher.
-}
{-# LANGUAGE DeriveGeneric #-}
{-# LANGUAGE DeriveGeneric, DeriveFunctor #-}
module Types.Import where
@ -67,7 +67,7 @@ data ImportableContents info = ImportableContents
-- locations. So, if a remote does not support Key/Value access,
-- it should not populate the importableHistory.
}
deriving (Show, Generic)
deriving (Show, Generic, Functor)
instance NFData info => NFData (ImportableContents info)
@ -81,6 +81,7 @@ data ImportableContentsChunkable m info
, importableHistoryComplete :: [ImportableContents info]
-- ^ Chunking the history is not supported
}
deriving (Functor)
{- A chunk of ImportableContents, which is the entire content of a subtree
- of the main tree. Nested subtrees are not allowed. -}
@ -92,6 +93,7 @@ data ImportableContentsChunk m info = ImportableContentsChunk
-- ^ Continuation to get the next chunk.
-- Returns Nothing when there are no more chunks.
}
deriving (Functor)
newtype ImportChunkSubDir = ImportChunkSubDir { importChunkSubDir :: RawFilePath }