mirrors/git-annex
2
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
git-annex/Utility/RawFilePath.hs

97 lines
2.8 KiB
Haskell
Raw Normal View History

more RawFilePath conversion Added a RawFilePath createDirectory and kept making stuff build. Up to 296/645 This commit was sponsored by Mark Reidenbach on Patreon.
2020-10-28 21:25:59 +00:00
{- Portability shim for basic operations on RawFilePaths.
RawFilePath will need to support Windows too Of course, readSymbolicLink always fails on Windows, but now it's ready for other things that don't fail there.
2019-12-06 18:17:48 +00:00
-
- On unix, this makes syscalls using RawFilesPaths as efficiently as
- possible.
-
- On Windows, filenames are in unicode, so RawFilePaths have to be
- decoded. So this library will work, but less efficiently than using
- FilePath would.
use ByteStrings when reading annex symlinks and pointers Now there's a ByteString used all the way from disk to Key. The main complication in this conversion was the use of fromInternalGitPath in several places to munge things on Windows. The things that used that were changed to parse the ByteString using either path separator. Also some code that had read from files to a String lazily was changed to read a minimal strict ByteString.
2019-01-14 19:19:20 +00:00
-
RawFilePath version of getCurrentDirectory This commit was sponsored by Jochen Bartl on Patreon
2020-10-28 20:03:45 +00:00
- Copyright 2019-2020 Joey Hess <id@joeyh.name>
use ByteStrings when reading annex symlinks and pointers Now there's a ByteString used all the way from disk to Key. The main complication in this conversion was the use of fromInternalGitPath in several places to munge things on Windows. The things that used that were changed to parse the ByteString using either path separator. Also some code that had read from files to a String lazily was changed to read a minimal strict ByteString.
2019-01-14 19:19:20 +00:00
-
- License: BSD-2-clause
-}
{-# LANGUAGE CPP #-}
update after RawFilePath transition
2020-11-09 16:06:53 +00:00
{-# OPTIONS_GHC -fno-warn-tabs #-}
use ByteStrings when reading annex symlinks and pointers Now there's a ByteString used all the way from disk to Key. The main complication in this conversion was the use of fromInternalGitPath in several places to munge things on Windows. The things that used that were changed to parse the ByteString using either path separator. Also some code that had read from files to a String lazily was changed to read a minimal strict ByteString.
2019-01-14 19:19:20 +00:00
module Utility.RawFilePath (
RawFilePath,
readSymbolicLink,
RawFilePath version of getCurrentDirectory This commit was sponsored by Jochen Bartl on Patreon
2020-10-28 20:03:45 +00:00
createSymbolicLink,
more RawFilePath conversion nukeFile replaced with removeWhenExistsWith removeLink, which allows using RawFilePath. Utility.Directory cannot use RawFilePath since setup does not depend on posix. This commit was sponsored by Graham Spencer on Patreon.
2020-10-29 14:33:12 +00:00
createLink,
removeLink,
use RawFilePath getFileStatus for speed Only done on those calls to getFileStatus that had a RawFilePath, not a FilePath. The others would probably be just as fast if converted to use it with toRawFilePath, but I'm not 100% sure. Note that genInodeCache' uses fromRawFilePath, but that value only gets used on Windows, so on unix the thunk will never be evaluated.
2019-12-06 18:44:42 +00:00
getFileStatus,
use RawFilePath getSymbolicLinkStatus for speed
2019-12-06 19:37:12 +00:00
getSymbolicLinkStatus,
use filepath-bytestring for annex object manipulations git-annex find is now RawFilePath end to end, no string conversions. So is git-annex get when it does not need to get anything. So this is a major milestone on optimisation. Benchmarks indicate around 30% speedup in both commands. Probably many other performance improvements. All or nearly all places where a file is statted use RawFilePath now.
2019-12-11 18:12:22 +00:00
doesPathExist,
RawFilePath version of getCurrentDirectory This commit was sponsored by Jochen Bartl on Patreon
2020-10-28 20:03:45 +00:00
getCurrentDirectory,
more RawFilePath conversion Added a RawFilePath createDirectory and kept making stuff build. Up to 296/645 This commit was sponsored by Mark Reidenbach on Patreon.
2020-10-28 21:25:59 +00:00
createDirectory,
more RawFilePath conversion Converted file mode setting to it, and follow-on changes. Compiles up through 369/646. This commit was sponsored by Ethan Aubin.
2020-11-05 22:45:37 +00:00
setFileMode,
use RawFilePath version of rename Some small wins, almost certianly swamped by the system calls, but still worthwhile progress on the RawFilePath conversion. Sponsored-by: Erik Bjäreholt on Patreon
2022-06-22 20:47:34 +00:00
rename,
use ByteStrings when reading annex symlinks and pointers Now there's a ByteString used all the way from disk to Key. The main complication in this conversion was the use of fromInternalGitPath in several places to munge things on Windows. The things that used that were changed to parse the ByteString using either path separator. Also some code that had read from files to a String lazily was changed to read a minimal strict ByteString.
2019-01-14 19:19:20 +00:00
) where
#ifndef mingw32_HOST_OS
use RawFilePath getFileStatus for speed Only done on those calls to getFileStatus that had a RawFilePath, not a FilePath. The others would probably be just as fast if converted to use it with toRawFilePath, but I'm not 100% sure. Note that genInodeCache' uses fromRawFilePath, but that value only gets used on Windows, so on unix the thunk will never be evaluated.
2019-12-06 18:44:42 +00:00
import Utility.FileSystemEncoding (RawFilePath)
use ByteStrings when reading annex symlinks and pointers Now there's a ByteString used all the way from disk to Key. The main complication in this conversion was the use of fromInternalGitPath in several places to munge things on Windows. The things that used that were changed to parse the ByteString using either path separator. Also some code that had read from files to a String lazily was changed to read a minimal strict ByteString.
2019-01-14 19:19:20 +00:00
import System.Posix.Files.ByteString
more RawFilePath conversion Added a RawFilePath createDirectory and kept making stuff build. Up to 296/645 This commit was sponsored by Mark Reidenbach on Patreon.
2020-10-28 21:25:59 +00:00
import qualified System.Posix.Directory.ByteString as D
use filepath-bytestring for annex object manipulations git-annex find is now RawFilePath end to end, no string conversions. So is git-annex get when it does not need to get anything. So this is a major milestone on optimisation. Benchmarks indicate around 30% speedup in both commands. Probably many other performance improvements. All or nearly all places where a file is statted use RawFilePath now.
2019-12-11 18:12:22 +00:00
more RawFilePath conversion At 318/645 after 4k lines of changes This commit was sponsored by Jake Vosloo on Patreon.
2020-10-29 16:02:46 +00:00
-- | Checks if a file or directory exists. Note that a dangling symlink
document
2020-07-20 01:31:06 +00:00
-- will be false.
use filepath-bytestring for annex object manipulations git-annex find is now RawFilePath end to end, no string conversions. So is git-annex get when it does not need to get anything. So this is a major milestone on optimisation. Benchmarks indicate around 30% speedup in both commands. Probably many other performance improvements. All or nearly all places where a file is statted use RawFilePath now.
2019-12-11 18:12:22 +00:00
doesPathExist :: RawFilePath -> IO Bool
doesPathExist = fileExist
RawFilePath version of getCurrentDirectory This commit was sponsored by Jochen Bartl on Patreon
2020-10-28 20:03:45 +00:00
getCurrentDirectory :: IO RawFilePath
more RawFilePath conversion Added a RawFilePath createDirectory and kept making stuff build. Up to 296/645 This commit was sponsored by Mark Reidenbach on Patreon.
2020-10-28 21:25:59 +00:00
getCurrentDirectory = D.getWorkingDirectory
createDirectory :: RawFilePath -> IO ()
createDirectory p = D.createDirectory p 0o777
RawFilePath version of getCurrentDirectory This commit was sponsored by Jochen Bartl on Patreon
2020-10-28 20:03:45 +00:00
use ByteStrings when reading annex symlinks and pointers Now there's a ByteString used all the way from disk to Key. The main complication in this conversion was the use of fromInternalGitPath in several places to munge things on Windows. The things that used that were changed to parse the ByteString using either path separator. Also some code that had read from files to a String lazily was changed to read a minimal strict ByteString.
2019-01-14 19:19:20 +00:00
#else
more RawFilePath conversion Converted file mode setting to it, and follow-on changes. Compiles up through 369/646. This commit was sponsored by Ethan Aubin.
2020-11-05 22:45:37 +00:00
import System.PosixCompat (FileStatus, FileMode)
RawFilePath will need to support Windows too Of course, readSymbolicLink always fails on Windows, but now it's ready for other things that don't fail there.
2019-12-06 18:17:48 +00:00
import qualified System.PosixCompat as P
more RawFilePath conversion Converted file mode setting to it, and follow-on changes. Compiles up through 369/646. This commit was sponsored by Ethan Aubin.
2020-11-05 22:45:37 +00:00
import qualified System.PosixCompat.Files as F
use filepath-bytestring for annex object manipulations git-annex find is now RawFilePath end to end, no string conversions. So is git-annex get when it does not need to get anything. So this is a major milestone on optimisation. Benchmarks indicate around 30% speedup in both commands. Probably many other performance improvements. All or nearly all places where a file is statted use RawFilePath now.
2019-12-11 18:12:22 +00:00
import qualified System.Directory as D
RawFilePath will need to support Windows too Of course, readSymbolicLink always fails on Windows, but now it's ready for other things that don't fail there.
2019-12-06 18:17:48 +00:00
import Utility.FileSystemEncoding
use ByteStrings when reading annex symlinks and pointers Now there's a ByteString used all the way from disk to Key. The main complication in this conversion was the use of fromInternalGitPath in several places to munge things on Windows. The things that used that were changed to parse the ByteString using either path separator. Also some code that had read from files to a String lazily was changed to read a minimal strict ByteString.
2019-01-14 19:19:20 +00:00
readSymbolicLink :: RawFilePath -> IO RawFilePath
RawFilePath will need to support Windows too Of course, readSymbolicLink always fails on Windows, but now it's ready for other things that don't fail there.
2019-12-06 18:17:48 +00:00
readSymbolicLink f = toRawFilePath <$> P.readSymbolicLink (fromRawFilePath f)
use RawFilePath getFileStatus for speed Only done on those calls to getFileStatus that had a RawFilePath, not a FilePath. The others would probably be just as fast if converted to use it with toRawFilePath, but I'm not 100% sure. Note that genInodeCache' uses fromRawFilePath, but that value only gets used on Windows, so on unix the thunk will never be evaluated.
2019-12-06 18:44:42 +00:00
RawFilePath version of getCurrentDirectory This commit was sponsored by Jochen Bartl on Patreon
2020-10-28 20:03:45 +00:00
createSymbolicLink :: RawFilePath -> RawFilePath -> IO ()
createSymbolicLink a b = P.createSymbolicLink
(fromRawFilePath a)
(fromRawFilePath b)
more RawFilePath conversion nukeFile replaced with removeWhenExistsWith removeLink, which allows using RawFilePath. Utility.Directory cannot use RawFilePath since setup does not depend on posix. This commit was sponsored by Graham Spencer on Patreon.
2020-10-29 14:33:12 +00:00
createLink :: RawFilePath -> RawFilePath -> IO ()
createLink a b = P.createLink
(fromRawFilePath a)
(fromRawFilePath b)
fix removeLink on windows This removeLink was introduced in commit e505c03bccdc6567cd517a6ddaf70a411489473d, which replaced code that used removeFile on Windows. So, I know git-annex did not used to do anything other than removeFile on Windows. If there were symlinks it wanted to remove, this would not work on windows, but of course it does not use symlinks on windows.
2020-11-19 16:20:18 +00:00
{- On windows, removeLink is not available, so only remove files,
- not symbolic links. -}
more RawFilePath conversion nukeFile replaced with removeWhenExistsWith removeLink, which allows using RawFilePath. Utility.Directory cannot use RawFilePath since setup does not depend on posix. This commit was sponsored by Graham Spencer on Patreon.
2020-10-29 14:33:12 +00:00
removeLink :: RawFilePath -> IO ()
fix removeLink on windows This removeLink was introduced in commit e505c03bccdc6567cd517a6ddaf70a411489473d, which replaced code that used removeFile on Windows. So, I know git-annex did not used to do anything other than removeFile on Windows. If there were symlinks it wanted to remove, this would not work on windows, but of course it does not use symlinks on windows.
2020-11-19 16:20:18 +00:00
removeLink = D.removeFile . fromRawFilePath
more RawFilePath conversion nukeFile replaced with removeWhenExistsWith removeLink, which allows using RawFilePath. Utility.Directory cannot use RawFilePath since setup does not depend on posix. This commit was sponsored by Graham Spencer on Patreon.
2020-10-29 14:33:12 +00:00
use RawFilePath getFileStatus for speed Only done on those calls to getFileStatus that had a RawFilePath, not a FilePath. The others would probably be just as fast if converted to use it with toRawFilePath, but I'm not 100% sure. Note that genInodeCache' uses fromRawFilePath, but that value only gets used on Windows, so on unix the thunk will never be evaluated.
2019-12-06 18:44:42 +00:00
getFileStatus :: RawFilePath -> IO FileStatus
getFileStatus = P.getFileStatus . fromRawFilePath
use RawFilePath getSymbolicLinkStatus for speed
2019-12-06 19:37:12 +00:00
getSymbolicLinkStatus :: RawFilePath -> IO FileStatus
getSymbolicLinkStatus = P.getSymbolicLinkStatus . fromRawFilePath
use filepath-bytestring for annex object manipulations git-annex find is now RawFilePath end to end, no string conversions. So is git-annex get when it does not need to get anything. So this is a major milestone on optimisation. Benchmarks indicate around 30% speedup in both commands. Probably many other performance improvements. All or nearly all places where a file is statted use RawFilePath now.
2019-12-11 18:12:22 +00:00
doesPathExist :: RawFilePath -> IO Bool
doesPathExist = D.doesPathExist . fromRawFilePath
RawFilePath version of getCurrentDirectory This commit was sponsored by Jochen Bartl on Patreon
2020-10-28 20:03:45 +00:00
getCurrentDirectory :: IO RawFilePath
getCurrentDirectory = toRawFilePath <$> D.getCurrentDirectory
more RawFilePath conversion Added a RawFilePath createDirectory and kept making stuff build. Up to 296/645 This commit was sponsored by Mark Reidenbach on Patreon.
2020-10-28 21:25:59 +00:00
createDirectory :: RawFilePath -> IO ()
createDirectory = D.createDirectory . fromRawFilePath
more RawFilePath conversion Converted file mode setting to it, and follow-on changes. Compiles up through 369/646. This commit was sponsored by Ethan Aubin.
2020-11-05 22:45:37 +00:00
setFileMode :: RawFilePath -> FileMode -> IO ()
fix build on windows
2020-11-11 12:51:42 +00:00
setFileMode = F.setFileMode . fromRawFilePath
use RawFilePath version of rename Some small wins, almost certianly swamped by the system calls, but still worthwhile progress on the RawFilePath conversion. Sponsored-by: Erik Bjäreholt on Patreon
2022-06-22 20:47:34 +00:00
avoid unix-compat's rename On Windows, that does not support long paths https://github.com/jacobstanley/unix-compat/issues/56 Instead, use System.Directory.renamePath, which does support long paths. Sponsored-by: Dartmouth College's Datalad project
2022-07-12 18:53:32 +00:00
{- Using renamePath rather than the rename provided in unix-compat
- because of this bug https://github.com/jacobstanley/unix-compat/issues/56-}
use RawFilePath version of rename Some small wins, almost certianly swamped by the system calls, but still worthwhile progress on the RawFilePath conversion. Sponsored-by: Erik Bjäreholt on Patreon
2022-06-22 20:47:34 +00:00
rename :: RawFilePath -> RawFilePath -> IO ()
avoid unix-compat's rename On Windows, that does not support long paths https://github.com/jacobstanley/unix-compat/issues/56 Instead, use System.Directory.renamePath, which does support long paths. Sponsored-by: Dartmouth College's Datalad project
2022-07-12 18:53:32 +00:00
rename a b = D.renamePath (fromRawFilePath a) (fromRawFilePath b)
use ByteStrings when reading annex symlinks and pointers Now there's a ByteString used all the way from disk to Key. The main complication in this conversion was the use of fromInternalGitPath in several places to munge things on Windows. The things that used that were changed to parse the ByteString using either path separator. Also some code that had read from files to a String lazily was changed to read a minimal strict ByteString.
2019-01-14 19:19:20 +00:00
#endif
Reference in a new issue Copy permalink