Commit graph

266 commits

Author SHA1 Message Date
Joey Hess
1878745a46 more s3 docs 2011-03-28 02:13:26 -04:00
Joey Hess
a7bd63eb01 basic s3 remote start
But bucket name is not handled right; it needs to be globally unique.
2011-03-28 01:32:47 -04:00
Joey Hess
4868b64868 Provide a less expensive version of git annex copy --to, enabled via --fast. This assumes that location tracking information is correct, rather than contacting the remote for every file. 2011-03-27 18:34:30 -04:00
Joey Hess
f8693facab doc update 2011-03-27 17:30:44 -04:00
Joey Hess
8bcdf42b99 annex.diskreserve can be given in arbitrary units (ie "0.5 gigabytes") 2011-03-26 14:37:39 -04:00
Joey Hess
bc80ace96b releasing version 0.20110325 2011-03-25 00:51:12 -04:00
Joey Hess
03fdd0d56e dropunused: Significantly sped up; only read unused log file once. 2011-03-23 23:47:02 -04:00
Joey Hess
6246b807f7 migrate: Support migrating v1 SHA keys to v2 SHA keys with size information that can be used for free space checking. 2011-03-23 17:57:10 -04:00
Joey Hess
8beb72e206 migrate: Bugfix for case when migrating a file results in a key that is already present in .git/annex/objects.
For example, this could happen if using SHA1 and a file with content
"foo" were added to that backend. Then a file with "content" foo were
migrated from the WORM backend.

Assume that, if a backend assigned the same key, the already annexed
content must be the same. So, the "old" content can be reused.
2011-03-23 17:25:28 -04:00
Joey Hess
af45a62980 update 2011-03-23 13:13:51 -04:00
Joey Hess
7400c8318a correct 2011-03-23 12:46:51 -04:00
Joey Hess
376fc65d3e add license text 2011-03-22 21:23:35 -04:00
Joey Hess
7051763b5b tweak 2011-03-22 21:00:18 -04:00
Joey Hess
c1dc407941 Fix space leak in fsck and drop commands.
The space leak was somehow caused by this line:

	absfiles <- mapM absPath files

I confess, I don't quite understand why this caused bad buffering,
but apparently the whole pipeline from git-ls-files backed up at that
point.

Happily, rewriting the code to only get the cwd once and use a pure
function to calculate absfiles clears it up, and should be a little more
efficient in syscalls too.
2011-03-22 20:31:22 -04:00
Joey Hess
5d75919561 update 2011-03-22 18:55:29 -04:00
Joey Hess
368e20eb84 diskreserve setting
Add annex.diskreserve config setting, to control how much free space to
reserve for other purposes and avoid using (defaults to 1 mb).
2011-03-22 17:53:40 -04:00
Joey Hess
c21998722c fast mode
Add --fast flag, that can enable less expensive, but also less thurough versions of some commands.

* Add --fast flag, that can enable less expensive, but also less thurough
  versions of some commands.
* fsck: In fast mode, avoid checking checksums.
* unused: In fast mode, just show all existing temp files as unused,
  and avoid expensive scan for other unused content.
2011-03-22 17:41:06 -04:00
Joey Hess
aa2d8e33df free space checking
Free space checking is now done, for transfers of data for keys that have free space metadata.
(Notably, not for SHA* keys generated with git-annex 0.24 or earlier.)

The code is believed to work on Linux, FreeBSD, and OSX; check compile-time
messages to see if it is not enabled for your OS.
2011-03-22 17:27:04 -04:00
Joey Hess
8ede2e255f add StatFS.hsc, copied from xmobar 2011-03-22 15:53:07 -04:00
Joey Hess
09b16afe02 releasing version 0.20110320 2011-03-20 18:11:00 -04:00
Joey Hess
6a2a17658c No longer auto-upgrade to repository format 2, to avoid accidental upgrades, etc. Use git-annex upgrade when you're ready to run this version. 2011-03-19 18:33:39 -04:00
Joey Hess
828a84ba33 Add version command to show git-annex version as well as repository version information. 2011-03-19 14:33:24 -04:00
Joey Hess
0663f14cf7 Fix support for remotes with '.' in their names. 2011-03-18 16:29:42 -04:00
Joey Hess
7b5b127608 Fix dropping of files using the URL backend. 2011-03-17 11:49:21 -04:00
Joey Hess
3a020e599e Merge branch 'master' into reorg
Conflicts:
	debian/changelog
2011-03-16 18:47:04 -04:00
Joey Hess
1079ade208 releasing version 0.24 2011-03-16 18:41:02 -04:00
Joey Hess
63360f7767 update 2011-03-16 18:33:28 -04:00
Joey Hess
00eb8ae829 prepping experimental release 2011-03-16 16:25:20 -04:00
Joey Hess
49da5d1a7b upgrade documentation 2011-03-16 15:51:42 -04:00
Joey Hess
d7ef5fd294 add explicit upgrade command 2011-03-16 15:48:26 -04:00
Joey Hess
0f8edc99ee Merge branch 'master' into reorg
Conflicts:
	debian/changelog
2011-03-16 13:48:04 -04:00
Joey Hess
35cbd107d5 detect systems w/o utmensat and ifdef out code that needs it 2011-03-16 13:46:08 -04:00
Joey Hess
5eb76d2b03 improve upgrade 2011-03-16 11:53:46 -04:00
Joey Hess
a080799900 upgrades seem to fully work 2011-03-16 11:00:18 -04:00
Joey Hess
500c4e44c5 v1 -> v2 upgrade partially working
still need to move location log files, and auto-commit
2011-03-16 02:35:48 -04:00
Joey Hess
f1e010f42e upgrade thoughts
long comments :)
2011-03-16 00:32:15 -04:00
Joey Hess
09a7689bc3 update and bug closures for v2 layout 2011-03-16 00:08:02 -04:00
Joey Hess
27472710c7 initial pass at doc update 2011-03-15 22:19:44 -04:00
Joey Hess
bc5c54c987 symlink touching fun
When adding files to the annex, the symlinks pointing at the annexed
content are made to have the same mtime as the original file. While git
does not preserve that information, this allows a tool like metastore to be
used with annexed files.
2011-03-14 23:00:23 -04:00
Joey Hess
175d055d4d Add Suggests on graphviz. Closes: #618039 2011-03-13 14:25:32 -04:00
Joey Hess
72d2684016 Rethink filename encoding handling for display. Since filename encoding may or may not match locale settings, any attempt to decode filenames will fail for some files. So instead, do all output in binary mode. 2011-03-12 15:30:17 -04:00
Joey Hess
26544de946 put in utf8 forcing workaround
Haskell's IO layer crashes on characters > 255 when in a non-unicode (latin1)
locale. Until Haskell gets better behavior, put in an admittedly ugly
workaround for that: git-annex forces utf8 output mode no matter what
locale is selected. So if you use a non-utf8 locale, your filenames with
characters > 127 will not be displayed as you'd expect. But at least it
won't crash.
2011-03-08 18:05:20 -04:00
Joey Hess
0de3005c64 whereis: New subcommand to show where a file's content has gotten to. 2011-03-05 17:23:55 -04:00
Joey Hess
6c1607ce66 Support ssh remotes with a port specified. 2011-03-05 15:47:00 -04:00
Joey Hess
e9fcd1eb5b releasing version 0.22 2011-03-04 15:23:04 -04:00
Joey Hess
c5c7eaf009 prep for release 2011-03-03 21:56:03 -04:00
Joey Hess
bc2df77642 Bugfix: When fsck detected and moved away corrupt file content, it did not update the location log. 2011-03-03 21:34:30 -04:00
Joey Hess
42259eee92 support git funky remote syntaxes
* Look for dir.git directories the same as git does.
* Support remote urls specified as relative paths.
* Support non-ssh remote paths that contain tilde expansions.
2011-03-03 21:02:29 -04:00
Joey Hess
1de12a2918 document describe command 2011-03-03 16:58:52 -04:00
Joey Hess
b5b78f26ec fix up commands that are trouble on bare repos
Most will just abort. init does a basic init and gives a command to
run elsewhere to finish it.
2011-03-03 16:40:55 -04:00
Joey Hess
a9d0538da5 updates for bare repo support 2011-03-03 15:59:16 -04:00
Joey Hess
6206b46e60 fsck: Check for and repair location log damage. 2011-03-02 14:30:36 -04:00
Joey Hess
1b9c4477fb New backends: SHA512 SHA384 SHA256 SHA224 2011-03-01 17:07:15 -04:00
Joey Hess
836e71297b Support filenames that start with a dash; when such a file is passed to a utility it will be escaped to avoid it being interpreted as an option. 2011-02-25 01:13:01 -04:00
Joey Hess
3390183400 Make test suite not rely on a working cp -pr.
(The Unix wars are still ON!)
2011-02-13 14:19:14 -04:00
Joey Hess
123f6a571d heh 2011-02-13 00:51:20 -04:00
Joey Hess
c319a336a3 Fix test suite to reap zombies.
I had not taken into account that the code was written to run git and leave
zombies, for performance/laziness reasons, when I wrote the test suite.
So rather than the typical 1 zombie process that git-annex develops, test
developed dozens. Caused problems on system with low process limits.
Added a reap function to GitRepo, that waits for any zombie child processes.
2011-02-13 00:50:09 -04:00
Joey Hess
ddd305aa10 releasing version 0.21 2011-02-11 23:23:36 -04:00
Joey Hess
fe55b4644e Fix display of unicode filenames.
Internally, the filenames are stored as un-decoded unicode.
I tried decoding them, but then haskell tries to access the wrong files.
Hmm.

So, I've unhappily chosen option "B", which is to decode filenames before
they are displayed.
2011-02-10 14:21:44 -04:00
Joey Hess
82bc10d5ea test: Set git user name and email in case git can't guess values. 2011-02-09 11:17:26 -04:00
Joey Hess
35a6506812 unannex: Fix recently introduced bug when attempting to unannex more than one file at a time. 2011-02-09 11:02:21 -04:00
Joey Hess
7a0826293e test: Don't rely on chmod -R working.
Sometimes I wish I could give all my users a real OS.
2011-02-09 00:12:45 -04:00
Joey Hess
dd90d4a70e configure: Check for sha1sum. 2011-02-08 19:31:27 -04:00
Joey Hess
45387b3fcb Deal with the mtl/monads-fd conflict. 2011-02-08 15:11:49 -04:00
Joey Hess
0c7d17ae06 new map subcommand, basically working
Still todo:

- add repos from uuid.log that were not directly found
- group repos into their respective hosts
- display inaccessible repos and broken remote connections in red
- anonymize the url display somewhat, so the maps can be shared
- use uuid info to tell when two apparently different repos are actually
  the same repo accessed in different ways
2011-02-03 19:05:15 -04:00
Joey Hess
c77ac11acc unannex: Commit staged changes at end
to avoid some confusing behavior with the pre-commit hook, which would see
some types of commits after an unannex as checking in of an unlocked file.
2011-02-01 21:27:23 -04:00
Joey Hess
27056daccd cleanup last change 2011-01-31 20:15:23 -04:00
Joey Hess
37c62eebb7 Preserve specified file ordering when instructed to act on multiple files or directories. 2011-01-31 20:06:34 -04:00
Joey Hess
3c49113023 releasing version 0.19 2011-01-28 14:42:06 -04:00
Joey Hess
e6da7eb177 Improved temp file handling
* Improved temp file handling. Transfers of content can now be resumed
  from temp files later; the resume does not have to be the immediate
  next git-annex run.
* unused: Include partially transferred content in the list.
2011-01-28 14:10:50 -04:00
Joey Hess
c30d38e108 better warnings display 2011-01-26 20:30:07 -04:00
Joey Hess
1a11085a50 drop: suppprt untrusted repos 2011-01-26 19:35:35 -04:00
Joey Hess
ba748a1198 fsck: handle untrusted repos 2011-01-26 17:44:40 -04:00
Joey Hess
b7903eb2d1 move partitioning out of keyPossibilities
And a bug fix in passing.
2011-01-26 16:44:14 -04:00
Joey Hess
7f6af79232 trust setting improvements 2011-01-26 16:20:28 -04:00
Joey Hess
f7e3d6eea2 document 3-level trust 2011-01-26 14:09:06 -04:00
Joey Hess
6a97b10fcb rework config storage
Moved away from a map of flags to storing config directly in the AnnexState
structure. Got rid of most accessor functions in Annex.

This allowed supporting multiple --exclude flags.
2011-01-26 00:17:38 -04:00
Joey Hess
dbb76c22d0 Support using the uuidgen command if the uuid command is not available. 2011-01-19 18:08:50 -04:00
Joey Hess
818111e0c2 releasing version 0.18 2011-01-14 15:10:13 -04:00
Joey Hess
c1839fdccb unlock: Fix behavior when file content is not present. 2011-01-13 23:46:02 -04:00
Joey Hess
2a67721d51 DEP5 2011-01-13 18:53:15 -04:00
Joey Hess
5869e7ccd5 test unused et al 2011-01-12 01:58:23 -04:00
Joey Hess
e18a4d566b migrate: Fix support for --backend option. 2011-01-11 21:32:38 -04:00
Joey Hess
b557a2ccf4 test migrate; 75% 2011-01-11 21:11:32 -04:00
Joey Hess
868486c6b6 update 2011-01-11 20:08:15 -04:00
Joey Hess
e2af0914fa fsck: Fix bug in moving of corrupted files to .git/annex/bad/ 2011-01-11 19:41:13 -04:00
Joey Hess
196c2fa786 Bugfix: copy --to and move --to forgot to stage location log changes after transferring the file to the remote repository. (Did not affect ssh remotes.) 2011-01-11 16:06:19 -04:00
Joey Hess
53170b1a14 fix real underlaying cause, and fix test suite to not skip it 2011-01-09 10:48:04 -04:00
Joey Hess
f4ddb580c8 bugfix: Fix crash caused by a symlink in the repo with link text ending in a "/". (Thanks Henrik for reporting.) 2011-01-09 10:04:16 -04:00
Joey Hess
9de982eab7 copyright years 2011-01-08 16:09:17 -04:00
Joey Hess
a78b0555e1 New migrate subcommand can be used to switch files to using a different backend, safely and with no duplication of content. 2011-01-08 15:54:14 -04:00
Joey Hess
32b0e10390 unannex: Now skips files whose content is not present, rather than it being an error. This allows gradual conversion from one backend to another by running unannex followed by add in each repository. 2011-01-08 15:14:41 -04:00
Joey Hess
d31e61a90d add news item for git-annex 0.16 2011-01-07 14:36:52 -04:00
Joey Hess
f3472d3a5d Test suite improvements. Current top-level test coverage: 65% 2011-01-07 14:06:32 -04:00
Joey Hess
2684cbbd23 clarify 2011-01-07 12:34:44 -04:00
Joey Hess
e43d4730c5 bugfix: Running copy --to when both local and remote had the key dropped it from local. 2011-01-07 02:14:22 -04:00
Joey Hess
71a8278f9c bugfix: Running move --to with a non-ssh remote failed. 2011-01-07 01:14:27 -04:00
Joey Hess
f4a26f01ea more tests 2011-01-06 22:22:09 -04:00
Joey Hess
87f424eca7 more tests 2011-01-06 21:39:26 -04:00
Joey Hess
2533d826fc make test suite link in git-annex's commands and run directly
this way, test coverage works
2011-01-06 20:26:57 -04:00