Commit graph

25873 commits

Author SHA1 Message Date
Joey Hess
f46f9f1bd3
Merge branch 'master' of ssh://git-annex.branchable.com 2019-04-10 09:57:44 -04:00
Joey Hess
3b6ea2c244
document importtree=yes 2019-04-10 09:46:27 -04:00
yarikoptic
7e039f9319 original report on inability to get a url 2019-04-10 13:30:17 +00:00
Joey Hess
6babb2c73f
remove wrong uniqueness constraint from ContentIdentifier db
Fix bug that caused importing from a special remote to repeatedly download
unchanged files when multiple files in the remote have the same content.

Unfortunately, there's really no good way to remove a uniqueness constraint
from a sqlite database. The best that can be done is to make a new table
and copy the data over. But that would require using persistent's
migrations or raw sql, and I don't want to do either.

Instead, a sledgehammer approach: Renamed .git/annex/cid to
.git/annex/cids. When the new database doesn't exist, it will be populated
from the git-annex branch.

Noting deletes the old database. Don't want to delete it out from under
some long-running git-annex process that might be using it. It could
eventually be deleted. But this is such a new feature, probably few repos
have the database in any case.
2019-04-09 19:58:24 -04:00
Joey Hess
5ece1408ae
analysis 2019-04-09 19:38:55 -04:00
Joey Hess
88bb928f22
devblog 2019-04-09 18:01:03 -04:00
Joey Hess
ae0a64f1c4
bug I noticed 2019-04-09 18:00:49 -04:00
Joey Hess
7b6d0da9b8
adb import
As well as adding the necessary methods, a few other changes to the adb
remote:

* Use ".annextmp" extension for temp files, to avoid conflict with other
  temp files.
* Stop using "echo $?" to get exit status of command inside adb.
  There were two problems; first the "echo" just before it meant it was
  always 0! And secondly, it seems kind of random on my phone whether it's
  1 or 0, not dependant on whether the command seems to have succeeded.
2019-04-09 17:52:41 -04:00
Joey Hess
1a1a5177fd
add tip for new adb import feature
This commit was sponsored by Jake Vosloo on Patreon.
2019-04-09 17:45:55 -04:00
Joey Hess
5a570da1ab
thoughts 2019-04-09 15:50:52 -04:00
Joey Hess
7bf18f23e5
todo 2019-04-09 14:07:47 -04:00
Joey Hess
2dc20e3fa4
update design doc with final design choices 2019-04-09 13:05:22 -04:00
Joey Hess
b51eceb326
reorg section and expand
conflict detection at import time is not detected, but I think it's ok
given this reasoning
2019-04-09 12:59:14 -04:00
Joey Hess
4211281336
remove old forum post that is a spam magnet
This was never a useful forum post, so I'm willing to sacrifice it.
2019-04-09 11:42:23 -04:00
Joey Hess
44f3699485
response 2019-04-09 11:41:51 -04:00
Joey Hess
609c505980
remove massive amount of spam comments on this forum post 2019-04-09 11:40:29 -04:00
Joey Hess
f40edb680c
doc clarification 2019-04-09 11:38:11 -04:00
Joey Hess
8191095bce
comment 2019-04-09 11:13:37 -04:00
Joey Hess
3d4ef050dd
comment 2019-04-09 11:11:29 -04:00
Joey Hess
0a14dfd383
comment 2019-04-09 11:08:18 -04:00
Joey Hess
996055b3cc
Merge branch 'master' of ssh://git-annex.branchable.com 2019-04-07 15:35:17 -04:00
jillcaballero
fbb07ee634 Added a comment: Kentucky Derby 2019-04-06 13:14:50 +00:00
Joey Hess
4af55c1f30
Merge branch 'master' of ssh://git-annex.branchable.com 2019-04-05 11:41:46 -04:00
Joey Hess
212c5b84a9
update 2019-04-05 10:35:06 -04:00
adamdwalker
069c074b6d Added a comment: IIHF 2019-04-05 12:37:58 +00:00
yarikoptic
7db8eaf512 initial question about possible "globus" special remote 2019-04-05 02:25:12 +00:00
Joey Hess
1f3245ddf5
close as basis of this is wrong 2019-04-04 12:50:55 -04:00
Joey Hess
d40a3580a5
comment 2019-04-03 13:27:58 -04:00
Joey Hess
727ac0451a
comment 2019-04-03 13:14:54 -04:00
Joey Hess
1b5f4a8e20
comment 2019-04-03 13:11:34 -04:00
Joey Hess
5813005ab6
comment 2019-04-03 13:01:07 -04:00
Joey Hess
e40fcf2530
fix name of --trust-glacier command in man page 2019-04-03 13:00:30 -04:00
driusan@4d47e7deeb2f5d3846792d049ed06f96a0c3ca98
2599296a31 be more explicit about new hash format 2019-04-01 19:52:00 +00:00
Ilya_Shlyakhter
d40b2e879f Added a comment: re: key content size 2019-04-01 17:44:29 +00:00
CandyAngel
979f6c7cd1 removed 2019-04-01 07:32:15 +00:00
maryjil2596
a477b519f5 Added a comment: aol account recovery 2019-04-01 06:52:11 +00:00
driusan@4d47e7deeb2f5d3846792d049ed06f96a0c3ca98
eb00b3f6da removed 2019-03-31 16:31:47 +00:00
driusan@4d47e7deeb2f5d3846792d049ed06f96a0c3ca98
7879bbeafd Added a comment: key content size 2019-03-31 16:31:28 +00:00
driusan@4d47e7deeb2f5d3846792d049ed06f96a0c3ca98
f250bb092d Added a comment: key content size 2019-03-31 16:31:09 +00:00
driusan@4d47e7deeb2f5d3846792d049ed06f96a0c3ca98
d70f248459 Added a comment: Options don't match git-annex lookupkey --help 2019-03-30 16:05:30 +00:00
driusan@4d47e7deeb2f5d3846792d049ed06f96a0c3ca98
7e92349438 Added a comment: Warning building with cabal 2019-03-30 00:19:11 +00:00
Joey Hess
bc302b56ae
test patch 2019-03-28 16:16:28 -04:00
Joey Hess
c68ae14268
further thought 2019-03-28 15:46:14 -04:00
Joey Hess
a53c2a7e13
Merge branch 'master' of ssh://git-annex.branchable.com 2019-03-28 14:04:25 -04:00
Joey Hess
b09c6e3016
todo item based on behavior yoh showed me 2019-03-28 14:04:20 -04:00
Joey Hess
2c735f1747
improve wording 2019-03-28 13:25:14 -04:00
Joey Hess
5d5521d1bb
mention that repo decription can be used 2019-03-28 13:21:37 -04:00
pellman.john@e59e5c6d98d49cd9632d6fbe0c5026ddc71d52fd
afd72811c6 Added a comment: Re: Inconsistent idiom 2019-03-28 03:59:04 +00:00
Joey Hess
e035bc5324
minor typos 2019-03-27 11:15:20 -04:00
Joey Hess
f4c49b8f81
this is not all run as root 2019-03-27 11:15:03 -04:00
Ilya_Shlyakhter
1c334f74d6 Added a comment 2019-03-26 18:27:04 +00:00
Ilya_Shlyakhter
9b4e06d8c2 fixed a typo 2019-03-26 17:51:19 +00:00
Ilya_Shlyakhter
38669f0817 Added a comment: simplifying the interface 2019-03-26 17:40:33 +00:00
yarikoptic
94b9c5da92 Added a comment: annex.thin without hardlinks would be useful for non-crippled systems as well 2019-03-25 18:57:37 +00:00
yarikoptic
cb539a2e5a Added a comment 2019-03-24 23:49:48 +00:00
yarikoptic
49ace859cb Added a comment: The issue persists with recent git-annex 2019-03-24 23:00:30 +00:00
Ilya_Shlyakhter
72b788dfaf re: documenting git-annex dependencies 2019-03-24 18:47:28 +00:00
89.200.13.45
b7512c1146 poll vote (OpenStack SWIFT) 2019-03-23 09:08:09 +00:00
Joey Hess
5c1e4d10e0
add news item for git-annex 7.20190322 2019-03-22 13:57:24 -04:00
Joey Hess
39d55a8541
back-compat warning for protocol=https 2019-03-22 12:22:34 -04:00
Joey Hess
7d37011a11
S3: Added protocol= initremote setting, to allow https to be used on a non-standard port
protocol=https implies port=443 and
port=443 implies protocol=https
-- this was necessary because the existing configs set port=443, but
with a protocol setting, users will naturally want to use it, and then
there's no need for them to supply the default https port. So we keep
back-compat, add a nicer way to enable https, and also add support for
non-standard https ports.
2019-03-22 12:17:05 -04:00
Joey Hess
e18ac37ff6
close old bug 2019-03-22 10:32:24 -04:00
Joey Hess
9ada4b38c1
comment 2019-03-22 10:30:22 -04:00
Joey Hess
59c8119b2a
comment 2019-03-22 10:18:07 -04:00
Joey Hess
648756b84d
despam 2019-03-22 10:09:14 -04:00
Joey Hess
ba6b396a97
improve docs 2019-03-22 09:59:56 -04:00
Joey Hess
077efce98b
fix wrong option, followup 2019-03-22 09:51:42 -04:00
Joey Hess
b5d1029b6e
remove unsupported option 2019-03-22 09:46:47 -04:00
Joey Hess
95087e8a87
reopen 2019-03-22 09:44:40 -04:00
Joey Hess
97ae0f2c22
Android: Fix typo of name of armv7l in installation script. Thanks, 4omecha. 2019-03-22 09:39:18 -04:00
Joey Hess
b22d07ba93
comment 2019-03-22 09:32:26 -04:00
Joey Hess
3c58e62142
comment 2019-03-22 09:30:49 -04:00
Joey Hess
5fea7efee7
comment and toddo 2019-03-22 09:23:31 -04:00
gueux
2e4fedf1a4 Added a comment 2019-03-21 22:59:38 +00:00
gueux
a6233719e6 Added a comment 2019-03-21 22:57:36 +00:00
gueux
c789270c44 Added a comment 2019-03-21 20:40:55 +00:00
Fabio
9d7663432b Added a comment: no problem with xdg-open 2019-03-20 21:57:01 +00:00
4omecha@fff0ca6fa5307d92706e5ee6812d8db8f8067df0
65e41fea40 2019-03-20 17:01:58 +00:00
Joey Hess
3bcfc285e7
update 2019-03-20 12:05:58 -04:00
yarikoptic
a008053f24 Added a comment: more info on hanging 2019-03-19 21:04:54 +00:00
Ilya_Shlyakhter
438ff50013 Added a comment 2019-03-19 20:40:50 +00:00
Joey Hess
caa5cca47f
Merge branch 'master' of ssh://git-annex.branchable.com 2019-03-19 15:57:19 -04:00
Joey Hess
0204d3443e
thought 2019-03-19 15:56:47 -04:00
Ilya_Shlyakhter
10291efa55 added suggestion for git-annex-test to do simple sanity checks on external utils before running tests that depend on them 2019-03-19 18:55:59 +00:00
Joey Hess
cf0ec85548
comment 2019-03-19 14:00:41 -04:00
Joey Hess
56b1274d8c
Merge branch 'master' of ssh://git-annex.branchable.com 2019-03-19 13:56:46 -04:00
Joey Hess
2118006711
comment 2019-03-19 13:53:32 -04:00
Joey Hess
1c2f6aee11
comment 2019-03-19 13:45:28 -04:00
yarikoptic
0b3d68d116 Added a comment 2019-03-19 17:41:12 +00:00
Joey Hess
738325ffb7
comment 2019-03-19 13:40:46 -04:00
Joey Hess
cce81f9b0c
comment 2019-03-19 13:34:45 -04:00
Joey Hess
059ff44e8b
comment 2019-03-19 13:28:08 -04:00
yarikoptic
5cfaf1ad39 Added a comment: reporting back 2019-03-19 17:01:10 +00:00
meribold
5b2caf30ae Added a comment: Re: Best solution to save disk space on exFAT 2019-03-19 14:32:29 +00:00
meribold
8f0117545c Added a comment: Re: Best solution to save disk space on exFAT 2019-03-19 14:22:57 +00:00
meribold
ab725aeb89 Added a comment: Re: Best solution to save disk space on exFAT 2019-03-19 14:14:38 +00:00
jamie@b5676b90eec0401ca8faac7c972eaf5676891601
ffb9b3160c Added a comment 2019-03-19 03:32:33 +00:00
Joey Hess
0f20c8c517
comment 2019-03-18 22:54:34 -04:00
yarikoptic
7bd01999fd fixed up formatting typo 2019-03-18 23:24:50 +00:00
yarikoptic
d992d13c11 tune up ;) 2019-03-18 22:56:22 +00:00
yarikoptic
97fc3866bb initial report on pre-commit hanging 2019-03-18 22:55:08 +00:00
Joey Hess
14c7be943a
devblog 2019-03-18 16:43:57 -04:00
Joey Hess
5ab97333e4
import: Let --force overwrite symlinks, not only regular files
The docs already implied this should work.
2019-03-18 16:40:15 -04:00
Joey Hess
258e8f8f29
Removed bundled gpg from the Linux standalone build and OSX dmg
Because gpg now always wants to use gpg-agent, and shipping such a daemon
in those is not a good idea.
2019-03-18 16:31:07 -04:00
Joey Hess
c96e623343
Merge branch 'master' of ssh://git-annex.branchable.com 2019-03-18 16:00:20 -04:00
Joey Hess
d5ee5fef65
fsck: Detect situations where annex.thin has caused data loss to the content of locked files.
In particular, when two files had the same content, and one was unlocked
and modified, with annex.thin that can corrupt the content of the
annex object, and so fsck on the other file should detect that.

getKeyStatus was relying on Database.Keys.getAssociatedFiles to tell
when a file is unlocked, but that can false positive because the
database can list old associated files.

Instead, separate out the case of unlocked object which has multiple
hardlinks when annex.thin is in use.
2019-03-18 15:59:43 -04:00
Ilya_Shlyakhter
c07c30bc5d Added a comment 2019-03-18 19:54:05 +00:00
Ilya_Shlyakhter
78d832f48b Added a comment 2019-03-18 19:44:08 +00:00
Joey Hess
60ca3ce043
Add -- before %f in the smudge/clean filter configuration
To support filenames starting with dashes.

To update the config of existing repositories, you can re-run git-annex init.

Perhaps it should check every time for the old config and update it, but
that has several problems:

	- read-only repos
	- unexpected commands like `git annex find` changing git configs
	  might be surprising behavior

Since filenames starting with dashes are not super common and the user can
re-init easily enough if their repo needs fixed, I went for the simplest
fix.
2019-03-18 14:12:13 -04:00
Joey Hess
e7f3e2a937
close as not a git-annex bug but a termux bug 2019-03-18 14:10:08 -04:00
Ilya_Shlyakhter
af34ef79ab Added a comment 2019-03-18 18:08:06 +00:00
Joey Hess
da99edac58
followup 2019-03-18 14:00:33 -04:00
Joey Hess
93df756184
moreinfo 2019-03-18 13:58:29 -04:00
Joey Hess
98650e8435
moreinfo 2019-03-18 13:50:41 -04:00
Joey Hess
ac33a5e85e
close 2019-03-18 13:45:02 -04:00
Joey Hess
ae9b28df77
comment 2019-03-18 13:37:44 -04:00
Joey Hess
8758f9c561
addurl --file: Fix a bug that made youtube-dl be used unneccessarily when adding an html url that does not contain any media. 2019-03-18 13:34:29 -04:00
Joey Hess
a87da159c1
comment 2019-03-18 13:21:43 -04:00
Joey Hess
2c0b8e6d4d
Merge branch 'master' of ssh://git-annex.branchable.com 2019-03-18 13:08:09 -04:00
Joey Hess
6491b62614
Makefile: Added install-home target which installs git-annex into the HOME directory 2019-03-18 12:36:03 -04:00
yarikoptic
e7294158aa youtube-dl protection kicks in where it shouldn't 2019-03-18 15:32:12 +00:00
Joey Hess
95e94b9d00
comment 2019-03-18 11:20:29 -04:00
Joey Hess
0fbfe8afb2
comment 2019-03-18 11:14:17 -04:00
maryjil2596
e3edc74838 Added a comment: iTunes Error 0xe8000015 2019-03-18 06:42:20 +00:00
jamie@b5676b90eec0401ca8faac7c972eaf5676891601
8c515b284e Added a comment 2019-03-17 03:29:31 +00:00
jamie@b5676b90eec0401ca8faac7c972eaf5676891601
860d2c38c2 Added a comment: strace 2019-03-16 22:17:37 +00:00
jamie@b5676b90eec0401ca8faac7c972eaf5676891601
a303327295 2019-03-16 22:13:49 +00:00
6yearold@36d59212c29d2959d6532d6db7928f01541bcf83
0ca577f932 2019-03-16 17:41:44 +00:00
sameerds
27c96d9b70 Added a comment: did not work for me 2019-03-16 10:07:09 +00:00
CandyAngel
2d6a364d4b removed 2019-03-14 12:02:41 +00:00
michelleaugud@9066f1a87c39514d1a75cd2f2bad842dccd7e0d4
e5923524f4 Added a comment: Now git-annex can be used on Android! 2019-03-14 11:51:13 +00:00
spwhitton
1812ec5dab more info 2019-03-13 18:15:08 +00:00
spwhitton
04acb0308a post question 2019-03-13 17:55:03 +00:00
Ilya_Shlyakhter
2951793905 added bug report where git worktree remove fails 2019-03-13 17:54:52 +00:00
CandyAngel
959b511b55 Added a comment 2019-03-13 08:33:37 +00:00
amindfv
13230c8f46 2019-03-13 07:20:12 +00:00
amindfv
d94f0e7a7d 2019-03-13 07:05:29 +00:00
Ilya_Shlyakhter
56fd24de0d added suggestion for importing files from special remotes without downloading them 2019-03-12 17:18:28 +00:00
gioele@678b7c03f524f2669b179b603f65352fcc16774e
db0757375b Added a comment: FAT/NTFS and POSIX allow different characters in file names 2019-03-12 10:51:20 +00:00
Joey Hess
4ed0c3d02f
devblog 2019-03-11 14:47:00 -04:00
Joey Hess
e1ab9a6d41
Merge branch 'master' of ssh://git-annex.branchable.com 2019-03-11 14:30:50 -04:00
Joey Hess
91f0f76252
need to write a tip
deferred because a tip that is limited to the directory special remote
is not very interesting to most
2019-03-11 14:30:05 -04:00
Joey Hess
5dd21116b7
update for deprecation of --tracking option 2019-03-11 14:27:01 -04:00
Joey Hess
4d610ee98a
Merge branch 'importtree' 2019-03-11 14:17:59 -04:00
Joey Hess
ffec06aaec
update 2019-03-11 14:13:58 -04:00
Joey Hess
057999f0fc
fix sync --content with remote.name.annex-tracking-branch=master:subdir
It was exporting the whole tree not just the subdir. Now tested fully
working in both directions.
2019-03-11 14:07:52 -04:00
Joey Hess
e1fdc8b374
record only subtree in export db and log after importing a subtree 2019-03-11 13:45:01 -04:00
Joey Hess
e46e40bf05
fix update of export tracking branch when exporting branch:subdir 2019-03-11 13:44:12 -04:00
Joey Hess
2912429640
better indicate when special remotes do not support renameExport
Avoid a warning message when renameExport is not supported, and just
fallback to deleting with a subsequent re-upload. Especially needed for
importtree remotes, where renameExport needs to be disabled.

This changes the external special remote protocol, but in a
backwards-compatible way. A reply of UNSUPPORTED-REQUEST to an older
version of git-annex will cause it to make renameExport return False.
2019-03-11 12:53:24 -04:00
Joey Hess
c755788256
sync: import when annex-tracking-branch is configured
This works, and tested syncing both gets changes from a special remote
and sends changes to it, keeping it fully in sync nicely!

But have not tried it with a subdir configured.
2019-03-09 13:57:49 -04:00
Joey Hess
633021e135
--no-push and remote.name.annex-push prevent exporting trees to special remotes
Users may want sync to only export, or only import and this is broadly
analagous to push and pull, so it makes sense to use the same
configuration for it.
2019-03-09 13:21:49 -04:00
Joey Hess
d9ee048d85
doc updates for import 2019-03-09 13:10:30 -04:00
publiwebmaxter@739143dcf7422b8de1502bf2925640bed6ef7014
0941ff5190 Added a comment 2019-03-09 08:33:49 +00:00
Joey Hess
6149a3b9bd
added progress bars
clean up old todo item I checked earlier, see commit
dec30d2b14
2019-03-08 12:43:03 -04:00
Joey Hess
e412129523
concurrency and status messages when downloading from import 2019-03-08 12:33:44 -04:00
Joey Hess
033e47b7d7
update 2019-03-07 19:44:00 -04:00
Joey Hess
33d79d84ff
Merge branch 'master' of ssh://git-annex.branchable.com 2019-03-07 16:15:52 -04:00
Joey Hess
a66dd19e15
devblog 2019-03-07 16:15:28 -04:00
anarcat
dba0e89b71 Added a comment 2019-03-07 20:15:10 +00:00
Joey Hess
ee5f1422df
remove debug print 2019-03-07 16:08:58 -04:00
Joey Hess
7e35c81ada
locking problem 2019-03-07 15:22:23 -04:00
anarcat
b43d382841 Added a comment: or -c annex.verify=false 2019-03-07 18:23:02 +00:00
anarcat
afeb00b19a Added a comment: parallelizing checksum and get 2019-03-07 18:21:22 +00:00
Joey Hess
9a72785307
fixes to export db lookup when accessing importtree=yes
Now in a fresh clone with a importtree=yes remote enabled,
git annex fsck --from the remote works.
2019-03-07 14:10:56 -04:00
Joey Hess
93025dd59f
add missing locking of ContentIdentifier database when writing
This is not super efficient; it would be better to lock the database
once and build up a queue of changes and flush once.

But, storeExportWithContentIdentifier is likely going to be the really
expensive part, so let's do the simple thing and only optimise later if
needed.
2019-03-07 13:32:33 -04:00
Joey Hess
3f449f845e
update 2019-03-07 13:28:18 -04:00
Joey Hess
68d1661251
cross-repo import now working correctly 2019-03-07 12:31:35 -04:00
crest
2cf3d68fe0 2019-03-07 10:48:01 +00:00
501st_alpha1
5843c0f905 Added a comment: Figured out how to sync with Keybase 2019-03-07 06:52:25 +00:00
Joey Hess
ee251b2e2e
implement updating the ContentIdentifier db with info from the git-annex branch
untested

This won't be super slow, but it does need to diff two likely large
trees, and since the git-annex branch rarely sits still, it will most
likely be run at the beginning of every import.

A possible speed improvement would be to only run this when the database
did not contain a ContentIdentifier. But that would only speed up
imports when there is no new version of a file on the special remote,
at most renames of existing files being imported.

A better speed improvement would be to record something in the git-annex
branch that indicates when an import has been run, and only do the diff
if the git-annex branch has record of a newer import than we've seen
before. Then, it would only run when there is in fact new
ContentIdentifier information available from a remote. Certianly doable,
but didn't want to complicate things yet.
2019-03-06 18:04:30 -04:00
Joey Hess
dec30d2b14
updates
Note that I tried an evil remote that lists ImportLocations with
../../../ in them and indeed this resulted in git blowing up and the
import failing, and not writing outside the repo.
2019-03-06 17:07:36 -04:00
Joey Hess
8e9713b769
add export+import test case 2019-03-06 16:49:33 -04:00
Joey Hess
b3d30e7d70
remove unncessary locking of ContentIdentifier db
Remote.Helper.ExportImport only reads from it, and locking is only
needed when writing.
2019-03-06 14:36:57 -04:00
yarikoptic
9f908c8856 Added a comment: more details on coreutils cp treatment of reflink 2019-03-06 16:00:35 +00:00
Joey Hess
f957f64278
add todo 2019-03-06 11:24:06 -04:00
maryjil2596
79643e1e54 Added a comment: Epson Printer Error Code 0x9d 2019-03-06 07:44:26 +00:00
maryjil2596
478776eab4 Added a comment: Epson Printer Error Code 0x9d 2019-03-06 07:43:56 +00:00
Joey Hess
89065f69cb
Merge branch 'master' of ssh://git-annex.branchable.com 2019-03-05 17:23:18 -04:00
Joey Hess
41c616d4a6
devblog 2019-03-05 17:23:06 -04:00
Joey Hess
0db393d82f
add bug 2019-03-05 17:19:26 -04:00
Joey Hess
5767b1b00d
avoid updating tracking branch when transfer to export throws exception 2019-03-05 16:51:13 -04:00
Joey Hess
dc278c059c
fix STM crash
git-annex: thread blocked indefinitely in an STM transaction
failed

git-annex: sqlite query crashed
CallStack (from HasCallStack):
  error, called at ./Database/Handle.hs:98:42 in main:Database.Handle
failed

This needs further investigation.
2019-03-05 16:37:40 -04:00
Joey Hess
46d33e804a
added checkPresentExportWithContentIdentifier
Ugh, don't like needing to add this, but I can't see a way around it.
2019-03-05 16:03:03 -04:00
Joey Hess
fd2a1aaa17
avoid using renameExport on import remotes 2019-03-05 14:57:48 -04:00
Joey Hess
9df9a3f82b
more todo 2019-03-05 14:55:22 -04:00
Joey Hess
f7be2e9d37
document how conflicts are handled with imports 2019-03-05 14:55:06 -04:00
tjbk123@277355c7f00c6df42e960e85caafa4b294872337
b7af89a8b4 Added a comment: Best solution to save disk space on exFAT 2019-03-05 18:23:03 +00:00
Joey Hess
8c54604e67
import+export from directory special remote fully working
Had to add two more API calls to override export APIs that are not safe
for use in combination with import.

It's unfortunate that removeExportDirectory is documented to be allowed
to remove non-empty directories. I'm not entirely sure why it's that
way, my best guess is it was intended to make it easy to implement with
just rm -rf.
2019-03-05 14:20:14 -04:00
Joey Hess
554b7b7f3e
fix todo 2019-03-04 18:20:12 -04:00
Joey Hess
cd3a2b023a
initial try at using storeExportWithContentIdentifier
Untested, and I'm not sure about the locking of the ContentIdentifier db.
2019-03-04 17:50:41 -04:00
Joey Hess
aaacf431d8
handle importtree=yes config
For now, it's only allowed when exporttree=yes is also set.
That simplified the implementation, but could later be changed if
there's a remote that makes sense to be an import but not an export.
However, it may work just as well to make a remote be readonly to
prevent export to it while still allowing import.
2019-03-04 16:07:35 -04:00
Joey Hess
5f17a9cc50
docs for importtree config 2019-03-04 15:39:19 -04:00
Joey Hess
3cd19fb4d0
use InodeCache to avoid races in import from directory special remote
This does not avoid all possible races, but it does avoid all likely
ones, and is demonstratably better than git's own handling of races
where files get modified at the same time as it's updating the working
tree.

The main thing this won't detect are not unlikely races where part
of a file gets changed while it's being copied and then the file is
restored to its original condition before the modification check.
No, it's more likely that the limitations of checking inode, size,
and mtime won't detect certian modifications, involving eg mmapped
files.
2019-03-04 13:57:23 -04:00
Horus
81c747ba69 Added a comment 2019-03-04 08:59:22 +00:00
Horus
153b1e3a2b 2019-03-03 13:21:02 +00:00
Joey Hess
d2b34da4be
Merge branch 'master' of ssh://git-annex.branchable.com 2019-03-01 16:59:22 -04:00
Joey Hess
8de8574d5e
devblog 2019-03-01 16:55:24 -04:00
Joey Hess
51fc969b66
notes 2019-03-01 16:44:34 -04:00
Joey Hess
18d7a1dbbb
make export and sync update special remote tracking branch
The branch is only updated once the export is 100% complete. This way,
if an export is started but interrupted and so the remote does not yet
contain some of the files, an import will make a commit on the old
branch, and so won't delete the missing files.
2019-03-01 16:35:48 -04:00
Joey Hess
d28b0a8bd0
use disconnected history for import tracking branch
This avoids the first merge from it deleting all files in the current
branch, which was very surpring and unwanted behavior.
2019-03-01 14:33:29 -04:00
Joey Hess
740f957cef
new problem 2019-03-01 13:49:26 -04:00
Joey Hess
1c8793691a
import: update location log for removed files 2019-03-01 13:26:59 -04:00
Joey Hess
5402c39882
plan for item 2019-03-01 12:56:20 -04:00
feulif
4bd3bd4e95 2019-02-28 21:51:54 +00:00
Ilya_Shlyakhter
e7de4f48f9 Added a comment: thanks for working on this 2019-02-28 18:06:27 +00:00
Joey Hess
84c9c93d58
Merge branch 'master' of ssh://git-annex.branchable.com 2019-02-27 16:50:32 -04:00
Joey Hess
200e007131
devblog 2019-02-27 16:50:21 -04:00
Joey Hess
a3f6e07fec
todo 2019-02-27 15:56:32 -04:00
Joey Hess
b1f10fbb4d
update location log during import 2019-02-27 13:58:03 -04:00
Joey Hess
e2e57f8556
initial export support for directory special remote
This does not guard against race condition yet, it's only for testing
purposes.
2019-02-27 13:42:34 -04:00
Joey Hess
45aacd888b
import downloader complete (untested)
Made some api changes.

listImportableContents needs to provide the size
of the data, so the downloader can check disk free space.

retrieveExportWithContentIdentifier is passed the filepath to write to

Use temporary "CID" key during download of a ContentIdentifier from a
remote, so withTmp can be used and then move the content to the real key
once it's known.
2019-02-27 13:15:02 -04:00
gueux
c7f8286e73 Added a comment 2019-02-27 09:34:12 +00:00
cman122887@9badeb8bdb364090f0a22e00ba16426ad65c34c9
913454e514 Added a comment: similar? 2019-02-27 02:47:57 +00:00
Ilya_Shlyakhter
cf53e50624 removed 2019-02-26 19:42:40 +00:00
Joey Hess
f4b773e9a1
incomplete action to download files from import 2019-02-26 15:25:28 -04:00
Joey Hess
e4e464da65
import command is updating tracking branch 2019-02-26 13:15:48 -04:00
Joey Hess
760f26ebc6
Merge branch 'master' into importtree 2019-02-26 11:36:36 -04:00
hoabg102@4a7a5918bc078f792113da142cf8c6d825a1825c
facbbfd91b 2019-02-26 08:50:57 +00:00
hoabg102@4a7a5918bc078f792113da142cf8c6d825a1825c
b94bcc8e77 2019-02-26 02:33:43 +00:00
Ilya_Shlyakhter
7bfca4fc05 added bug report for when git-annex-import declines to import files that are under the repo but are git-ignored 2019-02-25 18:34:16 +00:00
mario
c39fd60958 Added a comment: Find (and other operations) over multiple repos 2019-02-25 14:33:27 +00:00
Ilya_Shlyakhter
a8f0b482bf added question about using own gpg/gpg-agent with standalone git-annex 2019-02-24 22:14:00 +00:00
Ilya_Shlyakhter
d269336f19 added bug report re: incomplete gpg in standalone git-annex sandbox 2019-02-24 21:58:39 +00:00
Ilya_Shlyakhter
8e635a0ee6 fixed URL link 2019-02-24 21:15:11 +00:00
Ilya_Shlyakhter
4bd02fbeda added bug report for the standalone runshell related to caching locale info 2019-02-24 21:06:33 +00:00
sameerds
22e9a49bd9 Added a comment: +1 2019-02-24 17:06:30 +00:00
david.j.buckmaster@984ff2704feacab53415ac5647206517d18f88f8
ea3e6322e7 Added a comment 2019-02-24 07:01:35 +00:00
david.j.buckmaster@984ff2704feacab53415ac5647206517d18f88f8
1202a2a48c removed 2019-02-24 06:59:21 +00:00
david.j.buckmaster@984ff2704feacab53415ac5647206517d18f88f8
24ebc3d12e Added a comment 2019-02-24 06:56:43 +00:00
david.j.buckmaster@984ff2704feacab53415ac5647206517d18f88f8
8c777cb36d removed 2019-02-24 06:43:34 +00:00
david.j.buckmaster@984ff2704feacab53415ac5647206517d18f88f8
eb6c0608e6 Added a comment 2019-02-24 06:41:01 +00:00
david.j.buckmaster@984ff2704feacab53415ac5647206517d18f88f8
3f450e5271 Added a comment 2019-02-24 01:20:15 +00:00
Joey Hess
89ee156059
Merge branch 'master' of ssh://git-annex.branchable.com 2019-02-23 16:04:15 -04:00
Joey Hess
15a4f91d07
devblog 2019-02-23 16:03:29 -04:00
Joey Hess
7072f7a071
note 2019-02-23 15:57:18 -04:00
Joey Hess
5bac8babdb
doc updated for import tree
Deprecated git annex export --tracking because it makes sense to have a
single configuration of tracking for both imports and exports.
2019-02-23 15:46:03 -04:00
david.j.buckmaster@984ff2704feacab53415ac5647206517d18f88f8
663c62d7ce 2019-02-23 18:38:42 +00:00
Joey Hess
464485bffe
Merge branch 'master' into importtree 2019-02-23 13:58:22 -04:00
Joey Hess
d685b119df
more design 2019-02-23 13:55:26 -04:00
Joey Hess
c5ceefdca6
Merge branch 'master' into importtree 2019-02-22 22:03:00 -04:00
Joey Hess
3c405838f8
more design 2019-02-22 22:02:50 -04:00
Joey Hess
4e0d08b66b
Merge branch 'master' into importtree 2019-02-22 21:18:13 -04:00
Joey Hess
200dc632f5
more design 2019-02-22 21:18:01 -04:00
Joey Hess
8c836623b7
design work 2019-02-22 16:18:09 -04:00
Joey Hess
d7e5a884f7
response 2019-02-22 16:03:19 -04:00
gan
5b7daecbd3 removed 2019-02-22 18:03:32 +00:00
gan
776916d5fe Added a comment: Clarification 2019-02-22 18:03:16 +00:00
gan
9e38dfd700 Added a comment: Clarification 2019-02-22 18:03:03 +00:00
gan
baa1699570 Added a comment: Provide flags to youtube-dl? 2019-02-22 18:01:26 +00:00
Joey Hess
d67494716c
Merge branch 'master' of ssh://git-annex.branchable.com 2019-02-21 17:46:09 -04:00