Commit graph

34947 commits

Author SHA1 Message Date
Joey Hess
f5eb28682a
expand 2019-08-04 13:59:24 -04:00
Joey Hess
8460bbcea9
note on git-lfs program 2019-08-04 13:16:59 -04:00
Joey Hess
c5ed11bc3f
documentation for git-lfs special remote 2019-08-04 13:15:47 -04:00
Joey Hess
408cb0af39
remove unused imports 2019-08-04 12:43:53 -04:00
Joey Hess
9aab851a55
fix reversion
lost check of resp_actions in b82ecf7076
2019-08-04 12:43:16 -04:00
Joey Hess
7269851550
download from LFS working
including resuming
2019-08-04 12:32:36 -04:00
Joey Hess
4af55c42bf
factored out downloadConduit from download
useful when an API provides a Request to download
2019-08-04 12:31:54 -04:00
Joey Hess
b82ecf7076
verify that LFS server responds with requested object
The protocol design allows the server to respond with some other object;
if a server for some reason a server did that, it would not be right for
git-annex to download its content. I don't think it would be a security
hole, since git-annex is downloading a specific key and will verify the
key's content. Seems like a good idea to belt-and-suspenders test for
such a misuse of the protocol.
2019-08-03 16:23:47 -04:00
Joey Hess
28c0395d61
start at retieval from LFS
Doesn't yet download the content, which will need to support resuming.
2019-08-03 12:51:16 -04:00
Joey Hess
5be0a35dae
implemented checkPresent for git-lfs 2019-08-03 12:21:28 -04:00
Joey Hess
f536a0b264
weaken comment
I'm seeing the github lfs server request an upload of an object that has
already been uploaded to it before. Probably because they offload
storage to S3 and so skipped the overhead of checking for an unncessary
upload.
2019-08-03 11:31:02 -04:00
Joey Hess
a16e83eec8
also debug http response status code 2019-08-03 11:30:06 -04:00
Joey Hess
74e9e3ccf0
add to request headers, don't overwrite 2019-08-03 11:15:08 -04:00
Joey Hess
fc09a41ed1
storing objects in git-lfs is working
Still need to record the sha256 and size when they cannot be determined
by inspecting the key.
2019-08-02 13:56:55 -04:00
Joey Hess
6c1130a3bb
lfs endpoint discovery and caching in git-lfs special remote 2019-08-02 12:38:14 -04:00
Joey Hess
03a765909c
move IO code out
Let's keep this entirely pure.

git-annex has its own facilities for running a ssh command, that make it
respect various config settings, and cache connections, etc. So better
not to have the library run ssh itself.
2019-08-02 10:57:40 -04:00
Joey Hess
2533acc7a2
note about ssh hostname sanitization 2019-08-02 10:40:55 -04:00
Joey Hess
1cef791cf3
skeleton git-lfs special remote
This is a special remote and a git remote at the same time; git can pull
and push to it and git-annex can use it as a special remote.

Remote.Git has to check if it's configured as a git-lfs special remote
and sets it up as one if so.

Object methods not implemented yet.
2019-08-01 15:30:12 -04:00
Joey Hess
9c20a8792d
fix names of per-remote git config keys
These are all prefixed by annex- and always have been, the docs were just
wrong.
2019-08-01 14:24:59 -04:00
Joey Hess
bd6c508334
finalizing lfs module
It may eventually move to its own package.
2019-08-01 14:04:56 -04:00
Joey Hess
435287db15
LFS endpoint guessing from remote url 2019-07-31 16:25:13 -04:00
Joey Hess
b4a416b996
cleaner endpoint type 2019-07-31 16:06:59 -04:00
Joey Hess
426a74265d
ssh discovery of LFS endpoint
At this point, I'm able to discover an endpoint, and requesting an
upload also worked, though I didn't try actually uploading content.
2019-07-31 15:51:40 -04:00
Joey Hess
78983d1e33
rename reorg 2019-07-31 15:04:37 -04:00
Joey Hess
f4e8ab969e
improve protocol support
support verification after upload

support for errors embedded in json
2019-07-31 14:55:15 -04:00
Joey Hess
9040fea09e
add uploadRequests 2019-07-31 13:22:33 -04:00
Joey Hess
b4d2fc6219
add downloadRequests 2019-07-31 12:28:03 -04:00
Joey Hess
909952d8e5
got transfer response part of protocol working
Testing against github, I was able to request an unauthenticated
download of an oid and parse the response that contains the url of the
object.
2019-07-31 12:06:56 -04:00
Joey Hess
6eb3a56daa
git-lfs protocol json instances
Have only tested that the ToJSON instances look like what's documented
for the git-lfs API.

Have not tested the FromJSON instances at all.
2019-07-29 15:47:17 -04:00
Joey Hess
5080a7be1e
fix build 2019-07-29 12:41:45 -04:00
Joey Hess
8826d52eea
Merge branch 'master' of ssh://git-annex.branchable.com 2019-07-29 12:29:00 -04:00
Joey Hess
724ebec3f0
lfs deep dive 2019-07-29 12:28:07 -04:00
geonemax67@f507d88f591246c5ff7de3b1f7fb2823684a789b
6ca7412390 Added a comment: SAMSUNG TV Repair Dubai 2019-07-29 11:14:48 +00:00
geonemax67@f507d88f591246c5ff7de3b1f7fb2823684a789b
05ff42834f removed 2019-07-29 10:02:36 +00:00
geonemax67@f507d88f591246c5ff7de3b1f7fb2823684a789b
a9725df299 removed 2019-07-29 09:56:09 +00:00
geonemax67@f507d88f591246c5ff7de3b1f7fb2823684a789b
29714ab4f0 Added a comment: SAMSUNG TV Repair Dubai 2019-07-29 09:55:47 +00:00
geonemax67@f507d88f591246c5ff7de3b1f7fb2823684a789b
80b389caed Added a comment: SAMSUNG TV Repair Dubai 2019-07-29 09:44:27 +00:00
felix.hagemann@b76e9ea0928cf33dacffc37ec3dbecf33171a8a5
4b6a893b4c 2019-07-29 06:05:05 +00:00
felix.hagemann@b76e9ea0928cf33dacffc37ec3dbecf33171a8a5
66de7ebe6d 2019-07-28 21:29:00 +00:00
Joey Hess
be417883a1
Merge branch 'master' of ssh://git-annex.branchable.com 2019-07-28 14:28:29 -04:00
Joey Hess
426053cb6c
Corrected some license statements
In 40ecf58d4b I changed the license of code I
wrote from GPL to AGPL. But, two files containing code I wrote combined
with code by others were updated to say their license is AGPL, while in
fact part of it was (the code I wrote) but part remained under the original
license (the code written by others).

Remote/Ddar.hs is now changed entirely back to GPL 3.

Annex/DirHashes.hs stays AGPL, but I broke out Utility/MD5.hs with the code
not written by me, and corrected its license statement to GPL-2, which
is the actual version of the GPL included with the code in its original
distribution at http://www.cs.ox.ac.uk/people/ian.lynagh/md5/
2019-07-28 14:27:33 -04:00
ahmadabi787@4794191381bef93a2daa0515a85ff953cba9b3e0
8b492a5c88 Added a comment: Technical support 2019-07-26 07:13:07 +00:00
ahmadabi787@4794191381bef93a2daa0515a85ff953cba9b3e0
ff1d11adf9 removed 2019-07-26 07:11:27 +00:00
ahmadabi787@4794191381bef93a2daa0515a85ff953cba9b3e0
198472d88c Added a comment 2019-07-26 07:07:29 +00:00
ahmadabi787@4794191381bef93a2daa0515a85ff953cba9b3e0
8bbc2ae976 removed 2019-07-26 07:05:28 +00:00
ahmadabi787@4794191381bef93a2daa0515a85ff953cba9b3e0
be1573e2e2 Added a comment: Technical support 2019-07-26 07:02:10 +00:00
Ilya_Shlyakhter
5759065e18 added suggestion to let git-annex-export export non-annexed files 2019-07-26 00:36:18 +00:00
Ilya_Shlyakhter
1b77164c83 question about git-annex interaction with git sparse checkout 2019-07-25 22:44:04 +00:00
Ilya_Shlyakhter
f257282cdc Added a comment 2019-07-23 20:57:11 +00:00
Ilya_Shlyakhter
924e89f932 added bug report about fsck flagging dead keys as errors 2019-07-23 20:56:19 +00:00