git-annex/doc/forum/read_directly_from_annex.mdwn
globallyunique@da2274b36ca296fe35912b9fd7387e3a5bd17c7c f02ec096d4
2020-05-09 19:25:28 +00:00

1 line
414 B
Markdown

I want to store my annex on google cloud storage (GCS) and load files from the annex on GCS directly into Big Query for processing. I'm planning on using DataLad's gitannex features. I'm thinking this kind of approach is needed to avoid the overhead of downloading to the server where the Datalad git repo is running and the need for space to store it on the regular file system. Is anything like this possible?