0
$\begingroup$

I am working on a project with large data files (~300MB). I want to version my work along with the data files so that it is always available online. I tried using git-lfs but it has a 1GB/month bandwidth limit, beyond which you're blocked for a month.

What are versioning tools using by data scientists for projects that use >100MB data files (both static and generated)?

$\endgroup$
0
$\begingroup$

I have used dvc. It has data versioning though I do not use that often. I tend to use the makefile (pipeline) features.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.