Questions tagged [version-control]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
7
votes
1answer
215 views

A the end of a big DS project, should I make trained models available on GitHub?

I almost completed two big Data Science personal projects based on Deep Learning. They are the fanciest models I've implemented up to now, and I'm pushing all my code on GitHub. Do you advice to ...
1
vote
0answers
16 views

Embedding git commit into the resulting data

Our pipeline works something like that: Collect bunch of raw data (10-100 GB) from microscope Process data using MATLAB scripts Change few parameters based on raw data, as well as add new features to ...
1
vote
0answers
146 views

Keras trained model exported with older version of Keras ( < 2.2.0 )

Is it possible to update a trained model saved in a file without retraining it ? I found the model on the web and I would like to use it but it uses Merge layers ...
2
votes
1answer
581 views

Dataset management: What are some strategies/solutions for efficiently storing datasets with their versions?

The problem: I've N classification models (independent), for each of these N models, I've different versions (eg: V0, V1, ..., Vfinal_production,Vexperimental). I'm looking for a way to store my ...
-3
votes
1answer
33 views

Extract all releases from GIT repository [closed]

I would like to examine an existing Git repository and extract all defined releases into a subfolder. For example, if application A had 26 releases, my bash script would extract all 26 versions into ...
48
votes
9answers
19k views

How to deal with version control of large amounts of (binary) data

I am a PhD student of Geophysics and work with large amounts of image data (hundreds of GB, tens of thousands of files). I know svn and ...
57
votes
9answers
9k views

Tools and protocol for reproducible data science using Python

I am working on a data science project using Python. The project has several stages. Each stage comprises of taking a data set, using Python scripts, auxiliary data, configuration and parameters, and ...