Questions tagged [automation]
The automation tag has no usage guidance.
11 questions
0
votes
1
answer
47
views
How to automate Jupyter notebook runs?
I have a general question. I often use Jupyter notebooks for prototyping. I am looking for practical ways to go to production. I know this might not be ideal, but as those are hobby notebooks, I'd ...
- 2,444
0
votes
0
answers
13
views
Is this how you would go about this NLP Project?
What do you think of these steps? And where can I find help with this project?
I am in a business class and was assigned a data science problem. I was advised to seek out a coder at my school who can ...
- 1
2
votes
1
answer
76
views
Automate naming of scanned documents
(If this is not the right forum for this, I apologize)
I'm trying to write a program that can automatically name scanned PDF files depending on what text they contain on their first page.
I have ~10,...
- 21
0
votes
0
answers
31
views
Are there tools that would run many machine learning fits without much setup?
Are there tools that would run many machine learning fits without much setup?
Such tool could be useful for discovering what kind of model could be the best fit, without trying each of them manually.
- 416
1
vote
0
answers
100
views
Automate detection of overfitting models based on autoML libraries
I'm trying to use machine learning to impute missing data in series using some auto-ML libraries in python (so far : dabl, FLAML, auto-sklearn and AutoKeras).
I know the way to detect overfitting in a ...
- 111
2
votes
1
answer
845
views
Automation of finding a starting point of measurement in a large dataset
I am looking for a way to automatically find a starting point of rising in my signal in Python. The data are collected with the frequency 10k (0.0001 s each) so the differences between each point are ...
- 43
5
votes
1
answer
350
views
Data Science Pipelines vs Common CD/CL
What is the advantage of Data Science Specific CI/CD (kubeflow, Algo, TFX, mlflow, sagemaker pipelines) vs the already baked flavors that are more generic: Jenkins, Bamboo, Airflow, Google Cloud Build,...
- 211
1
vote
1
answer
289
views
Auto-scheduling with Machine Learning
I am very new to Data Science, but I have an use case which I want to solve.
I want to build a data synchronization scheduler which keeps track of the amount of data sync after every scheduled ...
- 113
0
votes
1
answer
53
views
Automated bug finder through machine learning?
Assume that I have a large software application, this application is event driven i.e. when a user configures something by pressing on a button a code flow executes.
Along with this application I ...
- 1
2
votes
1
answer
62
views
Tool for test/train automation
I need to test different datasets as well as different algorithm implementations. The current workflow looks like:
Perform feature extraction from train set
Train classifier on this features
Feed ...
- 323
2
votes
3
answers
93
views
Are there any frameworks available that allow for automated large scale supervised machine learning?
The typical steps for solving a machine learning/pattern recognition problem:
Data Analysis and splitting the data into test and train sets.
Choosing a model.
Training the model, and testing the ...
- 487