Questions tagged [machine-learning-model]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
2
votes
1answer
15 views

What inference can we draw from the frequency distribution of thresholds?

I've the probability scores of positive class of two models. The frequency distribution of those probability scores(thresholds) are like this Model #1 Model #2 It's a binary classification problem....
0
votes
0answers
14 views

Online Algorithms

How to use Stochastic Gradient Descent as an Online Machine Learning Algorithm? I have a dataset with large flow of data everyday and need to use an Online algorithm to handle it so to train my model ...
3
votes
1answer
56 views

Time Series Model for multiple trends

I am a newbie in the ML field. So please, neglect or better correct, if I am wrong somewhere. Currently working on a model training for time series data. My problem is a little more specific to bike-...
2
votes
0answers
19 views

How to use learning curve in reality

CONTEXT: I have some simulated data by which I made and trained a model. during my training, I enjoyed having a large number of samples, and therefore my model is leveraging it by being decently ...
22
votes
7answers
6k views

What would I prefer - an over-fitted model or a less accurate model?

Let's say we have two models trained. And let's say we are looking for good accuracy. The first has an accuracy of 100% on training set and 84% on test set. Clearly over-fitted. The second has an ...
2
votes
0answers
18 views

How to find transictions and group variables

Having a dataset like this: ...
0
votes
0answers
14 views

How to test yolo model with correct .name configuration file as it is getting pointed to data/coco.names instead of cfg/obj.names while testing?

Im getting below error while testing my newly retrained model on my custome dataset command to test : !./darknet detect cfg/yolo-voc.2.0.cfg backup/yolo-voc_last.weights helmet.jpg output: Error: in ...
-2
votes
0answers
13 views

index 46 is out of bounds for axis 0 with size 40 [closed]

from sklearn.model_selection import train_test_split train_data,test_data=train_test_split(df1,test_size=0.2,random_state=0) import statsmodels.formula.api as sf m1=sf.ols("Profit~RnD+Administration+...
1
vote
1answer
37 views

How to save and load model from unsupervised learning?

[Beginner] Sorry if this is dumb question. I am following the model from this article and below. ...
1
vote
1answer
27 views

How to use scikit metrics for a statsmodel or vice versa?

Am working on binary classification problem with 5K records. Label 1 is 1554 and Label 0 is 3558. I did refer this post but not sure whether it is updated now or anyone has any way to compute this ...
2
votes
1answer
43 views

How to Bootstrap dataset for 10000 AUC scores?

I am new to ML and trying to learn the nuances. I work on a binary classification problem with 5K records. Label 1 is 1554 and Label 0 is 3554. What I currently do is 1) split the data into train(...
2
votes
1answer
26 views

Why and how to match variables in logistic regression?

I have a dataset of ~4.7K records focused on binary classification with 60 features. class 1 is of 1554 records and class 2 is of 3558 records. Now I would like to find the risk factors that ...
2
votes
1answer
21 views

How to retrain a K-Modes model based on daily data?

I have read that retraining a model depends highly on what you are trying to achieve. I am conscious that maybe I need to retrain my model daily and after a certain time I have to train the model ...
1
vote
1answer
36 views

ML Project - Achieve 2 Objectives

I have a dataset with 5K records focused on binary classification. I am posting it here to seek your suggestions on project methodology Currently what is my objective is 1) Run statsmodel logistic ...
5
votes
3answers
30 views

How does one define the possibility space of valid priors (models)?

When one trains a model on data of any complexity one inevitably ends up with a one particular model among a vast many possible models that would make similar (or even, the same) predictions. For ...
1
vote
1answer
29 views

What does scaling a gradient do?

In the MuZero paper pseudocode, they have the following line of code: hidden_state = tf.scale_gradient(hidden_state, 0.5) What does this do? Why is it there? I'...
1
vote
3answers
85 views

How to handle features with very broad range

I have a long list of continuous values like in the image below: The plot looks like this: How to handle such features? If I train the model with this, the model will not have the best precision, ...
0
votes
0answers
16 views

Machine learning after Cosine Similarity for fuzzy name matching

I am following ING Bank's Large Scale Fuzzy Name Matching and I have implemented their awesome_cossim_topn to produce a dataframe of names and their associated similarities. I then added the other ...
1
vote
2answers
30 views

Plots of data using DBSCAN algorithm not making sense

I am using clustering for my data. Since the DBSCAN algorithm will also tell me an estimate of clusters that I can use, I have used DBSCAN. I have tried for the ...
0
votes
0answers
13 views

Best model for removing a consistent background image

I'm working on an ML driven background replacement from photos, where the background will always be consistent, but the objects in front of that background (in this case humans) will be different - ...
0
votes
1answer
8 views

how to label the data of accelerometer

I have dataset collected by the accelerometer of smartphone I want to make label the data in tow classes normal 0 and not normal 1 second question how can I filter the data
1
vote
1answer
42 views

Training a Siamese Neural Network for object similarity assessment

I am training a Siamese neural network with pairs of similar and dissimilar objects. The features of the objects are binary data on whether they contain some properties or not (2048 features per ...
3
votes
1answer
32 views

which is better : F1-score of 'N' in imbalanced data or 'N+3' in balanced data?

I have a dataset with 4712 records. Label 1 is 1558(33%) and Label 0 is 3154 (67%) a) Currently when I run the model and analysis as is (without sampling techniques), I get an ...
2
votes
0answers
20 views

How can I “export” a model from Orange once I have prototyped a solution?

Using Orange, I would like to use the underlying python model within the control system of my device. The device is a simple machine which is not connected to the internet. My intent is to use the ...
0
votes
1answer
41 views

How to understand clearly the feature importance computing in random forest model

I want to know the details of feature importance computing of random forest with gini index. I refer to this Chinese blog:https://www.jianshu.com/p/7a876bb876b9. But I don't understand clearly these ...
0
votes
0answers
35 views

Audio Analysis - Training the model - Tuple Index out of Range Error

I am trying to analyse an Audio file and train the system based on that extracted features but I am getting an error while Fitting the model saying "Tuple Index out of Range". I have provided the ...
1
vote
2answers
97 views

Training machine learning models from log files

Im starting to learn about ml and most of examples show very simple examples on how to train your ml modell. For me this looks more like statistic calculations than actual ml. These kind of examples ...
2
votes
0answers
21 views

Implementing a Kernel Adaptive Filtering model explained in a paper

In this paper, Stock price prediction using kernel adaptive filtering within a stock market interdependence approach, the authors propose a method for predicting stock prices by combining the ...
0
votes
0answers
7 views

Using Complex Event Processing Engine for Machine Learning Models

we are running several models to detect events on customer and financial data using a cron-tab. (runs every 5 minutes currently) Some of these events are described as a model (often using ML methods ...
2
votes
2answers
44 views

Does Feature Normalization affect Gradient Descent | Linear Regression

am new to datascience and i want to learn linear regression so i coded linear regression from scratch and performed gradient descent to find the best $w_\theta$ and $b_\theta$ values using a tutorial. ...
1
vote
1answer
25 views

How does joint probability generate new data in generative model

Learning about different Machine Learning concepts, I came across Generative and Discriminative model. To infer from what I have studied, generative model is based on P(x,y)(Joint probability ...
0
votes
2answers
59 views

How to handle addresses of the restaurants to feed the data-set in the ML model?

I have data from different restaurants which have also address of the restaurants now I want to predict the food delivery timing based on the given data, now the restaurant address is one of the ...
0
votes
0answers
21 views

Transforming Data for Classification

I have a dataset of the type: Time_from_anchor is the time from when the diagnosis was made, if he had cancer. i.e patient 1 was diagnosed with cancer at 0. He had tests x and y at time -1 and tests ...
0
votes
1answer
19 views

Covariates in machine learning classificatoin

I would like to classify a number of people as sick and healthy. I have all the body measures as features. I have to control for age and sex because body features are affected by that. How do I adjust ...
0
votes
0answers
14 views

Reproducing risk curve

I want to reproduce the curve above with a code implementation using MNIST data. How can I plot the curve above with an increasing model complexity? What should I do to run experiments with increasing ...
0
votes
0answers
81 views

why evaluate_generator accuracy too much by using flow_from_directory with shuffle true?

i am using tensorflow and keras on colab i train with shuffled data but i met this strange accuracy with evaluate_generator with my training set that has 95% acc if i did not shuffle my data with ...
1
vote
0answers
14 views

Learning the change in data

I've got a large dataset of sensor data (so gyroscope, accelerometer and so on). This is sampled at about 60hertz. Here's an example of some milliseconds of data It's a simple csv file with like 1000 ...
1
vote
0answers
23 views

Pre-training model with existing seasonal data for new dataset with maximum limit

I apologise if this is a simple one, I'm not sure if this is not possible or if I'm just not using the right keywords to find the answer; Say I've got a pizza store, I've been able to successfully ...
0
votes
1answer
12 views

Recommendation Model

Hi i'm working on a practice project on amazon movie reviews and i did everything that was asked except building a model that will recommend movies to users which have not been watched nor been rated. ...
0
votes
1answer
22 views

LSTM fot text classification always returns the same results

Hello fellow Data Scientists, I'm trying to make a classifier that was to classify sequences of text into some predefined classes, but i always get the same output, can anyone help me understand why? ...
0
votes
1answer
38 views

Deep Learning for non-continuous dataset

I am working with this dataset which is record of student academic details and I want to predict the student's performance. since the dataset is non-continuous I cannot apply CNN on this dataset. ...
2
votes
3answers
69 views

How to fix my high validation loss and inaccuracy

New to machine learning and tried to train my bird recognization model and found very high validation loss and inaccuracy. I'm using this dataset: http://www.vision.caltech.edu/visipedia/CUB-200-2011....
0
votes
0answers
7 views

Why would predicting a percentage bring my test score R2 nearly to zero?

I am trying to predict the Score on an exam from various predictors. The exam have a total # of points (ScoreMaximum) you can have and each exam can have a different ScoreMaximum. When I try to ...
1
vote
0answers
14 views

Does the type of y value affect the prediction power of model?

I am using the sunlight intensity time series data(X) to predict plant height(Y) in different locations using CNN model in Keras. I am wondering if I change the group Y values into 2 categories: High ...
0
votes
0answers
13 views

What language is most used in deep learning research?

I see the GAN source code all in Python, or otherwise, BERT seems to be all in Python as well. I was under the impression that ...
0
votes
0answers
12 views

How to encode factor predictors in prediction models

The response variable as well as all predictor variables in my dataset are factors. I want to build a model for predicting the response variable. As I understand I have to first encode my predictor ...
0
votes
1answer
28 views

Forecasting Consumption for Multiple Products for Multiple Regions

Came across a very interesting Real-World Time Series Forecast Problem. Can you please help me understand the right track to resolve the below Time Series problem: Input Data Sample: and we want to ...
0
votes
0answers
7 views

What techniques can I use to find position relationship in group of elements?

I have 14,000 tagged documents. These are custom forms that our employees create and fill out. I need to build a model that will be able to classify the types of each input field of the form in order ...
0
votes
1answer
21 views

Ensemble Techniques - Boosting

I understand boosting is a sequential learning technique and it use the prediction from previous model as a dataset for new model ,after adding weight to the misclassified data points. The point ...
0
votes
0answers
15 views

Scaling ML/DL classifier

I have been trying to find some guideline through google/stackoverflow for scaling a classification system. E.g. how can I scale a face recognition system if we want to add new people into the system? ...