All Questions
Tagged with neural-network classification
307 questions
1
vote
0
answers
14
views
Neural Network Overfitting on Linearly Separable Dataset
Please let me know if this question is not proper to ask here
For context, I have a dataset regarding to tiktok user engagement. The predicted variable is binary, either 'claim' or 'opinion'. From ...
- 11
0
votes
0
answers
15
views
My network to classify dialects is not working
I have written the following code to classify dialects based on the timit dataset using .wav files. For some reason my model is not learning and classifies everything into the same class. Is it ...
1
vote
1
answer
49
views
Everything is classified as background by segmentation model
I am training a U-NET model for medical image segmentation. Problem is that the binary masks that im using to train the model mostly consist of background pixels and a very small region of the whole ...
- 61
1
vote
1
answer
44
views
Unordered Set Classification Problem
In my setup I have one feature which is a sparse list representing categories. For example, let's say that we have M categories in the interval ...
- 111
0
votes
0
answers
17
views
Training the neural network does not give the expected result
I'm trying to create a pytorch neural network capable of recognizing peaks in 2D graphs. Previously, I was able to get a result close to what I wanted, but it was not ideal and did not give a ...
- 1
0
votes
1
answer
41
views
Where can I get 5000+ classified images of zoo animals? [closed]
please help! We are college students doing this for a project. The project is using neural networks and want to build a model that takes in an input of a colored image of an animal and outputs the ...
0
votes
0
answers
229
views
Empty Confusion Matrix and Zero Precision/F-score
Could you please say why I'm getting this warning while doing a binary classification using Artificial Neural Networks? The data are colored images.
...
- 101
2
votes
1
answer
194
views
What is the benefit of the exponential function inside softmax?
I know that softmax is:
$$ softmax(x) = \frac{e^{x_i}}{\sum_j^n e^{x_j}}$$
This is an $\mathbb{R}^n \implies \mathbb{R}^n$ function, and the elements of the output add up to 1. I understand that the ...
- 123
0
votes
1
answer
410
views
Correlation between multiple time series
For research, we put some test samples through a physical process for a certain period of time and make measurements. The general structure of the data we collect is as follows:
...
0
votes
1
answer
31
views
How to fit n features in a number of neurons smaller than n
Suppose I have a feature composed by 784 numbers, and I want to use it as input of a neural network implemented from scratch whose first layer has 64 neurons.
How can I put 784 numbers in 64 neurons?
- 152
0
votes
1
answer
78
views
Understanding correlation - Machine Learning
I am experimenting a project on identifying cancer or not - Binary classification
The dataset has many columns. Here, I added correlation values between few input columns and the target column[cancer/...
- 21
1
vote
1
answer
74
views
Example of a 2D dataset and a classifier stuck at local minimum
We always hear about neural networks getting stuck at local minima, but I cannot visualize one. Can you please give me some examples?
I am not looking for something like below picture and a neural ...
- 111
0
votes
1
answer
115
views
Classification of a noisy data
What method can be used to classify data in the following example?
There is a table (hundreds of strings and hundreds of columns). Several columns in this table uniquely allow you to classify each row:...
- 1
0
votes
0
answers
880
views
How can I improve the accuracy of my pytorch neural network for classification of tabular data?
As a newbie in 'pytorch', I am building a neural network for classification of faulty water pumps in Tazania for this competition I am also using ax-platform for ...
user144514
0
votes
1
answer
22
views
Is there a procedure for determining if a classification problem is ill-defined?
Consider a group of objects denoted $O = \{o_0, o_1, \cdots\}$ where each object is associated with a feature vector $F = \{f_0, f_1, \cdots\, f_{N-1}\}$. For this case, assume the features are ...
- 123
0
votes
1
answer
137
views
Machine learning algorithms for tabular dataset
I have a dataset with 120 features and 5000 instances. The dataset is combination of categorical and numerical values. It is a tabular dataset. My problem is a binary classification problem. I trained ...
- 361
0
votes
0
answers
51
views
How to improve validation score
I am working on time series classification. My data has 4 classes. I used this paper's architecture on my data (1611.06455). However, my results look like this :
. Here is a link to my notebook
I ...
- 139
1
vote
1
answer
18
views
The proper loss function for regression that prediction values do not lie on one side of the real values
I'm doing a prediction task using machine learning. First I'm doing a regression task, then I use the values to predict its class.
I used MSE as loss function. However, my prediction values are ...
- 165
2
votes
1
answer
49
views
All classification models except neural network giving 100% accuracy
I have a dataset of size (140,000, 10) containing 1 dependent variable. I used MinMax scaler on independent variables. For the target value, there is a class imbalance of 94% 0's and 6% 1's. Used ...
- 23
1
vote
0
answers
45
views
Determining if a city belongs to a country by coordinates with neural networks
I have a task from NN course from my university: I have worldcities dataset with columns (longitude (-180 to 180), latitude ( -80 to 60), is_russia (0 or 1)). ~15000 rows.
And I have to train NN to ...
- 11
1
vote
1
answer
3k
views
How to export shap waterfall values to dataframe?
I am working on a binary classification using random forest model, neural networks in which am using SHAP to explain the model predictions. I followed the tutorial and wrote the below code to get the ...
- 2,655
1
vote
1
answer
38
views
why my boosting model overfits even with just 4 features out of 61?
I am working on a binary classification problem using balanced bagging random forest, neural networks and boosting techniques. my dataset size is 977 and class proportion is 77:23.
I had 61 features ...
- 2,655
0
votes
1
answer
408
views
Classification for two dimensional data
I have time series like 500 data points of $(x,y)$ pairs, where $x$ = time in seconds and $y$ = signals. Each of these candidates/time series has an additional label, which tells about the nature of ...
- 139
0
votes
1
answer
58
views
When to use best hyperparameters - Feature selection or Model building?
I am working on a binary classification with 977 rows using different algorithms
I am planning to select important features using wrapper methods.
As you might know, wrapper methods involve use of ML ...
- 2,655
4
votes
1
answer
2k
views
Automated feature selection packages - Python
I am working on a binary classification with 977 rows. class proportion is 77:23. I have lot of high cardinality categorical variables and couple of numeric variables such as Age and quantity.
I would ...
- 2,655
1
vote
0
answers
1k
views
SMOTE before categorical encoding vs SMOTE after categorical encoding
I have a small dataset of 977 rows with a class proportion of 77:23.
For the sake of metrics improvement, I have kept my minority class ('default') as class 1 (and 'not default' as class 0).
My input ...
- 2,655
6
votes
1
answer
15k
views
How does SMOTE work for dataset with only categorical variables?
I have a small dataset of 977 rows with a class proportion of 77:23.
For the sake of metrics improvement, I have kept my minority class ('default') as class 1 (and 'not default' as class 0).
My input ...
- 2,655
1
vote
2
answers
371
views
Low accuracy on the test set
I have a dataset with 16 features and 32 class labels, which shows the following behavior:
Neural network classification: high accuracy on train 100%, but low accuracy on the test set 3% (almost like ...
- 173
0
votes
1
answer
57
views
Why best hyperparameters leads to drop in test performance?
I am working on a binary classification problem using random forests (75:25 - class proportion). Label 0 is minority class. So, I am following the below approach
a) execute RF with default ...
- 2,655
0
votes
1
answer
357
views
why sign flip to indicate loss in hyperopt? [closed]
I am using the hyperopt to find best hyperparameters for Random forest.
My objective is to get the parameters which returns the best f1-score as my dataset is ...
- 2,655
1
vote
2
answers
550
views
Explainable AI solutions and packages in Python
I recently built a logistic regression for binary classification
While I understand that logistic regression is inherentlt interpretable, I am trying to use explainable AI solutions to understand the ...
- 2,655
7
votes
2
answers
12k
views
Encoding before vs after train test split?
Am new to ML and working on a dataset with lot of categorical variables with high cardinality.
I observed that in lot of tutorials for encoding like here, the encoding is applied after the train and ...
- 2,655
1
vote
1
answer
2k
views
how to link the predicted output to the original observation?
Am working on a binary classification using logistic regression data
I have 1000 rows and 28 features. Three to 4 variables are Id variables like product_id, subject_id etc
During train_test split, I ...
- 2,655
0
votes
1
answer
119
views
Why -2 is seen in supervised binning using decision tree?
I have a continuous variable called salary, age etc and output variable as loan_status
Instead of me choosing the cut off points for salary and age bins , I used Decision Tree to compute the bins ...
- 2,655
0
votes
1
answer
324
views
How to use hierarchical variable in a ML model
I am working on a binary classification problem with 1000 rows and 20 variables.
I have variables like product_id, city, ...
- 2,655
2
votes
1
answer
171
views
exclude variables with no variation during prediction?
I am working on a binary classification problem.
I do have certain input categorical variables such as gender, ethnicity etc.
...
- 2,655
0
votes
1
answer
33
views
How to use rule-based labelling intelligently?
I have a dataset like below
The outcome column is labelled as positive if the % difference between target final Qty and ...
- 2,655
0
votes
2
answers
35
views
How to show prototype of output before building model
Currently in my work, we are working on a POC for a AI project.
We intend to do a binary classification using traditional classification algorithms.
However, my boss wants me to show a feel of the ...
- 2,655
0
votes
1
answer
310
views
Estimate timeline for a ML Project
I am a novice data scientist and have been asked to provide an estimate for a data science project in our organization.
From the problem stmt description, i am able to understand that it is a ...
- 2,655
1
vote
1
answer
176
views
Audio Classification with Counter
I'm trying to create a model that can identify one particular sound, and every time it hears that sound, it increases a counter by 1. So for example, if it hears a specific bird chirping ten times, ...
- 11
1
vote
1
answer
129
views
How to analyze repeated measure data for prediction?
In my work, we collect sales data of our products. We have a set of 1st level customers (lets call that group as jacks) with whom we do we business. These jacks then sell our products to end customers ...
- 2,655
1
vote
0
answers
18
views
Modeling events with an intermediate stage
For a lot of prediction problems, there's an intermediate stage which must occur for the target event to occur. For example, to graduate from college, one must first be accepted. For an internet ad to ...
- 111
1
vote
0
answers
26
views
What kind of ML approach is more suitable for detecting event related signal changes?
First of all please if there is a better way to phrase my question let me know. It will help with search. ( This part : "detecting event related signal changes" )
Here you can see 4 black ...
- 188
0
votes
2
answers
214
views
Activation and Loss Function not chosen correctly when use Neural Network
I have three classes for my text dataset before.
These are my classes:
0 = Cat
1 = Not Both
2 = Dog
Then I use this code:
...
- 13
0
votes
0
answers
542
views
Improve model accuracy in multi-classification problem
I use a MLP to classify three different classes A, B, C. The loss function I use is categorical cross entropy and the optimiser ...
3
votes
1
answer
657
views
When should I oversample data?
I am dealing with multi-class classifiers. My data is unbalanced. Hence, I need to apply sampling techniques before training (undersampling or oversampling). When I apply undersampling, ...
- 151
3
votes
1
answer
435
views
How do you add negative class sample for binary classification?
How do you prepare the negative dataset for binary classification? Let us say that I am building a classifier that has to classify whether the input image is of a car or not. I already have a dataset ...
- 231
0
votes
1
answer
29
views
Use Lstm for classifying problem
i have a dataset of 10000 event with 16 feature, and a vector of dimension 10000 that represent the label of each event; for what i understand is a classification problem but it's required to use a ...
0
votes
1
answer
79
views
How to pass variable length data as feature to a neural network?
I am working on building a model to classify the type of touch the user makes (Long Press, Left Swipe, Right swipe, and so on). I have data with features that characterize the user's touch, like ...
- 101
3
votes
1
answer
342
views
Train-test split and augmentation strategy for small dataset for video classification problem
I have a small data set of videos of approximately 100 videos for each class for a binary classification problem. This results in a total of 200 videos. I am applying two types of augmentations on the ...
- 133