Podcast #128: We chat with Kent C Dodds about why he loves React and discuss what life was like in the dark days before Git. Listen now.

Questions tagged [machine-learning]

Methods and principles of building "computer systems that automatically improve with experience."

Filter by
Sorted by
Tagged with
1
vote
0answers
10 views

types of metrics to evaluate the performance of regression models?

I have a conceptual question related to types of performance analysis of regression models. In general we have - R Square, Root Mean Squared Error and Mean squared Error to evaluate Regression ...
0
votes
0answers
5 views

Universal function approximation with fixed values (as vector or matrix)

I was thinking about way to represent/approximate universal function and came up with the idea that a plain fixed numbers could be used to represent pretty much any function on a fixed interval. I ...
0
votes
0answers
8 views

How to use a unique machine learning model for different types of inpute?

This question is generic because I am in the middle of pseudo code and sorry for not sharing the example of main code. The question is that suppose I have a neural network (or any other type of) model ...
0
votes
1answer
17 views

Neural network is not giving the expected output after training in Python

My neural network is not giving the expected output after training in Python. Is there any error in the code? Is there any way to reduce the mean squared error (MSE)? I tried to train (Run the ...
0
votes
0answers
6 views

What reasons to explore if we have difference in the actual values of two different years? [on hold]

I have a dataset which has store ids and date ranges and some other features. My target is number of visitors to the store. I have found that there is a difference between targets of one store id in ...
4
votes
1answer
17 views

Is it possible to generate syllogisms using an NLP algorithm?

I want to build a tool that generates sensible syllogisms. An example of a syllogisms is: all A are B. all C are A. all C are B). I want the triplet (A, B, C) to be semantically related to each other ...
0
votes
0answers
13 views

What reinforcement learning algorithm to choose for self-driving car

I have a car that has three sensors at the front. Using these sensors only I want to let it learn to drive on a track. I'm new to reinforcement learning, but I was thinking about using the Q-learning ...
0
votes
1answer
9 views

What are the steps and correct order of the operations in Machine Learning? [from Getting data to optimising models]

I've followed lots of tutorials on Machine Learning but in each of these, they go for a different strategy so it's quite confusing for me. I want to Know that what are the operations involved and what ...
0
votes
1answer
13 views

What are advantages of oversampling over changing threshold for unbalanced classes?

Let's say that I have unbalanced data set that has two classes, and I am using Random Forest to make my predictions. Random forest will be biased towards the majority class, which will cause low ...
1
vote
0answers
7 views

Generate Intro-Text for Newsletter

I am trying to implement the following idea. For a daily newsletter I would like to generate an engaging and funny intro text, such as: Good morning. Sorry if there are beer stains and buffalo ...
-2
votes
0answers
13 views

Unable to understand the following part of the research paper [on hold]

I am currently reading the following research paper https://www.researchgate.net/publication/326013025_New_doctors_ranking_system_based_on_VIKOR_method And I am unable to understand the Process: 3.1....
1
vote
0answers
19 views

Unsupervised Function Optimization using Input and Output for Loss Function?

I have some vectors {$\mathbf{X_1 ... X_n}$} and they are all of dimension 1 x N. Vectors {$\mathbf{X_1' ... X_n'}$} are also 1 x N and are related to {$\mathbf{X_1 ... X_n}$}, but the relation cannot ...
1
vote
1answer
20 views

To calculate my confusion matrix with recall and precision, my test set need to be equal(balanced)?

In my CNN, I have 200 'negative' images and 50 'positive' images in my test set and I want to make a confusion matrix. My doubt is if I have to equalize the samples in the dataset because if I keep ...
0
votes
0answers
16 views

Split time series data into Train Test and Valid sets in Python

I'm working on a project in which I have combined 2 datasets if time series (e.g D1, D2). D1 was with the 5-minutes interval and ...
0
votes
0answers
19 views

Why do I have leakage while using Stratified Group K Fold?

I have the following case: Training data in the form of x, y coordinates on different frames (from a video). Based on this I computed some features, using only the training data and labels. A model ...
2
votes
1answer
20 views

Ways to combine embeddings

I am building a recommender for an online shop and I have categorical inputs that belong to one of the following categories: user current session features (e.g. ...
0
votes
1answer
23 views

Time Series Generation - Multi Dimensional Time Series Data

Disclaimer: Mathematicians please don't be mad at me for the use of some of the terminologies in this post. I am an Engineer. :-) Background: So I am currently working on a problem where I have to ...
0
votes
0answers
10 views

Is it feasable to “predict” 2d (~2x20 array) output using a CNN

I'm trying to generate a "beatmap" (from osu!mania) based on an audio file. To do this, I've applied fast fourier transform (this can change to Mel-frequency cepstrum, but that's not super relevant) ...
0
votes
3answers
28 views

Types of Machine Learning/Data Analysis

I am looking for a framework or chart that classifies all the different types of data analysis/machine learning. I want to use this classification to organize my knowledge/areas to learn. Examples of ...
3
votes
2answers
40 views

Am I overfitting my random forest model (more information in description)?

First off, sorry if this a novice question! Relatively new to all this stuff. Posted this in Stack Overflow and someone sent me here! Hope it's the right place. Anyway, I'm working with 22 datasets ...
2
votes
0answers
14 views

What are the tradeoffs between Bayesian Deep Learning and Deep Gaussain Processes?

I understand the differences between Deep Gaussian Processes(DGPs) and Bayesian Deep Learning(BDL): DGPs are essentially feed-forward neural networks where each node is a Gaussian Processes, which BDL ...
0
votes
0answers
12 views

Autoencoder clustering with a small dataset

I have a dataset which is relatively small (less than a 1000 samples). I run an autoencoder on a training set, and then check the reconstruction error on a validation set and stop training before it ...
0
votes
1answer
35 views

Which Machine Learning methods would be good for a beginner-level Data Science project for described dataset? [on hold]

I want to do my first beginner-level project regarding Data Science. I picked my data set which is described below. I want to make a Python script which will make some predictions on our data set ...
0
votes
0answers
3 views

Plotly Bar Graph Color Scale [migrated]

I'm trying to keep a bar graph values on the same color scale - for example: ...
0
votes
0answers
7 views

Finding image dataset of color-blindness charts [on hold]

I had an idea to train a CNN to classify numbers seen on color-blindness charts like the one seen below. I have Google for such dataset but did not find anything. How should I approach this?
0
votes
2answers
23 views

Managing NaN in target variables (testing)

Please can someone advise me on how to handle NaN in my target variables set? I've tried a variety of things but none is working. Here's what I've tried: Imputing zeros (0) in Y_test Replacing NaN ...
0
votes
1answer
12 views

How to build in symmetry of inputs into a Deep Neural Network?

I have a Deep Neural Network that takes $n$ inputs $X = [X_1, \ldots, X_n]^T$ and gives $n$ ouputs $Y = [Y_1, \ldots, Y_n]^T$. Normally, I can just do a standard deep neural network with a few fully ...
0
votes
1answer
17 views

Build a model to classify given string/text input

I need to build ML/NN model to classify/predict a given string pattern. Sample training data looks as shown in the image. Input will be the string in the column "Id Number", i need to tell to which ...
0
votes
0answers
5 views

m = rating.pivot_table(index=['user_name'], columns=['site'], values = 'rating') [on hold]

m = rating.pivot_table(index=['user_name'], columns=['site'], values = 'rating') I wrote this command, and it shows this error. I do not know what's wrong can any ...
0
votes
0answers
14 views

Statistical loss function for categorical distributions

For training an autoencoder model whose outputs (and inputs) are parameters from a categorical distribution $[q_1, q_2, \ldots, q_n]$, I have to define a proper loss function measuring the distance ...
0
votes
0answers
38 views

Prediction error without having a true value

Quick summary about the problem: we are trying to deploy our regression model, where the clients require "individual prediction error". Since we're predicting something unknown in advance, we can't ...
0
votes
0answers
7 views

How to get a percentage of similarities of new data added based on model trained using a huge training set in machine learning

I need to find similarities in newly added data using machine learning. We have a huge data set with more than 200 000 rows having following information: Name D.O.B City (From predefined list) Phone ...
1
vote
2answers
29 views
0
votes
2answers
54 views

How to handle addresses of the restaurants to feed the data-set in the ML model?

I have data from different restaurants which have also address of the restaurants now I want to predict the food delivery timing based on the given data, now the restaurant address is one of the ...
0
votes
0answers
8 views

should we apply he Same normalization to New Data as well for prediction [on hold]

I came across the post. Should we apply normalization to test data as well?
1
vote
2answers
19 views

Unsupervised image classification?

Does this exist? What algorithm or combinations of algorithms would be able to classify images without supervision? For example if you have many pictures of cats and dogs, then without being trained ...
1
vote
0answers
11 views

Gaussian process regression for large dimensional input space

I am working for Gaussian process (GP) regression $y=f(\mathbf{x})+\epsilon$ with $\mathbf{x}\in \mathbb{R}^D$ and $D$ can be as large as few 100. I have attempted with the GPML toolbox and the exact ...
0
votes
2answers
32 views

Multi-class classification with mostly zero valued data

I implemented a multi-class regression and wanted to test it using the MNIST dataset. I realized that if I use standardization $X \leftarrow \frac{X-mean(X)}{std(X)}$, over 50% of all features ...
0
votes
3answers
38 views

What is the minimum requirement for the dataset for time series forecasting?

I have a dataset of patients where, for each patient, a measurement is taken 3 times per day. For example, patient 1 has recordings at 7.30 am, 12.30 pm and 8.30 pm. Patient 1 has a collection of 30 ...
0
votes
1answer
30 views

confusion on outliers

I am not able to distinguish the outliers - When to go with std. dev and When do we need to go with Median. My understanding on std. dev. is - if the data is away from mean by more than 2 std dev. we ...
1
vote
0answers
13 views

Voronoi Diagram Algorithm for Geo Locations? [on hold]

As per my Understanding: Voronoi diagram: A Voronoi diagram is a simple concept, and it's based on the minimal distance needed to reach a landmark. If you need to go to a metro station, the most ...
0
votes
1answer
23 views

What is considered a large (medium, small) input for simple feedforward neural networks?

What would be considered a large (or medium or small) number of input neurons for a feedforward neural network? While I am trying to do phoneme detection using inputs of 3200 sound-samples, I became ...
2
votes
2answers
62 views

Is machine learning the right tool for this job?

I would like to create a troubleshooting wizard. The user will go through the wizard and choose different options, what options they choose will determine what is displayed next in the wizard. ...
0
votes
1answer
17 views

How to convert photo to a vector drawing

I am using the following code to convert photo to a drawing: ...
2
votes
0answers
21 views

Adding learning episodes to epochs with Keras

I want to implement a prototypical network (https://arxiv.org/pdf/1703.05175.pdf) with keras (there are some implementations in pytorch and tensorflow, but those are not ideal for me). This NN is ...
0
votes
1answer
24 views

The distribution of dataset train and test are the differents, how to fix this?

I am new in data science and like some help to understand my problem. For instance, I have two signals non-stationary for the same condition (figure 1). I acquisition them at different times(in the ...
0
votes
2answers
26 views

Link prediction on network embeddings

A picture is worth a thousand words, so I decided to illustrate how I imagine the procedure of link prediction on network embeddings. In the figure below the LR model stands for the "Logistic ...
0
votes
1answer
15 views

Preprocessing of 3D CAD files for Keras Conv3D input

I'd like to apply some machine learning on 3D CAD data. File format should ideally be mesh-based like STL. Keras offers 3D convolutional layers (https://keras.io/layers/convolutional/), so it can ...
-1
votes
0answers
12 views

Found input variables with inconsistent numbers of samples: [415, 506], [on hold]

I am working on the boston data set on sklearn, after i removed the outliers(using z score method) from my independent variables X, i got that error, meaning my y variable isnt the same with the X. ...
-1
votes
1answer
22 views

what features can I get from the sample?

I have dataset of 100 000 words labeled by surname(is last name / not last name) Example: kitchen | 0 kennedy | 1 etc. I tried extract lenth of word, count of each letter and such simple features ...