Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [machine-learning]

Methods and principles of building "computer systems that automatically improve with experience."

0
votes
0answers
6 views

What does “explain” mean in “the model explains a large portion of the variance in the response variable”?

In "An Introduction to Statistical Learning" (or actually anywhere else) R^2 (when close to 1) is defined as: "R^2 value close to 1 indicates that the model explains a large portion of the variance ...
1
vote
1answer
52 views

learning curve Sklearn

I was trying Random Forest Algorithm on Boston dataset to predict the house prices medv with the help of sklearn's RandomForestRegressor. Just to evaluate how good ...
0
votes
1answer
14 views

Is it possible to train this image classifier?

I'm writing a mobile app that will enable a user to scan a Craft Beer Label from a bottle, tap, six pack, etc. The scan will only work for my customers who are the Brewers themselves, so I will have ...
0
votes
0answers
8 views

working on different size of images for CAD system

Is it possible to work on image dataset of different sizes for CAD system using supervised learning modules, i.e., I have a dataset of brain tumour images with a different size of tumours, they are ...
1
vote
2answers
31 views

Terminology question

In Machine Learning, is the definition of the Model just the algorithm that was selected for the problem domain, or is the Model the algorithm and the training data? Thanks.
0
votes
1answer
12 views

Query regarding (.output_shape) parameters used in CNN model

I am applying CNN model on my dataset for predictions. After reshaping the dimensions, the input_shape of my model1 becomes: model1.input_shape: (None, 1, 3, 4) then i apply CNN ist input layer ...
0
votes
0answers
20 views

Forecasting time series of binary vectors of given length

Please help me. I have a time series $$ x^{(1)}, x^{(2)}, \ldots, x^{(n)} $$ where $x^{(i)}=(x_1^{(i)}, x_2^{(i)}, \ldots, x_m^{(i)})$, $x_j^{(i)} \in \{0,1\}$, that is every $x^{(i)}$ is a binary ...
0
votes
2answers
40 views

How to find out bad images?

I have a task to find out bad visuals from given video. Let's define bad images in the video as per the human brain -: ...
0
votes
1answer
29 views

How can I increase the number of iterations per epoch in MATLAB?

I am training a deep learning network using MATLAB and would like to increase the number of iterations per epoch. Using trainingOptions ...
0
votes
1answer
33 views

How to handle noisy data?

I have X values such as [0.2, 0.1, 0.3, 0.5, 20, -0.2, -0.1, -0.6, -0.8, -30] Now I know that if the abs value is below a certain threshold, let's say 2, the y-...
0
votes
2answers
17 views

Classifier not predicting real data

I'm trying to train a classifier to recognize my own signature. This is how I built my classifier How did I collect data? Signed on a piece of paper for 50 times and created 50 images out of it. for ...
1
vote
1answer
27 views

What is non-decomposable and/or non-differentiable loss function?

I have been reading some deep learning literature and came up with these concepts of non-decomposable and non-differentiable loss functions. My question is are these same thing? if not how are they ...
0
votes
1answer
27 views

how to find holiday effect on revenue?

I have 2 datasets from 2013-2017 for each day. a) Revenue generated by Locations and date. b) Holiday name and date I would like to know how each holiday is impacting the revenue by location. I am ...
0
votes
0answers
17 views

Generate Decision tree on one multi level categorical feature

I have 100K pairs of categorical observation(feature) and Label , for an example : As you can see, observations are over lapping the labels (different observations can have the same label) and ...
0
votes
0answers
4 views

Literature Resources on Object Detection

I would like to learn as much as I can about object detection, including the history and math behind it. My plan is to build up my knowledge all the way to state of the art object detection techniques ...
1
vote
1answer
30 views

Reinforcement learning: negative reward (punish) illegal actions?

If you train an agent using reinforcement learning (with Q-function in this case), should you give a negative reward (punish) if the agent proposes illegal actions for the presented state? I guess ...
0
votes
1answer
9 views

Object tracking in 2 consequent frame

I have a video that consist of a lot of objects. I detect these objects correctly in every frame. For example you can see here 2 sequence frame detection of objects: Frame 1: Frame 2: I want draw ...
0
votes
0answers
13 views

Ensemble of LSTM (for text) and machine learning models based on bagging or voting techniques

Are there any good kernels or blogs on ensemble of LSTM (on textual data) and machine learning models like Naive Bayes, Random Forest, Gradient Boosting etc. (on meta data of text) Ex data: ...
0
votes
2answers
33 views

Deep Learning Network decreasing in accuracy

In order to familiarize myself with semantic segmentation and convolutional neural networks I am going through this tutorial by MathWorks: Semantic Segmentation Using Deep Learning I did not use the ...
0
votes
0answers
9 views

What kind of layer can do a channel number reduction?

I have a tensor of (1, 1, 1000, 64), i.e. a vector of 1x1000 with depth=64 channels. I'd like to transform this into a vector with a single channel (1, 1, 1000, 1): Using: a ...
0
votes
0answers
9 views

Word2Vec how to handle trend sensitive data from a live feed

(Sorry for the wall of text) TL;DR - I wonder how to regularly retrain a model on trend sensitive data from a live feed. I have been working on developing a Machine Learning model with Word2Vec as ...
3
votes
1answer
19 views

Train CNN's / Rotation and Mirroring

i am thinking about using a CNN to classify certain images from industrial production, like scratches, stain, particles etc. the problem is we don't have many images. We only get around 10 parts with ...
0
votes
1answer
19 views

Caret + RStudio: Error “Please make sure `y` is a factor or numeric value” when training

I'm new to Caret and I've been trying a couple things to get the hang of things. But this error happened to me and I'm not sure why. I've been trying to train a model with some data I got from "...
1
vote
1answer
21 views

Wave form analysis ML algorithm [closed]

I am trying to determine a person's emotions from their speech. This immediately rings Machine Learning bells and the first step in any ML problem is getting and processing data. My first question is, ...
1
vote
1answer
36 views

What are common ways to identify subject and object from a question?

I am looking for a way to extract the potential subject and object from a question in French. For the moment, I am building some handmade rules. Alternatively, I started to think of using an already ...
1
vote
1answer
32 views

How can I improve a machine learning model?

I am a Machine learning newbie and i am trying my hands with a dataset which has 9 features and my aim is to figure out the optimal multi class classification model which fits my dataset. I applied ...
2
votes
1answer
19 views

Batch normalization vs batch size

I have noticed that my performance of VGG 16 network gets better if I increase the batch size from $64$ to $256$. I have also observed that, using batch size $64$, ...
0
votes
1answer
43 views

Nearest Neighbors on mixed data types in high dimensions

I would like to be able to use nearest neighbors to attempt to find the most similar samples to a subclass of samples (think treated vs untreated) in a dataset with continuous, categorical, and text ...
1
vote
2answers
42 views

Suggest an order to read data science books [closed]

I'm an undergraduate student that is currently studing data science. However, since we generally don't delve deeply onto things in class, I want to take some time to review the fundamentals and ...
0
votes
1answer
60 views

Concept of Cross-Entropy [closed]

Can anyone say the cross entropy Conceptually in machine learning for selecting best features, in simple way? I confused about that. You do not really understand something unless you can explain it ...
1
vote
2answers
34 views

Multi Class Classification on large dataset with over 600 classes

I'm trying to train a text data for multi class classification which comprises of 1 Million rows. After cleaning the data, I'm using a sparse matrix of Word2Vec features (Feature size is 300) The ...
0
votes
0answers
10 views

Hierarchical clustering algorithm for data matrix

Let's assume that a set of five vectors $x_1, x_2,...,x_5$, with readily computed pairwise distances $d(x_i,x_j)$ given in the following matrix: \begin{bmatrix} 0 & 4 & 9 & 6 & 5\\ 4 &...
3
votes
1answer
42 views

How to prefer no choice instead of bad choice with sklearn decision tree

I'm using sklearn decision trees to classify documents in two possible types "type1" and "type2". I've isolated few features that seem pertinent and tried to combine them manually to evaluate the ...
0
votes
3answers
53 views

In a binary classification, should the test dataset be balanced?

I have a dataset with 4519 samples labeled as "1", and 18921 samples labeled as "0" in a binary classification exercise. I am well aware that during the training phase of a classification algorithm (...
0
votes
0answers
21 views

Modeling data for Machine Learning

I am a beginner in machine learning and i struggle with understanding of how can i structure my data or get useful data to solve my problem or if it's even possible or needed with machine learning. ...
0
votes
1answer
12 views

During a regression task, I am getting low R^2 values, but elementwise difference between test set and prediction values is huge

I am doing a random forest regression on my dataset (which has abut 15 input features and 1 target feature). I am getting a decently low R^2 of <1 for both the train and test sets (please do let me ...
1
vote
1answer
14 views

Advice on what Machine Learning Algorithms to study for a Job to candidate matching algorithm

I have asked in a few places and this seems to get down voted for some reason. If this is not the place to ask this then some advice on how and where to ask it would be appreciated. I'm creating a ...
1
vote
1answer
28 views

Activation Functions

What is the purpose of linear activation functions in keras, isn't the entire point of activation functions to introduce non-linearity?
1
vote
2answers
27 views

data pre-processing before image classification

I'm working on a machine learning project, Images classification (shape: 100 x 100)-> (vector of 10000), I did some pre-processing before applying decision trees algorithm , I got an accuracy of 55 % ...
4
votes
2answers
47 views

Why Decision trees performs better than logistic regression [closed]

I'm working on a machine learning project, a classification of (100 x 100) Images (every pixel contains 0 or 255), my training set contains 10000 examples (which I split into 2 parts 80% training/20% ...
0
votes
0answers
15 views

consine similarity results are high

I have vectors of length 160, and I'm trying to measure the cosine similarity between they. Each value in the vector represents a feature (frequency of words in lexicons), so most (not all; to give ...
1
vote
2answers
29 views

Running an LSTM with Music Data

I'm working on a project for a class where I'm trying to create an algorithm that learns music and creates its own music. I'm having trouble on how to set up the data for it to be inputted into the ...
1
vote
0answers
19 views

LSTM data scaling formula based on range

I am planning to run LSTM for a prediction project which has the following input ...
0
votes
1answer
19 views

Multi-Class Text Classification: Doc2Vec performing very bad compared to Hashing Vector

I have a multi-class text classification problem in hand this is similar to product category mapping where we map products to its correct Category based on the text content provided. I first created ...
0
votes
0answers
16 views

multiple hypothesis testing in machine learning

I am working with a dataset with multiple measurements at different time points, and outcomes at each time point. I have been asked by my supervisor to predict the outcomes at later timepoints using ...
0
votes
0answers
8 views

What algorithm I should use if I want to find periodical pattern and forecast next period?

I want to forecast the frequency which user write its file. For example: user access A.file 50 times in Monday and Saturday, and user access it 25 times in other days. If I fit the model with Monday,...
0
votes
0answers
12 views

Questions about Backpropagation Through Time for Gated Recurrent Unit?

I'm trying to implement it myself so I can understand it more. I ended up deriving the gradients myself. So my understanding is that if $t=T$ is the terminal time index, and suppose you have forward ...
0
votes
0answers
6 views

dataset for human memory modelling and spaced repetition

I'm working with a trainable model of the human memory. The linked paper sets up a decay function to model how you slowly forget information between repetition sessions. Their spaced repetition ...
0
votes
0answers
6 views

Learning PyOpenCL and PyCuda for parallel processing

Hello data scientists, I'm trying to learn OpenCL and CUDA, especially Python + OpenCL/CUDA, and how to write some decent beginner programs. I've done vector add, and basics like that. There seems ...