People who code: we want your input. Take the Survey

Questions tagged [machine-learning]

Machine Learning is a subfield of computer science that draws on elements from algorithmic analysis, computational statistics, mathematics, optimization, etc. It is mainly concerned with the use of data to construct models that have high predictive/forecasting ability. Topics include modeling building, applications, theory, etc.

Filter by
Sorted by
Tagged with
0
votes
1answer
619 views

identifying input sequence using neural network

I fount simple neural scenario sayinh : network having 3 layers, 3 inputs and 2 outputs. It should be trained to recognize a simple pattern - if inputs are correspondingly 6.0,7.0 and 8.0 then outputs ...
2
votes
0answers
3k views

Error::Type of predictors in new data do not match that of the training data

I am building a classification model using randomForest. When trying to predict I get the below error Type of predictors in new data do not match that of the ...
3
votes
2answers
355 views

Is our data “Big Data” (Startup)

I worked at a startup/medium sized company and I am concerned that we may be over-engineering one of our products. In essence, we will be consuming real-time coordinates from vehicles and users and ...
2
votes
1answer
100 views

Adaptive learning of user's IoT setting preferences

We are working on a project to Predict the settings of the IoT devices(fan/light/AC) the user is using, based on his: location, outside temperature, humidity, time of the day etc... Training data is ...
3
votes
0answers
74 views

Train a classifier for a game with feedback on chosen move instead of true labels

I'm having some trouble describing in one line what I want, which is probably why I haven't had much luck with Google. Say I have a game like 2048 where the possible actions each step are fixed (and ...
2
votes
2answers
1k views

Combining Datasets with Different Features

I have multiple datasets, with slightly differing features. What tools can I use to make this a homogeneous dataset? Dataset1: ...
6
votes
2answers
1k views

Why should I care about seasonal data when I forecast?

I have a timeseries with hourly gas consumption. I want to use ARMA/ARIMA to forecast the consumption on the next hour, basing on the previous. Why should I analyze/find the seasonality (with Seasonal ...
6
votes
2answers
13k views

Python or R for implementing machine learning algorithms for fraud detection [closed]

I was wondering which language can I use: R or Python, for my internship in fraud detection in an online banking system: I have to build machine learning algorithms (NN, etc.) that predict transaction ...
4
votes
2answers
122 views

Deriving Confidences from Distribution of Class Probabilities for a Prediction

I run into this problem from time to time and have always felt like there should be an obvious answer. I have probabilities for potential classes (from some classifier). I will offer the prediction ...
2
votes
2answers
235 views

Spam detection in social media

I want to train a binary classification algorithm for spam detection using labeled data set of mentions from social media. These mentions have the following features: URL, text message, posting ...
2
votes
1answer
115 views

Machine learning for state-based transforms?

If I provide: A list of possible transforms, and, A list of input states, and, A corresponding list of output states for each input state, and, A fitness function to score each output state Which ...
1
vote
0answers
205 views

Find correlation in observed data

I have a method that calculates a certain variable. This variable is biased by an error which should be related to the observables that were used to calculated the variable. I don't have an exact ...
5
votes
1answer
141 views

Learn and sample from a generative model with 2000 boolean features

My data is a set of about 1 million training examples, where each example is represented by about 2000 boolean features. Examples aren't labelled - it wouldn't really have any meaning in this domain. ...
5
votes
2answers
114 views

Bigdata cluster compatible distributed predictive model

I might be asking a dumb question but my question is can I write a python program (lets say a classifier) using some library that scales in hadoop (not only using a simple parallel processing).The ...
1
vote
0answers
154 views

Problem while reusing model for new observations

I want to build a model using R, save it and reloading it when required. I am able to save the model and reload it without any problem, however when i use the model along with predict statement, I am ...
3
votes
1answer
565 views

Most important part of feature standardization and how is standardization affected by sparsity?

I am thinking of preprocessing techniques for the input data to a convolutional neural network (CNN) using sparse datasets and trained with SGD. In Andrew Ng's coursera course, Machine Learning, he ...
3
votes
2answers
470 views

Adjusting Probabilities When Using Alternative Cutoffs For Classification

I am reading Applied Predictive Modeling by Max Khun. I chapter 16 he discusses using alternate cutoffs as a remedy for class imbalance. Suppose our model predicts the most likely outcome of 2 events,...
2
votes
2answers
356 views

What should I care about while stacking as an ensemble method?

I'm using SMO, Logistic Regression, Bayesian Network and Simple CART algorithms for classification. Results form WEKA: ...
2
votes
1answer
416 views

Scalable open source machine learning library written in python

I believe sci kit learn is written in python,however that not scalable.Spark mlib or ml is scalabale but written in scala.I am looking for an ongoing effort where a machine learning library is being ...
2
votes
2answers
5k views

What is the actual output of Principal Component Analysis?

I'm trying to understand PCA, but I don't have a machine learning background. I come from software engineering, but the literature I've tried to read so far is hard for me to digest. As far as I ...
1
vote
0answers
47 views

Trying to come up with a feature to improve emotion classifier based on facial movement using facial landmarks

I managed to create an emotion recognition system that uses dense optical flow on each entire frame. While the accuracy range is within 80-90% with cross-validation, I am aiming to improve the ...
0
votes
1answer
4k views

What are the performance measures in the neural networks field?

I constructed a neural networks in R using neuralnet package. I want to test that using cross-validation, that is a technique based on using 4/5 of the dataset to ...
0
votes
1answer
935 views

Cross validation for C5.0 algorithm

I want to try K-fold cross validation in R for C5.0 algorithm, The following is the code i use. Can someone suggest me how can i include k-fold as well? Classifi_C5.0 <- C5.0(TARGET ~., , data = ...
1
vote
2answers
595 views

How to speed up optimization using Differential Evolution?

My application is high frequency trading. My data are time series of the bid and ask prices of a stock recorded on every tick (change in price). For each data point I also have a certain indicators ...
1
vote
0answers
86 views

How to include class as a feature

I am currently experimenting with the idea of including the class of a feature vector as a separate feature. My work is about preposition selection in learner language use. I want to train a ...
3
votes
1answer
170 views

Predict set elements based on other elements

Sorry if this has been answered before but could someone help me with solving the following problem: Each symbol in a dataset has a set of labels. Given a set of labels how can we predict more labels ...
4
votes
3answers
1k views

What is the right algorithm to detect segmentations of a line chart?

To be concrete, given 2D numerical data as is shown as line plots below. There are peaks on a background average movement (with small vibrations). We want to find the values of pairs (x1, x2) if those ...
7
votes
1answer
2k views

How to extract features and classify alert emails coming from monitoring tools into proper category?

My company provides managed services to a lot of its clients. Our customers typically uses following monitoring tools to monitor their servers/webapps: OpsView Nagios Pingdom Custom shell scripts ...
2
votes
1answer
3k views

How to combine two different random forest models into one in R?

I have two different dataset with same variables. I have built training models separately using random forest. Now i want to combine both these models. Could anyone tell me how can i this be achieved? ...
8
votes
4answers
1k views

Online machine learning tutorial

Does anyone know some good tutorials on online machine learning technics? I.e. how it can be used in real-time environments, what are key differences compared to normal machine learning methods etc. ...
2
votes
0answers
164 views

Debugging Neural Network for (Natural Language) Tagging

I've been coding a Neural Network for recognizing and tagging parts of speech in English (written in Java). The code itself has no 'errors' or apparent flaws. Nevertheless, it is not learning -- the ...
4
votes
3answers
195 views

Is it ok to interprete PCA plot this way?

I have several samples (C2, C4, C5) and want to check if they are at a certain stage. I included some known samples (D0 - D77) which were generated at different stages by another lab. In the PCA plot, ...
1
vote
1answer
682 views

Difference between OLS(statsmodel) and Scikit Linear Regression

I have a question about two different methods from different libraries which seems doing same job. I am trying to make linear regression model. Here is the code which I using statsmodel library with ...
4
votes
1answer
162 views

Why are HMMs called linear-chain?

I found in many sources that Hidden Markov Models are linear-chain networks(e.g. in Predicting Structured Data book by MIT). However, as I understand it, HMMs can have any edges in its graph. Even ...
9
votes
2answers
453 views

Relationship between VC dimension and degrees of freedom

I'm studying machine learning and I feel there is a strong relationship between the concept of VC dimension and the more classical (statistical) concept of degrees of freedom. Can anyone explain such ...
2
votes
0answers
1k views

Caffe net.predict() outputs random results (GoogleNet)

I used pretrained GoogleNet from https://github.com/BVLC/caffe/tree/master/models/bvlc_googlenet and finetuned it with my own data (~ 100k images, 101 classes). After one day training I achieved 62% ...
1
vote
0answers
35 views

How to extract the values used in columns by a Classification model in R?

I want to find the variables (and its values) used to build a classification model? I came to know that the following code does the same get_all_vars(model_built, dataset_used_for_building_a_model) ...
3
votes
1answer
713 views

Text classification: Choosing training and testing set for each category

I am very new to machine learning. I have a text classification problem in hand. I have a tagged dataset of around 750 documents( short texts), categorized manually into 16 buckets. I want to train a ...
0
votes
1answer
3k views

rpart and rpart2

I'm not sure if this is more appropriate for SO or DS in Stack Exchange since technically it's not about coding: in caret package for training in R, it's possible ...
0
votes
1answer
946 views

Machine Learning Startup Ideas [closed]

I just started using machine learning and was wondering if anybody have cool ideas for a Startup project, I've seen this website Treato and was amazed by it. Thanks.
3
votes
2answers
4k views

Where does the sum of squared errors function in neural networks come from?

Training a basic multilayer perceptron neural network boils down to minimizing some kind of error function. Often the sum of squared errors is chosen as a this error function, but where does this ...
1
vote
1answer
1k views

Create a prediction formula from data input

I have an algorithm which have as an input about 20-25 numbers. Then in every step it uses some of these numbers with a random function to calculate the local result which will lead to the final ...
5
votes
1answer
510 views

Comparing accuracy of models in ordinal regression / classification

I am looking into creating a model to predict whether an item is "Very Good", "Good", "Bad" or "Very Bad". After I fit the training data to the models, comparing the accuracy of the models during ...
3
votes
1answer
448 views

Finding user similarities within informal data sets

I'm new to all this and am putting together a learning project. I've decided on finding similarities between users in a data set such as http://en.wikipedia.org/wiki/Enron_Corpus. After doing a bit of ...
2
votes
0answers
503 views

Where can I download a tagged dataset of text related to finance, programming, analytics etc.? [closed]

I want to create and train a model which classifies a new text content into finance, programming, analytics, design etc. Where can I get a relevant dataset to train my models? TIA.
2
votes
1answer
1k views

Random Forest, Type - Regression, Calculation of Importance Example

I am trying to use a Random Forest Model (Regression Type) as a substitute of logistic regression model. I am using R - randomForest Package. I want to understand the meaning of Importance of ...
8
votes
4answers
4k views

How to learn spam email detection?

I want to learn how a spam email detector is done. I'm not trying to build a commercial product, it'll be a serious learning exercise for me. Therefore, I'm looking for resources, such as existing ...
2
votes
3answers
161 views

What possible data products can be built using this dataset [closed]

I have a dataset which contains information about when do people enter and leave a premise. I have the following information in the dataset : Person Id Time of Entry Time of Leaving The dataset has ...
5
votes
2answers
152 views

How to cluster a link traversal dataset

I'm using Google Analytics on my mobile app to see how different users use the app. I draw a path based on the pages they move to. Given a list of paths for say a 100 users, how do I go about ...
1
vote
1answer
328 views

Wordnet Lemmatization

I tried finding about exception lists in wordnet lemmatizers. "Morphy() uses inflectional ending rules and exception lists to handle different possibilities" which I read from http://www.nltk.org/...