# All Questions

29,153 questions
Filter by
Sorted by
Tagged with
2k views

### How to calculate classification accuracy with confusion matrix?

I have Train and Test data, how to calculate classification accuracy with confusion matrix ? Thanks ...
190 views

### Business exception reporting

I work in an analytical role at a a large financial services firm. We do a ton of daily reporting over metrics that rarely change in a meaningful way from day to day. From this daily reporting, our ...
856 views

### pandas dataframes memory [closed]

I have a question about memory usage. I want to do 4 things: ...
6k views

### Small project ideas for Machine Learning [closed]

I need some serious help. I am supposed to implement a project (Non-Existing as of now) for my Machine Learning course. I have no basics in AI or Data mining or Machine learning. I have been searching ...
191 views

### Clustering strings inside strings?

I am not sure whether I formulated the question correctly. Basically, what I want to do is: Let's suppose I have a list of 1000 strings which look like this: cvzxcvzxstringcvzcxvz ...
789 views

### MovieLens data set

I want to analyze MovieLens data set and load on my machine the M1 file. I combine actually two data files (ratings.dat and movies.dat) and sort the table according ...
394 views

### Which packages or functions can I use in R to plot 3D data like this?

There're many data points, each of which is associated with two coordinates and a numeral value, or three coordinates. And I wish it is coloured. I checked packages "scatterplot3d" and "plot3D" but I ...
6k views

### Field Aware Factorization Machines

Can anyone explain how field-aware factorization machines (FFM) compare to standard Factorization Machines (FM)? Standard: http://www.ismll.uni-hildesheim.de/pub/pdfs/Rendle2010FM.pdf "Field Aware": ...
243 views

### Distributed Scalable Decision Trees

Are there any good sources that explain how decision trees can be implemented in a scalable way on a distributed computing system. Where in a given source is this explained?
6k views

### Bayes Optimal Decision Boundaries for Gaussian Data with Equal Covariance

I am drawing samples from two classes in the two-dimensional Cartesian space, each of which has the same covariance matrix $[2, 0; 0, 2]$. One class has a mean of $[1.5, 1]$ and the other has a mean ...
6k views

### On-line random forests by adding more single Decisions Trees

A Random Forest (RF) is created by an ensemble of Decision Trees's (DT). By using bagging, each DT is trained in a different data subset. Hence, is there any way of implementing an on-line random ...
1k views

### Machine Learning - Where is the difference between one-class, binary-class and multinominal-class classification?

Where is the difference between one-class, binary-class and multinominal-class classification? If I like to classify text in lets say four classes and also want the system to be able to tell me that ...
48 views

### Machine Learning - Where is the difference between one-class, binary-class and multinominal-class classification? [duplicate]

Where is the difference between one-class, binary-class and multinominal-class classification? If I like to classify text in lets say four classes and also want the system to be able to tell me that ...
8k views

### Masters thesis topics in big data

I am looking for a thesis to complete my master M2, I will work on a topic in the big data's field (creation big data applications), using hadoop/mapReduce and Ecosystem ( visualisation, analysis ...),...
1k views

### Energy consumption time series forcasting

Is there a good java library for doing time series energy consumption forecasting based on weather data and other variables?
3k views

### Python and R good tutorials? [closed]

I would like to learn both Python and R for usage in data science projects. I am currently unemployed, fresh out of university, scouting around for jobs and thought it would be good if I get some ...
4k views

### R Script to generate random dataset in 2d space

I want to analyze the effectiveness and efficiency of kernel methods for which I would require 3 different data-set in 2 dimensional space for each of the following cases: BAD_kmeans: The data set ...
336 views

### Differences in scoring from PMML model on different platforms

I've built a toy Random Forest model in R (using the German Credit dataset from the caret ...
481 views

### Masters thesis topics in Applied probability and Probabilistic models in Machine Learning [closed]

I'm looking for a topic for my masters thesis. Machine learning is my primary domain and I want to work on probabilistic models and applied probability in Machine Learning. Please suggest some ...
2k views

### Scalable Outlier/Anomaly Detection

I am trying to setup a big data infrastructure using Hadoop, Hive, Elastic Search (amongst others), and I would like to run some algorithms over certain datasets. I would like the algorithms ...
326 views

### Regression Model for explained model(Details inside)

I am kind of a newbie on machine learning and I would like to ask some questions based on a problem I have . Let's say I have x y z as variable and I have values of these variables as time progresses ...
177 views

### what is buyer classification problem?

Recently in a data analytic job interview for an e-commerce site, they asked me, do i have some knowledge of buyer classification problem. Unfortunately i heard this term for the first time. After ...
232 views

### Is it possible to identify different queries/questions in sentence?

I want to identifies different queries in sentences. Like - Who is Bill Gates and where he was born? or ...
68 views

### Adaptive regression parameter estimation in R

How would I do parameter estimation and prediction for the adaptive regression model using R, as in the 4th page of the paper linked below? http://papers.ssrn.com/sol3/papers.cfm?abstract_id=923635 ...
39 views

### What are the parameter estimation methods for the two methods in this paper?

Automated Time Series Forecasting for Biosurveillance in the above paper, page 4, two models, non-adaptive regression model, adaptive regression model, the non-adaptive regression model's parameter ...
1k views

### What is the best Data Mining algorithm for prediction based on a single variable?

I have a variable whose value I would like to predict, and I would like to use only one variable as predictor. For instance, predict traffic density based on weather. Initially, I thought about using ...
25k views

### Any Online R console?

I am looking for an online console for the language R. Like I write the code and the server should execute and provide me with the output. Similar to the website Datacamp.
3k views

### What is the state of the art in the field of NLP? [closed]

I am new to Natural Language Processing, I think NLP is a challenging field, the syntax and semantic ambiguities could cause a lot of problems. For example I think for these problems machine ...
147 views

### “Hadoop” formats for user database: online advertising

I was wondering if someone could point me to suitable database formats for building up a user database: basically I am collecting logs of impressions data, and I want to compile a user database ...
655 views

### Where to start on neural networks

First of all I know the question may be not suitable for the website but I'd really appreciate it if you just gave me some pointers. I'm a 16 years old programmer, I've had experience with many ...
161 views

### How to do this complicated data extrapolation, prediction modeling?

I have some very complicated data about some movie sales online, first for each data entry, I have a key which is a combination of five keys, which are territory, day, etc, and then, for each key I ...
3k views

### Single Layer Perceptron with three classes

I need some help with a single layered perceptron with multiple classes. What I need to do is classify a dataset with three different classes, by now I just learnt how to do it with two classes, so I ...
2k views

### Why are NLP and Machine Learning communities interested in deep learning?

I hope you can help me, as I have some questions on this topic. I'm new in the field of deep learning, and while I did some tutorials, I can't relate or distinguish concepts from one another.
8k views

### Stochastic gradient descent based on vector operations?

let's assume that I want to train a stochastic gradient descent regression algorithm using a dataset that has N samples. Since the size of the dataset is fixed, I will reuse the data T times. At each ...
5k views

### Hashing Trick - what actually happens

When ML algorithms, e.g. Vowpal Wabbit or some of the factorization machines winning click through rate competitions (Kaggle), mention that features are 'hashed', what does that actually mean for the ...
154 views

### Can we quantify how position within search results is related to click-through probability?

Suppose, for example, that the first search result on a page of Google search results is swapped with the second result. How much would this change the click-through probabilities of the two results? ...
209 views

### Collaborative Social Network Visualization

I do movement building work for Effective Altruism (http://en.m.wikipedia.org/wiki/Effective_altruism), and would like to level up our growth strategy. It occurred to me that a social network ...
11k views

### Methods for standardizing / normalizing different rank scales

I know there is the normal subtract the mean and divide by the standard deviation for standardizing your data, but I'm interested to know if there are more appropriate methods for this kind of ...
44 views

### how to get the Polysemes of a word in wordnet or any other api?

how to get the Polysemes of a word in wordnet or any other api. I am looking for any api. with java any idea is appreciated?
8k views

### Cosine Similarity for Ratings Recommendations? Why use it?

Lets say I have a database of users who rate different products on a scale of 1-5. Our recommendation engine recommends products to users based on the preferences of other users who are highly similar....
140 views

### Union grouping in bipartite graphs?

I'm trying to figure out a good (and fast) solution to the following problem: I have two models I'm working with, let's call them players and teams. A player can be on multiple teams and a team can ...
398 views

### data processing, correlation calculation

I have product purchase count data which looks likes this: user item1 item2 a 2 4 b 1 3 c 5 6 ... ... ... These data are ...
2k views

### Scikit Learn Logistic Regression Memory Leak

I'm curious if anyone else has run into this. I have a data set with about 350k samples, each with 4k sparse features. The sparse fill rate is about 0.5%. The data is stored in a ...
6k views

### Career switch to Big Data Analytics

I am a 35 year old IT professional who is purely technical. I am good at programming, learning new technologies, understanding them and implementing. I did not like mathematics at school, so I didn't ...
391 views

### Book keeping of experiment runs and results

I am a hands on researcher and I like testing out viable solutions, so I tend to run a lot of experiments. For example, if I am calculating a similarity score between documents, I might want to try ...
3k views

### machine learning algorithms for 2d data?

I'm looking for a supervised learning algorithm that can take 2d data for input and output. As an example of something similar to my data, consider a black image with some sparse white dots. Blur that ...
65 views

### What circumstances causes two different classifiers to classify data exactly like one another

Okay, here is the background: I am doing text mining, and my basic flow is like this: extract feature (n-gram), reduce feature count, score (tf-idf) and classify. for my own sake i am doing comparison ...
887 views

### Recommended Language/Framework for Building a New Recommendation Engine

Next week I'm going to begin prototyping a recommendation engine for work. I've implemented/completed the Netflix Challenge in Java before (for college) but have no real idea what to use for a ...