All Questions

Filter by
Sorted by
Tagged with
2
votes
2answers
2k views

How to calculate classification accuracy with confusion matrix?

I have Train and Test data, how to calculate classification accuracy with confusion matrix ? Thanks ...
6
votes
4answers
190 views

Business exception reporting

I work in an analytical role at a a large financial services firm. We do a ton of daily reporting over metrics that rarely change in a meaningful way from day to day. From this daily reporting, our ...
2
votes
0answers
856 views

pandas dataframes memory [closed]

I have a question about memory usage. I want to do 4 things: ...
2
votes
4answers
6k views

Small project ideas for Machine Learning [closed]

I need some serious help. I am supposed to implement a project (Non-Existing as of now) for my Machine Learning course. I have no basics in AI or Data mining or Machine learning. I have been searching ...
6
votes
1answer
191 views

Clustering strings inside strings?

I am not sure whether I formulated the question correctly. Basically, what I want to do is: Let's suppose I have a list of 1000 strings which look like this: cvzxcvzxstringcvzcxvz ...
4
votes
1answer
789 views

MovieLens data set

I want to analyze MovieLens data set and load on my machine the M1 file. I combine actually two data files (ratings.dat and movies.dat) and sort the table according ...
2
votes
1answer
394 views

Which packages or functions can I use in R to plot 3D data like this?

There're many data points, each of which is associated with two coordinates and a numeral value, or three coordinates. And I wish it is coloured. I checked packages "scatterplot3d" and "plot3D" but I ...
11
votes
3answers
6k views

Field Aware Factorization Machines

Can anyone explain how field-aware factorization machines (FFM) compare to standard Factorization Machines (FM)? Standard: http://www.ismll.uni-hildesheim.de/pub/pdfs/Rendle2010FM.pdf "Field Aware": ...
4
votes
2answers
243 views

Distributed Scalable Decision Trees

Are there any good sources that explain how decision trees can be implemented in a scalable way on a distributed computing system. Where in a given source is this explained?
6
votes
1answer
6k views

Bayes Optimal Decision Boundaries for Gaussian Data with Equal Covariance

I am drawing samples from two classes in the two-dimensional Cartesian space, each of which has the same covariance matrix $[2, 0; 0, 2]$. One class has a mean of $[1.5, 1]$ and the other has a mean ...
14
votes
1answer
6k views

On-line random forests by adding more single Decisions Trees

A Random Forest (RF) is created by an ensemble of Decision Trees's (DT). By using bagging, each DT is trained in a different data subset. Hence, is there any way of implementing an on-line random ...
6
votes
2answers
1k views

Machine Learning - Where is the difference between one-class, binary-class and multinominal-class classification?

Where is the difference between one-class, binary-class and multinominal-class classification? If I like to classify text in lets say four classes and also want the system to be able to tell me that ...
1
vote
0answers
48 views

Machine Learning - Where is the difference between one-class, binary-class and multinominal-class classification? [duplicate]

Where is the difference between one-class, binary-class and multinominal-class classification? If I like to classify text in lets say four classes and also want the system to be able to tell me that ...
1
vote
1answer
8k views

Masters thesis topics in big data

I am looking for a thesis to complete my master M2, I will work on a topic in the big data's field (creation big data applications), using hadoop/mapReduce and Ecosystem ( visualisation, analysis ...),...
1
vote
1answer
1k views

Energy consumption time series forcasting

Is there a good java library for doing time series energy consumption forecasting based on weather data and other variables?
4
votes
9answers
3k views

Python and R good tutorials? [closed]

I would like to learn both Python and R for usage in data science projects. I am currently unemployed, fresh out of university, scouting around for jobs and thought it would be good if I get some ...
3
votes
1answer
4k views

R Script to generate random dataset in 2d space

I want to analyze the effectiveness and efficiency of kernel methods for which I would require 3 different data-set in 2 dimensional space for each of the following cases: BAD_kmeans: The data set ...
2
votes
3answers
336 views

Differences in scoring from PMML model on different platforms

I've built a toy Random Forest model in R (using the German Credit dataset from the caret ...
1
vote
0answers
481 views

Masters thesis topics in Applied probability and Probabilistic models in Machine Learning [closed]

I'm looking for a topic for my masters thesis. Machine learning is my primary domain and I want to work on probabilistic models and applied probability in Machine Learning. Please suggest some ...
10
votes
2answers
2k views

Scalable Outlier/Anomaly Detection

I am trying to setup a big data infrastructure using Hadoop, Hive, Elastic Search (amongst others), and I would like to run some algorithms over certain datasets. I would like the algorithms ...
2
votes
2answers
326 views

Regression Model for explained model(Details inside)

I am kind of a newbie on machine learning and I would like to ask some questions based on a problem I have . Let's say I have x y z as variable and I have values of these variables as time progresses ...
2
votes
1answer
177 views

what is buyer classification problem?

Recently in a data analytic job interview for an e-commerce site, they asked me, do i have some knowledge of buyer classification problem. Unfortunately i heard this term for the first time. After ...
6
votes
1answer
232 views

Is it possible to identify different queries/questions in sentence?

I want to identifies different queries in sentences. Like - Who is Bill Gates and where he was born? or ...
2
votes
1answer
68 views

Adaptive regression parameter estimation in R

How would I do parameter estimation and prediction for the adaptive regression model using R, as in the 4th page of the paper linked below? http://papers.ssrn.com/sol3/papers.cfm?abstract_id=923635 ...
3
votes
0answers
39 views

What are the parameter estimation methods for the two methods in this paper?

Automated Time Series Forecasting for Biosurveillance in the above paper, page 4, two models, non-adaptive regression model, adaptive regression model, the non-adaptive regression model's parameter ...
5
votes
2answers
1k views

What is the best Data Mining algorithm for prediction based on a single variable?

I have a variable whose value I would like to predict, and I would like to use only one variable as predictor. For instance, predict traffic density based on weather. Initially, I thought about using ...
28
votes
10answers
25k views

Any Online R console?

I am looking for an online console for the language R. Like I write the code and the server should execute and provide me with the output. Similar to the website Datacamp.
1
vote
2answers
3k views

What is the state of the art in the field of NLP? [closed]

I am new to Natural Language Processing, I think NLP is a challenging field, the syntax and semantic ambiguities could cause a lot of problems. For example I think for these problems machine ...
1
vote
2answers
147 views

“Hadoop” formats for user database: online advertising

I was wondering if someone could point me to suitable database formats for building up a user database: basically I am collecting logs of impressions data, and I want to compile a user database ...
7
votes
5answers
655 views

Where to start on neural networks

First of all I know the question may be not suitable for the website but I'd really appreciate it if you just gave me some pointers. I'm a 16 years old programmer, I've had experience with many ...
6
votes
1answer
161 views

How to do this complicated data extrapolation, prediction modeling?

I have some very complicated data about some movie sales online, first for each data entry, I have a key which is a combination of five keys, which are territory, day, etc, and then, for each key I ...
4
votes
3answers
3k views

Single Layer Perceptron with three classes

I need some help with a single layered perceptron with multiple classes. What I need to do is classify a dataset with three different classes, by now I just learnt how to do it with two classes, so I ...
26
votes
3answers
2k views

Why are NLP and Machine Learning communities interested in deep learning?

I hope you can help me, as I have some questions on this topic. I'm new in the field of deep learning, and while I did some tutorials, I can't relate or distinguish concepts from one another.
10
votes
2answers
8k views

Stochastic gradient descent based on vector operations?

let's assume that I want to train a stochastic gradient descent regression algorithm using a dataset that has N samples. Since the size of the dataset is fixed, I will reuse the data T times. At each ...
12
votes
1answer
5k views

Hashing Trick - what actually happens

When ML algorithms, e.g. Vowpal Wabbit or some of the factorization machines winning click through rate competitions (Kaggle), mention that features are 'hashed', what does that actually mean for the ...
6
votes
3answers
154 views

Can we quantify how position within search results is related to click-through probability?

Suppose, for example, that the first search result on a page of Google search results is swapped with the second result. How much would this change the click-through probabilities of the two results? ...
4
votes
3answers
209 views

Collaborative Social Network Visualization

I do movement building work for Effective Altruism (http://en.m.wikipedia.org/wiki/Effective_altruism), and would like to level up our growth strategy. It occurred to me that a social network ...
5
votes
2answers
11k views

Methods for standardizing / normalizing different rank scales

I know there is the normal subtract the mean and divide by the standard deviation for standardizing your data, but I'm interested to know if there are more appropriate methods for this kind of ...
1
vote
1answer
44 views

how to get the Polysemes of a word in wordnet or any other api?

how to get the Polysemes of a word in wordnet or any other api. I am looking for any api. with java any idea is appreciated?
6
votes
2answers
8k views

Cosine Similarity for Ratings Recommendations? Why use it?

Lets say I have a database of users who rate different products on a scale of 1-5. Our recommendation engine recommends products to users based on the preferences of other users who are highly similar....
8
votes
2answers
140 views

Union grouping in bipartite graphs?

I'm trying to figure out a good (and fast) solution to the following problem: I have two models I'm working with, let's call them players and teams. A player can be on multiple teams and a team can ...
2
votes
1answer
398 views

data processing, correlation calculation

I have product purchase count data which looks likes this: user item1 item2 a 2 4 b 1 3 c 5 6 ... ... ... These data are ...
4
votes
1answer
2k views

Scikit Learn Logistic Regression Memory Leak

I'm curious if anyone else has run into this. I have a data set with about 350k samples, each with 4k sparse features. The sparse fill rate is about 0.5%. The data is stored in a ...
9
votes
7answers
6k views

Career switch to Big Data Analytics

I am a 35 year old IT professional who is purely technical. I am good at programming, learning new technologies, understanding them and implementing. I did not like mathematics at school, so I didn't ...
11
votes
2answers
391 views

Book keeping of experiment runs and results

I am a hands on researcher and I like testing out viable solutions, so I tend to run a lot of experiments. For example, if I am calculating a similarity score between documents, I might want to try ...
4
votes
2answers
3k views

machine learning algorithms for 2d data?

I'm looking for a supervised learning algorithm that can take 2d data for input and output. As an example of something similar to my data, consider a black image with some sparse white dots. Blur that ...
3
votes
1answer
65 views

What circumstances causes two different classifiers to classify data exactly like one another

Okay, here is the background: I am doing text mining, and my basic flow is like this: extract feature (n-gram), reduce feature count, score (tf-idf) and classify. for my own sake i am doing comparison ...
1
vote
2answers
887 views

Recommended Language/Framework for Building a New Recommendation Engine

Next week I'm going to begin prototyping a recommendation engine for work. I've implemented/completed the Netflix Challenge in Java before (for college) but have no real idea what to use for a ...
-1
votes
2answers
962 views

NLP lab, linux or windows and which programming languages? [closed]

I would like to do some data mining and NLP experiments to do some research I have decided to use NLTK or related tools and software Which environment or operating system do you suggest for my ...
10
votes
3answers
2k views

How can I classify text considering word order, instead of just using a bag-of-words approach?

I've made a Naive Bayes classifier that uses the bag-of-words technique to classify spam posts on a message board. It works, but I think I could get much better results if my models considered the ...

15 30 50 per page
1
574 575
576
577 578
584