Questions tagged [dataset]

A dataset is a collection of data, often in tabular or matrix form. This tag is NOT intended for data requests ("where can I find a dataset about ...") --> see OpenData

Filter by
Sorted by
Tagged with
2
votes
1answer
131 views

Data cleaning: Relationships between columns

I have a training data set distributed in two files. File 1: This contains actual classification for each X1. X1 is unique in this file. X1 has one-to-one relationship with X2, i.e. X2 is also unique....
0
votes
1answer
87 views

new and fresh ideas with stack exchange dataset [closed]

I'm a new bee for data analysis . i need to work on a research project in big data analysis. first of all i search for a dataset and i found interest in stack exchange data dump. however i browse for ...
2
votes
1answer
1k views

InterquartileRange takes up most instances in data set

I'm very new to this community, so please overlook my noobness. I have a data set with 2948 instances and I tried to remove outliers using InterquartileRange filter in Weka. The issue is that the ...
10
votes
3answers
724 views

Network analysis classic datasets

There are several classic datasets for machine learning classification/regression tasks. The most popular are: Iris Flower Data Set; Titanic Data Set; Motor Trend Cars; etc. But does anyone know ...
4
votes
1answer
911 views

What types of features are used in a large-scale click-through rate prediction problem?

Something that I often see in papers (example) about large-scale learning is that click-through rate (CTR) problems can have up to a billion of features for each example. In this Google paper the ...
3
votes
1answer
1k views

Pre-processing (center, scale, impute) among training sets (different forms) and the test set - what is a good approach?

I am currently working on a multi-class classification problem with a large training set. However, it has some specific characteristics, which induced me to experiment with it, resulting in few ...
0
votes
1answer
453 views

Identity covariance matrix, decorrelated data?

Why would you want to decorrelated data? As I am reading about PCA and whitening on image data for DNN, I wonder what is the purpose of achieving the identity covariance matrix in your data is? Is ...
2
votes
1answer
5k views

What is the best way to scale a numerical dataset [closed]

I have a dataset with differents attributes which don't have the same range on their values which is a problem when we need to compute distance beetween objects. After some research i found that i can ...
1
vote
2answers
758 views

Appropriate way to store data in R

I have data, which looks like this: These data are only for one subject. I will have a lot more. These data will be analyzed in R. Now I'm storing them like this: ...
4
votes
2answers
202 views

Where did this NY Times op-ed get his Google Search data?

I hope this is a question appropriate for SO. The article in question: http://www.nytimes.com/2015/01/25/opinion/sunday/seth-stephens-davidowitz-searching-for-sex.html As far as I can tell, the only ...
1
vote
1answer
820 views

Measuring similarity for sets with same cardinality

The Jaccard coefficient measures similarity between finite sample sets, and is defined as the size of the intersection divided by the size of the union of the sample sets. I had 100 sets all of same ...
1
vote
1answer
2k views

Time series change rate calculations for displaying trend line chart

I'm struggling to find a solution to produce a line chart which shows a trend from a Time Series metric. I try to make my line chart look similar to the following: Basically, I want to make use of ...
2
votes
2answers
197 views

How to make an effective sampling from a database of text documents?

Problem: I want to know methods to perform an effective sampling from a database. The size of the database is about 250K text documents and in this case each text ...
2
votes
3answers
964 views

OCR / Text Recognition and Recovery Problem

I am working on a research project that deals with American military casualties during WWII. Specifically, I am attempting to construct a count of casualties for each service at the county level. ...
3
votes
1answer
102 views

Trouble representing a problem

I have a problem and I'm having trouble representing it - first I thought I should use graph theory (nodes and edges) and now I'm not sure. My data is some tanks names and it's volumes, those tanks ...
4
votes
3answers
9k views

Large categorical dataset for regression

I need to collect several large datasets (thousands of samples, dozens of features) for regression with only categorical inputs. I already look for such datasets in the UCI repository, but I did not ...
0
votes
2answers
417 views

Data transposition code in R

I've been working in SAS for a few years but as my time as a student with a no-cost-to-me license comes to an end, I want to learn R. Is it possible to transpose a data set so that all the ...
2
votes
0answers
86 views

Cross-sell models and additional holders

I would like to pose a question about how to treat additional holders in the propensity-to-buy models of banking products. Up to now I was only taking into considerations the clients as first holders....
3
votes
2answers
953 views

API for historical housing prices

I'm looking for an (ideally free) API that would have time series avg/median housing prices by zip code or city/state. Quandl almost fits the bill, but it returns inconsistent results across ...
8
votes
1answer
211 views

Evaluating Recommendation engines

What is the standard way for evaluating and comparing different algorithms while developing recommendation system? Whether we need to have a predetermined annotated ranked dataset and then compare ...
3
votes
1answer
290 views

Confused about description of YearPrediction Dataset

https://archive.ics.uci.edu/ml/datasets/YearPredictionMSD According to the description given in the above link, the Attribute information specifies "average and covariance over all 'segments', each ...
2
votes
2answers
244 views

DBPedia as Table not having all the properties

I browsed a sample for available data at http://dbpedia.org/page/Sachin_Tendulkar. I wanted these properties as columns, so I downloaded the CSV files from http://wiki.dbpedia.org/DBpediaAsTables. ...
2
votes
0answers
315 views

Creating Data model for mahout recommendation engine

I am trying to build an item-item similarity matching recommendation engine with mahout. The data set is as in the following format ( attributes are in text not in numerals format ) ...
3
votes
1answer
3k views

Data sets for evaluating text retrieval quality [closed]

I'm searching for data sets for evaluating text retrieval quality. TF-IDF is a popular similarity measure, but is it the best choice? And which variant is the best choice? Lucenes Scoring for example ...
8
votes
2answers
894 views

Matrix properties and machine learning/data mining

I'm doing some data analysis in a Statistical Pattern Recognition course using PRML. We analyzed a lot of matrix properties, like eigenvalues, column independence, positive semi-definite matrix, etc. ...
4
votes
1answer
787 views

MovieLens data set

I want to analyze MovieLens data set and load on my machine the M1 file. I combine actually two data files (ratings.dat and movies.dat) and sort the table according ...
3
votes
1answer
5k views

R aggregate() with dates

I am working on a data set that has multiple traffic speed measurements per day. My data is from the city of chicago, and it is taken every minute for about six months. I wanted to consolidate this ...
4
votes
3answers
3k views

Single Layer Perceptron with three classes

I need some help with a single layered perceptron with multiple classes. What I need to do is classify a dataset with three different classes, by now I just learnt how to do it with two classes, so I ...
1
vote
1answer
64 views

Versatile data structure for combined statistics

Not sure if this is Math, Stats or Data Science, but I figured I would post it here to get the site used. As a programmer, when you have a system/component implemented, you might want to allow some ...
1
vote
0answers
34 views

Freebase Related Models [closed]

It may be unlikely that anyone knows this but I have a specific question about Freebase. Here is the Freebase page from the Ford Taurus automotive model . It has a property called "Related Models". ...
1
vote
0answers
28 views

Apps to manage/host data sets [closed]

I'm looking for the best solution to manage and host datasets for journalistic pursuits. I am assessing https://www.documentcloud.org and http://datahub.io/. Can anyone explain the differences ...
1
vote
0answers
42 views

Subgraph isomorphism and Anti-monotone property

While finding frequent subgraphs in single large graph, subgraph isomorphism (test) is not considered because its not anti-monotone. How and why subgraph isomorphism is not anti-monotone ?
13
votes
6answers
623 views

Datasets understanding best practices

I am a CS master student in data mining. My supervisor once told me that before I run any classifier or do anything with a dataset I must fully understand the data and make sure that the data is clean ...
8
votes
4answers
1k views

Job title similarity

I'm trying to define a metric between job titles in IT field. For this I need some metric between words of job titles that are not appearing together in the same job title, e.g. metric between the ...
2
votes
1answer
134 views

Getting GitHub repository information by different criteria

New to the Data Science forum, and first poster here! This may be kind of a specific question (hopefully not too much so), but one I'd imagine others might be interested in. I'm looking for a way to ...
3
votes
1answer
1k views

Data preparation and machine learning algorithm for click prediction

I am new to machine learning. I have a task at hand of predicting click probability given user information like city, state, OS version, OS family, device, browser family, browser version, etc. I have ...
5
votes
2answers
196 views

Techniques for trend extraction from unbalanced panel data

My data set is formatted like this: User-id | Threat_score aaa 45 bbb 32 ccc 20 The list contains the top 100 users with the highest threat ...

1
19 20 21 22
23