Questions tagged [data]

Questions mostly concerned with managing data, without focus on pre-processing or modelling.

Filter by
Sorted by
Tagged with
4
votes
2answers
774 views

Recommendations for storing time series data

As part of my thesis I've done some experiments that have resulted in a reasonable amount of time-series data (motion-capture + eye movements). I have a way of storing and organizing all of this data, ...
1
vote
1answer
556 views

Data frame mutation in R

I have a data frame of the following format: Symbol Date Time Profit $BANKNIFTY 4/1/2010 9:55:00 -1.18% <br>$BANKNIFTY 4/1/2010 12:30:00 -2.84% $BANKNIFTY 4/1/2010 12:45:00 7.17% &...
2
votes
0answers
656 views

Weighted k nearest neighbor search

I've searched quite a bit and haven't landed on any useful results. The problem statement is: Given a set of vectors, I wish to find its approximate k-nearest neighbors. The caveat here is that each ...
3
votes
1answer
99 views

Advise on making predictions given collection of dimensions and corresponding probabilities

I am a CS graduate but am very new to data science. I could use some expert advise/insight on a problem I am trying to solve. I've been through the titanic tutorial on gaggle.com which I think was ...
5
votes
1answer
9k views

How to preprocess different kinds of data (continuous, discrete, categorical) before Decision Tree learning

I want to use some Decision Tree learning, such as the Random Forest classifier. I have data of different types: continuous, discrete and categorical. How do I have to preprocess data in order to ...
2
votes
0answers
50 views

What proxies could be used to assess economic value of Stackoverflow for its users?

I'm intrigued by the open data provided by StackExchange, and have been running some really interesting queries on the data.stackexchange.com page (using the Stackoverflow dataset). In particular, I ...
2
votes
3answers
413 views

How to store complex tables and structures?

I'm wondering about general approaches to storing complex tables and structures. For example, imagine I have a table like this: ...
2
votes
1answer
87 views

Spatial clustering based on response to inputs and building a reduced model

Stats version: I have a few measurements of a function that takes three inputs and produces a few 2D fields of outputs: $f_i(a,b,c;x,y)$, with $f$ being a vector of several quantities. I would like to ...
3
votes
1answer
271 views

python - Will this data mining approach work? Is it a good idea?

I need to extract fields like the document number, date, and invoice amount from a bunch of .csv files, which I believe are referred to as "unstructured text." I have some labeled input files and will ...
4
votes
2answers
77 views

Finding aggregated information of data

I am new to data science. I have a dataset of around 200,000 records, having 5 columns. There is a field called, class. For each ...
3
votes
2answers
134 views

What kind of research can be done with genomic data?

It's well known that science has given us large amount of free accessible data, such as http://www.1000genomes.org and http://www.ncbi.nlm.nih.gov/genbank. How can we play around with the data and ...