Questions tagged [data]
Questions mostly concerned with managing data, without focus on pre-processing or modelling.
868
questions
0
votes
1
answer
82
views
how often should one sample a dataset?
I have some archive data that show the variation of a certain quantity X measured over 1-year intervals.
I'm now facing the problem of understanding how X correlates with another variable Y, that I ...
- 143
3
votes
1
answer
66
views
Establishing data science programs as an independent discipline
What are the benefits of establishing data science programs as an independent discipline rather than creating data scientists in different fields? (for students, universities and the society as a ...
- 930
4
votes
3
answers
1k
views
Deploying machine learning modules
I am looking to find some resources about what I wan't to do :I wan't to make some GUI of my machine learning models and finally deploy them as a web app.I find R Shiny to be somehow ok , but it ...
- 133
1
vote
0
answers
48
views
Generate a set of abstract search terms
I am developing an application for research purposes that uses randomly generated tweets to detect emerging conceptual topics. I need to collect a large amount of them (let's say, beyond 5 million) ...
- 111
3
votes
2
answers
210
views
Domain-specific data science programs
I am looking for domain-specific data science programs (as a major, not a minor or specialization). I found programs in bio-statistics (and other disciplines in public health), MS in marketing ...
- 930
1
vote
1
answer
11k
views
How to generate bootstrapping samples in R?
Here is my original dataset from a voting activity. Each participant voted for one option (A,B,C,D,E,F) listed below. The numerical value is the total number of participants who voted for each option.
...
- 111
1
vote
2
answers
219
views
Data Science education curriculum design and guidelines in Computer Science and other Disciplines
I am studying data science education curriculum design and guidelines. All resources I have up to now is about data science in statistics education and library and information science education.
Is ...
- 930
4
votes
2
answers
1k
views
Recommendations for storing time series data
As part of my thesis I've done some experiments that have resulted in a reasonable amount of time-series data (motion-capture + eye movements). I have a way of storing and organizing all of this data, ...
- 558
1
vote
1
answer
669
views
Data frame mutation in R
I have a data frame of the following format:
Symbol Date Time Profit
$BANKNIFTY 4/1/2010 9:55:00 -1.18%
<br>$BANKNIFTY 4/1/2010 12:30:00 -2.84%
$BANKNIFTY 4/1/2010 12:45:00 7.17%
&...
- 21
4
votes
2
answers
2k
views
Weighted k nearest neighbor search
I've searched quite a bit and haven't landed on any useful results.
The problem statement is:
Given a set of vectors, I wish to find its approximate k-nearest neighbors.
The caveat here is that each ...
- 141
3
votes
1
answer
107
views
Advise on making predictions given collection of dimensions and corresponding probabilities
I am a CS graduate but am very new to data science. I could use some expert advise/insight on a problem I am trying to solve. I've been through the titanic tutorial on gaggle.com which I think was ...
7
votes
1
answer
13k
views
How to preprocess different kinds of data (continuous, discrete, categorical) before Decision Tree learning
I want to use some Decision Tree learning, such as the Random Forest classifier.
I have data of different types: continuous, discrete and categorical. How do I have to preprocess data in order to ...
- 879
2
votes
0
answers
64
views
What proxies could be used to assess economic value of Stackoverflow for its users?
I'm intrigued by the open data provided by StackExchange, and have been running some really interesting queries on the data.stackexchange.com page (using the Stackoverflow dataset).
In particular, I ...
- 23
2
votes
3
answers
710
views
How to store complex tables and structures?
I'm wondering about general approaches to storing complex tables and structures. For example, imagine I have a table like this:
...
- 163
3
votes
1
answer
99
views
Spatial clustering based on response to inputs and building a reduced model
Stats version: I have a few measurements of a function that takes three inputs and produces a few 2D fields of outputs: $f_i(a,b,c;x,y)$, with $f$ being a vector of several quantities. I would like to ...
- 176
4
votes
1
answer
298
views
python - Will this data mining approach work? Is it a good idea?
I need to extract fields like the document number, date, and invoice amount from a bunch of .csv files, which I believe are referred to as "unstructured text." I have some labeled input files and will ...
- 43
5
votes
1
answer
102
views
Finding aggregated information of data
I am new to data science. I have a dataset of around 200,000 records, having 5 columns. There is a field called, class. For each ...
- 335
4
votes
2
answers
168
views
What kind of research can be done with genomic data?
It is well known that science has given us large amounts of free accessible data, such as https://www.1000genomes.org and https://www.ncbi.nlm.nih.gov/genbank. How can we play around with the data and ...
- 3,510