# All Questions

35,961 questions
Filter by
Sorted by
Tagged with
90 views

### Data store for testing data products?

Is there a recommended approach for storing processed data for testing new data products? Basically, I'd like to have a system where a data scientist or an analyst could think of a new data product ...
• 141
1 vote
753 views

### LFR as synthesized data for dynamic community detection methods

In recent methods for community detection in dynamic networks, LFR benchmark is used as dynamic dataset generator, but I thought it is for static community based data generation. For example in paper ...
• 359
965 views

### Building a static local website using Rmarkdown: step by step procedure [closed]

I am trying to understand the procedure of building a static local website using R and Rmarkdown. I am aware of a Rmarkdown website where the procedure is outlined, ...
• 123
1 vote
151 views

### Is it ethical to claim experience with big data when the data isn't a part of the new advertising/social media/retail fad?

Obviously most employers, when hiring a data scientist, would prefer experience with big data and/or data science. But what can one safely assume they will acknowledge as experience? Let's say ...
• 322
1 vote
88 views

### Correct tagging but wrong parse tree

If I parse following sentence: He is playing cricket in ground with grass. with stanford parser, the result is: ...
160 views

### SAS. How to write "OR" [closed]

How to write "OR" in this example? DATA a1; set a; if var1=1 OR 2; run; P.S. va1 is the categorial (with categories: 1, 2, 3)
1 vote
1k views

### Classification of skills based on job ads

I have around 1,000 job ads in the filed of IT (in excel file). I want to find the skills which are mentioned in each of ads. and then find the similar jobs based on skills. My method: I created 12 ...
1 vote
258 views

### Logistic Regression Cost Function Error

with regards to the Logistic Regression cost function of: And hypothesis: Is there a way to tell the +/- of the error for how "confident" the hypothesis is? E.g. if the +/- of the error was 0.1, I ...
• 111
32k views

### Do data scientists use Excel?

I would consider myself a journeyman data scientist. Like most (I think), I made my first charts and did my first aggregations in high school and college, using Excel. As I went through college, ...
• 523
2k views

### Learning resources for data science to win political campaigns?

Does anyone know, where I can learn about applying data science to win a political campaign? I know the Obama campaign had 12 data scientists in 2008 and 165 data scientists in 2012. In 2012, they ran ...
284 views

### What is the term for when a model acts on the thing being modeled and thus changes the concept?

I'm trying to see if there is a conventional term for this concept to help me in my literature research and writing. When a machine learning model causes an action to be taken in the real world that ...
• 83
1 vote
96 views

### how to modify sparse survey dataset with empty data points?

I am working on a data set where the categorical variables have lots of empty spaces (not "NA" but ""). For example, one variable has 14587 empty spaces out of 14644 observations. There are many such ...
• 1,067
254 views

### Canonical VS Graph Isomorphism [closed]

I'm having a having a hard time understanding the difference between an isomorphism in graphs and canonical graphs. I have read through the Wikipedia articles, but it still isn't clicking. Can ...
• 1,159
14k views

### How to generate synthetic dataset using machine learning model learnt with original dataset?

Generally, the machine learning model is built on datasets. I'd like to know if there is any way to generate synthetic dataset using such trained machine learning model preserving original dataset ...
• 323
2k views

### Choosing between Storm+Trident-ML, Storm+SAMOA or Spark Streaming+MLlib

I want to implement Streaming Naive Bayes in a distributed system. What are the best approach to choose framework. Should I choose: Storm alone and implement streaming naive bayes on my own in storm ...
• 141
3k views

### How to create and format an image dataset from scratch for machine learning?

I've only worked with ML with .csv formats. I've worked with image formats too but only premade imagesets (MNIST,etc). If I were to create an imageset from scratch, how are the class labels typically ...
1 vote
204 views

### Huge discrepancies in Logistic Regression and SVM using HOG features to identify an Object

I am doing some research on Logistic regression and SVM using different parameters using HOG features. I am facing a bit of problem while understanding each classifier with combination of different ...
• 111
266 views

### Clustering not producing even clusters

I'm using k-means clustering to processes running on machines. Dataset sample : machine name, process m1,java m2,tomcat m1,word m3,excel Build a matrix of ...
• 207
7k views

### How does SQL Server Analysis Services compare to R?

This may be too broad of a question with heavy opinions, but I really am finding it hard to seek information about running various algorithms using SQL Server Analysis Service Data Mining projects ...
• 213
1k views

### Which book is the best for introduction to analysis social network using python3 [closed]

I am a beginner studying social network analysis. I installed python 3 just 2 weeks ago. There are a lot of books for python and social network analysis. I couldn't choose one of them. I found one ...
518 views

### Identity covariance matrix, decorrelated data?

Why would you want to decorrelated data? As I am reading about PCA and whitening on image data for DNN, I wonder what is the purpose of achieving the identity covariance matrix in your data is? Is ...
1k views

### Recommendation - item based vs user based [closed]

I have one clarification - First the definitions- User-based: Recommend items by finding similar users. This is often harder to scale because of the dynamic nature of users. Item-based: Calculate ...
191 views

3k views

### Forecasting sales and creating model [closed]

In a assignment we are given macro economic indicators like GDP, Consumer price index, Producer Price index and Industrial production index. Also we are given Crude oil, Sugar prices and FM-CG Sales. ...
1 vote
754 views

### How can the performance of a neural network vary considerably without changing any parameters?

I am training a neural network with 1 sigmoid hidden layer and a linear output layer. The network simply approximates a cosine function. The weights are initiliazed according to Nguyen-Widrow ...
• 123
1 vote
1k views

### How do I get Twitter Dataset for Visualization [closed]

I am a newbie. I would like to do visualization on twitter data : top trends based on country (over map) and time variations (for each months in 1 year or for each year) . Can someone tell me where ...
• 111