Questions tagged [dataset]

A dataset is a collection of data, often in tabular or matrix form. This tag is NOT intended for data requests ("where can I find a dataset about ...") --> see OpenData

Filter by
Sorted by
Tagged with
0
votes
1answer
345 views

How should classification be done for a very small data set?

I am looking at data from the London Data Store based on social characteristics between London boroughs. Since there are only about 30 London boroughs, the data sets I am looking at are naturally ...
1
vote
3answers
2k views

Creating data model out of .csv file using Python

I want to create a data model out of a .csv file using Python. I mean to create dependencies, for example the primary key and stuff such that I can check if the new ...
1
vote
0answers
77 views

Initialize a recommender system with no dataset

Consider a platform for content recommendation based on the user history. The contents are books and articles and by history I mean what the user has read, what he has shared and so on. I know that ...
4
votes
1answer
311 views

What does BNG stand for

When i look at the available datasets in https://www.openml.org i often see a BNG dataset with no further information about it. Can someone explane what BNG means in this context? I am especially ...
2
votes
1answer
880 views

Dataset management: What are some strategies/solutions for efficiently storing datasets with their versions?

The problem: I've N classification models (independent), for each of these N models, I've different versions (eg: V0, V1, ..., Vfinal_production,Vexperimental). I'm looking for a way to store my ...
6
votes
1answer
528 views

Should I prevent augmented data to leak to the test/cross validation sets

I have been working with the cats vs dogs dataset from kaggle which consist on 25000 images of cats and dogs labelled accordingly (btw, great dataset, totally recommended!) One of the things I did ...
1
vote
1answer
41 views

Can't interpret the text information and ratings matrix imported to NN

I have a Recommender system which uses a Collaborative bayesian approach using pSDAE for recommending scientific articles from the Citeulike Dataset The text information (as input to pSDAE) is in the ...
2
votes
2answers
116 views

What are possible approaches to deal with unseparable data even after PCA?

Greetings data scientists, I am dealing with a complex classification/prediction problem and I am finding very difficult to separate the classes at all. Even after PCA, my data (over the two PCs), ...
1
vote
0answers
23 views

Data set for Q & A system training [closed]

What is the standard (or just good) open data set to train a model for question answering? Ideally, not only in English. Thanks!
5
votes
1answer
108 views

In what data science applications has the stack exchange dump been used?

Anonymized dumps of the stack exchange data are available here. Do you know projects or article that have been using these data (for social network analysis or information retrieval) ? My little ...
2
votes
1answer
136 views

Datasets in NLP research papers

I am looking for a dataset containing a large number of NLP research papers and abstracts. Are there any open access datasets like that? If so, can you please share the details?
7
votes
1answer
715 views

How do we make data Obfuscate or “De-identificate” to make it anonymous and share it publicly?

Right now, I am working on preparing a small dataset for release to the public by getting rid of sensitive information. While working on it, I wondered... what are the best practices of dealing ...
1
vote
2answers
858 views

Cluster titles or ingredients of food into n-categories

I have a dataset which has information about food recipes (in german), that looks like this: Here is a link to a small .csv file (first 1000 rows of my data) https://drive.google.com/file/d/...
4
votes
1answer
2k views

Is it legal to scrape YouTube videos for training data? [closed]

Is it legal, at least as long as I am not "selling" the video under my name, to scrape YouTube videos to train a neural network? If it is not, is there a procedure to get permission for the above? I ...
0
votes
3answers
222 views
3
votes
1answer
17k views

Error 'Expected 2D array, got 1D array instead:'

While performing a simple fitting operation on the Titanic dataset. The following is my code: ...
1
vote
1answer
30 views

Should I modify dataset?

I am working on a dataset which contains more than 80 features, and thousands of instances. Among those features there are some nominal ones, such as IP SOURCE, IP DESTINATION, Flow ID, which don't ...
-1
votes
1answer
145 views
0
votes
1answer
562 views

Age range prediction according to browsing history [closed]

I need to predict age or age range of a user according to his/her browsing history from a news website. The only data I am able to get is USER-ID, URLs-visited, TAGs from those URLs, "which category ...
-1
votes
1answer
47 views

Dataset processing question

I am a newbie in Data Science, so please don't blame me for stupid questions. Here is my problem. I've got a dataset (no empty cells, only numerical values) consisted of 15 columns (1st - user id, ...
1
vote
0answers
38 views

How to create a neural network with many different values in Matlab? [closed]

I want to create a neural network in Matlab. I have 16 import matrices in each iteration, my import data changes in every iteration and there are more than 100000 iterations. The target is a matrix ...
4
votes
2answers
2k views

Nested features with one to many relationships

I have a dataset that has (among others) a categorical variable with many levels and further attributes associated with each level. For example, consider predicting machine failure based on its last ...
0
votes
1answer
2k views

How to generate ratings without training data?

I am working on generating restaurant ratings automatically and I have various feature values like delivery time, cost estimate, etc. I want to generate a rating for each restaurant between 0 to 5. ...
4
votes
1answer
1k views

How do you map phrase IDs to sentence IDs in the Stanford Sentiment Analysis dataset?

I am trying to reproduce results obtained on the Stanford Sentiment Analysis dataset, which contains sentiment annotations for syntactic components of sentences taken from Rotten Tomatoes reviews. ...
1
vote
1answer
1k views

How to find the datasets for skill test (like java, python, c c++, etc.) [closed]

I want to extract the skills from a resume using Natural languge processing. To train my model I don't any dataset. where can I get a sample dataset for extracting skills from resume?
3
votes
2answers
2k views

How to deal with large data sets

So i'm very new to this, forgive my silly questions. I've got some data I need to analyse, I would usually just use excel it doesnt seem to be able to do the job. I have .csv files containing data ...
1
vote
1answer
119 views

Do you know a dataset for regression where deep learning outperforms svm and random forests? [closed]

I am currently trying to learn about deep learning. I asked myself where deep learning outperforms SVM and Random Forest on regression? Do you have any dataset for regression where deep learning ...
2
votes
0answers
273 views

Keras or TensorFlow Examples for Working with Large Text Datasets (~10M Sentences)

I'm looking for any tutorials or examples for using either Keras or TensorFlow on large text datasets (at least a few million sentences). I've looked at some of the examples using the ...
-1
votes
1answer
7k views

Error in f1(x) : argument “b” is missing, with no default

f1 <- function(a,b,c,d,e,f) { -111.605*a-208.39+(14.882-b)^2+35.29813*c-.001251205/d-1.050695*e+11.63420*f } ...
5
votes
2answers
124 views

Amalgamating multiple datasets with different variables coding

I have several datasets with thousands of variables. This different datasets have different variables for the same thing. Is there a way to automatically/semi-automatically check compatible variables ...
3
votes
2answers
98 views

Detecting spammers with artificially generated target class

I have a bunch of data related to my company's incoming and outgoing calls, and I'm trying to detect spam callers in order to blacklist them. The features I've extracted from the data are a bit simple ...
2
votes
1answer
72 views

Recombining rare values

I have a column called item_colour which describes the colour of products in my dataset. There are 85 colours and some of the colours are unique or they represent a small part of the data ( I have ...
1
vote
1answer
137 views

Detecting and confirming sentiments in chat messages

Say I have a spreadsheet of 1000 chat messages that are labeled as happy, sad or funny. What is the best way of detecting if the labels are indeed correct or if they need improvement? How would I go ...
1
vote
1answer
6k views

Plot RDD data using a pyspark dataframe from csv file [closed]

I have just started working with pyspark on very large csv file. I am using Spark version 2.1.0. I want to read data from a .csv file and load it into a spark dataframe and then after filtering ...
0
votes
1answer
2k views

Fashion Clothing images Dataset with image description

I am searching for Fashion Clothing image dataset where each image is associated with description. Basically description should contains all information about cloth. like - ...
10
votes
2answers
5k views

Benchmark datasets for collaborative filtering

I'd like to test a new algorithm for collaborative filtering. A typical use case is to recommend movies based on the preferences of users similar to the specific user. What are some common benchmark ...
1
vote
2answers
5k views

Converting a nominal attributes to numerical ones in data set

I'm using the NSL-KDD data set which contains nominal and numerical values, and I want to convert all the nominal values to numerical ones. I tried the get_dummies ...
0
votes
1answer
157 views

Cropping Images for Dataset

Problem I want to train HyperGAN with a set of 400+ images of people, but they aren't the specified size (32x32 pixels) for training. Question Is there any way/program to help cropping/resizing them ...
2
votes
3answers
116 views

How do I explain the relationship between Health and Weight?

I have two columns in my dataset: Health and Weight, both being of numeric type: ...
2
votes
3answers
3k views

Sentiment Analysis: Creating dictionary from dataset

I've collected around half a million of unmarked comments from a newspage. The newspage has anti-foreign background. Because of that, a relativley high number of comments contain hate. Do you have ...
-3
votes
3answers
202 views

Median versus Average, how to choose?

I want to test how long it takes to run an algorithm. So here is what I am doing: close all the other un-needed applications, run my algorithms alone considering some unstable computer system ...
1
vote
2answers
143 views

Where can I find a trained neural network data to play with?

This is the trained neural network for the XOR operator: Can I find something like a trained network for recognizing hand writing digits somewhere on the internet? Is there an "official format" for ...
0
votes
2answers
966 views

how can i collect data set from social networks like instagram?

My name is Reza, a Master Student at Golestan University of Technical and engineering, Iran and my M.Sc. thesis is about detect fake account on social networks. so i need data set. how can i collect ...
2
votes
3answers
570 views

Preprocessing in Data mining?

I am still new to data mining but I really want (and need) to learn it so badly. I know that before I can actually process my data in softwares like WEKA, I need to do some filtering like cleaning the ...
0
votes
2answers
158 views

Deep learning - aesthetics data modelling

I want to train neural network on aesthetics. I am getting confused on how to go about for training data. Assume, I have large data set of landscapes, portraits, wildlife etc which are aesthetic ...
2
votes
2answers
186 views

Should I divide my dataset in multiple prediction models?

Let's say I have an expertise in the domain knowledge of the dataset I am working on. I know that part of my dataset acts 100% differently than the rest. Also, it is straightforward to check if a row ...
1
vote
1answer
852 views

A data set to distinguish man from woman?

Is there a set and/or a model that is available freely in the Internet that can tell man from woman based on input image?
0
votes
1answer
793 views

Why use the .idx data format?

The MNIST handwritten digit dataset uses a file format .idx. What are the advantages of this file format over alternatives such as CSV, TSX and ODS?
1
vote
0answers
65 views

Intrusion Detection System (IDS)

I am new to anomaly intrusion detection system. I was reading the service specific anomaly detection for network intrusion detection but I could not understand section 3.2.3 payload Distribution, page ...
0
votes
1answer
94 views

Prove data points not enough? Estimate required number of data points?

I am working on a problem with only ~ 30 data points, I need to use these 30 points to build a machine learning model (ridge regression, random forest ... etc.), then use it to predict on another ...

1
17 18
19
20 21
24