Questions tagged [dataset]

A dataset is a collection of data, often in tabular or matrix form. This tag is NOT intended for data requests ("where can I find a dataset about ...") --> see OpenData

Filter by
Sorted by
Tagged with
0
votes
1answer
37 views

How should I sample my validation set if I randomly sample training data?

I have: training dataset of size 150k. validation dataset of size 19k. At each epoch I randomly sample without replacement 10k datapoints for training because I get Out of Mem Errors. I need to ...
0
votes
0answers
11 views

Representing multi-channel input signals with a single signal

I am working on an EEG signal classification problem. My dataset consists of EEG signals stored as 19X30000 NumPy arrays. Each row represents a single channel. For now, I am converting each of the ...
1
vote
1answer
96 views

Segment 5-7 min audio into sentence wise audio clips for creating speech recognition dataset

I am trying to create a speech recognition dataset, especially for Indian Accents. I am taking from colleagues to build this. Daily I send an article link and ask them to record and upload it to ...
0
votes
2answers
40 views

How can I reduce the volume of data (No column to be dropped)?

I have a data set of 80,000 samples (40k 3 axis accelerometer and 40k Gyro data). I am trying to implement KNN and Random Forest for activity recognition on ESP8266 Node MCU. The limited memory of the ...
0
votes
0answers
12 views

Open dataset of Adobe analytics data? [closed]

I'm trying to create a mock environment for testing queries against Adobe Analytics events data, is there any place I could find such public data, json or tables, anything will do. (found some google ...
-1
votes
1answer
76 views

Sklearn SVM question classification

So, I have found that there are many ways to classify words with sklearn's SVM algorithm. But I want to classify questions by taxonomy, as shown in the following dataset: The goal of this task is to ...
1
vote
1answer
13 views

How to operate dataset from paperswithcode.com?

I'm trying to use IG-3.5B-17k dataset from paperswithcode.com, but I can't figure out how to do that exactly. How to do it? I guess I need to use this site API? Am I even able to use this dataset?
1
vote
1answer
96 views

Public dataset for news articles with their associated categories for multilabel data classification

I am wondering if there are any public datasets of news, like New York Times (NYT) or similar to various news categories such as politics, entertainment, lifestyle, general news, sports etc. I want to ...
1
vote
1answer
21 views

Log scaling whole dataset

I am log scaling my whole dataset in log base 10. When I do this I get -infitity for the minimum value. I am wondering how I can get rid of this -infinity? I have been advised to add a small value ...
1
vote
1answer
19 views

Dataset used for regression

Using Linguistic Cues for the Automatic Recognition of Personality in Conversation and Text www.aaai.org › JAIR-3012PDF Web results Using Linguistic Cues for the Automatic Recognition of Personality ...
0
votes
2answers
68 views

How to read the labeled enron dataset categories?

I am trying to use the labeled Enron dataset (link) but I am really confused about the labeling system they use. I understand the Cat_[1-12]_level_weight is some ...
1
vote
0answers
17 views

How can I include these 4 variables into my code in R [closed]

Here's a glimpse of the dataset I'm using. SpeedDating dataset: The data set I'm using is SpeedDating. My goal is to look at whether or people prefer to date each ...
2
votes
1answer
47 views

Python is reading my data with NANS and Infs, but they don't have any

I'm having an issue in Python where it says that the dataframe I have loaded through pandas.read_csv() cannot be scaled using ...
0
votes
2answers
8k views

How do I read a dat file, for which I don't know its structure?

Is there any way to atleast read the text from the dat file. I have its corresponding mdf file hence I know what all data and columns are there in it. How do I figure out the contents in my dat file. ...
0
votes
0answers
6 views

Consolidating Region Dimensions in Tableau

I am currently using the example excel spreadsheet in Tableau. After dragging category and segment dimensions to rows and the region dimension and quantity measure to columns, I realize there are two ...
1
vote
2answers
2k views

Orange3 summarizing data, grouping data values

Is there a simple way in orange3 (not writing a Python script) to summarize data and group similar data values? For example, instead of plotting a scatter with lots of data points, I would like to ...
0
votes
1answer
25 views

Exploratory Data Analysis on dataset divided by winners and losers

I have a dataset where I have features from winning tennis players and the other half are from a losing tennis players: ...
13
votes
3answers
23k views

Where can I download historical market capitalization and daily turnover data for stocks?

There are plenty of sources which provide the historical stock data but they only provide the OHLC fields along with volume and adjusted close. Also a couple of sources I found provide market cap data ...
0
votes
0answers
9 views

How fine-tune a pretrained model from a github repository on my own dataset pytorch [closed]

I would like to finetune a model in a github repository on my own dataset, how can I do that?
0
votes
0answers
7 views

How to deal with a small dataset for image classification using CNN?

I have a dataset consisting of characters(lowercase and uppercase) and numbers, totalling about 62 classes. The data I have are about 45 images per class and no test data. The data is a subset of the ...
0
votes
1answer
158 views

Comparing data sets with different measurements

I'm currently writing a thesis based on Cyber Crime, however I'm unsure of the proper to compare/analyse my data sets to talk about them in my thesis. One piece of data (https://www.pandasecurity....
1
vote
1answer
17 views

Domain scoring based on ranking

I am a computer science student working on a small information retrieval project. I have a dictionary with a domain as a key and it's ranking as value. Based on that ranking, I need to score every ...
0
votes
0answers
7 views

How can i get all the values related to the first column in a direct or indirect relationship?

I wanna write a function using python that allows me to compare each value from the second column of my DataFrame with the first column and if they don't matche compare the second column in the same ...
0
votes
0answers
5 views

Hypothesis about Telecom Data Analysis - a Q from new learner

in one of my online courses, I'm supposed to analyze and plot any problem of my choice, cool right! Accordingly, I have the data from one Internet Service Provider (ISP) which is related to the ...
0
votes
0answers
10 views

Image parameters for SRGAN

In some implementations of SRGAN I've noticed, that datasets consist of the high-resolution images and the low-resolution images are created later by, e.g. resizing (decreasing the size) hr-images. ...
0
votes
1answer
58 views

What to do if a specific label of a category appears only a few times?

Let's say I am trying to predict whether a car will be auctioned or not (not what I'm actually trying to do, but it represents it pretty well) using tabular data. I have the year the car was made, its ...
6
votes
2answers
16k views

Always drop the first column after performing One Hot Encoding?

Since one of the columns can be generated completely from the others, and hence retaining this extra column does not add any new information for the modelling process, would it be good practice to ...
0
votes
0answers
9 views

Demand Prediction (Retail Sales) Datasets for Benchmarking

I've been looking for 2 days and can't seem to find what would normally appear as trivial: a Time series (preferabl daily or intra-day resolution) Demand or Sale Labelling Retail Dataset Preferably ...
1
vote
0answers
9 views

Are there any publicly available scan document database containing text together with ticked/unticked checkboxes?

I would like to train an optical mark recognition model (OMR) to detect and classify the ticked/unticked state of checkboxes in documents. Does anyone know where I can have access to a publicly ...
0
votes
4answers
962 views

First steps on a new cleaned dataset

What is the very first thing you do when you get your hands on a new data set (assuming it is cleaned and well structured)? Please share sample code snippets as I am sure this would be extremely ...
1
vote
1answer
11 views
0
votes
0answers
5 views

Measuring stability of data and determining minimum size of dataset

I come from a different field so please bear with me. I have a list of users using a certain application, after each usage certain data is collected about how the session went from a network ...
2
votes
1answer
21 views

Given a regression based model with many feature variables; what tools would you utilize to figure out which feature variables add the most variance?

Given a hypothetical dataset {S} with 100 X feature variables and 10 predicted Y variables. X1 ... X100 Y1 .... Y10 1 .. 2 3 .. 4 4 .. 3 2 .. 1 Let's say I want to improve the accuracy of Y1. I am ...
1
vote
0answers
290 views

“Failed to find data adapter that can handle input” when working with mixed data

I have been trying to make my own generator that would handle an [image, float] value for the x (input), while the y is an int (linear output). My data is compiled into a ...
1
vote
1answer
21 views

What is the proper proportion for train and test set for classification system?

I have recently googled the best proportion for training and test set for classifying physiological data between normal and abnormal. Much of the source tells that the proportion should be 70:30 or 80:...
0
votes
1answer
26 views

Consequences of using XGBoost regressor for small dataset(< 500 rows)

I am using XGBoost regressor to train my model for 322 rows of data and the train and test split is as follows: ((257, 9), (257,), (65, 9), (65,)) I am using the ...
1
vote
1answer
52 views

computer science student - asking for some machine learning guiding (voice cloning)

I have chosen my synopsis topic for my second last semester. I want to make a text-to-speech program, that speaks with the voice of a game character. I have worked with machine learning in my class, ...
2
votes
1answer
151 views

Dataset where svm performance is significantly different from random forest

Is there a specific dataset where svm performs significantly better or worse than random forest? I know that the performance could depend on the dataset but is there a specific dataset?
1
vote
1answer
237 views

How to resize MNIST images to fit AlexNet model

I am using the keras API to load in the MNIST dataset. My problem is I need to use AlexNet as my algorithm. Understanding the AlexNet model, I require to start with 277x277 images but the MINST ...
1
vote
0answers
6 views

Available data sets on basic income pilot studies? [closed]

I'm interested in exploring data relating to any UBI/basic income pilot studies that have been conducted but have been unable to find any so far? thanks
1
vote
1answer
54 views

How do I prepare data in which each output row depends on multiple input rows?

My goal is to predict the value of Y based on multiple values of X1 and X2 for each observation of Y. In my example, I want to predict whether a customer will file for bankruptcy (table 1) based on ...
1
vote
1answer
10 views

Do I load all files at once or one at a time?

I currently have $1700+$ CSV files. Each of them is in the same format and structure, give or take a row or possibly a column at the end. Each CSV is $\approx 3.8$ MB. I need to perform a ...
0
votes
1answer
23 views

How do I build a model to predict which service a customer will use on an app?

There's an app with over 50 services. I have the data on the type of service a specific customer (they have a unique customer number) does on the app, the date, location, time, duration on a service ...
1
vote
1answer
14 views

California housing prices dataset on Kaggle

This is the dataset I'm referring to: https://www.kaggle.com/camnugent/california-housing-prices I am a bit confused regarding the dataset. Specifically, why is the number of houses not provided? We ...
0
votes
0answers
6 views

Question on What I would use for a Piece of Data

I have 3 categories that we can call A, B, and C. In almost every case we B/A = C. B and A are given in the Dataset and C is what I am find an trying to use elsewhere. The higher number C is the ...
1
vote
4answers
562 views

Which type of model to use and what's my target variable

I am a beginner in Data Science field, so sorry if my question is too basic. The task is to build an ad bidding model for online marketing which allows you to deliver targeted ads to the right ...
0
votes
1answer
18 views

Technical term to describe/differentiate the structure of an instance by the number of samples per instance ('tuple' vs 'time series')

Several terms are used to describe the structure of instances of a dataset. For example, an instance can be 'univariate' if it depends on only one variable or 'multivariate' if it depends on 2 or more ...
0
votes
0answers
11 views

How could I find the number of instances per fold to plot a histogram, in my dataset?

I am currently trying to learn machine learning with Python, and I have been given an .npz file containing the data. I have explored the dataset, and after exploration noted that it has 5 datatypes: <...
0
votes
0answers
19 views

How to create a matrix in excel

I'm solving a system of equations in excel on a rolling data series. In each row is the data for a matrix that I need to invert, but I'm having a difficult time creating the matrix inline. I will do ...
1
vote
1answer
53 views

How to fake data based on the condition and weight

I'm trying to fake data for the coffee shop. I've two features age and menu. Menu includes various type of drinks such as coffee [latte, espresso, mocca, etc], tea [milktea, lemontea], milk [freshmilk,...

1
2 3 4 5
24