Questions tagged [dataset]

A dataset is a collection of data, often in tabular or matrix form. This tag is NOT intended for data requests ("where can I find a dataset about ...") --> see OpenData

Filter by
Sorted by
Tagged with
0
votes
0answers
13 views

Known datasets for long document analysis

Are there good baselines datasets or benchmarks for similarities/retrieval of long texts (extremely long documents, books, etc.)? Although significant both academically and applicational, I cannot get ...
0
votes
0answers
18 views

How to take certain percent of weights from certain featurs in machine learning model?

I am trying to build a ML model that predicts the winner, 2nd, and 3rd place. The dataset has 15 features. However, I would like to have 80% influence of 9 features and the 20% from the rest of the ...
0
votes
0answers
9 views

Creating ANN's (LSTM) for multiple datasets

I have three datasets, each representing time-series water quality data from three different regions (upper, middle, lower regions) of the same geographic area. I want to create different types of ...
0
votes
1answer
14 views

What is the best way to match street addresses in a dataset in Python?

I have a dataset of land parcels owned by the government and I am attempting to match street addresses to an existing list of government agencies. I've used fuzzy matching and used a regex that ...
0
votes
1answer
17 views

computer science student - asking for some machine learning guiding (voice cloning)

So I have chosen my synopsis topic for my second last semester. I want to make a text-to-speech program, that speaks with the voice of a game character. I have worked with machine learning in my ...
0
votes
0answers
2 views

Need a dataset for automobile insurance fraud [migrated]

i need to apply deep learning to detect automobile insurance fraud. Are there any data sets available?
-1
votes
1answer
14 views

Is there a reference data set for ridge regression?

In order to test an algorithm, I am looking for a reference data set for ridge regression in research papers. Kind of like the equivalent of MNIST but for regression.
0
votes
1answer
16 views

Standardizing features by one specific feature

I am working on a project with a dataset that looks something like the following: ...
0
votes
0answers
7 views

Can I perform Verification and validation checks on datasets like AndroPRAguard, Drebin(contain malware and benign mobile apps)?

Verification and validation checks for data: Verification of data: - Visual Checks: It checks data visually. Double Entry Check: It checks duplication of data in the database. Validation of data: ...
0
votes
0answers
13 views

Have a Large Data-set of Real-Word Cover Letters [closed]

I recently launched a web app that does a basic analysis of cover letters. Not linking it here because I don't want this question to be about promotion. I use very basic NLP to tell users insights ...
0
votes
0answers
15 views

UAV dataset for machine learning [closed]

I am writing my master thesis about Unmanned Aereal Vehicles and the sensor-camera data. It will be used for navigation and obstacle avoidance. Does anybody know any sources that I can download some ...
0
votes
0answers
13 views

When normalizing unstructured data, can you take the mean and standard deviation globally?

I'm watching this FastAI machine learning lesson, which is about the famous MNIST dataset. I've gottent to the point where we should normalize the data and, much to my surprise, the instructor uses ...
0
votes
0answers
42 views

Is it a good practice to exclude the noisy data for training a model?

I executed a linear search on an array containing all unique elements in range [1, 10000], sorted in increasing order with all search values i.e., from 1 to 10000 and plotted the runtime vs search ...
1
vote
0answers
21 views

Unbeaten classification dataset?

Looking for a dataset that meets the following criteria: Multi-class, 3+ labels, preferably not binary. Tabular data, not ...
0
votes
0answers
9 views

fastai - using 'untar_data' function in kaggle kernel

I have recently started with fastai lesson 1 and I am using kaggle to run the course notebooks. While going through the ‘lesson1-pets’ notebook we use ...
2
votes
1answer
31 views

Is my dataset unbalanced?

So I'm trying to implement Nvidia's end to end driving paper to simply have an agent in Carla follow the lanes. I'm trying to predict the steering angle of the car based on the RGB images from the ...
1
vote
1answer
25 views

Trying to locate a COVID Dataset

I have been looking for a dataset that includes: Age Hospitalized ICU Disposition (Recovered,Death) Has anyone located one ? Preferably from a western country as China's data is suspect. I find ...
0
votes
0answers
8 views

Are there any object detection datasets with the same format as PASCAL VOC?

I was wondering if there are any object detection datasets that have the same format as the PASCAL VOC dataset. Furthermore I would be specifically looking for satellite imagery datasets in that ...
3
votes
1answer
36 views

Iterate over multiple dataframe rows at the same time

I have 16 different dataframes with the same number of rows/columns and another 2 separate dataframes with that same shape that i'm using to compare with the 16 dataframe values. I need to loop over ...
0
votes
2answers
11 views

Converting data format

I'm trying to use the recent COVID-19 data from the site of Italian Civil Protection, but they use a rather complicated time format that I'm finding troublesome as a novice to plot as data in a graph. ...
-2
votes
0answers
7 views

Log normal Distribution

https://www.kaggle.com/nowke9/ipldata After downloading this dataset, I wrote the following commands to load and display the dataset. import math import numpy as np import pandas as pd from scipy ...
0
votes
0answers
14 views

Upsell project based on sales records

in my company we are working on a upset project in which we are trying to solve the following problem: What we propose to our customer that he/she may be interested in based on the fact that he/she ...
0
votes
0answers
8 views

Database with cause-effect variables?

I came across this site: http://webdav.tuebingen.mpg.de/cause-effect/ Which is a database with cause-effect pairs... I found it really useful, but unfortunately they only have pairs (2 variables). I ...
0
votes
0answers
30 views

Multiple choice gap-fill question (with distractors) dataset for evaluating NLP algorithms

I am looking for a standard gap-filling multiple-choice exercise (with distractors) dataset that can be used to evaluate the NLP gap-filling ML algorithms. I expect the dataset to contain questions ...
1
vote
1answer
20 views

Create new data set

I am going to classify the hotel reviews as positive, negative and neutral. For train the model I couldn't find any data set with labels positive, negative and neutral. I could find this Hotel Reviews ...
0
votes
0answers
4 views

Where and how can I get dataset of patient narratives on the internet to predict diseases? [migrated]

My aim is to create a trained model for predicting diseases. I need data set consisting of the following fields: ...
-1
votes
0answers
12 views

how to generate variates from a particular categorical binary data?

So im working with more than 100 thousand samples dota2 dataset which consist of the winner and the "hero" composition from each match. I was trying to build winner of the match prediction model ...
0
votes
1answer
8 views

How to check the randomness or the distribution of an attribute in a dataset?

I have a dataset. I want to make its randomness nature match with another dataset (2nd one). Basically I want to modify the 2nd dataset values and make them similiar in distribution or nature in ...
0
votes
0answers
13 views

Predicting future of power consumption in repeating manufacturing process

I have this situation. We are tracking the power consumption of an industrial machine and by looking at the power consumption (in watt) we're trying to predict whenever something will break resulting ...
0
votes
1answer
15 views

Call routing using AI

I'm trying to find out how AI can help with efficient customer service, in fact call routing to the right agent. My usecase is given context of a query from a customer and agents' expertise, how can ...
0
votes
1answer
18 views

Pyspark Dataframes to Pandas and ML Ops - Parallel Execution Hold?

If I convert a spark dataframe into a pandas dataframe and subsequently apply pandas operations and sklearn models to the dataset in databricks, will the operations from pandas and sklearn be ...
0
votes
0answers
9 views

What are and how can I unserstand/process geo levels id from this dataset?

I am using the dataset from this driven data competition: https://www.drivendata.org/competitions/57/nepal-earthquake/data/ There are three features (geo_level_id_1, geo_level_id_2, geo_level_id_3) ...
4
votes
2answers
68 views

Discrimination vs Calibration - Machine Learning Models

I came across a new term called Calibration while reading about prediction models. Can you please help me understand how different it is from ...
0
votes
0answers
14 views

Review Helpfulness Datasets

My team is looking for a user review dataset which we can compare to one of these Amazon datasets. The dataset needs to include text reviews and a review helpfulness rating. I know this is a long-...
0
votes
0answers
31 views

How to build wake-word detection dataset from keyword pronunciations

I have quite a few audio files which are just pronunciation of one particular word, of course there are different tones, accents etc. I want to build model for wake-word detection, so I need to ...
0
votes
0answers
8 views

Is test data needed on model with no hyper-parameter

I am doing classification using Linear Discriminant Analysis (LDA), which has no hyper-parameters. I am aware the difference between validation and test set, i.e. validation is used for hyper-...
-2
votes
0answers
9 views

Face data set with ca. 100-1000 images on each individual [migrated]

I'm looking for a data set that has a larger number of images associated with 1 individual in a set to fine-tune a neural net for identification as a research project. Having 5-10 individuals is more ...
0
votes
0answers
24 views

Short text data set for classification & active learning project

I am looking for datasets that contains sentences/ very short documents for a project in the field of active learning in text classification. I've looked on yelp / imdb reviews dataset but the ...
0
votes
0answers
7 views

how can i use twitter API to extract terms or words in Arabic language without coding

I get the approval from twitter developers to access the data from twitter to collect data set in Arabic but I don't know how can I utilize without using code I need to extract data directly by ...
1
vote
2answers
20 views

I am working on a pose dataset and want to convert this data into CSV format. How to convert this data into a single row of data

This is the data for one pose. I have a lot of data like this which i want to convert to CSV to apply machine learning algorithm. I am assuming I have to convert this data into a single row of comma ...
1
vote
0answers
12 views

open source time series sales data for forecasting

I'm looking for open source time series sales data (past 2-3 yrs or more) that contains at least the following variables. ...
0
votes
0answers
25 views

Dealing with low variation data

So my current project involves using a neural network to try and predict the probability of a player getting a kill in a first-person shooter. I've recorded a number of features that should be ...
0
votes
1answer
68 views

Custom keras dataset generator not accepted by fit_generator

I've got a problem trying to use generators in Keras. I've got TensorFlow 2.1 with Python 3.7. I'm using the Keras version bundled with TensorFlow I have defined a class for my generator derived from ...
6
votes
3answers
783 views

Is it possible to use a generative model to “share” private data?

Let's say we have some data set, with lots of instances $X$ and a target $y$. If it is of some importance, you may assume that it is a "real life" data set : medium sized, with important correlations, ...
0
votes
0answers
33 views

PyTorch Dataset/DataLoader workflow with multiple .h5 files

I have multiple .h5 files, totaling 50GB, all of the same two-column format (first column: value, second column: label). I only have enough RAM to load one .h5 file at a time. I am unsure on how to ...
0
votes
1answer
48 views

What to do if a specific label of a category appears only a few times?

Let's say I am trying to predict whether a car will be auctioned or not (not what I'm actually trying to do, but it represents it pretty well) using tabular data. I have the year the car was made, its ...
0
votes
1answer
14 views

Help with breaking up a column in PowerBI to make a bar chart

My data set is a list of documents. I have a column in my data set - 'Independent Variable'. This column can contain nothing, i.e. 'NA', or one variable, i.e. 'var1', or multiple, i.e. 'var1;var2;var3'...
2
votes
1answer
24 views

Quantify the amount of differences of one data set to another

Basically I'm seeking the best method for my case scenario here. For example with the image shown below, the left one is poincare maps dataset #1, and the right is dataset #2. What's the best method ...
3
votes
1answer
31 views

How to determine the best way to replace empty records in the dataset?

I am doing a project related to predicting the next glucose value based on his/her past records. But in some patients, some of the recordings are missing. There are 2 scenarios of how the blood ...
2
votes
2answers
44 views

Creating a custom dataset for object detection

I'm currently trying to build a model to recognize approximately 10 labels (food items) in a fairly controlled environment (refrigerator). I was unable to find datasets that worked well enough for my ...

1
2 3 4 5
20