Questions tagged [dataset]

A dataset is a collection of data, often in tabular or matrix form. This tag is NOT intended for data requests ("where can I find a dataset about ...") --> see OpenData

Filter by
Sorted by
Tagged with
0
votes
0answers
5 views

fastai - using 'untar_data' function in kaggle kernel

I have recently started with fastai lesson 1 and I am using kaggle to run the course notebooks. While going through the ‘lesson1-pets’ notebook we use ...
1
vote
1answer
27 views

Is my dataset unbalanced?

So I'm trying to implement Nvidia's end to end driving paper to simply have an agent in Carla follow the lanes. I'm trying to predict the steering angle of the car based on the RGB images from the ...
0
votes
1answer
21 views

Is there any data set containing list of windows software and the category each one of them belongs to?

I wanted a dataset which lists many windows softwares according to their categories for a project. eg: anaconda: software development, roblox: gaming, VLC: video player etc. I searched but could not ...
1
vote
4answers
313 views

Which type of model to use and what's my target variable

I am a beginner in Data Science field, so sorry if my question is too basic. The task is to build an ad bidding model for online marketing which allows you to deliver targeted ads to the right ...
1
vote
1answer
19 views

Trying to locate a COVID Dataset

I have been looking for a dataset that includes: Age Hospitalized ICU Disposition (Recovered,Death) Has anyone located one ? Preferably from a western country as China's data is suspect. I find ...
-1
votes
0answers
17 views

Convert dataset to table format [closed]

I am trying to understand the given dataset. I want it to simplified in table format. Basically, there is no primary key here. SF and SR are values. Y1, L1, Y2, L2, Y3, L3 are columns. Can someone ...
0
votes
0answers
8 views

Are there any object detection datasets with the same format as PASCAL VOC?

I was wondering if there are any object detection datasets that have the same format as the PASCAL VOC dataset. Furthermore I would be specifically looking for satellite imagery datasets in that ...
2
votes
1answer
23 views

Iterate over multiple dataframe rows at the same time

I have 16 different dataframes with the same number of rows/columns and another 2 separate dataframes with that same shape that i'm using to compare with the 16 dataframe values. I need to loop over ...
0
votes
1answer
16 views

How do I build a model to predict which service a customer will use on an app?

There's an app with over 50 services. I have the data on the type of service a specific customer (they have a unique customer number) does on the app, the date, location, time, duration on a service ...
0
votes
2answers
9 views

Converting data format

I'm trying to use the recent COVID-19 data from the site of Italian Civil Protection, but they use a rather complicated time format that I'm finding troublesome as a novice to plot as data in a graph. ...
-2
votes
0answers
6 views

Log normal Distribution

https://www.kaggle.com/nowke9/ipldata After downloading this dataset, I wrote the following commands to load and display the dataset. import math import numpy as np import pandas as pd from scipy ...
0
votes
0answers
14 views

Upsell project based on sales records

in my company we are working on a upset project in which we are trying to solve the following problem: What we propose to our customer that he/she may be interested in based on the fact that he/she ...
2
votes
1answer
111 views

Reinforcement Learning on real time data over a web server

Question: is it possible to implement a reinforcement learning model over a NodeJS server? This server would be receiving binary forms of data (open /close; yes/no) in real time. The objective for ...
0
votes
0answers
14 views

Further Classification by function [closed]

I am a bit confuse and stuck at a problem, may be someone can guide me in right direction I am doing an analysis and have 3 datasets, supporting, against and neutral, or in simple say negative, ...
0
votes
0answers
9 views

Dataset containing news URL,headline and label as Finacial/Non Financial crime [closed]

I need help in getting a dataset which contains News URl,NEWS headline/text and label as if they belong financial or non financial related crime.I need it specifically to extract out details using NER ...
2
votes
2answers
81 views

features importance

Suppose I have dataset labeled with two classes such as healthy and unhealthy and I applied feature selection (features importance)on dataset. How can I know that features are important to which ...
0
votes
0answers
7 views

Database with cause-effect variables?

I came across this site: http://webdav.tuebingen.mpg.de/cause-effect/ Which is a database with cause-effect pairs... I found it really useful, but unfortunately they only have pairs (2 variables). I ...
1
vote
2answers
268 views

Time series normalization using min max technique

I have a time series dataset and I would like to normalize the data (diff which is of type list) as below using Min Max ...
3
votes
2answers
2k views

What is the best way to read SQL dataset in to Tensorflow?

What is the best way to read SQL database in to Tensorflow? Currently, I am using Postgres on server and developed DL algorithm on Tensorflow using Jupyter Lab. How can I import data into Jupyter Lab ...
0
votes
0answers
27 views

Multiple choice gap-fill question (with distractors) dataset for evaluating NLP algorithms

I am looking for a standard gap-filling multiple-choice exercise (with distractors) dataset that can be used to evaluate the NLP gap-filling ML algorithms. I expect the dataset to contain questions ...
1
vote
1answer
20 views

Create new data set

I am going to classify the hotel reviews as positive, negative and neutral. For train the model I couldn't find any data set with labels positive, negative and neutral. I could find this Hotel Reviews ...
0
votes
1answer
98 views

How to approach the PlantVillage dataset?

I'm working on the PlantVillage dataset and i want to predict the type of the disease from the image of a leaf. The dataset is labeled in pairs (Type of the plant,Healthy/name of the disease). I'm ...
0
votes
0answers
4 views

Where and how can I get dataset of patient narratives on the internet to predict diseases? [migrated]

My aim is to create a trained model for predicting diseases. I need data set consisting of the following fields: ...
1
vote
1answer
110 views

How to split a dataset into train and test sets for time series (multiple step-multiple output forecasting)?

I am trying to use an LSTM neural net to do multiple step / multiple output forecasting (I predict multiple values in one time knowing some values in the past). But, I have realized that I must be ...
-1
votes
0answers
10 views

how to generate variates from a particular categorical binary data?

So im working with more than 100 thousand samples dota2 dataset which consist of the winner and the "hero" composition from each match. I was trying to build winner of the match prediction model ...
0
votes
0answers
13 views

Predicting future of power consumption in repeating manufacturing process

I have this situation. We are tracking the power consumption of an industrial machine and by looking at the power consumption (in watt) we're trying to predict whenever something will break resulting ...
0
votes
1answer
8 views

How to check the randomness or the distribution of an attribute in a dataset?

I have a dataset. I want to make its randomness nature match with another dataset (2nd one). Basically I want to modify the 2nd dataset values and make them similiar in distribution or nature in ...
0
votes
1answer
17 views

Pyspark Dataframes to Pandas and ML Ops - Parallel Execution Hold?

If I convert a spark dataframe into a pandas dataframe and subsequently apply pandas operations and sklearn models to the dataset in databricks, will the operations from pandas and sklearn be ...
0
votes
1answer
14 views

Call routing using AI

I'm trying to find out how AI can help with efficient customer service, in fact call routing to the right agent. My usecase is given context of a query from a customer and agents' expertise, how can ...
1
vote
1answer
58 views

If the entire production dataset is known is advance, should I use it when fitting normalization parameters?

I found in multiple sources the recommendation not to fit the normalization parameters on the combined train/test dataset when evaluating the model, to prevent data leakage. I presume this ...
0
votes
0answers
9 views

What are and how can I unserstand/process geo levels id from this dataset?

I am using the dataset from this driven data competition: https://www.drivendata.org/competitions/57/nepal-earthquake/data/ There are three features (geo_level_id_1, geo_level_id_2, geo_level_id_3) ...
2
votes
1answer
20 views

Combining time-series data from different devices

I am using four different sensor models (four different devices) to gather some biometric data(eg. heart rate) for the same user, for the same time period. In an ideal scenario, all the devices are ...
1
vote
1answer
107 views

Converting VOC2012 annotation .xml to segmentation .png

Does anyone know a good way to convert VOC2012 annotations files in xml to SegmentationClass ...
0
votes
2answers
197 views

Classification Dataset which is linearly non separable

I am trying to find a dataset which is linearly non-separable. I checked the Iris dataset and the UCI website says: The data set contains 3 classes of 50 instances each, where each class refers to ...
0
votes
1answer
31 views

On which data evaluate an object detection model ? (similar or real life data ?)

I'm training an object detection model (SSD300) to detect and classify body poses in thermal images. Even I have more than 2k different poses, the background does not change much (I have only 5 ...
0
votes
1answer
21 views

single v/s multiple user machine learning model

What are the merits and demerits of training machine learning models(One-class svm, isolation forest, DBSCAN) for anomaly detection on single-user data set and multiple user data set.? keep in mind ...
0
votes
1answer
68 views

Logistic Regression outperforms MLPClassifier

I am new in ML and I am trying to train classifier. I have a tiny dataset, just 90 examples, I divided it 70/30 train/test set and started to train. As I know MLP must outperform Logistic Regression, ...
1
vote
2answers
180 views

Pre-processing on MRI images

I have MRI images of brain tumors collected from a hospital (not a benchmark dataset). And I am planning to use them to predict/classify tumour types using a typical machine learning approach: texture ...
1
vote
1answer
42 views

Autoencoder anamoly detection

I recently learnt about the anamoly detection using autoencoders(specifically denoisinng autoencoders).To train the autoencoders do we need a data having some pattern? or is there some way to ...
1
vote
5answers
59k views

Remove part of string in R

I have a table in R. It just has two columns and many rows. Each element is a string that contains some characters and some numbers. I need number part of the element. How can I have number part? For ...
4
votes
2answers
63 views

Discrimination vs Calibration - Machine Learning Models

I came across a new term called Calibration while reading about prediction models. Can you please help me understand how different it is from ...
0
votes
0answers
14 views

Review Helpfulness Datasets

My team is looking for a user review dataset which we can compare to one of these Amazon datasets. The dataset needs to include text reviews and a review helpfulness rating. I know this is a long-...
1
vote
1answer
286 views

How to treat a categorical variable which can have multiple values in regression?

I am working on a regression problem and has a categorical feature 'CATEGORY' which can take as many as 1600 categories. On top of that, each observation can have any number of categories in that ...
0
votes
0answers
28 views

How to build wake-word detection dataset from keyword pronunciations

I have quite a few audio files which are just pronunciation of one particular word, of course there are different tones, accents etc. I want to build model for wake-word detection, so I need to ...
0
votes
0answers
8 views

Is test data needed on model with no hyper-parameter

I am doing classification using Linear Discriminant Analysis (LDA), which has no hyper-parameters. I am aware the difference between validation and test set, i.e. validation is used for hyper-...
-2
votes
0answers
9 views

Face data set with ca. 100-1000 images on each individual [migrated]

I'm looking for a data set that has a larger number of images associated with 1 individual in a set to fine-tune a neural net for identification as a research project. Having 5-10 individuals is more ...
0
votes
0answers
24 views

Short text data set for classification & active learning project

I am looking for datasets that contains sentences/ very short documents for a project in the field of active learning in text classification. I've looked on yelp / imdb reviews dataset but the ...
7
votes
3answers
12k views

Public dataset for news articles with their associated categories

I am wondering if there are any public datasets of Google news with various news categories such as politics, entertainment, lifestyle, general news, sports etc. I want to use such dataset for topic ...
0
votes
0answers
7 views

how can i use twitter API to extract terms or words in Arabic language without coding

I get the approval from twitter developers to access the data from twitter to collect data set in Arabic but I don't know how can I utilize without using code I need to extract data directly by ...
0
votes
1answer
39 views

Custom keras dataset generator not accepted by fit_generator

I've got a problem trying to use generators in Keras. I've got TensorFlow 2.1 with Python 3.7. I'm using the Keras version bundled with TensorFlow I have defined a class for my generator derived from ...

1
2 3 4 5
20