Questions tagged [dataset]

A dataset is a collection of data, often in tabular or matrix form. This tag is NOT intended for data requests ("where can I find a dataset about ...") --> see OpenData

Filter by
Sorted by
Tagged with
2 votes
1 answer
75 views

Where can I find free multi-instance single-label datasets for object detection?

I'm trying to find free multi-instance single-label datasets for object detection online. By "multi-instance and single-label" I mean that each image contains only object belonging to one ...
1 vote
2 answers
58 views

How to group a unique column and find the mean value in a separate column in R

My table of data looks like this image (but with many more lines): I want to be able to find the mean age of each region, so the mean age for region SSC20790 and so on. I believe I can use the <...
0 votes
1 answer
12 views

Is it a good idea to add predictable features in dataset before training?

For example, let's say a dataset has 100+ columns. And the ml has to recognize a complex pattern containing 1000 different conditions. And one of those conditions is, the integer from the first column ...
0 votes
1 answer
27 views

Feature Engineering on transactional dataset clustering

I have a data set with transactions details from different business (roughly 1 thousand business entities). Each row is a transaction. The structure of the dataset is as follows: client_id Sex Age ...
11 votes
2 answers
10k views

How to split train/test in recommender systems

I am working with the MovieLens10M dataset, predicting user ratings. If I want to fairly evaluate my algorithm, how should I split my training v. test data? By default, I believe the data is split ...
0 votes
0 answers
10 views

How do I train an instance segmentation model with an image classification dataset?

Say I have a clean dataset of different types of utensils. By clean, I mean the images are already cropped, augmented, and ready to use for image classification models. If I want to detect multiple ...
0 votes
1 answer
14 views

Str.contains and isin function do not return all correct rows of dataframe

Given a list of strings L1 L1 = ['a', 'b', 'c'], I need to extract the rows which contain the values given in list L1. I used the isin function: ...
2 votes
1 answer
147 views

Reinforcement Learning on real time data over a web server

Question: is it possible to implement a reinforcement learning model over a NodeJS server? This server would be receiving binary forms of data (open /close; yes/no) in real time. The objective for ...
0 votes
0 answers
9 views

Where can I download ImageNet-22k

I only found ImageNet-21K on the ImageNet website, but I need ImageNet-22K. Where can I download ImageNet-22k?
0 votes
0 answers
18 views

How Can I find the medical image datasets for congenital heart defect

I am working on implementing the image segmentation model for diagnosing a patient with a congenital heart defect. But I couldn't find the image datasets. please, anyone, help me to Find the Image ...
0 votes
1 answer
50 views

Applicability of ARIMA model on non stationary data

I have a time series dataset that does not have the stationary property. The dataset is monotonically increasing or sometimes showing no change over periods of time. Can I apply the ARIMA model to ...
1 vote
2 answers
651 views

Using categorical and continuous variables in Deep Learning

I would like to apply a MLP to some business seller data. I found that the data is a mix of both categorical and continuous features. For what I read it is not advisable to feed a neural network with ...
2 votes
1 answer
82 views

Python is reading my data with NANS and Infs, but they don't have any

I'm having an issue in Python where it says that the dataframe I have loaded through pandas.read_csv() cannot be scaled using ...
1 vote
1 answer
209 views

Converting VOC2012 annotation .xml to segmentation .png

Does anyone know a good way to convert VOC2012 annotations files in xml to SegmentationClass ...
3 votes
2 answers
82 views

Storing Large dataset for processing and analysis of data

I am new to data engineering and wanted to know , what is the best way to store more than 3000 GB of data for further processing and analysis ? I am specifically looking for open source resources . I ...
0 votes
2 answers
31 views

If you are making a ensemble model does training data on base models have to be different from one another

I was reading this article talking about ensemble models. I was interested in the max voting model using 3 base learners. However, I am a little confused about the process. Currently, I'm thinking it ...
2 votes
1 answer
2k views

How to resize MNIST images to fit AlexNet model

I am using the keras API to load in the MNIST dataset. My problem is I need to use AlexNet as my algorithm. Understanding the AlexNet model, I require to start with 277x277 images but the MINST ...
2 votes
1 answer
183 views

Dataset where svm performance is significantly different from random forest

Is there a specific dataset where svm performs significantly better or worse than random forest? I know that the performance could depend on the dataset but is there a specific dataset?
0 votes
2 answers
97 views

How to choose our data set wisely?

I have a couple of questions and I was wondering if you could answer them. I have a bunch of images of the cars (side view only). I would like to train a model with those images. My objects of ...
1 vote
1 answer
68 views

computer science student - asking for some machine learning guiding (voice cloning)

I have chosen my synopsis topic for my second last semester. I want to make a text-to-speech program, that speaks with the voice of a game character. I have worked with machine learning in my class, ...
2 votes
1 answer
17 views

What Preprocessing is Needed for Semantic Search Using Pre-trained Hugging Face Transformers?

I am building a project for my bachelor thesis and am wondering how to prepare my raw data. The goal is to program some kind of semantic search for job postings. My data set consists of stored web ...
3 votes
2 answers
594 views

Pre-processing on MRI images

I have MRI images of brain tumors collected from a hospital (not a benchmark dataset). And I am planning to use them to predict/classify tumour types using a typical machine learning approach: texture ...
1 vote
1 answer
82 views

If the entire production dataset is known is advance, should I use it when fitting normalization parameters?

I found in multiple sources the recommendation not to fit the normalization parameters on the combined train/test dataset when evaluating the model, to prevent data leakage. I presume this ...
1 vote
4 answers
722 views

Which type of model to use and what's my target variable

I am a beginner in Data Science field, so sorry if my question is too basic. The task is to build an ad bidding model for online marketing which allows you to deliver targeted ads to the right ...
1 vote
1 answer
81 views

How do I prepare data in which each output row depends on multiple input rows?

My goal is to predict the value of Y based on multiple values of X1 and X2 for each observation of Y. In my example, I want to predict whether a customer will file for bankruptcy (table 1) based on ...
1 vote
1 answer
57 views

Comparing two data distributions, not the probability distribution

Let's assume that I have the 200 MNIST data. These 200 data are divided into two training dataset. one training dataset has 100 and another training dataset has the remaining 100. I trained my two CNN ...
2 votes
1 answer
73 views

What to do if a specific label of a category appears only a few times?

Let's say I am trying to predict whether a car will be auctioned or not (not what I'm actually trying to do, but it represents it pretty well) using tabular data. I have the year the car was made, its ...
1 vote
1 answer
7k views

Tensorflow Model fitting ValueError: Layer sequential expects 1 inputs, but it received 520 input tensors

I am trying to train a model using Tensorflow. I am reading a huge csv file using tf.data.experimental.make_csv_dataset Here is my code: Imports: ...
2 votes
1 answer
162 views

Creating a single number from a numpy array - Python [closed]

I am working on a gender classification project. I am extracting the pixels of an image using a Numpy array in Python, similar to the one below: ...
0 votes
1 answer
23 views

Topic modelling or Keyword extraction for a small dataset

I am working on a project where I have a dataset which contains very less data. These are the comments of people. I have only 130 lines with 10 words per line. My goal is to identify the common topics ...
1 vote
2 answers
1k views

Time series normalization using min max technique

I have a time series dataset and I would like to normalize the data (diff which is of type list) as below using Min Max ...
0 votes
1 answer
220 views

How to approach the PlantVillage dataset?

I'm working on the PlantVillage dataset and i want to predict the type of the disease from the image of a leaf. The dataset is labeled in pairs (Type of the plant,Healthy/name of the disease). I'm ...
3 votes
2 answers
371 views

Training, Testing and Validation Dataset [closed]

I'm training a Unet model for tumor segmentation. I have a dataset of 400 patients for that. The used images are CT scans (3D images) that I divide into 2D images (for a total of 30k 2D images). I am ...
0 votes
1 answer
155 views

How to prepare training data for deep learning models

I am working on a project which involves the application of deep learning models. I have collected training data. In collected images, I have more than one object in interest. I am not very clear how ...
0 votes
0 answers
20 views

Is there any way to get data sets from mldata.org?

I need data sets for my project."Record of heart sound " which has Recordings of normal and abnormal heartbeats used to recognize heart murmurs etc. link: http://mldata.org/repository/data/...
0 votes
1 answer
183 views

I need sources of interrogative, exclamatory, and imperative sentences

I am working on accumulating a large database of labeled sentences for several projects/experiments. At present I am only using Wikipedia and Project Gutenberg as sources of data. Between these two ...
0 votes
2 answers
22k views

How do I read a dat file, for which I don't know its structure?

Is there any way to at least read the text from the dat file. I have its corresponding mdf file hence I know what all data and columns are there in it. How do I figure out the contents in my dat file. ...
1 vote
1 answer
481 views

How to split a dataset into train and test sets for time series (multiple step-multiple output forecasting)?

I am trying to use an LSTM neural net to do multiple step / multiple output forecasting (I predict multiple values in one time knowing some values in the past). But, I have realized that I must be ...
1 vote
3 answers
52 views

Very simple real-valued time-series dataset for RNN prototyping

Is there a simple real-valued time-series dataset on which a vanilla RNN model can be trained. With "very simple" I mean only two to four real-valued inputs per time step and a single real-valued ...
0 votes
1 answer
375 views

Training loop stops after the first epoch in PyTorch

I'm trying to train a seq2seq model using PyTorch using the Multi30K dataset from Dutch to English language. Here is my snippet of code: CustomMulti30k class ...
1 vote
1 answer
76 views

How to Proceed with Tokenized text content which is given in number?

I have one data set of customer review, but the text data is given is tokenized text number. I am unable to proceed thinking about how to proceed? As I am encountering such data set the first time, ...
0 votes
0 answers
26 views

How to give label to synthetic data

I am doing some research. I have created a dataset with 4 features using a uniform distribution. I think it is a right way to do it but I am not sure. I have done sum the features values/numbers of ...
0 votes
0 answers
18 views

Generating data

I have been stuck in a Problem, for more than 2 weeks now. I need to generate data set, that have actual Probability. I am doing an experiment, my ML framework gives me probability intervals for the ...
1 vote
3 answers
87 views

Test / Train split - is it always necessary (supervised learning)?

I am currently working on my first machine learning model (Palmer Penguins dataset). I am going to train the 3 machine learning models, each of them using the different model architecture (Decision ...
4 votes
1 answer
2k views

Weighted loss functions vs weighted sampling?

For image classification tasks, is there a practical difference between using weighted loss functions vs. using weighted sampling? (I would appreciate theoretical arguments, experience or published ...
2 votes
2 answers
107 views

Log analysis dataset with labeled cybersecurity issues

I am seeking to find a dataset with log files that have labeled cybersecurity issues. As I am trying to build a cybersecurity log analysis model there is no preference on the type of the log, but ...
1 vote
1 answer
88 views

On which data evaluate an object detection model ? (similar or real life data ?)

I'm training an object detection model (SSD300) to detect and classify body poses in thermal images. Even I have more than 2k different poses, the background does not change much (I have only 5 ...
0 votes
1 answer
14 views

Python library for recommendation engine

I have a dataset containing records of books issued to students in college. It comprises the following fields: Department of student Date on which book is issued to the student Details of the book ...
0 votes
0 answers
22 views

Best way to store "small" data

I have a small dataset consisting of around 200 measurements of different light sources. The light is measured with a broadband and an IR diode, and the resulting voltage is sampled it with 4 ...
3 votes
1 answer
53 views

Am I supposed to be using Mixed Effects?

I ran a GLS random effects regression on some NBA data in Stata, and I was told that it was wrong because I didn't use mixed effects model. This may every well be the case, but I was quite confused by ...

1
2 3 4 5
28