Questions tagged [dataset]

A dataset is a collection of data, often in tabular or matrix form. This tag is NOT intended for data requests ("where can I find a dataset about ...") --> see OpenData

Filter by
Sorted by
Tagged with
0
votes
0answers
8 views

Where can I find windows environment image dataset?

I'm looking for a dataset of windows environment images labeled with main windows elements like window, taskbar, close button, etc., independent of the Windows version. Is there any?
0
votes
1answer
9 views

Applicability of ARIMA model on non stationary data

I have a time series dataset that does not have the stationary property. The dataset is monotonically increasing or sometimes showing no change over periods of time. Can I apply the ARIMA model to ...
-1
votes
1answer
21 views

datatypes as input in machine learning algorithms

I have a dataset and I am trying to perform binary classification by using different machine learning algorithms I have seven columns as input where all are int64 except of one that is float64. So my ...
1
vote
0answers
30 views

Why we call Mix-up method is a data augmentation technique?

I am bit confused in the Mixup data augmentation technique, let me explain the problem briefly: What is Mixup For further detail you may refer to original paper . We double or quadruple the data ...
0
votes
0answers
65 views
+50

Cannot test custom object detection model

I am using this tutorial: https://gilberttanner.com/blog/tensorflow-object-detection-with-tensorflow-2-creating-a-custom-model . I have trained the model but when I try to test it with this command: <...
0
votes
0answers
10 views

How do you optimise BPNN with PSO?

In the context of prediction, how would you optimise a backpropogation neural network with particle swarm optimisation?
0
votes
0answers
10 views

Where can I get audio datasets? [closed]

Pls I need help I am supposed to curate dataset for depressed and undepressed patients Audio dataset I really don't know how to go about it Pls do u have any idea how I should do it?
0
votes
1answer
22 views

Creating Dataset for Classification, How much balanced a good dataset should be?

I am creating a dataset with 4 classes, and there are 50K rows, I am already getting 86% accuracy, 0.85 Precison, 0.86 Recall and 0.71 F1-Score on SVM with 80,20 split. I have to publish this dataset ...
1
vote
0answers
13 views

Dataset for IoT activities [closed]

First of all, I am not sure whether this is the correct Stackexchange site for this question. If not, please let me know :) My question: I am looking for a dataset pertaining to IoT activities. ...
0
votes
0answers
5 views

Methods to extract / merge signal from three noisy time series (of same event)

I have three time series of same length, all containing magnitude measurements of the same event "A". But each time series is using a different method of measurement. My goal is to merge the ...
0
votes
0answers
18 views

Setting Time and Date Format in Python

I have a dataset with a time column and a separate date column in .xlsx format. time column has values in the below format: 12:32:21.499145197 12:32:21.499145197 date column has values in the below ...
0
votes
0answers
7 views

Should I normalise or detrend time series data before creating MLP models

Am building MLP models on forecasting timeseries data. Am new in the field of machine learning and I have read about Detrending and normalisation. So which method (normalisation or detrending) will be ...
1
vote
0answers
38 views

How to represent/aggregate data belonging to same group, and feed to model for training?

I have a problem in which there are couple of records that belong to the same group, like multiple observations. For example this data set has three groups, For each group, I have three observations....
0
votes
1answer
17 views

Training loop stops after the first epoch in PyTorch

I'm trying to train a seq2seq model using PyTorch using the Multi30K dataset from Dutch to English language. Here is my snippet of code: CustomMulti30k class ...
1
vote
0answers
12 views

What is an efficient implementation of a custom map-style dataset for a hdf5 file with irregular structure?

I have a hdf5 file that contains picture of a certain number of people, from a certain number of source cameras, for many seconds. So it is like this: ...
0
votes
1answer
13 views

Calculating statistical ranks between datasets with unpaired observations

The problem is the following: I have multiple datasets for which I want to calculate a ranking for each. All observations contained in the datasets can be arbitrarily permuted, so they are unpaired, ...
0
votes
0answers
19 views

How to detect data drift for a small size serving dataset with respect to a large training dataset?

The training data contains almost 6 million records and the serving/inference data that I get in batch contains about 400 records. Before my model does any predictions on the inference data I need to ...
0
votes
1answer
29 views

Why do I get different results at inference time even with fixed seed?

I am a very beginner in deep learning and am playing with voice cloning project. I trained my dataset and used the trained model to synthesize some sentences and was surprised to get a very different ...
1
vote
0answers
15 views

How to integrate Zoho analytics with Jupyter notebook? [closed]

I am trying to connect Zoho Analytics and Python for importing data from Zoho Analytics. I have already installed !pip install zoho-analytics-connector. What should ...
0
votes
0answers
4 views

Does the clip duration in a training dataset affect the inference output?

I am a very beginner in deep-learning and am playing with a voice cloning project (involving Tacotron 2 model). For that I am building a training dataset to make a French voice. My goal is to get ...
0
votes
0answers
12 views

Is it possible to classify type of a product from textual tags of those product (no image data)

I'm new to ML, but I'm looking to classify/categorise apparel products based on text data that comes with those products. Type of products range from Shirts to Earrings. I have approximately 60k ...
1
vote
2answers
21 views

Handling missing data for the majority class

I'm working with an unbalanced (10:1) dataset for classification. I also have a bunch of missing data on certain columns. If I discard them all, I still have a 5:1 ratio, so I guess I can afford to ...
0
votes
1answer
31 views

Data Preparation for dates

I have two columns, a birth year and the first year of being a customer. There is a large number of samples that have a birth year less than the first year of being a customer which does not make ...
1
vote
2answers
33 views

Updating a train/val/test set

It is considered best practice to split your data into a train and test set at the start of a data science / machine learnign project (and then your train set further into a validation set for ...
0
votes
0answers
5 views

how to analyze mobile usage and sleep time data

this is my first question on data science forum. I have a little doubt about if I'm asking this question on the right forum therefor any help, edit and change is appreciated. It's been a long time I'm ...
0
votes
0answers
11 views

How to label motion video data?

I am building an Arabic sign language dataset. How to label many frames of a video to detect the full motion? (like the following gif) So when I do it again the model understands the sign I only ...
1
vote
2answers
50 views

Test / Train split - is it always necessary (supervised learning)?

I am currently working on my first machine learning model (Palmer Penguins dataset). I am going to train the 3 machine learning models, each of them using the different model architecture (Decision ...
1
vote
0answers
21 views

How to predict data from sequence of sequences of variable size?

input data ...
0
votes
2answers
42 views

How can I know that this works and is correctly done?

Problem: This seems to be very wrong, cannot pinpoint what I am missing or doing wrong here. Should all rows for each column be Normalized? How? I am working on some small thing, and want to get a ...
1
vote
1answer
12 views

Error Loading and Training on Tensorflow's 'Speech Commands Dataset'

I am trying to replicate the most basic version of this Google LEAF example. I am having problems loading in the Tensorflow Speech Commands Dataset. I load the datasets in as a TFRecord: ...
1
vote
0answers
14 views

Where to get all major stock market events/regimes and dates?

I am looking for a dataset that gets all events and regimes in the stock market (i.e. an event like 9/11 and a regime like Bush's presidency). I was doing some searching and found I could probably do ...
0
votes
1answer
14 views

How to drop the previous rows of a database based on a matching value in a column?

So I am currently trying to sort through a data frame containing attribute classes and values of teams. However, my data has multiple rows of different classes and values of the same Team ID/Attribute ...
0
votes
0answers
25 views

Dataset for OCR from aerial view using YOLOv5s

The task is to detect rotated alphanumeric characters embedded on colored shapes. We will have an aerial view of the object (from a UAS: Unarmed Aerial System). Something of this sort: (One Uppercase ...
0
votes
0answers
23 views

Create rows filling the sequence of numbers in a 'period column' and the 'value column' with 0 in python/pandas

I need to fill a dataframe with rows completing the values that the system doesn't show on the report (e. g. a week that the product had no sales): The report: Product Week Total_Sales 0 A 1 82 1 A ...
1
vote
0answers
49 views

Predicting single floats based on set of 2 feature arrays each of 100 values

I am trying to predict audio to video desynchronization based on set of two arrays of lenght 100 which consist of coresponding audio and video samples. The problem is that my labels are single floats (...
4
votes
2answers
220 views

How to determine if my data split is appropriate for my data size?

I currently have a model that has a pretty large dataset (50ishMB) and was performing pretty well with a 80:20 split. However, when I tried changing it up to a 50:50 split, the model performed 28% ...
2
votes
2answers
92 views

Dataset and why use evaluate()?

I am starting in Machine Learning, and I have doubts about some concepts. I've read we need to split our dataset into training, validation and test sets. I'll ask four questions related to them. 1 - ...
0
votes
1answer
23 views

Data Anonymization for all domains?

I am using a dataset from Marketing and sales department. The dataset contains customer name (company name), company address, pincode, no of orders placed, revenue generated from that customer etc. My ...
0
votes
0answers
16 views

How to read multiple JSON files to a dataframe in R? can I get the code with the comments on it to understand it better?

I have multiple json files in a folder called "app users". These json files has NAN values as well in it.
0
votes
0answers
20 views

Handling repeating data from different individuals

I have a dataset that has some unique values but also includes information from multiple individuals that are repeating, meaning they are describing the same attributes and can have the same or ...
1
vote
0answers
16 views

Tokenizer returning incorrect values and losing a lot of data

(cross posted from main stackoverflow) This is a weird situation so I hope I can explain it correctly. My partner and I are working on a ML project where we create a model that predicts whether a ...
2
votes
0answers
22 views

Return the gradient and y intercept (m, b) to create two lines to best fit the data

I have been working on this task for a few hours now and have been unsuccessful with getting the target result. I have tried using multiple methods of trying to split the dataset using different ...
1
vote
0answers
12 views

Looking for multi output image datasets

I'm looking for image datasets that have multiple labels. So far I could only find one dataset of age, sex and ethnicity prediction but I'm looking for something a little less known than that one. ...
0
votes
0answers
29 views

A data in which an employee id is given in multiple months and many categorical features are there. To predict future retention. Recommend what to do?

I have this dataset in which we have to predict the retention of employees,i.e. how much will an employee stay in a company? This seems easy but the main obstruction here is that the same employee_id ...
0
votes
0answers
9 views

What is a good API or dataset for the “main” airport by country (not city)

As above. LON is an example of being the UKs main airport although technically that isn’t a single airport code it covers all London airports. The same is for STO which covers all of stockholms main ...
0
votes
1answer
21 views

How do you do data management?

I have about a few million records (small CSV / JSON file) from different sources, with about 50k added everyday. All on my local host. Until now, I have been using simple file structure to manage ...
0
votes
0answers
6 views

I am trying to sum up the "travel time in minute" for lane "GP" and grouping it under a single "Toll ID"

I am trying to sum up the "travel_time_minutes" for lane_type "GP" and grouping it under a single "Toll ID". I mean 0.11 + 0.50 + 1.21 for GP and retaining the Toll ID of ...
0
votes
1answer
20 views

How to make model not too dependent on one variable?

Let's suppose I have a generic model: Variable A | Variable B | Variable C | Variable D Variable Dis a categorical variable. ( ...
3
votes
0answers
32 views

Is it Scientifically Rigorous to create a multimodal ML Model with data from multiple sources

I'm attempting to create a multimodal machine learning model for disease diagnosis. However, I'm having quite a bit of difficulty finding public data sets with all the data I need. For example, I need ...

1
2 3 4 5
27