Questions tagged [dataset]

A dataset is a collection of data, often in tabular or matrix form. This tag is NOT intended for data requests ("where can I find a dataset about ...") --> see OpenData

Filter by
Sorted by
Tagged with
1
vote
0answers
11 views

How can I solve character encoding problem

I'm working with Pandas Series of strings that include text with encoding symbols and I need to decode them to UTF-8. I tried ...
0
votes
0answers
14 views

Best method to determine future success or to determine best linearity? [closed]

Long time viewer, but first time poster, so excuse me if i'm in the wrong place please. Anyway, I am working on a project that is pretty interesting. Through data mining, I am able to gather a ton of ...
0
votes
0answers
14 views

Τest dataset of research papers in computer science with relevance judgments [closed]

Is there a freely available test dataset of research papers in computer science field? I need to evaluate my text retrieval system which uses a computer science domain ontology called CSO, so the ...
1
vote
0answers
5 views

Architectures that take inputs of mixed sampling rates

Let's say a model is trained on multiple datasets of 1D time series. These datasets have been gathered with different sampling rates. I plan to use a convolution neural network to process these time ...
0
votes
1answer
12 views

(Labeled, if possible) time-series datasets for anomaly detection [closed]

I would like to create a big list of available time-series datasets for anomaly detection. I'm especially interested in the following: The time-series data should be segmented into cycles Ideally, ...
2
votes
2answers
29 views

What is the use of using width/height shift in data augmentation?

I'm not sure to understand the use of augmentation data using width shift and height shift. Say I have limited image data, and I want to create new data using Keras' ImageDataGenerator. To classify ...
0
votes
1answer
18 views

Using Palmer Penguins Dataset Instead of Iris Flower Dataset

I have been trying to replace the Iris Flower dataset with the Palmer Penguin dataset for a neural network tutorial. I am using the tutorial at https://www.kaggle.com/antmarakis/another-neural-network-...
2
votes
1answer
26 views

Using the whole dataset for testing (not validation) in case of small datasets

for an object detection task I created a small dataset to train an object detector. The class frequency is more or less balanced, however I defined some additional attributes with environmental ...
-1
votes
1answer
18 views

Kaggle Titanic Problem

I have two datasets train and test I did all the data cleaning on both the datasets.In my test dataset I don't have the dependant variable while in the train set I have dependent as well as ...
0
votes
0answers
13 views

Should I resize my object localization dataset in order to train a fully convolutional network?

I want to create a fully-convolutional neural net that trains on wider face datasets in order to draw bounding box around faces. The dataset is highly diverse in the image sizes. So my question is, ...
0
votes
0answers
20 views

Image Dataset for course project

I am currently studying Machine Learning course and now we are requested ( each student ) to find an Image dataset to work on for the course project. I am new to ML and it's now a week and I am trying ...
2
votes
0answers
15 views

What is the difference between Pachyderm and Git?

I learned that tools like Pachyderm version-control data, but I cannot see any difference between that tool with Git. I learned from this post that: It holds all your data in a central accessible ...
0
votes
0answers
15 views

My validation set losses are static

My dataset looks something like this: ...
2
votes
1answer
28 views

How would you build a big production ready image training dataset from scratch?

How would you most likely create a large production ready image training dataset from scratch including annotations for a image classification task? We will take a large amount of images (~1 million) ...
2
votes
1answer
28 views

Percentage of smaller dataset with respect to bigger dataset

I have two datasets, which are lists of multidimensional real-valued vectors. One dataset (call it $A=\{x_1, x_2, x_3, ..., x_n\}$ is of a big size, the other (call it $B=\{x_1, x_2, x_3, ..., x_m\}$)....
0
votes
1answer
18 views

How to add a column for descending row numbers into dataset in R

I am new to R and would like to insert a new column that numbers the row to a large dataset. I have no idea how to use 'mutate()' to insert this. Would appreciate ...
0
votes
0answers
4 views

While Merging image datasets which of the image parameters should be prepossessed/Normalized before giving to a CNN Model?

When two datasets are merged or images of different parameters size, dimension, Format are combine which parameters of the datasets should be normalized/ pre-processed before giving it to a model?
0
votes
0answers
10 views

Data set compatability with LSTM's or convLSTM's

I am currently working on a data set which has the structure - frames x Number of Objects. Each object is of size 7x5 and the task is to classify each object into one of the 4 classes. I have been ...
1
vote
1answer
19 views

Which data sets would help to predict (exponential) market trends?

Which kind of datasets do websites such as MeetGlimpse, trends.co, explodingtopics.com use to detect exponential market trends? I love them (not affiliated) and would like to better understand how ...
0
votes
0answers
8 views

What makes a high quality image dataset?

I am constructing a custom dataset for image classification. It is a simple task in the sense that only one class needs to be detected. However it is crucial that the dataset is high quality, and I am ...
2
votes
1answer
28 views

How to generate higher quality jpg plots on R [closed]

I have tried generating higher quality of data visualization plots from RStats. I tried increasing frame dimensions but it's still max at about ~350kb. How do I generate higher quality images from ...
2
votes
2answers
20 views

How to determine if dataset is a suitable representation of the context?

How can I determine if the data I have collected is a good enough representation of the context? For example, I am working on an object detection system and have been building an image dataset. How ...
1
vote
3answers
20 views

Deep Learning model for classifying skin diseases

I have planned to create a deep learning model that classifies skin diseases(around 5 to 7 diseases). Please suggest me a good deep learning model to go with. I am planning to integrate this model as ...
0
votes
0answers
12 views

Preparing and combining datasets for predictions

I am trying to create and train a model to predict the winner of a professional DOTA match. This model is only for "fun" and shouldn't be used for ...
0
votes
0answers
18 views

how do i preprocess percentage data?

I am analyzing a problem where i have 5 diseases and the measure of effectiveness of a remedy in its 7 first applications. The data is organized as an Excel spreadsheet as follows: (The spreadsheet ...
1
vote
1answer
49 views

How to load all images using image_dataset_from_directory function?

I am working on a multi-label classification problem I faced memory issues so I want to use Keras image_dataset_from_directory method to load all images as batch. how to apply multi-label technique on ...
1
vote
0answers
51 views

“Failed to find data adapter that can handle input” when working with mixed data

I have been trying to make my own generator that would handle an [image, float] value for the x (input), while the y is an int (linear output). My data is compiled into a ...
0
votes
1answer
29 views

Can I pass path to a dataset in train_test_split

My Directory ...
-2
votes
0answers
9 views

Where to find good quality data sets about electricity data per country?

I want to investigate and compare different countries level regarding electrification as a part of studying how prepared they are in electrification of the automotive segment. Examples of information ...
2
votes
0answers
17 views

How will my CNN results be affected by large discrepancies between the number of samples in some of the classes?

The number of samples in my dataset range between 3800 and 100,000 per class. Was wondering if my neural network will be more biased towards the classes with a higher number of images. I'm trying on ...
1
vote
0answers
8 views

why does tox21 loads as having 12 classes in pytorch geometric?

Why is the tox21 dataset loaded with predefined 12 classes when it should be binary classification, thus two classes? Code sampled modified: ...
1
vote
1answer
14 views

What is the meaning of pct_trend_adjusted in FiveThirtyEight's polling data?

I'm working on polling data from fivethirtyeight. What is the meaning of the pct_trend_adjusted column here? I understand that pct stands for percentage, but I don'...
1
vote
1answer
16 views

Is it better to augment both training and validation sets or just training set?

Is it better to augment data both training and validation sets or just the training set in order to achieve the best accuracy possible on a convolutional neural network? why?
0
votes
0answers
11 views

Is there a pre-trained network trained on RGB-D (4) channels?

The most used pre-trained networks for computer vision (e.g. ResNet50) are trained on 3 channels (RGB). At the same time, many cameras used in robotics return RGB-D outputs, that is including depth ...
0
votes
2answers
19 views

Information Visualization: which parameters should a data scientist plot to best explain the work behind a Neural Network?

I'm a beginner in the field and I wrote and trained my first Convolutional Neural Network from scratch. I would like to know what types of graphics and parameters a data scientist uses to plot to ...
1
vote
0answers
34 views

How to resize MNIST images to fit AlexNet model

I am using the keras API to load in the MNIST dataset. My problem is I need to use AlexNet as my algorithm. Understanding the AlexNet model, I require to start with 277x277 images but the MINST ...
0
votes
0answers
15 views

How to do parameter estimation on relatively few samples?

Context: I have a time series on which I've trained an autoencoder for anomaly detection (AD) purposes. My time-series is 6 years worth of daily data, but for AD purposes, I am looking at one week ...
0
votes
1answer
24 views

How to split data into training, validation, test data sets if the data is non-stationary?

When splitting data into training, validation, test data sets to be fed to machine learning model, the data is ideally expected to be stationary. However, in the real world, some data is non-...
1
vote
1answer
56 views

Azure automl time series forecasting error

I'm using Microsoft Azure automl to try and generate models for time series forecasting but I keep getting an error: ...
0
votes
0answers
11 views

Forecasting: Regression - Worse performance for a subset of data

I have a dataset for which I'm using different forecasting methods (Ridge/Lasso Regression / Random Forests / AdaBoost / Gradient Boosting) to compare their performance. For the full dataset, I ...
28
votes
8answers
5k views

Why is it wrong to train and test a model on the same dataset?

What are the pitfalls of doing so and why is it a bad practice? Is it possible that the model starts to learn the images by heart instead of understanding the underlying logic?
0
votes
0answers
9 views

In a dataset, how to detect simple relationship between two columns (datatype not restricted to numerical values)?

Suppose, I have a dataset with the following features: (FirstName, LastName, FullName, SchoolJoiningDate, SchoolGraduationDate) My aim is to validate the data before feeding it into the ML pipeline. ...
0
votes
0answers
10 views

query category wise dara

I have stored the some products and there respective category in sql. Like this. Now I want fetch all product from table with respective category. output should be=>
0
votes
1answer
54 views

Number of units for first layer in Keras Sequential Model

I have a huge CSV structured dataset. I'm feeding that dataset to a Keras Sequential Model. My question is, can my Model have number of units greater than the number of input features? At the moment, ...
0
votes
1answer
23 views

How can I generate reasonable dummy/artificial data from a pre-existing time-series data?

I have a dataset like this, basically all numerical time-series data. I would like to generate dummy/artificial/fake data for future values of this, preferably in python. How can I achieve this for ...
0
votes
0answers
14 views

Same accuracy on KNN for different distance metrics

I am new to data analysis and I am trying to run a kNN classifier on a lung cancer dataset with multiple attributes. For all k values I tasted (1 to 10), I obtain the same accuracy when using either ...
2
votes
0answers
32 views

Offline/Batch Reinforcement Learning: Doubly Robust Off-policy Estimator takes huge values

Context: My team and I are working on a RL problem for a specific application. We have data collected from user interactions (states, actions, etc.). It is too costly for us to emulate agents. We ...
1
vote
0answers
16 views

Non-uniform class occurances in input data for classification task - how to tackle it?

So, I gathered political articles for my thesis, now I want to be able to classify given text. Though the classes distribution is actually crazy. Class 1: 964 docs Class 2: 37,020 Class 3: 640 Class ...
1
vote
0answers
15 views

Making a tagged Part-of-Speech corpus with the help of a lexicon

I have a part-of-speech lexicon that has two columns, words and part-of-speech tags, inside a Pandas's Dataframe. Also, I have a list of tokens (words) in another Dataframe. I want to take each ...
0
votes
0answers
43 views

How to predict variables based on multiple samples?

The problem I tried to do some ML models but everytime I had some weird plots and I couldn't understand these scores. I'm relatively new to ML and maybe someone can help me with this data with some ...

1
2 3 4 5
23