Questions tagged [dataset]

A dataset is a collection of data, often in tabular or matrix form. This tag is NOT intended for data requests ("where can I find a dataset about ...") --> see OpenData

Filter by
Sorted by
Tagged with
0
votes
1answer
61 views

How to choose our data set wisely?

I have a couple of questions and I was wondering if you could answer them. I have a bunch of images of the cars (side view only). I would like to train a model with those images. My objects of ...
0
votes
1answer
30 views

Dimensionality reduction and prediction when all columns have approximately same variance

I have a dataset of 25 columns where the goal is to predict the value of the 25th column based on the previous 24 columns. The dataset is quite big that's why I initially thought to proceed with PCA ...
0
votes
1answer
129 views

fastai - using 'untar_data' function in kaggle kernel

I have recently started with fastai lesson 1 and I am using kaggle to run the course notebooks. While going through the ‘lesson1-pets’ notebook we use ...
0
votes
0answers
19 views

Image Dataset for course project

I am currently studying Machine Learning course and now we are requested ( each student ) to find an Image dataset to work on for the course project. I am new to ML and it's now a week and I am trying ...
0
votes
1answer
34 views

Dataset : Handling rows where some column value is not applicable

I am working on some LTE Data say of shape (100000, 10) . Now suppose I have a column Jitter Avg. Now Jitter occurs only for any connected call and for call which could not be setup due to some ...
0
votes
1answer
52 views

Number of units for first layer in Keras Sequential Model

I have a huge CSV structured dataset. I'm feeding that dataset to a Keras Sequential Model. My question is, can my Model have number of units greater than the number of input features? At the moment, ...
0
votes
1answer
25 views

Model with 2 datasets: combine time series data and statistics

I am new to data science modelling so apologies if using wrong terminology in advance. I have a standard time series dataset of historical prices which is used to train/test a simple Random Forest ...
0
votes
1answer
27 views

Dynamic graph dataset

I'm working with dynamic graph embedding but I can not seek the dataset for my problem. Can you help me find dataset with some requires: A series of graph which represent for dynamic graphs. Each ...
2
votes
0answers
15 views

What is the difference between Pachyderm and Git?

I learned that tools like Pachyderm version-control data, but I cannot see any difference between that tool with Git. I learned from this post that: It holds all your data in a central accessible ...
0
votes
0answers
13 views
-2
votes
0answers
14 views

KeyError: 'tweets' [closed]

i am having issues with sentiment-analysis with flask api , it giving me error,kindle share some knowledge thanks in advance ...
2
votes
1answer
27 views

Percentage of smaller dataset with respect to bigger dataset

I have two datasets, which are lists of multidimensional real-valued vectors. One dataset (call it $A=\{x_1, x_2, x_3, ..., x_n\}$ is of a big size, the other (call it $B=\{x_1, x_2, x_3, ..., x_m\}$)....
2
votes
1answer
27 views

How would you build a big production ready image training dataset from scratch?

How would you most likely create a large production ready image training dataset from scratch including annotations for a image classification task? We will take a large amount of images (~1 million) ...
4
votes
3answers
2k views

What are the basic approaches for balancing a dataset for machine learning?

Sometimes we come across datasets where classes are imbalanced. For example, class A may have 2000 instances, but class B has only 200. How can we train a classifier for such datasets?
0
votes
0answers
11 views

How do you incorporate distance in object detection tasks/datasets? [closed]

What are some approaches people have taken when trying to build an object detection dataset, that consider the object from a range of distances, such as up close or far away? What method of data ...
0
votes
1answer
4k views

How do I read a dat file, for which I don't know its structure?

Is there any way to atleast read the text from the dat file. I have its corresponding mdf file hence I know what all data and columns are there in it. How do I figure out the contents in my dat file. ...
19
votes
3answers
9k views

Dataset for Named Entity Recognition on Informal Text

I'm currently searching for labeled datasets to train a model to extract named entities from informal text (something similar to tweets). Because capitalization and grammar are often lacking in the ...
0
votes
1answer
16 views

How to add a column for descending row numbers into dataset in R

I am new to R and would like to insert a new column that numbers the row to a large dataset. I have no idea how to use 'mutate()' to insert this. Would appreciate ...
1
vote
3answers
210 views

Keras Classifier returns similar output for all Predictions

I completed training the model with an accuracy of 1.000 and a validation accuracy of 0.9565. Unfortunately whenever i input a image into my model i get the same output regardless. Am i doing ...
0
votes
1answer
311 views

Sampling labeled data for anomaly detection

I'm currently working on a project that requires the use of unsupervised anomaly detection, but I'm unable to find a relevant data set, so I'm considering the following option: Assuming I have a data ...
0
votes
1answer
34 views

Standardizing features by one specific feature

I am working on a project with a dataset that looks something like the following: ...
0
votes
0answers
4 views

While Merging image datasets which of the image parameters should be prepossessed/Normalized before giving to a CNN Model?

When two datasets are merged or images of different parameters size, dimension, Format are combine which parameters of the datasets should be normalized/ pre-processed before giving it to a model?
1
vote
1answer
16 views

Which data sets would help to predict (exponential) market trends?

Which kind of datasets do websites such as MeetGlimpse, trends.co, explodingtopics.com use to detect exponential market trends? I love them (not affiliated) and would like to better understand how ...
0
votes
0answers
10 views

Data set compatability with LSTM's or convLSTM's

I am currently working on a data set which has the structure - frames x Number of Objects. Each object is of size 7x5 and the task is to classify each object into one of the 4 classes. I have been ...
0
votes
1answer
54 views

How to write custom de-identification algorithm in Python?

I have tried a simple algorithm to anonymize my data using the de-identification technique. But the code doesn't work for me. I want to anonymize the data by slightly changing the values. The data ...
1
vote
1answer
94 views

How to prepare Audio-text data for speech recognition

I have gathered some raw audio from all the conferences, meetings, lectures & casual conversation that I was part of. The machine transcription did not offer good results (from Azure, AWS etc.) I ...
0
votes
1answer
311 views

LSTM - How to prepare train from a dataset which contains multiple observations for different events

I m using LSTM in a project related to MobiFall dataset which contains falls and daily activitives - such as walking, sitting etc - sensed by accelerometer, gyroscope and orientation sensors in x,y,z ...
2
votes
1answer
26 views

How to generate higher quality jpg plots on R [closed]

I have tried generating higher quality of data visualization plots from RStats. I tried increasing frame dimensions but it's still max at about ~350kb. How do I generate higher quality images from ...
2
votes
2answers
155 views

How to quantitatively compare two or more complex data sets

I have a series of datasets that are composed of 100 or so variables and a corresponding response variable. I am often faced with the question of trying to attribute differences in the response ...
2
votes
0answers
108 views

How to read data in DSX from Data hub object storage container?

I am creating a new notebook with DSX. I have a data set that I want to use. It is not CSV. I found that I could go to Data hub by clicking top-right tile near my logged in name, then object storage ...
0
votes
0answers
7 views

What makes a high quality image dataset?

I am constructing a custom dataset for image classification. It is a simple task in the sense that only one class needs to be detected. However it is crucial that the dataset is high quality, and I am ...
2
votes
2answers
20 views

How to determine if dataset is a suitable representation of the context?

How can I determine if the data I have collected is a good enough representation of the context? For example, I am working on an object detection system and have been building an image dataset. How ...
0
votes
1answer
29 views

Can I pass path to a dataset in train_test_split

My Directory ...
0
votes
1answer
592 views

Should the type of Boolean categorical features be numerical or categorical after encoding?

There are categorical features which have two different value in my dataframe next to numerical features. I've converted these categorical values to 0 or 1. I will apply correalation elimination on ...
1
vote
3answers
20 views

Deep Learning model for classifying skin diseases

I have planned to create a deep learning model that classifies skin diseases(around 5 to 7 diseases). Please suggest me a good deep learning model to go with. I am planning to integrate this model as ...
0
votes
0answers
12 views

Preparing and combining datasets for predictions

I am trying to create and train a model to predict the winner of a professional DOTA match. This model is only for "fun" and shouldn't be used for ...
0
votes
0answers
18 views

how do i preprocess percentage data?

I am analyzing a problem where i have 5 diseases and the measure of effectiveness of a remedy in its 7 first applications. The data is organized as an Excel spreadsheet as follows: (The spreadsheet ...
1
vote
1answer
2k views

Extracting data and saving data from hdf5

I have a hdf5 file, and I want to extract a part of the data and save it as the same format. The data type is DATATYPE H5T_IEEE_F32BE So far I have ...
1
vote
1answer
40 views

How to load all images using image_dataset_from_directory function?

I am working on a multi-label classification problem I faced memory issues so I want to use Keras image_dataset_from_directory method to load all images as batch. how to apply multi-label technique on ...
0
votes
1answer
42 views

Algorithm for user profiling without distinct profiles

I am trying to design an algorithm that takes in a new user with the variables department, location, job_role etc. and I want a machine-learning algorithm to decide ...
1
vote
1answer
48 views

Azure automl time series forecasting error

I'm using Microsoft Azure automl to try and generate models for time series forecasting but I keep getting an error: ...
1
vote
0answers
27 views

“Failed to find data adapter that can handle input” when working with mixed data

I have been trying to make my own generator that would handle an [image, float] value for the x (input), while the y is an int (linear output). My data is compiled into a ...
9
votes
2answers
4k views

Splitting train/test sets by an identifier?

I know sklearn has train_test_split() to split a train and test set. But I read that, even with setting a random seed, if your actual dataset is updated regularly, ...
-2
votes
0answers
9 views

Where to find good quality data sets about electricity data per country?

I want to investigate and compare different countries level regarding electrification as a part of studying how prepared they are in electrification of the automotive segment. Examples of information ...
0
votes
1answer
13 views

Data mining: Clique based clustering to make comparison in social network analysis

I am a very beginner in data mining. I want to work on Clique based clustering method. I want to make a comparison between various datasets for social network analysis or community detection of social ...
1
vote
1answer
26 views

How to deal with different audio formats for audio classification?

I am working on an audio classification problem statement to classify between two audio classes. I have collected samples from jotform, they are providing audio widget to collect .wav audio but it ...
2
votes
1answer
32 views

Application of Machine learning in modelling experimental system as a PhD topic

I am working as a control Engineer in a high energy physics lab. I am looking for a PhD thesis topic. Our experimental system is highly non linear and can't be modeled using standard white box ...
1
vote
1answer
22 views

Predicting invoice data of 12 month using only 1 month data

I have only 1 month of historical data of invoices can I predict next 12 month of data with good accuracy if it is possible then which model should I used for prediction? Thanks
1
vote
1answer
103 views

How to train on extended data set correctly

I have trained my classifier on pictures with a mixture of several classes on each picture, e.g. A-F. The classifier is able to (nearly) correctly segment those classes on the images. Now I got more ...
2
votes
0answers
17 views

How will my CNN results be affected by large discrepancies between the number of samples in some of the classes?

The number of samples in my dataset range between 3800 and 100,000 per class. Was wondering if my neural network will be more biased towards the classes with a higher number of images. I'm trying on ...

1
2 3 4 5
23