Questions tagged [dataset]

A dataset is a collection of data, often in tabular or matrix form. This tag is NOT intended for data requests ("where can I find a dataset about ...") --> see OpenData

Filter by
Sorted by
Tagged with
0
votes
0answers
8 views

Combining time-series data from different devices

I am using four different sensor models (four different devices) to gather some biometric data(eg. heart rate) for the same user, for the same time period. In an ideal scenario, all the devices are ...
0
votes
0answers
5 views

Place365 Mean Pixel Subtraction Values

In Place205, input images are zero-centered by mean pixel (rather than mean image) subtraction with the following values explained in readme.txt file when ...
0
votes
0answers
35 views

Finding patterns in dataset

I've got a big dataset which looks like: ...
0
votes
0answers
10 views

Using Images uploaded in google drive in Colab

Does anyone know how to use already uploaded images in Google Drive to colaboratory for creating a trainloader? I'm creating the trainloader and model in Pytorch
0
votes
1answer
23 views

How should I read the following heatmap?

I've been playing around with the linear regression, and I was thought that before commencing it's always good to plot an heatmap to see whether there are features that somehow is worth testing for ...
4
votes
2answers
54 views

Is there a way to recognize which of these scatter plots is “better”?

I doubt better is the correct adjective, apologies for that. What I mean is this: I have a set of files (1200~) each paired with a scatterplot image. I need to find a way to classify which data files ...
-1
votes
0answers
11 views

Showing Data of multiple magnitude in same chart

I am a UX Designer and currently working on some designs revolving around analytics and trends. One of the problems I am facing is to show data of multiple magnitudes in the same chart. For example, ...
0
votes
0answers
9 views

Where can I find a dataset with labelled articles by topic? [migrated]

I am looking for a dataset containing articles (with article-text, or alternatively I am fine with only URLs too) and the corresponding topic label (i.e. politics, art, gardening etc.) Any idea?
0
votes
0answers
16 views

How do I get a food choke video dataset (creatively)? [closed]

I wish to get food choke video dataset for food choke action recognition, but there is no such dataset available. How should I get those videos dataset (creatively if possible)?
1
vote
1answer
14 views

Creating pronunciation dictionary for ASR

I am working on ASR(automatic speech recoginition) on Somali data as master thesis and now I am stuck with how to create a phonetics or pronunciation dictionary for it. I searched over net and could ...
0
votes
0answers
14 views

How to recognition gender based on the whole body using Deep learning? [closed]

I can identify gender using the face image. Is there any way to identify gender based on a whole human body? If yes, do anybody has pre dataset to train a model
0
votes
0answers
10 views

Getting -NaN during DARKNET training, what am i doing wrong? [closed]

I want to train YOLOv3 to detect humans on aerial pictures. Im using VisDrone Object Detection in Images dataset: github.com/VisDrone/VisDrone-Dataset I wrote a script that converted labels to ...
0
votes
1answer
55 views

Logistic Regression outperforms MLPClassifier

I am new in ML and I am trying to train classifier. I have a tiny dataset, just 90 examples, I divided it 70/30 train/test set and started to train. As I know MLP must outperform Logistic Regression, ...
0
votes
0answers
6 views

Virtual Generation of Synthetic Ancient and Dirty English Documents

I have a collection of dirty background image, below is the sample: I have also a collection of an actual image of a dirty document with text on it, just like below: My problem with my actual image ...
2
votes
1answer
49 views

When should we use the principles of tidy data by Hadley Whickham, and when should we avoid using it?

I have been studying and data science for the past 6 months, however I just came across the principles of tidy data by Hadley Wickham in an article by Jean-Nicholas Hould. This completely changed my ...
0
votes
1answer
27 views

On which data evaluate an object detection model ? (similar or real life data ?)

I'm training an object detection model (SSD300) to detect and classify body poses in thermal images. Even I have more than 2k different poses, the background does not change much (I have only 5 ...
0
votes
1answer
33 views

What should I do with a test and train set not having same classes?

Assume we have a train dataset with 5 classes a,b,c,d,e but the test dataset have only d and e with extra class f not present in train set. If i want to do machine learning with this datset in weka or ...
0
votes
0answers
20 views

How do I read a dat file, for which I don't know its structure?

Is there any way to atleast read the text from the dat file. I have its corresponding mdf file hence I know what all data and columns are there in it. How do I figure out the contents in my dat file. ...
0
votes
1answer
20 views

single v/s multiple user machine learning model

What are the merits and demerits of training machine learning models(One-class svm, isolation forest, DBSCAN) for anomaly detection on single-user data set and multiple user data set.? keep in mind ...
0
votes
0answers
7 views

How can partial dependence help us see whether a dip in the data is caused by external factors or not?

I'm watching this FastAI course, and we're trying to predict the price of bulldozers. At one point, we figured the year the bulldozers were made is very important, so we plotted a graph with x = year ...
0
votes
0answers
34 views

Train a neural network through comparisons between images using Keras

I have a Dataset composed of 2 arrays of images and an array of desired outputs. Arrays have the same length. I have to train a neural network using keras able to recognize who is younger/older/same ...
1
vote
0answers
9 views

Non-parametric regression on set of time series: One model for each or one for all series?

Let's say I have a set of 1D time series which values have been samples in equip-distant time steps with timestamps $1,2,3,...$, they have all the same lengths and are somewhat similar in shape. I ...
0
votes
1answer
16 views

How to group a unique column and find the mean value in a separate column in R

My table of data looks like this image (but with many more lines): I want to be able to find the mean age of each region, so the mean age for region SSC20790 and so on. I believe I can use the <...
1
vote
0answers
14 views

Tool/Technology/Framework to process file with 1GB

I'm new to datascience, but I have the following problem: 1) Read a file of 1GB, which each line is a json object 2) There are two more files, much smaller, which I need to JOIN some data In this ...
1
vote
1answer
19 views

How to compute modulo of a hash?

Let's say that I have a set of users in my database, that have GUIDs as their IDs. I use xxhash to generate fixed-length hashes for each value, so that I can then ...
0
votes
0answers
11 views

Which one is used to calculate the number of data needed for Machine Learning Models?

I am wondering which one is used to calculate the needed number of data for Machine Learning models between Hoeffding's Inequality and Power Analysis. I don't know which one people use when we need to ...
0
votes
1answer
21 views

Machine learning analysis for data set

I have a data set that contains houses, different features, and its prices. I'm trying to do an advanced analysis for this data set, I already did house price prediction analysis using different ...
1
vote
0answers
26 views

How to estimate and/or determine how much data is enough to train a model?

To train a nice supervised algorithm (for instance, a dependency parser, a parts-of-speech tagger or NER) data is essential, but how many samples are necessary or enough? From what kind of ...
0
votes
1answer
20 views

What is the main concept of using lexical,linguistic, semantic or syntactic approach in NLP for cyberbullying

I am really in need of some explanation, I am working on an NLP cyber-bullying detection tool which I will deploy to the web using Django framework, however, am stuck on some idea, can someone explain ...
1
vote
1answer
25 views

If a dataset is imbalanced in real life, should I train on my machine learning model on an imbalanced dataset [closed]

I have a dataset where around 20% of the data is the positive class and 80% of the data is the negative class. When I undersample and train my classifier on a balanced dataset and test on a balanced ...
1
vote
1answer
50 views

Train-Test split for a recommender system

In all implementations of recommender systems I've seen so far, the train-test split is performed in this manner: ...
2
votes
0answers
34 views

Fixed-Width vs Adaptive Binning

I have some continuous variable in my data that I wish to apply binning for. The values range from 0 to 800 but I got motivated by the fact that the data distribution was left skewed as you could see ...
1
vote
1answer
36 views

Autoencoder anamoly detection

I recently learnt about the anamoly detection using autoencoders(specifically denoisinng autoencoders).To train the autoencoders do we need a data having some pattern? or is there some way to ...
1
vote
0answers
52 views

Alignment of time series

I have two time series of different lengths: ...
0
votes
1answer
26 views

difference btw data distribution and frquency distribution

I have a dataset with 'n' features and corresponding labels(binary in nature). How can I calculate the data distribution and frequency distribution of the same? What is the difference btw the two?
1
vote
0answers
13 views

Calculate marginal probability distributions of a dataset

I have a dataset with 'n' features and a label(binary) corresponding each entry. I am using a predicitive model to predict these labels using those 'n' features. Now, I wish to know the marginal ...
1
vote
0answers
26 views

Need help regarding my thesis project related to Data Analysis [closed]

I am working on a project with a company that manufactures Injection molding machines. I am to perform data analysis on some selected parameters as a part of my thesis to tell the company if from ...
2
votes
1answer
68 views

How to properly apply CrossValidation and/or split the dataset?

I have a particular problem and do not really now how to properly validate my experiments in this scenario. There is one big data set with 100.000 samples, 99.000 y=0, 1.000 y=1 Each sample has 1.000 ...
2
votes
1answer
30 views

How do i get to make colab read my images from my google drive?

I havee about 2000 images, I have uploaded them to my Google drive. How do I make colab see and read these images. All the images are in one folder.
1
vote
0answers
17 views

propensity to pay in healthcare Datasets [closed]

I am searching for datasets or data sources (free or paid) to do a propensity to pay for healthcare industry. I found many solutions that offer complete solutions but whats interesting to me that they ...
1
vote
0answers
19 views

Organize the Dataset

I am working on a neural network(Variational Autoencoder) to separate music instruments I don't know how to organize my data I have a folder full of spectrograms of the songs as a mix and the ...
0
votes
0answers
32 views

How to find feature names of Breast Cancer Wisconsin (Prognostic) Data Set?

I want to work on a data set from UCI machine learning repository, It's WPBC. After reading the document on it website and some researching on the internet just understand that it has 34 features as ...
0
votes
1answer
14 views

Previous work Replication and Research ethics Ask Question

I am very much concerned about biding by research ethics in my work, especially issues to do with plagiarism. I come across a recent research paper in my field of study that applies state-of-the-art ...
2
votes
2answers
32 views

Data Quality Assessment in Image Data

I'm working on a CNN model that classifies images. After scraping image files from the Internet, I found that many of them didn't look this way as described by the searching keyword (for example ...
1
vote
0answers
16 views

News de duplication dataset

I am looking for a news dataset with semantically duplicate news articles tagged. Basically all the news articles which talk about the same story should be grouped. The stories can be worded ...
0
votes
0answers
16 views

Correlation between numeric variables of different meaning

I have a data set containing information about buildings, such as the area code, the neighborhood code, the number of floors, the year in which the house was built and the year in which restorations ...
1
vote
0answers
32 views

Dataset for musical Instruments recognition

I am looking for a "rich" Dataset to Teach my model to seperate Music intruments .. any Suggestion ? I found the URMP Dataset but it doesn't have many files.. I appreciate your help thanks and happy ...
2
votes
1answer
50 views

Is a data set considered to be linearly separable if it can only be separated by multiple hyperplanes?

For example, on the linear separability Wikipedia article, the following example is given: They say "The following example would need two straight lines and thus is not linearly separable". On the ...
8
votes
3answers
106 views

Is (nearly) all data separable?

Suppose I have some data set with two classes. I could draw a decision boundary around each data point belonging to one of these classes, and hence, separate the data, like so: Where the red lines ...
3
votes
0answers
16 views

Why RANDOM noise images always predicted as BIRD?

Say I have fine-tuned a 10-classification ResNet18 network on CIFAR-10 and the accuracy on validation set is about 93%. However when feeding into 5000 random noise images (Gaussian noise with the ...

1 2 3 4 5 19