Questions tagged [dataset]

A dataset is a collection of data, often in tabular or matrix form. This tag is NOT intended for data requests ("where can I find a dataset about ...") --> see OpenData

Filter by
Sorted by
Tagged with
0
votes
1answer
19 views

Machine learning analysis for data set

I have a data set that contains houses, different features, and its prices. I'm trying to do an advanced analysis for this data set, I already did house price prediction analysis using different ...
1
vote
0answers
19 views

How to estimate and/or determine how much data is enough to train a model?

To train a nice supervised algorithm (for instance, a dependency parser, a parts-of-speech tagger or NER) data is essential, but how many samples are necessary or enough? From what kind of ...
0
votes
0answers
12 views

What is the main concept of using lexical,linguistic, semantic or syntactic approach in NLP for cyberbullying

I am really in need of some explanation, I am working on an NLP cyber-bullying detection tool which I will deploy to the web using Django framework, however, am stuck on some idea, can someone explain ...
1
vote
1answer
25 views

If a dataset is imbalanced in real life, should I train on my machine learning model on an imbalanced dataset [closed]

I have a dataset where around 20% of the data is the positive class and 80% of the data is the negative class. When I undersample and train my classifier on a balanced dataset and test on a balanced ...
1
vote
1answer
32 views

Train-Test split for a recommender system

In all implementations of recommender systems I've seen so far, the train-test split is performed in this manner: ...
0
votes
0answers
14 views

Any one has data set of apple disease detection? [closed]

I am working on Disease detection of Apple fruits so if any one has info please comment me.
2
votes
0answers
29 views

Fixed-Width vs Adaptive Binning

I have some continuous variable in my data that I wish to apply binning for. The values range from 0 to 800 but I got motivated by the fact that the data distribution was left skewed as you could see ...
0
votes
1answer
20 views

How is commercial use determined for data sets? [closed]

I found a data set that has all the info I need but it has a non commercial license on it. I tried contacting the organization but haven’t heard from them for several days. This is the site: https://...
0
votes
0answers
23 views

Autoencoder anamoly detection

I recently learnt about the anamoly detection using autoencoders(specifically denoisinng autoencoders).To train the autoencoders do we need a data having some pattern? or is there some way to ...
1
vote
0answers
44 views

Alignment of time series

I have two time series of different lengths: ...
0
votes
1answer
20 views

difference btw data distribution and frquency distribution

I have a dataset with 'n' features and corresponding labels(binary in nature). How can I calculate the data distribution and frequency distribution of the same? What is the difference btw the two?
1
vote
0answers
13 views

Calculate marginal probability distributions of a dataset

I have a dataset with 'n' features and a label(binary) corresponding each entry. I am using a predicitive model to predict these labels using those 'n' features. Now, I wish to know the marginal ...
1
vote
0answers
26 views

Need help regarding my thesis project related to Data Analysis [closed]

I am working on a project with a company that manufactures Injection molding machines. I am to perform data analysis on some selected parameters as a part of my thesis to tell the company if from ...
2
votes
1answer
64 views

How to properly apply CrossValidation and/or split the dataset?

I have a particular problem and do not really now how to properly validate my experiments in this scenario. There is one big data set with 100.000 samples, 99.000 y=0, 1.000 y=1 Each sample has 1.000 ...
2
votes
1answer
22 views

How do i get to make colab read my images from my google drive?

I havee about 2000 images, I have uploaded them to my Google drive. How do I make colab see and read these images. All the images are in one folder.
1
vote
0answers
15 views

propensity to pay in healthcare Datasets [closed]

I am searching for datasets or data sources (free or paid) to do a propensity to pay for healthcare industry. I found many solutions that offer complete solutions but whats interesting to me that they ...
1
vote
0answers
19 views

Organize the Dataset

I am working on a neural network(Variational Autoencoder) to separate music instruments I don't know how to organize my data I have a folder full of spectrograms of the songs as a mix and the ...
0
votes
0answers
27 views

How to find feature names of Breast Cancer Wisconsin (Prognostic) Data Set?

I want to work on a data set from UCI machine learning repository, It's WPBC. After reading the document on it website and some researching on the internet just understand that it has 34 features as ...
0
votes
1answer
14 views

Previous work Replication and Research ethics Ask Question

I am very much concerned about biding by research ethics in my work, especially issues to do with plagiarism. I come across a recent research paper in my field of study that applies state-of-the-art ...
2
votes
2answers
31 views

Data Quality Assessment in Image Data

I'm working on a CNN model that classifies images. After scraping image files from the Internet, I found that many of them didn't look this way as described by the searching keyword (for example ...
1
vote
0answers
14 views

News de duplication dataset

I am looking for a news dataset with semantically duplicate news articles tagged. Basically all the news articles which talk about the same story should be grouped. The stories can be worded ...
0
votes
0answers
16 views

Correlation between numeric variables of different meaning

I have a data set containing information about buildings, such as the area code, the neighborhood code, the number of floors, the year in which the house was built and the year in which restorations ...
1
vote
0answers
29 views

Dataset for musical Instruments recognition

I am looking for a "rich" Dataset to Teach my model to seperate Music intruments .. any Suggestion ? I found the URMP Dataset but it doesn't have many files.. I appreciate your help thanks and happy ...
2
votes
1answer
37 views

Is a data set considered to be linearly separable if it can only be separated by multiple hyperplanes?

For example, on the linear separability Wikipedia article, the following example is given: They say "The following example would need two straight lines and thus is not linearly separable". On the ...
8
votes
3answers
100 views

Is (nearly) all data separable?

Suppose I have some data set with two classes. I could draw a decision boundary around each data point belonging to one of these classes, and hence, separate the data, like so: Where the red lines ...
3
votes
0answers
16 views

Why RANDOM noise images always predicted as BIRD?

Say I have fine-tuned a 10-classification ResNet18 network on CIFAR-10 and the accuracy on validation set is about 93%. However when feeding into 5000 random noise images (Gaussian noise with the ...
0
votes
0answers
14 views

Where can I download images along with their annotations xml?

I need images and their annotation(xml) of various catgeries like 'Jackets','truck' ,'glasses' .Which site can I find them or is there any github repository where I ...
1
vote
2answers
33 views

In datasets, why don't we represent nominal values that are part of a scale with numbers?

I am trying to pre-process a small dataset. I don't understand why I am not supposed to do the thing I explained below: For example, say we have an attribute that describes the temperature of the ...
0
votes
0answers
15 views

Where is the start point if I want to use artificial intelligence on NASA space industry?

It sounds like dump question but as a beginner, working/learning AI and want to understand what artificial intelligence in the NASA space industry is doing. I want to work on this field but I don't ...
0
votes
0answers
15 views

How to use ttest on kfold data test results?

I used K-fold and partition my dataset to 10 sets of train and test after that put the result for every folds on a table, now I have 10 sets of results. After it get average of every column(my ...
2
votes
2answers
78 views

in which case can I say that the data are bad and I ll achieve nothing using machine learning on it

general Infos about my dataset: I have 40k data points and 5 features. I'm doing regression and trying to build a model that can predict the error of a GPS. for example imagine that your vehicle GPS ...
0
votes
0answers
9 views

Handling data with exactly same features but slightly different outputs? [Regression Problem]

I have a dataset where if I remove two attributes, in some cases remaining features are exactly the same but target value changes slightly. In my test set, I don't have those removed attributes so I ...
0
votes
0answers
17 views

Landmark images from Google-Landmarks dataset

I'm trying to find different landscapes images (for example Eiffel Tower, Neuschwanstein Castle etc) for an image classification task. I created a web sraping script but didn't get much more than 1000 ...
2
votes
1answer
31 views

Problem in creating a Numpy Dataset for Classification problem

I am trying to train a classification Model to classify Images, but my images here are Numpy arrays of 1's and 0's as shown in the Image, For now, I have tried, ...
0
votes
2answers
24 views

Dealing with data with no classes

I am new for data science subject and I am trying to learn on my own. Please bear with me if this is a stupid question. I have a dataset that has no classes. The data set comprises people's activity ...
2
votes
2answers
163 views

How to select features for a ML model

I have a dataset with 5K records for binary classification problem. My features are min_blood_pressure, max_blood_pressure, <...
1
vote
0answers
7 views

Corpus suggestion for financial domain [closed]

I am looking for a financial corpus or any form of publicly available financial texts which is replete with technical terms and acronyms. Any suggestion is appreciated.
2
votes
1answer
43 views

Text embeddings and data splitting

I have created some document embeddings which were then used further in text classification tasks. After revisiting my code I was unsure about the workflow I used to train the document embeddings. At ...
2
votes
1answer
21 views

is it a good idea to take the derivative or integral of some features and add them as new features in machine learning?

I'm learning how to do feature Engineering and come across some ideas in my head that's why I want to ask if I had some dataset with some features let's say 2 features and I have a timestamp column ...
1
vote
1answer
20 views

Quantifying the imbalanceness of a dataset

after looking a lot in the literature there is really a lot of how to work with imbalanced dataset but so far I can not find a definition of a imbalanced metric that quantifies how much imbalanced ...
1
vote
2answers
18 views
2
votes
1answer
38 views

How does one decide a dataset to be labelled 'Imbalanced'?

What, specifically, is the proportion that serves as the demarcation between balanced and imbalanced datasets in a binary classification problem as it is almost impossible to get a dataset with ...
0
votes
1answer
14 views

How to reshape ndarray to calculate the mean squared error?

y_train.shape = (7654,1) y_test.shape = (1914,1) mae = mean_absolute_error(y_train, y_test) gives: "ValueError: Found input variables with inconsistent numbers ...
1
vote
1answer
19 views

What are the standard parameters values for SMOTE technique?

I'm working on an imbalanced class data set (200 samples) with 2 classes, first class has 50 sample and second has 150 sample. My questions: When I use SMOTE technique on my data set my total ...
0
votes
1answer
16 views

Is it possible to change test and train data size when using crossvalind function with Kfold param?

I was looking at MATLAB Help and want to work with "crossvalind" function. It would two parameters that you can use it. If you use "HoldOut" you can define partition size of test and train data set ...
4
votes
1answer
37 views

What are some (non image) datasets where deep networks are required for good performance?

It is well known that deep networks tend to outperform shallow networks and other classical machine learning techniques such as boosting on learning tasks involving images. I believe this is because ...
0
votes
2answers
29 views

How to apply data binning on reviews data? [closed]

I need to apply data binning on a set of reviews, I have searched for some data binning methods for reviews and long-texts and couldn't find anything other than classification. Is NLP or ...
1
vote
0answers
16 views

Why crossvalind and cvpartition results are different?

I did a Test on my data set with "cvpartition" and "crossvalind" functions (in MATLAB) with the same parameters and data set, but why the error results are different and which one is correct? Codes ...
0
votes
0answers
21 views

How to do normalize distribution technique on a simple matrix?

This is just a practice about normal distribution in MATLAB and not a real project. I created a simple matrix and want to test normal distribution on it, it's ...