Questions tagged [dataset]

A dataset is a collection of data, often in tabular or matrix form. This tag is NOT intended for data requests ("where can I find a dataset about ...") --> see OpenData

Filter by
Sorted by
Tagged with
0
votes
0answers
10 views

Searching for Multitarget regression dataset [closed]

input variable 3-10(data type : Numbers) target variable 2-10(data type : Numbers) Number of data points more than 2000
0
votes
1answer
15 views

Combining Two CSV's in Jupyter Notebook

I want to combine both CSV files based on Column1, also when combined each element of Column1 of both csv should match and also each row or Please suggest how to reorder Column1 according to another ...
0
votes
0answers
6 views

Are there labeled multivariate time series data sets where only a subset/partial number of time series is relevant for each class?

I am looking for a data set of multivariate time series data which contains classes that only require a subset of time series for their identification. Assume a human activity recognition data set ...
0
votes
1answer
15 views

How would you encode missing pixels in image data?

I am working through an example on the MNIST dataset, and was just curious, if your image input data were missing some pixels, how would you encode it. Since the values are always positive, and ...
0
votes
1answer
7 views

Which colour channel from a TIFF image do I have to use?

I'm going to use the following dataset to do semantic segmentation with U-Net network. LGG Segmentation Dataset This dataset contains brain MR images together with manual FLAIR abnormality ...
0
votes
0answers
14 views

Where to save image features to avoid repeating extraction?

I am implementing Bag-of-Visual-Words. Part of that is SIFT, it has a task of extracting features and outputs a vector. Afterwards, the vector are clustered and made into a histogram. Histograms are ...
0
votes
0answers
16 views

How to prepare Audio-text data for speech recognition

I have gathered some raw audio from all the conferences, meetings, lectures & casual conversation that I was part of. The machine transcription did not offer good results (from Azure, AWS etc.) I ...
1
vote
1answer
32 views

Creating a valid dataset for obtaining results

I have created a domain-specific dataset, lets say it is relating to python programming topic posts. I have taken data from various places specific to this topic to create positive examples in my ...
0
votes
0answers
8 views

Semantic segmentation with greyscale images

I'm trying to reproduce a research with greyscale images instead of colour images. I have found that there are pre-trained networks, like VGG16, with ImageNet. But that dataset has colour images, and ...
-2
votes
0answers
17 views

Best approach for classifying large image dataset [closed]

I am looking to use machine learning to solve a fairly straightforward problem, with a few interesting points. (I can't give away too many specific details, sorry...) I have a dataset of over 800 ...
-1
votes
0answers
14 views

Mutual User Ratio Between Sub-Products - Analysis [closed]

I have data regarding mutual monthly users between 3 sub-products for the past 6 months. Attached an example of 2 sub products. What kind of Insights I can provide? Is this data is usable somehow? ...
0
votes
0answers
38 views

Do I need to use learning algorithms for this type of data?

I'm studying the behavior of machine failures in a production scenario. For this, I generated random data to form my imbalanced training set, consisting of categorical data, which indicate whether or ...
1
vote
2answers
26 views

What are suitable datasets for univariate time series forecasting with RNNs, LGBM, TBATS, SARIMA models (topic, frequency, sources)? [closed]

I am currently looking for a suitable dataset (univariate time series) for short-term forecasting using lag features or moving windows of lag features to employ models like LSTM, GRU, SARIMA, LGBM, ...
1
vote
0answers
30 views

What is the correct way to use Active Learning on a huge and unbalanced text dataset?

I am working on a huge and unlabeled text dataset. It has over 30M lines (= sentences). We are trying to detect illegal sentences by analyzing 20 different legal issues (e.g. racism, insults, etc.). ...
1
vote
0answers
23 views

Fine tuning a automatic speech recognition model with my own dataset

I'm using wav2letter to develop a speech-to-text system. wav2letter has pre-built acoustic and language models which is great, however the audio that I am transcribing from is unique in comparison to ...
0
votes
1answer
24 views

Comparing Dataset - Should I use the same Test dataset?

I am training ML CNN model. I want to compare different images dataset. The dataset all have different characteristics (Translated or not, Rotated or not, etc.). I do not modify the ML model between ...
1
vote
1answer
15 views

What is the right way to store datasets for a CNN project [closed]

Our image classification project has thousands of raw photos, masks and reshaped images. We store source code in git. But datasets don't belong to source code version control. How should we store thee ...
0
votes
2answers
44 views

How to deal with mixed type features?

I'm working on a dataset with more than 2000 features. Most of the features contain both numerical values and categorical features. For example, in the feature represents how long has the user been ...
3
votes
1answer
47 views

Is it possible to have stratified train-test split of a set based on two columns?

Consider a dataframe that contains two columns, text and label. I can very easily create a stratified train-test split using ...
0
votes
2answers
33 views

Which algorithm to use for transactional data

I'm given a Dataset of transactions and asked to find insights for businesses. I'm extremely new to ML / Data science and have only been experiencing with KMeans. The dataset has the following ...
4
votes
1answer
37 views

Public datasets that show “cyclical” behavior

I am looking for any publicly available dataset that has a "cyclical" structure to it, in the sense that if I plot the data in a certain way, a loop becomes visible. A good example of this ...
0
votes
0answers
9 views

Does Call Detail Record(CDR) data record different cell-site/tower on incoming and outgoing call/text?

I am working on CDR data to find important locations of user. The data I have does not have coordinates so I will be using cell-site location as user's location. But after doing some working on data I ...
1
vote
0answers
7 views

Checkerboard artefacts vs distinct objects in GANs

I found a very good solution for getting rid of checkerboard artefacts in GANs: https://github.com/junyanz/pytorch-CycleGAN-and-pix2pix/issues/190 Instead of using Transposed Convolution, use bilinear ...
0
votes
0answers
9 views

Free exchange rate data API for all countries at at least daily frequency since at least 2000?

I thought it would be a very common dataset: world exchange rates at daily frequency for every currency pair (or each currency's rate vs USD so triangulation can fill in for every other rate) But ...
0
votes
1answer
19 views

(Serious) Dataset of paedophilic Youtube comments (or similar)? [closed]

I think it would be useful to create a model that tries to predict whether a youtube comment is paedophilic - maybe the model should also take into account the channel name/description/front image. It'...
0
votes
0answers
10 views

Predicting a variably-placed value in a vector

I have $m$ vectors in $\mathbb{R}^n$, where $m >> n$, and I want to train a model to impute a value $x_i$ in $\mathbf{x}$, where $1 \leq i \leq n$ (and can vary by vector). For instance, I may ...
0
votes
1answer
8 views

Dataset to be used to learn NN regressions in classroom experiments

Can you suggest me datasets with intermediate size of about 1000-10000 to work with neural network regressions in classroom experiments? It seems that there are much more datasets for classification ...
0
votes
1answer
47 views

How do I read the cord_19_embeddings_2020-07-16.csv from the CORD19?

What I'm trying to do I wanted to use the CORD19 word embeddings csv to map them to certain findings from the rest of the dataset, but as we can see there are no stings in the first column. The way I ...
2
votes
1answer
29 views

What does it mean that an hypotesis is consistent?

I am studying concept learning, and I am focusing on the concept of consistency for an hypotesis. Consider an Hypotesis $h$, I have understood that it is consistent with a training set $D$ iff $h(x)=c(...
2
votes
3answers
53 views

What is the best way for synthetic data generation while maintaining privacy?

For one of the projects where we are working as third party contractors, we need a way for the company to share some datasets which can be used for data science. It is not possible for the company to ...
0
votes
0answers
13 views

Should I filter my chess game-states?

I have written an AI which plays chess and learns from a dataset of game-states, where each state is a record of a board position and a corresponding result of the game. This causes some inequalities ...
0
votes
1answer
21 views

What to consider when training on data from multiple sources (datasets) [closed]

I am trying to train a ConvNet on a certain problem. I have different datasets collected from different research groups on the same problem. I want to merge them together to make one big dataset - but ...
1
vote
1answer
14 views

Cleaning a certain feature to predict salary using Machine Learning

Info: I am working on a dataset, and i would like to create a model that would predict salary. Columns are as follows: ...
1
vote
0answers
20 views

Will setting up time series data in this way cause data leakage?

I am trying to predict future stock market values using a gradient boosted tree model. As far as I know, gradient boosted trees use the data in one row, and only that row, to predict the target ...
0
votes
1answer
32 views

Sklearn SVM question classification

So, I have found that there are many ways to classify words with sklearn's SVM algorithm. But I want to classify questions by taxonomy, as shown in the following dataset: The goal of this task is to ...
0
votes
0answers
10 views

Estimate class proportions of a feature, central limit theorem

haven't been feeling smart lately and this is probably the most trivial question ever but I really need to know. I'm trying to point estimate some population parameters. I sampled from 1000 randomly ...
2
votes
1answer
18 views

Missing at random vs missing not at random: What if it is both? (Does one imply the other?)

My understanding is that: Missing at random: Whether or not a variable's value is missing is dependent on the values of the other variables. Missing not at random: When the propensity for a variable'...
1
vote
0answers
33 views

Pandas how to change values in a column [closed]

I have data on mchip, chip schip and mcaid that contains the following columns/features: year (between 2000 and 2016), state, age and month. I have a problem with several years. For example, I want to ...
2
votes
0answers
9 views

Dataset suggestion: video dataset with accurate depth and pose info

Please suggest some datasets (can be synthetic, like rendered in blender or so) which have video frames (30fps preferred) with accurate ground truth depth maps and pose (rotation and translation for ...
0
votes
1answer
22 views

Exploratory Data Analysis on dataset divided by winners and losers

I have a dataset where I have features from winning tennis players and the other half are from a losing tennis players: ...
2
votes
1answer
42 views

List of numbers as classifier input

I am trying to use my data to predict the classes of the input. My data are as the following: ...
0
votes
1answer
23 views

How to determine sample rate of a time series dataset?

I have a dataset of magnetometer sensor readings which looks like: ...
1
vote
0answers
9 views

Datasets for software defined network (SDN)

I am working on a project with Software Defined Networks (SDN), and new to SDN area. I was checking around internet to find a benchmark dataset, which is a flow based dataset inorder to apply ML ...
0
votes
1answer
15 views

How to Transpose dataframe with custom output? [closed]

I have a data like this: I want to transpose it like this in python:
1
vote
2answers
27 views

Modality of data

Can anyone please explain in clear words what is generally meant by "modality of data"? I know what modality means with respect to distributions.
0
votes
0answers
12 views

Dynamic graph dataset

I'm working with dynamic graph embedding but I can not seek the dataset for my problem. Can you help me find dataset with some requires: A series of graph which represent for dynamic graphs. Each ...
1
vote
2answers
25 views

R : Counting the number of observations per category

I'm currently starting out in R and wondering how to count the number of observations per day, per node, per replicate from the below dataset, and store in a different data set. The original dataset ...
-1
votes
1answer
14 views

training accuracy greater than validation accuracy

The problem that I'm facing is that the training accuracy of my model is way higher than the validation accuracy, were talking about an approximate value of 0.2. ...
1
vote
0answers
14 views

How to deal with different audio formats for audio classification?

I am working on an audio classification problem statement to classify between two audio classes. I have collected samples from jotform, they are providing audio widget to collect .wav audio but it ...
2
votes
0answers
28 views

Where can i download a benign PE dataset? or at least which website is the best candidate for crawling and downloading normal executables?

I'm planning to gather a benign dataset for my ML malware detection model the problem I'm having is finding benign PE files, i just need a source that has a dataset of normal executables, i will scan ...

1
2 3 4 5
22