Questions tagged [dataset]

A dataset is a collection of data, often in tabular or matrix form. This tag is NOT intended for data requests ("where can I find a dataset about ...") --> see OpenData

Filter by
Sorted by
Tagged with
1
vote
2answers
57 views

How to deal with mixed type features?

I'm working on a dataset with more than 2000 features. Most of the features contain both numerical values and categorical features. For example, in the feature represents how long has the user been ...
4
votes
1answer
1k views

Is it possible to have stratified train-test split of a set based on two columns?

Consider a dataframe that contains two columns, text and label. I can very easily create a stratified train-test split using ...
0
votes
3answers
199 views

Which algorithm to use for transactional data

I'm given a Dataset of transactions and asked to find insights for businesses. I'm extremely new to ML / Data science and have only been experiencing with KMeans. The dataset has the following ...
4
votes
1answer
55 views

Public datasets that show “cyclical” behavior

I am looking for any publicly available dataset that has a "cyclical" structure to it, in the sense that if I plot the data in a certain way, a loop becomes visible. A good example of this ...
0
votes
0answers
23 views

Does Call Detail Record(CDR) data record different cell-site/tower on incoming and outgoing call/text?

I am working on CDR data to find important locations of user. The data I have does not have coordinates so I will be using cell-site location as user's location. But after doing some working on data I ...
1
vote
0answers
11 views

Checkerboard artefacts vs distinct objects in GANs

I found a very good solution for getting rid of checkerboard artefacts in GANs: https://github.com/junyanz/pytorch-CycleGAN-and-pix2pix/issues/190 Instead of using Transposed Convolution, use bilinear ...
0
votes
0answers
12 views

Free exchange rate data API for all countries at at least daily frequency since at least 2000?

I thought it would be a very common dataset: world exchange rates at daily frequency for every currency pair (or each currency's rate vs USD so triangulation can fill in for every other rate) But ...
0
votes
1answer
20 views

(Serious) Dataset of paedophilic Youtube comments (or similar)? [closed]

I think it would be useful to create a model that tries to predict whether a youtube comment is paedophilic - maybe the model should also take into account the channel name/description/front image. It'...
1
vote
0answers
11 views

Predicting a variably-placed value in a vector

I have $m$ vectors in $\mathbb{R}^n$, where $m >> n$, and I want to train a model to impute a value $x_i$ in $\mathbf{x}$, where $1 \leq i \leq n$ (and can vary by vector). For instance, I may ...
1
vote
1answer
13 views

Dataset to be used to learn NN regressions in classroom experiments

Can you suggest me datasets with intermediate size of about 1000-10000 to work with neural network regressions in classroom experiments? It seems that there are much more datasets for classification ...
2
votes
1answer
185 views

How do I read the cord_19_embeddings_2020-07-16.csv from the COVID-19 Open Research Dataset Challenge (CORD-19) on Kaggle?

What I'm trying to do I wanted to use the CORD19 word embeddings csv to map them to certain findings from the rest of the dataset, but as we can see there are no stings in the first column. The way I ...
3
votes
1answer
32 views

What does it mean that an hypotesis is consistent?

I am studying concept learning, and I am focusing on the concept of consistency for an hypotesis. Consider an Hypotesis $h$, I have understood that it is consistent with a training set $D$ iff $h(x)=c(...
2
votes
3answers
63 views

What is the best way for synthetic data generation while maintaining privacy?

For one of the projects where we are working as third party contractors, we need a way for the company to share some datasets which can be used for data science. It is not possible for the company to ...
1
vote
1answer
25 views

Cleaning a certain feature to predict salary using Machine Learning

Info: I am working on a dataset, and i would like to create a model that would predict salary. Columns are as follows: ...
1
vote
0answers
50 views

Will setting up time series data in this way cause data leakage?

I am trying to predict future stock market values using a gradient boosted tree model. As far as I know, gradient boosted trees use the data in one row, and only that row, to predict the target ...
0
votes
1answer
64 views

Sklearn SVM question classification

So, I have found that there are many ways to classify words with sklearn's SVM algorithm. But I want to classify questions by taxonomy, as shown in the following dataset: The goal of this task is to ...
0
votes
0answers
11 views

Estimate class proportions of a feature, central limit theorem

haven't been feeling smart lately and this is probably the most trivial question ever but I really need to know. I'm trying to point estimate some population parameters. I sampled from 1000 randomly ...
2
votes
1answer
30 views

Missing at random vs missing not at random: What if it is both? (Does one imply the other?)

My understanding is that: Missing at random: Whether or not a variable's value is missing is dependent on the values of the other variables. Missing not at random: When the propensity for a variable'...
1
vote
0answers
36 views

Pandas how to change values in a column [closed]

I have data on mchip, chip schip and mcaid that contains the following columns/features: year (between 2000 and 2016), state, age and month. I have a problem with several years. For example, I want to ...
2
votes
0answers
9 views

Dataset suggestion: video dataset with accurate depth and pose info

Please suggest some datasets (can be synthetic, like rendered in blender or so) which have video frames (30fps preferred) with accurate ground truth depth maps and pose (rotation and translation for ...
0
votes
1answer
23 views

Exploratory Data Analysis on dataset divided by winners and losers

I have a dataset where I have features from winning tennis players and the other half are from a losing tennis players: ...
2
votes
1answer
53 views

List of numbers as classifier input

I am trying to use my data to predict the classes of the input. My data are as the following: ...
0
votes
1answer
179 views

How to determine sample rate of a time series dataset?

I have a dataset of magnetometer sensor readings which looks like: ...
1
vote
0answers
44 views

Datasets for software defined network (SDN) [closed]

I am working on a project with Software Defined Networks (SDN), and new to SDN area. I was checking around internet to find a benchmark dataset, which is a flow based dataset inorder to apply ML ...
0
votes
1answer
20 views

How to Transpose dataframe with custom output? [closed]

I have a data like this: I want to transpose it like this in python:
2
votes
2answers
443 views

Modality of data

Can anyone please explain in clear words what is generally meant by "modality of data"? I know what modality means with respect to distributions.
0
votes
1answer
30 views

Dynamic graph dataset

I'm working with dynamic graph embedding but I can not seek the dataset for my problem. Can you help me find dataset with some requires: A series of graph which represent for dynamic graphs. Each ...
1
vote
2answers
2k views

R : Counting the number of observations per category

I'm currently starting out in R and wondering how to count the number of observations per day, per node, per replicate from the below dataset, and store in a different data set. The original dataset ...
0
votes
1answer
674 views

training accuracy greater than validation accuracy

The problem that I'm facing is that the training accuracy of my model is way higher than the validation accuracy, were talking about an approximate value of 0.2. ...
1
vote
1answer
26 views

How to deal with different audio formats for audio classification?

I am working on an audio classification problem statement to classify between two audio classes. I have collected samples from jotform, they are providing audio widget to collect .wav audio but it ...
2
votes
0answers
175 views

Where can i download a benign PE dataset? or at least which website is the best candidate for crawling and downloading normal executables?

I'm planning to gather a benign dataset for my ML malware detection model the problem I'm having is finding benign PE files, i just need a source that has a dataset of normal executables, i will scan ...
1
vote
2answers
22 views

Biasing SVM algorithm towards particular subset of data

I'm training an SVM model for sentiment analysis, based on social media data eg. tweets. The model will be trained using a small selection of a particular company's tweets in order to classify new ...
0
votes
0answers
18 views

RMSE in NGBoost example appears to be unreasonably high

I tried using Standford's ML Group NGBoost. I tried using this example provided by the authors of the repository. While training the output is along the lines of : ...
1
vote
0answers
25 views

What is important for Pharmaceutical companies to answer with Big Data Analysis?

I am a data scientist, and I have some biological background (genetics). I have been asked to give a talk for our customers from pharmaceutical industry. I should show them how they benefit from Big ...
-1
votes
1answer
25 views

How to Select Rows from Pandas DataFrame with condition [closed]

I have a dataframe (csv file) which consists of about 8000 songs (column name "Song")of e.g. 20 singers(column name "Artist"), so each singer has more than one song. I want to ...
1
vote
2answers
31 views

Negative Value in Covid-19 Dataset

I am currently practicing my data visualization skills with ourworldindata dataset. I noticed there is a negative value of new_cases in Benin country. Out of ...
1
vote
0answers
17 views

Orange 3 working with multiple datasets [closed]

I do not know if it is possible to somehow connect different datasets, that are related in some way, in Orange 3. I am working with EEG multiple files (of channel values results) and one main data ...
1
vote
1answer
13 views

Dataset recommendation, ordinal target variable

Does anyone have any recommendations for datasets with an ordinal target? I'm currently using a rounded target from the Boston dataset. ...
0
votes
3answers
60 views

How do i get dummies for this dataset

I am using an udemy course for MachineLearning and I am trying to form a dummy for my variable the column is Country I want to change to France Germany Spain France ...
0
votes
1answer
21 views

Transform large pd.Series into a DataFrame of n columns

I have a pd.Series with, for instance, n lines. I would like to transform this series in a ...
2
votes
0answers
44 views

Regression dataset with categorical features

I have thought of a regression technique that I want to try on several datasets. I would like these datasets to have the following properties: Be a tabular dataset (no images). Have at least 20k rows,...
0
votes
0answers
33 views

How to pass noisy images as input and original images as labels in Keras - Autoencoders

I want to make denoising autoencoder, I've added some noise to images, and i want to use them for training, original images will be used as label. Reading the keras documentation I've found that I ...
1
vote
1answer
31 views

Ingredients, Recipes and recipe ratings. I would like to predict the rating based on combination of ingredients

I would really appreciate some help on the first steps to my problem, suggestions of modeling techniques i could use or relevant research (i could not find any). I have a list of ingredients (150 in ...
0
votes
0answers
11 views

Best approach for finding longest permutation lengths between two endpoints?

Curious on the best approach or mathematical topic category so I may research involving permutations I believe, or maybe it is number theory this question pertains to? I am interested in if datasets ...
1
vote
0answers
62 views

What is the difference between domain randomization and data augmentation?

Domain randomization (https://arxiv.org/abs/1703.06907) is used to create a synthetic dataset with enough variance that it will encompass unseen real data, as just one variation. I am trying to ...
0
votes
2answers
175 views

Combine two DataFrames column wise in Pandas

I have 2 Dataframes as shown and I want a new DataFrame where the 1st column is the 1st column of the 1st DataFrame and 2nd column from the 1st column of the 2nd DataFrame. I have tried pivot table ...
0
votes
0answers
13 views

Perform collaborative recommender analysis without rating in a transactional data

I'm exploring options for recommender systems optimized for the online retail dataset, which would take into account that no product or user rating is available. Can collaborative recommender analysis ...
2
votes
1answer
48 views

looking for public dataset for stock market

I want to do some modelling and data visualization on historical stock data, including price, volume, financials, etc. Is there an public dataset available for stock price history? I looked at a few, ...
0
votes
0answers
19 views

Question regarding strata in Geron's book

In the book "Hands-On Machine Learning with Scikit-Learn and Tensorflow" by Aurélien Géron. There is a regression project explained. My doubt is regarding his example for 'stratified sampling'. He ...
0
votes
0answers
46 views

Best way to add border to rectangular images to train on StyleGAN2

TLDR: What is a best way to add borders to rectangular images with widely variable aspect ratios (from 0.5 to 2.0) to later use them as training data in StyleGAN2 with data resolution of 1024x1024 and ...

1 2 3
4
5
23