Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [dataset]

A dataset is a collection of data, generally represented in tabular form, with columns signifying different variables and rows signify different members of the set.

0
votes
1answer
9 views

how do i separate individual data from a single string

A lot of data like **current address, current city ...**etc are missing in the majority of strings. I know how to preprocess data but the noob in me is unable to categorize the data from a single ...
0
votes
0answers
6 views

How to efficiently store large amounts of speech to text data

I am currently facing the problem of having to deal with a lot of data (a few hundred GB and growing) for an automated speech recognition (or speech to text) task. Most datasets I am using are coming ...
0
votes
0answers
9 views

Do you have access to the Marmot dataset for document analysis? The official link is not working [on hold]

Through here you can find all the links that are not working: http://www.icst.pku.edu.cn/cpdp/sjzy/index.htm So far I haven't been able to access this dataset.
0
votes
1answer
8 views

What architecture would best perform image material segmentation?

I want to perform semantic/stuff segmentation, but then classify and segment with respect to the material properties of objects in an image, rather than the objects themselves. This means that, ...
0
votes
0answers
12 views

Repeated groups of columns in data analysis

I have a got a medical records for analysis, which have repeated groups of columns holding information about the medicines taken. The records are initially stored as an Excel table, having multiple ...
1
vote
1answer
30 views

How to select random data for two different recommender systems?

The business problem: We have two different vendors that offer personalized recommender engines and want to do A/B testing with them. The recommendation will give the user a personalized offer via a ...
0
votes
0answers
10 views

Linux commands description data set [on hold]

I am a beginner I try to build an assistant for my Linux, I choose to use machine learning approach to build it, the user will ask for any task related to files/directories manipulation in natural ...
0
votes
1answer
20 views

Pre-processing on MRI images

I have MRI images of brain tumors collected from a hospital (not a benchmark dataset). And I am planning to use them to predict/classify tumour types using a typical machine learning approach: texture ...
0
votes
0answers
8 views

Are there any open data sets for software clasification? [migrated]

I want to train a classifier that takes as input the description of a software installation and outputs tags based on categories that the new installation fits into. Are there any publicly available ...
0
votes
0answers
14 views

How can I get the input sentances of the keras sample IMDB dataset?

I am using the sample dataset provided by the Keras library. Dataset of 25,000 movies reviews from IMDB, labeled by sentiment (positive/negative). Reviews have been preprocessed, and each review is ...
0
votes
0answers
9 views

Semantic segmentation training on images of different sizes - good practices

What are the good practices of handling images when training the neural networks for semantic segmentation, but the images have different sizes and aspect ratios? Also, how to properly handle small ...
0
votes
0answers
12 views

Looking for Spatio-temporal Datasets [migrated]

Spatio dataset is a dataset which contain latitude-longitude and also time variable. I got the dataset about spatio-temporal on this site http://js.cit.datalens.api.here.com/datasets/starter_pack/...
3
votes
2answers
34 views

Data set with multiple tables

I want to check an algorithm that learns the connections between different tables in a database. Where can I find datasets that are compound of multiple tables (i.e. more than 5) that have ...
0
votes
0answers
16 views

Is there a name for this phenomena (Asking a question that is obviously not covered by a case study)

I came across this situation when presenting conference papers as part of my PhD (Data Modelling, and Fault prediction). The set up is as follows: I would provide a 10 - 15 minute pitch of my case ...
0
votes
2answers
24 views

model to predict annual outcome based on previous years data

I have below datasets for two years each holding about 10.000 records. Every week a new report is generated that shows the performance for the current or any previous month. Therefore a more recent ...
0
votes
0answers
6 views

How should I create attributes in my dataset if any permutation of the values yield the same result?

I am trying to make a movie rating predicting system. My approach is that the team (actors, directors, writers, producers, etc) is the determining factor. There can be more than one of each of those ...
0
votes
1answer
13 views

Training on a subset of data for few epochs and then proceeding to the next subset for few epochs and so on?

My training data is very huge and it's impossible to load all of it at once even into main memory. So I'm loading a few blocks (subset) of data and training till convergence, then proceeding to next ...
1
vote
0answers
19 views

When projecting data with UMAP, should I use only the samples I need projected or the entire dataset?

I have a neural network that maps my data samples to a 64-dimensional embedding. I wish to visualize a few of these embeddings (between 30 and 600) through a 2-dimensional projection, and I plan to ...
1
vote
1answer
31 views

How to do feature analyzing : pandas groupby(). mean

I'm analyzing Titanic data from Kaggle1 with a kind of guiding book. In the book, feature analyzing about the relationship between Pclass data and Survived data is done like below. ...
0
votes
0answers
16 views

Low AUC in a Linear Regression Model

I am using AWS Machine Learning service to create my own Linear Regression model using my own dataset, however when the model is created the Evaluation Summary shows a very low AUC of 0.519 The ...
4
votes
0answers
37 views

Where's a good place to get feedback on my portfolio? [closed]

I'm putting together my portfolio for freelance work in data science. I'm curious if there are communities on stackexchange or elsewhere that are helpful resources for receiving feedback.
0
votes
0answers
28 views

Equivalence of Tidy Data and Third Normal Form

In Hadley Wickham's "Tidy Data" paper, he states that In tidy data: Each variable forms a column. Each observation forms a row. Each type of observational unit forms a table. ...
0
votes
0answers
15 views

Collecting BBC News data to analyze, using selenium with python

I am trying to collect BBC news data based on some keywords, and want to collect it in the descending order of date (sorted with date). However, I only see the data in the order of relevance. Is there ...
0
votes
0answers
9 views

Are there any meaningless photo data sets? [migrated]

I am looking for a dataset. All I want is just a background photo. It can be a building, a river, or a house. But it must be a natural picture, not a drawn picture. Is there such a data set? It would ...
2
votes
2answers
46 views

What is the difference between public test and private test on Kaggle

I am trying to use the datasets from a competition held on Kaggle in which the dataset contains fer2013.csv file having columns emotion, pixels, and usage where usage contains 3 values i.e "training", ...
0
votes
0answers
34 views

Finding FAQs from dataset with its other attributes from other dataset

I'm new to Data Science and want to know the procedure that I should follow to tackle the following problem : I've been given 2 datasets. The first dataset has 2 columns : ...
0
votes
1answer
32 views

How Can I Solve it? TypeError: fillna() got an unexpected keyword argument 'implace' [closed]

I am trying to replace NaN values in a given dataset with this import pandas as pd import quandl import math df.fillna(-9999, implace=True) But I keep on ...
0
votes
0answers
21 views

Which model for Kaggle Diabetic Retinopathy Image Dataset?

What model is the best to use on this Kaggle dataset, such that there is about a >70% accuracy but is not too resource intensive for say a desktop? Is this even possible? Should I go for a deep ...
0
votes
1answer
9 views

How understand scatter like this way? [closed]

I am trying to learn some EDA skills and I get a scatter like this way: I don't see that there are some model relationships or group-related patterns between these two data. I mean what I thought was ...
0
votes
0answers
14 views

How to read a LISP-readable form data into python?

I have been trying to read this data into python. I tried various techniques but I am not able to organise it in a format that can be used for training a model. Has anybody got any idea how to read ...
0
votes
0answers
17 views

Huge difference in accuracy when using two datasets (instead of one) for text classification in Python

Recently I started reading more about NLP in order to learn more about the subject. The problem that I've encountered, now that I'm trying to make my own classification algorithm (the text sends a ...
3
votes
1answer
26 views

Structure the dataset for financial machine learning

I am trying to construct a dataset to apply MLP in forecasting financial returns. The main idea is that I want to predict future equity returns (1 month ahead, but the horizon can vary, just to give ...
1
vote
0answers
23 views

segmentation of brain tumor in MRI images

I have a dataset of brain tumours images. and I have to build a model to classify the malignancy grade of these tumours. The size of the tumours varies from small to large. The ROI are already ...
0
votes
1answer
45 views

When to stop collecting data?

I have developed an iterative process via which I can collect data in batches. The data are points in a predefined 3D space. I am trying to explore and locate clusters in that 3D space based on my ...
2
votes
1answer
24 views

What is the largest public wearable accelerometer dataset?

I'm looking for public datasets of people wearing a device with an accelerometer (and potentially other sensors eg gyroscope or magnetometer). What are some of the largest available datasets like ...
0
votes
1answer
11 views

Website for Datasets - Miles and Shevlin book, “Applying Regression & Correlation”

I've very much enjoyed Miles and Shevlin (2015) book, "Applying regression & correlation : a guide for students and researchers." The book mentions availability of datasets, but the website ...
0
votes
0answers
18 views

Does anybody know where can I find this dataset or a similar one?

Does anybody know where can I find the radar emitter dataset used in this paper? Or any other dataset for specific emitter identification, I can't find anything free anywhere.
-1
votes
0answers
8 views

working on different size of images for CAD system

Is it possible to work on image dataset of different sizes for CAD system using supervised learning modules, i.e., I have a dataset of brain tumour images with a different size of tumours, they are ...
0
votes
1answer
17 views

Are there any multi-type public datasets out there? [closed]

Does anyone know of any good public datasets for supervised learning that would contain data where instances are described with different types of data (ie. timeseries data, categorical data, images, ....
2
votes
2answers
48 views

How can I improve a machine learning model?

I am a Machine learning newbie and i am trying my hands with a dataset which has 9 features and my aim is to figure out the optimal multi class classification model which fits my dataset. I applied ...
0
votes
0answers
10 views

dataset for human memory modelling and spaced repetition

I'm working with a trainable model of the human memory. The linked paper sets up a decay function to model how you slowly forget information between repetition sessions. Their spaced repetition ...
1
vote
0answers
10 views

Generating labeled dataset for training a neural network

I am currently working on a project in which i'm supposed to classify whether an image contains a translucent watermark or not. This is hard to do with standard object classification or template ...
3
votes
0answers
79 views

What is the best way to read SQL dataset in to Tensorflow?

What is the best way to read SQL database in to Tensorflow? Currently, I am using Postgres on server and developed DL algorithm on Tensorflow using Jupyter Lab. How can I import data into Jupyter Lab ...
-1
votes
0answers
44 views

How can i take advantage of google Speech Commands dataset

I am building a Simple audio recognition for key word spotting taking inspiration from here.Apart from the dataset available Speech Commands dataset. i would also like to add words like "move" and a ...
-1
votes
0answers
18 views

What optimization algorithm is more suitable for timetable rescheduling problem?

I'm working on the project where university course is represented as a to-do list, where: course owner (teacher of the course) can add tasks (containing the URL to the resource needs to learn and two ...
7
votes
1answer
145 views

On a multi lingual sentiment corpus

I am looking to compile a sentiment corpus for news articles in multiple languages (~100k per lang. for a machine learning experiment) where each article is labeled positive, neutral, or negative. I ...
1
vote
1answer
25 views

Does this type of classification exist?

Im fairly new to data science and trying to see if a type of classification exists for my needs. I understand that a classification into 2 categories will look something like this: You have 2 ...
0
votes
1answer
16 views

Change values from nominal to numeric

I want to change the values of the class labels from nominal into numeric. e.g if the values of a class are {iris-setosa,iris-virginica,iris-versicolor} i want to make them {0,1,2} so the instances ...
1
vote
1answer
19 views

Understanding a dataset (prior to applying ML models) with no metadata given

How do you understand a dataset when there is no metadata given (no details about the attributes given in the dataset)? It is difficult to comprehend the attribute names as only the short forms are ...
0
votes
1answer
31 views

Is there any way how to make samples balanced?

I have a dataset which consists of attributes on breakdown of machines.The target variable is machine status which are populated with ones and zeros. The distribution of ones and zeros are given below ...