Questions tagged [dataset]

A dataset is a collection of data, often in tabular or matrix form. This tag is NOT intended for data requests ("where can I find a dataset about ...") --> see OpenData

Filter by
Sorted by
Tagged with
0
votes
1answer
1k views

Run Apriori algorithm in python 2.7

I have a DataFrame in python by using pandas which has 3 columns and 80.000.000 rows. The Columns are: {event_id,device_id,category}.[] each device has many events and each event can have more than ...
0
votes
0answers
157 views

Which Machine Learning Algorithm should be used to predict Waveforms from an already existing collection of waveforms ?

I am new to machine learning and I was wondering what algorithm to use to predict waveforms from an already existing waveform data samples. I have the x coordinates and Y coordinates or (waveforms) ...
0
votes
3answers
216 views

Need to prepare the data to Link Analysis project?

I've a dataset with following schema: ...
0
votes
2answers
289 views

Splitting Data in scikit-learn

I know how to split the dataset into train and test sets using train_test_split but is there any way that I can split the dataset into three different sets i.e. "Train set", "Test set", and "...
0
votes
1answer
168 views

Verification of trained system

I have trained a system in order to detect some features from a set of scenarios. Now the system can detect and classify that set. How can I validate how that system works in real world? What ...
0
votes
2answers
370 views

Data transposition code in R

I've been working in SAS for a few years but as my time as a student with a no-cost-to-me license comes to an end, I want to learn R. Is it possible to transpose a data set so that all the ...
0
votes
1answer
2k views

How do I read a dat file, for which I don't know its structure?

Is there any way to atleast read the text from the dat file. I have its corresponding mdf file hence I know what all data and columns are there in it. How do I figure out the contents in my dat file. ...
0
votes
1answer
43 views

Missing Values In New Data

(Before someone marks this as duplicate - I'm not asking about training data, I'm asking about new data which has come in and needs to be classified) Suppose I've got a dataset which has 5 predictors ...
-1
votes
2answers
204 views

What is the approx minimum size of dataset required to build 90% correct model?

I am working with a financial dataset size which is around 3000. I have attempted the supervised-learning regression techniques and not able to go beyond 70% accuracy. Features: 10 Data size:3700 ...
-1
votes
1answer
5k views

Animal Detection dataset

Update 1: I know that I can seperate animal,bird object annotations/images from imagenet. In fact I already filtered annotations/images that are my interested and downloaded them by URL. I searched ...
-1
votes
1answer
22 views

How to Select Rows from Pandas DataFrame with condition [closed]

I have a dataframe (csv file) which consists of about 8000 songs (column name "Song")of e.g. 20 singers(column name "Artist"), so each singer has more than one song. I want to ...
-1
votes
1answer
46 views

Dataset processing question

I am a newbie in Data Science, so please don't blame me for stupid questions. Here is my problem. I've got a dataset (no empty cells, only numerical values) consisted of 15 columns (1st - user id, ...
-1
votes
2answers
315 views

Finding databases with same columns and different content/ model

I am looking for datasets that have the same columns and their content (rows) are different. When I run a decision tree (classification) I'll get different models (trees) for each of them. It can be ...
-1
votes
2answers
41 views

How to deal with nan values after merging / joining two dataframes? [closed]

A lot of time after merging two pandas dataframes, I end up with NaNs in the new dataframe, that's just how the way it is, because one csv does not have all the ID's that the other has (Two dataframes ...
-1
votes
1answer
92 views

training accuracy greater than validation accuracy

The problem that I'm facing is that the training accuracy of my model is way higher than the validation accuracy, were talking about an approximate value of 0.2. ...
-1
votes
1answer
74 views

Custom Pandas function for formatting

My data consists of a lot of Dataframes having the format as below: ...
-1
votes
1answer
52 views

Using machine learning to optimize parameter scores [closed]

I have a dataset containing fraud and non fraudulent data. The system in place is a rule based engine with over 20 rules. If the total score is above a certain threshold the payment is classified as ...
-1
votes
1answer
532 views

Age range prediction according to browsing history [closed]

I need to predict age or age range of a user according to his/her browsing history from a news website. The only data I am able to get is USER-ID, URLs-visited, TAGs from those URLs, "which category ...
-1
votes
1answer
223 views

How to visualise very large graphs with 250M nodes and 500M+ edges? [closed]

I have graph data which has 250 million nodes and over 500 million edges. My files are roughly 230GB is size, this includes the node and edge files. I am having major difficulties visualising the ...
-1
votes
1answer
263 views

ML project ideas for dataset [closed]

Not sure if this is the right forum, but currently i have a dataset which contains a list of TV shows. Each record contains pricing between competitors (price in provider 1. Example: Itunes) TV show ...
-1
votes
2answers
41k views

Replacing values in multiple columns of a data frame in R

for example consider this dataframe : ...
-1
votes
1answer
440 views

K MEANS Big dataset [closed]

Can you please recommend me for a big dataset for k means? It would be cool if it will integrate easily with python, but any thing will be good.
-1
votes
0answers
8 views

unhashable type 'numpy.ndarray' [closed]

I'm testing my code, which works perfectly with a smaller set of data (two columns: 1st is Date, 2nd values). I use the same formatting with the new data and the only differences I can discern at the ...
-1
votes
0answers
7 views

Platform to detect mistakes [closed]

I am a mathematics teacher and I wish to build a platform to detect mistakes in handwritten solutions and mathematical diagrams. Is it possible? Please help me.
-1
votes
0answers
25 views

Combining Satellite Data of Different Resolutions [closed]

I have precipitation satellite data of different resolutions: one is a 4.5 square kilometers and the other is 10 square kilometers. What would be a sufficient way to combine the two for further ...
-1
votes
0answers
26 views

Can data file be converted into csv file properly using notepad++?

I am using dataset from UCI machine learning repository. I need to convert .data file into .arff file. I have used notepad++ and convert data file into a csv file. Is there any problem with this ...
-1
votes
1answer
30 views

upsampling imbalanced dataset in decision tree

I have a imbalanced dataset with 3 output labels with one class with 98 percent and other two classes with 1 percent each. I need to run decision tree on this dataset. Should i be upsampling this ...
-1
votes
1answer
21 views

Is there a reference data set for ridge regression?

In order to test an algorithm, I am looking for a reference data set for ridge regression in research papers. Kind of like the equivalent of MNIST but for regression.
-1
votes
1answer
67 views

searching for clouds (in the sky) images big dataset

I'm looking for a big dataset of clouds (in the sky) ground based images. i need tens of thousands of images. It is important that the images will be ground based and not from satellite/ flights. I'...
-1
votes
1answer
32 views

Machine learning analysis for data set

I have a data set that contains houses, different features, and its prices. I'm trying to do an advanced analysis for this data set, I already did house price prediction analysis using different ...
-1
votes
1answer
182 views

How to plot datasets 1 factors for K mean clustering python

I'm unable to plot the data for K mean clusering algo usingsklearn as it throws this error : TypeError: scatter() missing 1 required positional argument: 'y' Here is the function I have written to ...
-1
votes
1answer
105 views

Inputting Data for Machine Learning in PyTorch

I have scoured the internet and documentation, but have not yet been able to find a simple explanation of how to load data and/or simply type data into pytorch. I am just learning this library, and I ...
-1
votes
2answers
53 views

Loops in R programming, [closed]

I want to update this Remaining column in this table below: How do I do this in R programming? I tried while (n.Remaining>0) { n.remaining <- n.total-n.expense} Desired Output:
-1
votes
1answer
519 views

image dataset uploading in google colab

I want to use a dataset in colab for training CNN. How to upload a dataset of gestures of 26 labels where each label has over 2400 images. Total size of data is around 1.5 GB but there are too many ...
-1
votes
1answer
347 views

Downsampling the dataset to create balanced dataset for neural models

I have a classification dataset with 10k instances and 4 classes and it is unbalanced. 7000 of it belongs to first class, 2000 of it belongs to second 800 of it belongs to third class and remaining ...
-1
votes
1answer
52 views

How many datasets are required in a prediction problem?

When working with prediction problems, is there a need to consider the change in time or not? For example, when trying to predict the price of a house, we just have the current features and the ...
-1
votes
1answer
133 views
-1
votes
1answer
6k views

Error in f1(x) : argument “b” is missing, with no default

f1 <- function(a,b,c,d,e,f) { -111.605*a-208.39+(14.882-b)^2+35.29813*c-.001251205/d-1.050695*e+11.63420*f } ...
-1
votes
2answers
69 views

Creating a dataset for benchmarking of timeseries preprocessing capabilities

I have been tasked with comparing the capabilities of different startups offering AI-assisted data preprocessing. Due to legal reasons I cannot offer company data for the benchmarking, not even ...
-1
votes
1answer
3k views

Obtaining datasets of photos of people and car license plates

Where can I legally obtain the following kinds of datasets for training an image recognition algorithm for commercial use? photos of people car license plates The privacy laws in Europe (Germany) ...
-1
votes
1answer
75 views

How do I coalesce data from various sources?

How do I setup an environment where I can coalesce data from various sources, like mysql databases and csv files, on my macbook? Is there some opensource tool like informatica? or... ?
-1
votes
2answers
79 views

What are the ranges for number of features and data points for datasets in general?

What are the common values for number of features and number of data points (training examples) for datasets commonly worked on in industry? Can somebody give me an upper and lower bound for each? Or ...
-1
votes
1answer
165 views

Synonym handling replacement issue with UDF in Apache Spark

We are currently working to replace the synonyms of certain words in a Row. We are facing the problem as shown below. ...
-2
votes
2answers
48 views

What is Data Science and Machine Learning and what language mostly used to program? [closed]

I am newbie in Data Science, Machine Learning and any related to data science but I want to try it. Unfortunately, googling makes it tedious and complicated so I hope to be answered by anybody who's ...
-2
votes
1answer
385 views

how can I train the model to predict duplicate records in machine learning?

I have the adjustment data in telecom domain: There are problems that sometimes the automation script generates the bill twice which causes duplicate records. I want to know how to prepare the data ...
-2
votes
0answers
14 views

Best chatbot dataset to achieve siri-like performance [closed]

What is one of the best chatbot data available, to achieve siri-like performance, or close to siri-like performance? And even if there is no such data available, then what is the best chatbot data for ...
-2
votes
0answers
19 views

How to use the SGD chatbot data? [closed]

This is the SGD dataset: here Here, when I open a .json file, I can't understand how to use it as a chatbot What would be the inputs and the expected outputs to my model?
-2
votes
0answers
14 views

AttributeError: 'numpy.ndarray' object has no attribute 'predict and having some warnings [closed]

from sklearn.metrics import confusion_matrix for i in range(len(model)): print('Model',i) cm=confusion_matrix(Y_test,model[i].predict(X_test)) TP=cm[0][0] TN=cm[1][1] FN=cm[1][0] FP=cm[0][...
-2
votes
1answer
3k views

How to use same encode label with same value used in training

I did save my model and using that model I want to predict the data. I am using Flask HTTP server for prediction endpoint. I have training data like this. I did save my model and using that model I ...
-2
votes
2answers
1k views

Predictive Model with sort-of-non-binary labels

I'm working with government infrastructure public tenders data and want to build a predictive model. I'm want to train a model to predict if a company will or will not participate in a public tender. ...