Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [machine-learning]

Methods and principles of building "computer systems that automatically improve with experience."

0
votes
0answers
7 views

Evaluating regression model in python - How do I interpret my results?

I'm trying to predict some 'malicious score' using RandomForestRegressor, and i'm trying to evaluate my model performence. I've tried all of scikit-learn documentation functions to evaluate, but not ...
0
votes
0answers
6 views

Distribution of Features

I am using a dataset. The aim is to predict the average monthly loss to the company. With feature enginnering I have introduced a feature loss using workload(given per day) and the absence (given per ...
0
votes
1answer
12 views

Combine results from multiple models

I am using chunks of 100000 rows at a time from the CSV file to train the a simple LASSO model. How do i combine all of these models trained from these different chunks? I would like to use all ...
0
votes
0answers
11 views

Which sklearn classification would perform best on shape= (2000, 1024) w/ binary features?

I have a training data set that is roughly 2000 rows by 1024 columns all binary data either 1's or 0's. The labels are numbers that equate to the letters of the alphabet so this basically a hand ...
0
votes
0answers
15 views

Intuition xgboost weights and log-loss / final leaf scores

Can somebody help clarify some points: Firstly; Consider a tree at the $ith$ iteration for a binary classification. Each tree assigns a log-loss score to each of the terminal leaf nodes which can ...
0
votes
1answer
4 views

Given is the result of the model performance. Help me with this MCQ

You also evaluate your model on the test set, and find the following: Human-level performance 0.1% Training set error 2.0% Dev set error 2.1% Test set error 7.0% What does this mean? (Check the ...
0
votes
0answers
6 views

Weka use training set VS 10-fold cross-validation

I'm working with a dataset in Weka and if I use training set, ID3 algorithm got everything right. If I use 10-fold cross-validation, ID3 algorithm got everything wrong on the same dataset. Why are ...
-1
votes
0answers
8 views

Amount of questions with entropy

I'm working on answering some questions, but I don't know how to do this one. This is the question: What is the entropy of the distribution of possible class labels at the start of the game, even ...
0
votes
1answer
10 views

Python Code to find the number of hapax legomena in a Text or Words_List

In corpus linguistics, a hapax legomenon is a word that occurs only once within a context, either in the written record of an entire language, in the works of an author, or in a single text. The term ...
0
votes
4answers
26 views

remove special character in a List or String

Input_String is Text_Corpus of Jane Austen Book output Should be : ['to', 'be', 'or', 'not', 'to', 'be', 'that', 'is', 'the', 'question'] But getting this Output : ['to', 'be,', 'or', 'not', 'to', '...
0
votes
0answers
18 views

Difference between scheme-dependent and scheme-independent attribute selection

I'm currently learning about machine-learning and I don't understand one thing. What's the difference between scheme-dependent and scheme-independent attribute selection? Thanks in advance!
0
votes
0answers
10 views

Evaluating fuzzy C-Means clustering

I am new machine learning practitioner. I have run fuzzy c-means algorithm on a multi-label dataset (PPI dataset) on the network using skfuzzy python library. I want to evaluate the performance of the ...
0
votes
0answers
6 views

How exactly is equivariance achieved in capsule networks?

I have read quite a lot about capsule networks but cannot understand how the squashed vector would also rotate in response to rotation of the image.A simple example would be helpful.I understand how ...
0
votes
0answers
10 views

output of k-mean cluster as collection of tweets

I want to cluster some 1000 tweets using k-mean algorithm. But I don't want the correct output, I just want clustering of tweets. Suppose 1 cluster contain 300 tweets than all the contain of 300 ...
0
votes
0answers
7 views

How to use boolean data to build DecisionTreeClassifier?

I was looking for solution on StackExchange, but I didn't find anything which matches my question. I am using this dataset: https://web.archive.org/web/20100704072013/http://lpis.csd.auth.gr/mlkd/...
0
votes
0answers
6 views

Downsampling frequent categories

Lets say I have machine learning classification model whose goal is to predict whether a given seller's e-commerce shipment will be returned by the shipment's buyer. There are many different sellers ...
0
votes
0answers
7 views

Estimating prevalence in a population as a credible interval after predicting labels with a binary classifier

I'm looking to get an estimate of the prevalence of 1's (i.e. the rate of positive labels) in a very large dataset that I have. However, I am hoping to report this percentage as a 95% credible ...
0
votes
1answer
13 views

Feature Scaling both training and test data

It is said that for: Feature Normalization - The test set must use identical scaling to the training set. And the point given is that: Do not scale the training and test sets using different ...
1
vote
2answers
21 views

Why normalize when all features are on the same scale?

So I'm doing the tensorflow tutorial found here: https://www.tensorflow.org/tutorials/keras/basic_classification Basically, my input is a [28x28] matrix (image) that I flatten to a [1x784] vector. ...
0
votes
0answers
16 views

Regularization in Python Code

I tried to understand the code provided below. This code is for Regularization using python. ...
0
votes
0answers
5 views

Recommendations of image recognition tools

I have a relational database containing hundreds of thousands of appliance with properly formatted information plus standardized images. Here is a basic sample of the format of the information My ...
0
votes
1answer
14 views

Loss function returns nan on time series dataset using tensorflow

This was the follow up question of Prediction on timeseries data using tensorflow. I have an input and output of below format. ...
2
votes
1answer
24 views

How can we use Neural Networks for Decision Making intead of Bayesian networks or Desicion Trees?

I am working on Decision Making in Self driving cars and I am wondering how I can use Neural networks (is there any type) ? that can repleace or mimic the bayesian networks or Decision Tree for ...
0
votes
0answers
12 views

Learning instructions from an instruction manual

I have a set of instruction manuals that follow a certain guideline and presents instructions about a specific product. What would be the best approach to use in order to create a machine learning ...
0
votes
0answers
16 views

Using both positive and negative values as neural network input?

In neural networks, we sometimes convert the input to z-scores. However, z-scores contain both negative and positive values, if we use such numbers as input, it seems that in some cases the neural ...
0
votes
0answers
22 views

feature weighting and feature subset selection

I'm planning to work on feature selection and am looking for some useful documentations, tutorials, books or anything about this topic and especially about feature weighting. Thank you for your help!
2
votes
1answer
28 views

K-nearest neighbors complexity

Why does the complexity of KNearest Neighbors increase with lower value of k? And when does the plot for k-nearest neighbor have smooth or complex decision boundary? Please explain in detail. And ...
0
votes
1answer
18 views

Sequence models word2vec

I am working on data-set with more than 100,000 records. This is how the data looks like: ...
0
votes
0answers
6 views

Cross-environment serialization and desrializatioin of ml models

I am new to ML and as Data Engineer was wondering how the general process of moving ML models to production works. Taking into account fact that many of models are prototyped in notebooks usually with ...
1
vote
1answer
10 views

Recommender system that connect users with each other , should I go for content based or collaborative filtering?

I am trying to build a system where user come on the platform and he chooses a topic(predefined few topics) and then we connect him with any random online user who chooses the same topic. Then they ...
0
votes
0answers
12 views

Dataset for ML project: Application of Machine Learning to improve breast cancer treatment

My issue in relation to finding the right dataset for my current project. I visited the cancer imaging website to find some data for investigating my hypothesis [which is " denser breast tissue (fibro-...
0
votes
1answer
12 views

Using neural networks with jumps in stock returns

I am using an LSTM network to analyse stock return patterns. A problem is that, there is usually huge jumps in stock returns but if you are only using the trading data, the jumps would seem pretty ...
1
vote
2answers
26 views

When creating a classification model, should predictors with little correlation to the response variable be included in the model?

I am building a predictive model designed to predict attrition within my organization. I am trying to decide whether to add certain predictors to my model. I used a Kruskal-Wallis rank sum test to ...
0
votes
1answer
16 views

Binary classificaiton for weather data if its class 1 or class 0 alert

I am working on weather data and it has few features that are independent variables such as severity, severity_id, urgency_id etc ... Based on these values, I would like to classify alerts into class ...
1
vote
0answers
22 views

Dataset Creation for Images

I am creating an image dataset of objects. We have 15 classes of objects and need to provide a color to the objects also. What ...
0
votes
1answer
14 views

How to migrate R decision tree to Java

I have trained a conditional inference decision tree in R using library party with function ctree and saved the model in an <...
1
vote
1answer
20 views

How to implement keras LSTM time series [on hold]

I am learning how to implement Keras LSTM on a simple time series data. The dataset I'm using has $12$ columns and $300k$ rows. Each group of $200$ rows represents ...
2
votes
2answers
18 views

What is the relation between input into LSTM and number of cells?

I want to train an LSTM network for time-series predictions, and want to get to the bottom of LSTM's. In my understanding, the number of cells in a single LSTM layer can vary. However, since each cell ...
1
vote
0answers
13 views

Latent Space of VAE

Say I have a dataset $D = \{a_1,a_2,a_3,...a_n\}$ on which I train a basic variational autoencoder (VAE) on (a couple of fully connected layers separated by nonlinearities). Does the latent space of ...
0
votes
1answer
13 views

Opensource Speech Recognition Library that is secure and trained on large data [on hold]

For all those who are working on developing a chatbot/assistant and care about the privacy of users consuming the speech recognition library, can you suggest an open souce library which is trained on ...
0
votes
0answers
9 views

Learning to Rank for information retrieval. [on hold]

I want to some csv data foramt and converted into light svm format and apply ranking algorithms and then need to get for which query what was the most relevant one in python can any one help me in ...
1
vote
3answers
47 views

How to find the most important attribute for each class

I have a dataset with 28 attributes and 7 class values. I want to know if its possible to find out the most important attribute(s) for deciding the class value, for each class. For example an answer ...
0
votes
1answer
32 views

Is my model over-fitting (LSTM,GRU)

I have small corpus max 150 text utterances, which is again distributed among 5 categories. To test I started with basic deep learning model, where i used word2vec embedding, added 1D convolution ...
0
votes
0answers
6 views

Is there a consensus on which voting to use in VotingClassifier and why? Hard voting vs. Soft voting?

I get much better accuracy in soft voting (e.g. 0.5) vs hard voting (e.g. 0.8). Should i report both? or can i depend on one of them? Am i conservative if i chose hard voting? I do understand the ...
0
votes
0answers
8 views

How to identify/Analyze HOG feature data is linearly separable or not?

Work Objective: I am working on Object tracking, I have extracted the Feature vector for ROI(Region of Interest)/template from Image, using this features i am looking to identify most probable ...
1
vote
2answers
20 views

Creating a feature by combining 2 features with different units?

If I want to create a new feature by combining 2 features with the same unit, I can just subtract them (e.g. buy volume vs sell volume). If the units are different, it doesn't make sense to subtract ...
1
vote
0answers
11 views

How to prepare photo data for training model to recognize bowling ball name, brand and manufacturer from photo of bowling ball?

I am asked to do this. The client can only prepare a only one photo for each ball from the product page of bowling manufacturer. However, I need huge amount of image data for each ball. Here is ...
0
votes
1answer
19 views

Using GridSearchCV and a Random Forest Regressor with the same parameters gives different results

As the huge title says I'm trying to use GridSearchCV to find the best parameters for a Random Forest Regressor and I'm measuring my results with mse. ...
0
votes
0answers
31 views

How can I classify these aerial images?

I want to use R to classify high res aerial images (4 band tiffs). The images are of residential food gardens in Portland. I want to train a model to be able to identify if there is a food garden ...
0
votes
0answers
14 views

Data science short courses in Europe

Maybe my question is broad and even "bad", so excuse me for that! I am looking for some good and intensive short courses in data science/machine learning etc. around Europe. By short i mean a week ...