# Questions tagged [naive-bayes-classifier]

Naive Bayes classifiers makes the naive assumption that the features are independent. They make use of Bayes theorem.

205 questions
Filter by
Sorted by
Tagged with
11 views

### Maximal risk for the Bayes classifier

In these lecture notes I found this statement This maximal risk for the Bayes classifier occurs precisely when $Y$ “contains no information” about the feature variable $X$. How do I prove it? If I ...
10 views

### Robustness and Sensitivity of Naive Bayes to Irrelevant Features

I understand that one of the strengths of Naive Bayes is its robustness to irrelevant features. However, it's also important to note that it can be sensitive to the presence of irrelevant features, ...
• 165
23 views

### How to take the $\log$ of $e$ when taken to the power of a matrix?

I'm having some troubles trying to solve the following question, I'm trying to find the $C$ which maximizes \begin{align}\text{arg max}_{1\geq m\geq K}(\log p(\mathbf{x}|C_m)+log P(C_m))\end{align}...
9 views

### If a set of random vectors are independent then would the join event of the random vector from the set and another random variable independent?

If all x_i from i=1 to n are independent. And y_i is dependent on x_i. Then can we always say that all (x_i, y_i) tuples are always independent of each other? x_i is a random vector of shape mx1, y_i ...
68 views

### Prediction in multiclass classification

Context: I need to make an multiclass classification to predict what type of sentence(law) the case will have in the end. Data: I Have several columns to predict the case:client, cause of action, ...
• 1
66 views

### Text preprocessing decreases classifier accuracy

I try to solve a binary text classification problem using sklearn's Tfidf Vecotrizer and a naive bayes classifier. Before I pass the training/test data to the vectorizer I do some text preprocessing. ...
26 views

### Naive Bayes classifier without training

I've a pooled group of individuals and a given number of features. So that my matrix looks like: individuals feature1 feature2 feature3 bob 1 0 1 ralph 0 1 1 mark 1 0 1 I want to discriminate ...
1 vote
174 views

• 11
1 vote
2k views

### Naive Bayes loss function

Does Naive Bayes classifier require a loss function for Bernoulli classification? If yes, what loss function does Naive Bayes classification use? And how does it work?
• 297
1 vote
488 views

### How to calculate true positive, true negative, false positive, negative and postive with Bayes Classifer from scratch

I am working on implementing a Naive Bayes Classification algorithm. I have a method def prob_continous_value which is supposed to return the probability density ...
• 147
44 views

### How to implement Naive Bayes classifier

I am working on implementing a Naive Bayes Classification algorithm. The problem requires classifying the following datasets: ...
• 147
640 views

### What Shape Does Naive Bayes make?

Decision Trees draw straight lines to partition the feature space. According to the Universal Approximation Theorem, Neural Networks can draw any continuous function. What sort of shape does the Naive ...
• 257
1 vote
39 views

### How different classifiers would perform on a particular data set

I am reading through and learning how different ML methods work on different types of data, but I have faced a data set that I am not sure how ML methods, such as decision tree, Naive Bayes, and KNN, ...
• 109
1 vote
388 views

### How do I deal with unbalance classes in a stock market prediction problem?

I am working on a prediction model to predict whether a stock should sell, hold or buy in n days. Each day (or row in the dataset), I classify whether this should ...
• 111
1 vote
85 views

### Comparison of different Naive Bayes algorithm for SMS classification

There are various types of Naive Bayes algorithms in the Sklearn library: Can all of them be used for text classifications? And which one's perform bette I tested out a simple text classification ...
• 15
69 views

### Algorithms for SMS spam detection

Which among KNN, Logistic and Naive Bayes would yield best results for SMS spam detection? Is there any other efficient approach worth exploring. I am planning to make a python application for SMS ...
• 3
128 views

### What type of 'Naive Bayes' algorithm is provided by Orange?

I've been using Orange for a while to rapidly prototype a few classification models. One of the ones I've been using is 'Naive Bayes'. If I understand correctly, there are a few types available based ...
642 views

### Really confused with characteristics of Naive Bayes classifiers?

Naive Bayes classifiers have the following characteristics-: They are robust to isolated noise points because such points are averaged out when estimating contiditional probabilities from data. Naive ...
• 165
1 vote
176 views

### How to choose products based on Number of good, bad and total reviews?

Let us suppose, I have few scenarios for products with good and bad reviews. P1: 1000 Good, 1 bad P2: 100 good, 10 bad P3: 20 Good, 0 bad P4: 10000 good, 500 bad ...
• 323
1 vote
121 views

### Why exactly KNN is outperforming Parzen by a huge margin in classificaton task

I'm trying to implement a Naive Bayes classifier, which uses either of hypercubic Parzen window or KNN to estimate a density function. The data I'm using is Fashion MNIST. The steps I take are that ...
• 123
219 views

### Naive bayes expectation maximization vs logistic regression for binary classification

Assuming I'm dealing with binary classification. For what kind of data Naive bayes using expectation maximization would give a better solution and for what kind of data logistic regression would be ...
• 101
1 vote
104 views

### Naive Bayes model - Missing output variable for specific sample(s)

With Naive Bayes model can we discard a training sample if the value of the sample's output variable is missing? And would that not make any difference to the parameter learning of the Naive Bayes ...
• 11
1 vote
368 views

### Independence of Features assumption in Naive Bayes

How do we know if your features in my dataset are independent before applying Naive Bayes? Basically I want to know is it possible for us to get an idea before training our model if Naive Bayes will ...
• 11
167 views

### Bad Input Shape -- How to interpret and Diagnose; Also side ML question

I apologize I am a ML novice, but I am trying to learn. I am making a classifier based on this dataset to predict mental health disorders based on features. I wanted to run a very simple NB classifer ...
1 vote
659 views

### Naives Bayes Text Classifier Confidence Score

I am experimenting with building a text classifier using Naive Bayes which has been pretty successful on my test data. One thing i am looking to incorporate is handling text that does not fit into any ...
• 31
29 views

### Can one still train a classifier with an unbalanced data set?

I want to train a binary Naive Bayes classifier. The problem is, is that I have an unbalanced set at my disposal, where the ration between the two classes is roughly 2:1 (250 examples from the first ...
1 vote
114 views

### Word list as a baseline for measuring a classifier's performance?

I am working on a simple Naive Bayes classifier that categorizes text messages as either "positive" or "negative". I was told that the simplest baseline to measure the classifier's ...
121 views

### Random Sequence Predictions

Can machine learning algorithms predict random number generators. key A= 1 2 3 B= 4 5 6 C= 7 8 9 Example to catch a number sequence 4 8 8 I would select B C C That would give me 27 number combinations ...
• 9