Skip to main content
Search type Search syntax
Tags [tag]
Exact "words here"
Author user:1234
user:me (yours)
Score score:3 (3+)
score:0 (none)
Answers answers:3 (3+)
answers:0 (none)
isaccepted:yes
hasaccepted:no
inquestion:1234
Views views:250
Code code:"if (foo != bar)"
Sections title:apples
body:"apples oranges"
URL url:"*.example.com"
Saves in:saves
Status closed:yes
duplicate:no
migrated:no
wiki:no
Types is:question
is:answer
Exclude -[tag]
-apples
For more details on advanced search visit our help page
Results tagged with
Search options questions only not deleted user 13891

Apache Spark is an open source cluster computing system that aims to make data analytics fast — both fast to run and fast to write, originally developed in the AMPLab at UC Berkeley.

0 votes
1 answer
977 views

SPARK 1.5.1: Convert multi-labeled data into binary vector

I am using SPARK 1.5.1, and I have DataFrame that looks like follow: labelsCol, featureCol (Label1, Label2, Label 32), FeatureVector (Label1, Label10, Label16, Label30, Label48), FeatureVector ... (L …
Rami's user avatar
  • 604
7 votes
2 answers
9k views

SPARK Mllib: Multiclass logistic regression, how to get the probabilities of all classes rat...

I am using LogisticRegressionWithLBFGS to train a multi-class classifier. Is there a way to get the probability of all classes (not only the top candidate class) when I test the model on new unseen s …
Rami's user avatar
  • 604
7 votes
1 answer
1k views

SPARK, ML: Naive Bayes classifier often assigns 1 as probability prediction

Hi I am using Spark ML to optimise a Naive Bayes multi-class classifier. I have about 300 categories and I am classifying text documents. The training set is balanced enough and there is about 300 tr …
Rami's user avatar
  • 604