3
$\begingroup$

Recently I read about path ranking algorithm in a paper (source: Knowledge Vault: A Web-Scale Approach to Probabilistic Knowledge Fusion).

In this paper was a table (Table 3) with facts and I tried to understand how they were calculated.

F1 (harmonic mean of precision and recall) = 0.04
P (precision) = 0.03
R (recall) = 0.33
W (weight given to this feature by logistic regression)

I found a formula for F1 via Google which is

$F1 = 2 * \frac{precision * recall}{precision + recall}$

The problem is that I get the result of 0.055 with this formula, but not the expected result of 0.04. Can someone help me to get this part? Also, does someone know how 'W' can be calculated? Thanks.

$\endgroup$
  • $\begingroup$ Their calculation looks simply wrong. The F1 column is not the harmonic mean, not even to the number of decimal places shown. $\endgroup$ – Sean Owen Feb 3 '15 at 11:55
  • $\begingroup$ Sounds like i should contact one of the authors of the paper. $\endgroup$ – Sven Lauterbach Feb 4 '15 at 12:49
  • $\begingroup$ The values of F1 calculated in Orange Test and Score widget are erroneous $\endgroup$ – Arvind Prasad Jun 21 '18 at 18:24
2
$\begingroup$

First you need to learn about Logistic Regression, it is an algorithm that will assign weights to different features given some training data. Read the wiki intro, is quite helpful, basically the Betas there are the same as the Ws in the paper.

The formula you have is correct, and those value do seem off. It also depends on the number of significant figures you have, perhaps they are making their calculations with more than the ones they are reporting.

But honestly, you can't understand much of the paper unless you understand LR

$\endgroup$
  • $\begingroup$ i will try to take a further look at logistic regression. Do you know any good source/webpage which explains logistic regression as easy as possible? $\endgroup$ – Sven Lauterbach Feb 2 '15 at 18:13
  • $\begingroup$ Is pretty well explained in this set of notes cs229.stanford.edu/notes/cs229-notes1.pdf $\endgroup$ – Leon palafox Feb 2 '15 at 19:13

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.