0
$\begingroup$

I am very new to nlp. I am doing a text segmentation task and for evaluating my model I need to calculate Pk and Windiff scores. My question is what is the ideal value for window size (k) for Pk score because different window sizes give different results. I am using this function nltk.metrics.segmentation.pk. Thanks.

$\endgroup$

1 Answer 1

1
$\begingroup$

I am also new to NLP, but according to some research papers:

Window size k should follow the next expresion:

https://books.google.es/books?id=lus_EAAAQBAJ

This applies for WinDiff and Pk scores.

Reference: https://books.google.es/books?id=lus_EAAAQBAJ

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.