I have downloaded the popular Enron email dataset. The dataset has two folders. When I try to import this in the Import documents widget, it skips files. Out of 5172 files it skips fifteen of them. This has happened with other text datasets too. Any solutions? Please answer asapenter image description here

  • I think there are format problems in these 15 skipped files. – Rejaul Karim Dec 3 at 8:20
  • I wondered that why did I get -2 votes, but thats okay. It is not a format problem. The same dataset can be read in python. Wouldn't it be great if there was a message box indicating which files were skipped. I also renamed all the files using batch program. The problem still persists. I can send you the link for the dataset. You can satisfy youself, on this is a genuine problem with large datasets text mining. The link is aueb.gr/users/ion/data/enron-spam/preprocessed/enron1.tar.gz This is a very popular dataset for spam detection – Arvind Prasad Dec 3 at 12:54
  • I further tried this on other datasets. It skips a lot of files. No reason for skipping files is given? – Arvind Prasad Dec 5 at 9:51

Your Answer

By clicking "Post Your Answer", you acknowledge that you have read our updated terms of service, privacy policy and cookie policy, and that your continued use of the website is subject to these policies.

Browse other questions tagged or ask your own question.