Timeline for Is there any APIs for crawling abstract of paper?
Current License: CC BY-SA 3.0
10 events
| when toggle format | what | by | license | comment | |
|---|---|---|---|---|---|
| May 19, 2014 at 7:18 | vote | accept | Alex Gao | ||
| May 18, 2014 at 6:54 | answer | added | Alex I | timeline score: 9 | |
| May 17, 2014 at 18:15 | answer | added | cwharland | timeline score: 5 | |
| May 17, 2014 at 11:55 | comment | added | Alex Gao | I think this stack-overflow answer link gives the best answer I can get. Maybe people who encounter this problem could also have a look at this page. | |
| May 17, 2014 at 11:39 | comment | added | Alex Gao | thx! However, the contract states that massive download of papers are not allowed. This creates some headache. | |
| May 17, 2014 at 9:35 | comment | added | Wojciech Walczak | So, how about converting PDFs to TXTs and then extracting the abstracts with regular expressions? | |
| May 17, 2014 at 9:05 | comment | added | Alex Gao | Thanks for your answer! I have already built a local database for this. The problem of crawling from various services is that I have to make parse rules for each website. | |
| May 17, 2014 at 9:03 | review | First posts | |||
| May 17, 2014 at 13:09 | |||||
| May 17, 2014 at 8:55 | comment | added | Wojciech Walczak | I doubt there's any general API for this. You can try crawling various services likes Academia.edu, publishers' sites and so on. Nevertheless, it would be easier to build a local database of documents first, and then experiment with extracting the abstracts. | |
| May 17, 2014 at 8:45 | history | asked | Alex Gao | CC BY-SA 3.0 |