I need to pull the names of companies out of resumes. Thousands of them. I was thinking of using NLTK to create a list of possible companies, and then cross-referencing the list of strings with something like SEC.gov.
I've already been able to successfully pull the candidate's name, and contact info off of the resumes with some RegEx, but this one has me quite stumped.
What I'm thinking is that I could use NLTK to create a list of strings of proper nouns from the resume's, and then search SEC.gov, or some other database.
This is a link to the SEC page I would be searching: SEC company search page
Read Resume1 Get all potential company names as list of strings potentialCompanies IF searching for string1 in SEC gets result, THEN add to candidateCompanies ELSE remove from potentialCompanies, go to next string
To people that have used NLTK, would there be a better way of getting the potential companies from the text besides using proper nouns?
Would there be a better place to search for companies than the SEC site?
I have never done any web scraping before, and don't really know where to start if it is needed.
(I had posted this on Stack Overflow but they told me that it might be better suited for here...)