Questions tagged [scraping]
Scraping is a data collection technique used for extracting data from websites or other online sources. It relies on deploying automated processes or bots to parse HTML.
10
questions with no upvoted or accepted answers
3
votes
0
answers
516
views
Problem Screen Scraping Google Data
I'm trying to use rvest to screen scrape headline news items from google and failing.
Having previously written a utility to screen scrape high level stats from DS.SE (not user info I have to say!), ...
- 571
2
votes
0
answers
433
views
How can I find company descriptions for a long list of companies?
I'm going to train an ml algorithm to qualify potential sales leads based upon company descriptions. To do this, I need to find the company descriptions programatically.
E.g. given a long list of ...
- 21
1
vote
0
answers
11
views
ML library to analyse UI patterns on a website?
now, this might be a bit of a stupid question (I’ve done a bit of data science / machine learning in my uni years but have gotten fairly er very rusty), but I’ll give it a go regardless. So, the idea ...
0
votes
0
answers
14
views
Retrieve a company's list of all physical assets locations based on its name
I have a list of ~1500 companies, of which I know only their names and possibly some identifiers such as the ISIN or the Ticker codes. For each of them, I would need to find the addresses of all their ...
0
votes
0
answers
156
views
Data Scraping Government Site
As I know it may be okay or may not be okay to data scrape a government website. Would the following site be okay to data scrape?
https://li-public.fmcsa.dot.gov/LIVIEW/pkg_carrquery.prc_carrlist
I ...
- 1
0
votes
0
answers
354
views
how to scrape images from facebook group
I want to scrape images from several Facebook groups some of them are public and some or not
I am new to web scraping but I tried to look for solutions with selenium or BeautifulSoup or scrappy but I ...
- 137
0
votes
0
answers
62
views
Automate downloading datasets via Colab
My desktop computer recently broke, and I'm currently working on a small laptop with barely 500mb of space left. I need to download about 100gb of files from the DFAUST dataset. I was wondering if ...
0
votes
1
answer
46
views
Is it possible to build a regression model for predicting movie gross using sections on their wikipedia pages?
I got this as an assignment from a company recruiter and I've successfully scraped a dataset of about 650 movies with their 'Plot', 'Music' and 'Marketing' sections and gross. I've tried tfidf and ...
0
votes
0
answers
27
views
How can you automate collecting curriculum vitae data?
I'm doing a machine learning project, for which I need data from thousands of curriculum vitae. For this, I need to collect data from the employees of some 50 specific companies. From each company, I ...
- 467
-1
votes
1
answer
111
views
Is it ok to use a dataset from public API for Final Year Project?
I am about to start a final year at my university and I want to do a Final Year Project based on Machine Learning.
I would like to learn basics of Machine Learning by utilising sci-kit.
My project ...
