Getting Started To get us started, you will need to start a new Python3 project with and install Scrapy (a web scraping and web crawling library for Python).

How we learnt to stop worrying and love web scraping For Nicholas DeVito, Georgia Richards and Peter Inglesby, custom webscrapers have driven their research — and their collaborations.