This is a quick demo of how to build a simple Python-based scraper, and automate it on a schedule using Github actions.
To get started with this on your computer:
- Clone this repository.
- Install Python and pipenv.
- Run
pipenv install jupyterlab requests bs4
- Give it a test with
pipenv run jupyter execute scrape.ipynb
- Open up the CSV file to see the results.
- Open the scrape.ipynb in Jupyter Notebook to see how everything works, and to edit.