Skip to content

Commit b89b7ae

Browse files
committed
Added optional command to usage section
1 parent da75627 commit b89b7ae

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

README.md

+1
Original file line numberDiff line numberDiff line change
@@ -21,6 +21,7 @@ Python packages include:
2121

2222
1. Clone this repository
2323
2. Move to the `yc-scraper` directory
24+
2. [Optional] Create an environment for `yc-scraper` (for example by ```conda create --name <env_name> --file requirements.txt```)
2425
3. Run `python yc_links_extractor.py`. This will fetch the individual URLs for the spider to crawl.
2526
4. Run `scrapy runspider scrapy-project/ycombinator/spiders/yscraper.py -o output.jl`. This generates a JSON lines file which you can read with Pandas:
2627

0 commit comments

Comments
 (0)