Skip to content

Commit f78c02d

Browse files
authored
Update README.md
1 parent 11c5b8b commit f78c02d

File tree

1 file changed

+8
-2
lines changed

1 file changed

+8
-2
lines changed

projects/farfetch-scraping/README.md

+8-2
Original file line numberDiff line numberDiff line change
@@ -27,5 +27,11 @@ b. Inside the .env file, add the following line: <br>
2727
Scraper_API_Key='{enter Scraper API key}' <br>
2828

2929
## Running web scrape
30-
7.
31-
9. If there's an error running the scrapy spiders, make sure twisted version is 21.7.0 and scrapy version is 2.11.0 <br>
30+
1. To retrieve the urls, run the following: <br>
31+
`scrapy crawl farfetch_women_get_urls -o farfetch_new_existing_deleted/FarFetch_Women_Urls.csv -t csv` <br>
32+
The spider name is "farfetch_women_get_urls", so we call this immediately after "scrapy crawl" <br>
33+
-o: csv file directory to save your scrape <br>
34+
-t: specify the output format, in our case, csv <br>
35+
3. To run a scrape for the item urls, run the following <br>
36+
`scrapy crawl farfetch_women_update_database -o farfetch_new_existing_deleted/FarFetch_Women_New.csv -t csv`<br>
37+
4. If there's an error running the scrapy spiders, make sure twisted version is 21.7.0 and scrapy version is 2.11.0 <br>

0 commit comments

Comments
 (0)