File tree 1 file changed +8
-2
lines changed
projects/farfetch-scraping
1 file changed +8
-2
lines changed Original file line number Diff line number Diff line change @@ -27,5 +27,11 @@ b. Inside the .env file, add the following line: <br>
27
27
Scraper_API_Key='{enter Scraper API key}' <br >
28
28
29
29
## Running web scrape
30
- 7 .
31
- 9 . If there's an error running the scrapy spiders, make sure twisted version is 21.7.0 and scrapy version is 2.11.0 <br >
30
+ 1 . To retrieve the urls, run the following: <br >
31
+ ` scrapy crawl farfetch_women_get_urls -o farfetch_new_existing_deleted/FarFetch_Women_Urls.csv -t csv ` <br >
32
+ The spider name is "farfetch_women_get_urls", so we call this immediately after "scrapy crawl" <br >
33
+ -o: csv file directory to save your scrape <br >
34
+ -t: specify the output format, in our case, csv <br >
35
+ 3 . To run a scrape for the item urls, run the following <br >
36
+ ` scrapy crawl farfetch_women_update_database -o farfetch_new_existing_deleted/FarFetch_Women_New.csv -t csv ` <br >
37
+ 4 . If there's an error running the scrapy spiders, make sure twisted version is 21.7.0 and scrapy version is 2.11.0 <br >
You can’t perform that action at this time.
0 commit comments