Skip to content
This repository has been archived by the owner on Apr 20, 2023. It is now read-only.

Unable to locate file with data dump from posts #147

Open
jtopper9 opened this issue Nov 20, 2021 · 0 comments
Open

Unable to locate file with data dump from posts #147

jtopper9 opened this issue Nov 20, 2021 · 0 comments

Comments

@jtopper9
Copy link

jtopper9 commented Nov 20, 2021

First off - thanks a bunch for making this script available. Very helpful.

The scraper looks to be working fine however I'm unable to figure out where the csv file containing the scraped data is located on my machine. Due to environmental issues i'm running the script through my IDE. Any thoughts?

#from selenium import Chrome
from selenium import webdriver
from instascrape import Profile, scrape_posts
import csv

Creating our webdriver

options = webdriver.ChromeOptions()
options.add_argument("")

Path to your chrome profile

w = webdriver.Chrome("/usr/local/bin/chromedriver", options=options)

Scraping JT's profile

SESSIONID = ''
headers = {"user-agent": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 "
"KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36",
"cookie": "sessionid=;"}
jt = Profile("et_used_boards")
jt.scrape(headers=headers)

Scraping the posts

posts = jt.get_posts(webdriver=w, login_first=True)
scraped, unscraped = scrape_posts(posts, silent=False, headers=headers, pause=10)

@jtopper9 jtopper9 changed the title Unable to find where data is being downloaded to Unable to locate file with data dump from posts Nov 20, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant