This shell script first acesses a catologue webpage passed as an argument. It parses the HTML for h2 tags that contain ISBNs of books.
Then, for each ISBN, it acesses that book's unique web page and converts one specific segment into a json file that is then parsed for information about the book: namely its isbn, name, and price. It then inserts the data obtained for each book into a database.
The script must always be called like this:
You can search different categories, for example, open source instead of web development, by changing the URL.
Here is an example of the output of the script:
Here is what the database looks like after the script has run:
