Added functionality to convert Excel spreadsheets to SQLite databases using openpyxl and pandas.

Author: aculich

SQLite-Setup.ipynb

@@ -137,10 +137,140 @@
     "---\n"
    ]
   },
+  {
+   "cell_type": "markdown",
+   "id": "dc376eb2-7994-4989-89af-004400d72648",
+   "metadata": {},
+   "source": [
+    "# Optional: Converting a Spreadsheet to SQLite\n",
+    "Try converting an .xlsx Excel Spreadsheet (downloaded from Google Sheets) to a SQLite Database.\n",
+    "\n",
+    "Make sure `openpyxl` is installed."
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": null,
+   "id": "7b8dff20-78cf-472a-b4d0-81c4c6d69886",
+   "metadata": {},
+   "outputs": [],
+   "source": [
+    "%pip install pandas openpyxl"
+   ]
+  },
+  {
+   "cell_type": "markdown",
+   "id": "2dece4a7-e3b9-461d-bf2a-68fadf7a5aed",
+   "metadata": {},
+   "source": [
+    "## 1. Download Google Sheet as Excel File\n",
+    "\n",
+    "- Open this [google sheet](https://docs.google.com/spreadsheets/d/1OzM6Sp92cDG_jkO4_WGEacuD0rwYF_g2kHOIuq6NgZM/view).\n",
+    "- Click **File > Download > Microsoft Excel (.xlsx)**\n",
+    "- Save the file to the data folder"
+   ]
+  },
+  {
+   "cell_type": "markdown",
+   "id": "e8750ea2-8bd7-4580-abf6-989510990660",
+   "metadata": {},
+   "source": [
+    "## 2. Convert Excel to SQLite using openpyxl and Pandas\n",
+    "[openpyxl](https://openpyxl.readthedocs.io/en/stable/) is a Python library designed for reading and writing Excel 2010 files (with extensions .xlsx, .xlsm, .xltx, .xltm). It enables Python programs to interact with Excel files, allowing for the creation, modification, and extraction of data.\n",
+    "\n",
+    "In the context of converting an Excel spreadsheet with multiple worksheets into a SQLite database, openpyxl is particularly useful for:\n",
+    " - **Reading Excel Files:** It facilitates the loading of Excel workbooks and accessing individual sheets, enabling the extraction of data from each worksheet.\n",
+    " - **Data Manipulation:** By integrating with libraries like pandas, openpyxl allows for the conversion of worksheet data into DataFrames, which can then be processed and stored in a SQLite database. \n",
+    "\n",
+    "By utilizing openpyxl in conjunction with pandas, you can efficiently read data from each worksheet of an Excel file and transfer it into corresponding tables within a SQLite database, with appropriate data type inference."
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": null,
+   "id": "28c8e145-72a8-48e5-ad64-b56c623db387",
+   "metadata": {},
+   "outputs": [],
+   "source": [
+    "import pandas as pd\n",
+    "import sqlite3\n",
+    "\n",
+    "# Path to your Excel file\n",
+    "excel_file = 'data/simplefolks.xlsx'\n",
+    "\n",
+    "# Connect to the SQLite database (or create it if it doesn't exist)\n",
+    "conn = sqlite3.connect('data/sheet2simplefolks.db')\n",
+    "\n",
+    "# Read all sheets into a dictionary of DataFrames\n",
+    "sheets = pd.read_excel(excel_file, sheet_name=None, engine='openpyxl')\n",
+    "\n",
+    "# Iterate over the dictionary and write each DataFrame to a SQLite table\n",
+    "for sheet_name, df in sheets.items():\n",
+    "    df.to_sql(sheet_name, conn, if_exists='replace', index=False)\n",
+    "\n",
+    "# Close the database connection\n",
+    "conn.close()\n",
+    "\n",
+    "print(\"All sheets have been successfully converted to SQLite tables.\")"
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": null,
+   "id": "ec65e1b2-f880-4962-aa0e-0fda795a0988",
+   "metadata": {},
+   "outputs": [],
+   "source": [
+    "%sql sqlite:///data/sheet2simplefolks.db"
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": null,
+   "id": "fabc752a-fecc-4a52-9ae0-24c53e67c904",
+   "metadata": {},
+   "outputs": [],
+   "source": [
+    "%sql SELECT * FROM sqlite_master;"
+   ]
+  },
+  {
+   "cell_type": "markdown",
+   "id": "0bf7ee4e-fbbe-453e-8015-8380f3874602",
+   "metadata": {},
+   "source": [
+    "## Optional: SQLite from the Command Line\n",
+    "\n",
+    "The SQLite project provides a simple command-line program named sqlite3 (or sqlite3.exe on Windows) that allows the user to manually enter and execute SQL statements against an SQLite database or against a ZIP archive. This document provides a brief introduction on how to use the sqlite3 program.\n",
+    "\n",
+    "Start the sqlite3 program by typing \"sqlite3\" at the command prompt, optionally followed by the name of the file that holds the SQLite database (or ZIP archive). If the named file does not exist, a new database file with the given name will be created automatically. If no database file is specified on the command-line, a temporary database is created and automatically deleted when the \"sqlite3\" program exits.\n",
+    "\n",
+    "Read more here: https://www.sqlite.org/cli.html"
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": 2,
+   "id": "ffb47489-fa52-4d70-b096-da9264d815d8",
+   "metadata": {},
+   "outputs": [
+    {
+     "name": "stdout",
+     "output_type": "stream",
+     "text": [
+      "exercises         people            politicians     \n",
+      "homes             pets              spreadsheet_data\n"
+     ]
+    }
+   ],
+   "source": [
+    "!echo .tables | sqlite3 data/sheet2simplefolks.db"
+   ]
+  },
   {
    "cell_type": "code",
    "execution_count": null,
-   "id": "1548534c-c1b7-498a-92d2-a7c9098f9a13",
+   "id": "f018bc2b-d482-4fd6-95ab-8fe1ff2dfa9e",
    "metadata": {},
    "outputs": [],
    "source": []