Write npm script to ingest Jackson property list

[replygirl]

This script should take in an Excel sheet (the property list) and add the items to Contentful

The property list: https://public.3.basecamp.com/p/5Y3wNeeDbJmqGXtGr3UU9Ud1

Fields of interest:

• Address: Use this to find the coordinates
• Owner: Use this to exclude non-CJ properties (QUESTION: should we discuss data model update to specify owner?)
• Dimension W + L: Use this to specify the bounds of a Lot (QUESTION: orientation?)

[replygirl]

From Basecamp:

This list is a year old- someone should check back with saki to make sure this is still how it is.

So we'll need to run this again with an updated xlsx before we release

[replygirl]

update, to be continued

Schemes needed:

• contentful
• js/json (not sure what for, it’s just low hanging fruit here)
• TBD

Consider switching from Excel to Airtable? idk

[yeti-detective]

So my preliminary questions are basically: "How do I post something to Contentful?" which it looks like @replygirl will give me the rundown, and what schemes are needed, which will probably be evident from the answer to the above.
Also, the sample XLSX kind of looks like something that would be downloaded from a public records site. Do we have control over the file or does it come from an outside source?

[replygirl]

Also, the sample XLSX kind of looks like something that would be downloaded from a public records site. Do we have control over the file or does it come from an outside source?

This is provided by Cooperation Jackson folks, we can reformat it and migrate it to anywhere we please--in other words, there isn't a hard spec for the input format other than what we see in the data

[yeti-detective]

I'm going to start with a class that can consume an XLSX and extract the fields needed to build the types in types/db/contentful.d.ts
It can be a child of a larger class that supports more input sources and outputs these Contentful interfaces.

[yeti-detective]

I didn't get as far as I wanted to over this weekend (my Typescript is rustier than I thought) but I've pushed some work to a branch in my fork and I'll pick it back up if I have any free time this week (he won't) or next weekend, otherwise.

[yeti-detective]

Progress Update: I've gotten the script to the state where you should be able to run yarn import-xlsx <absolute or relative path to XLSX file> and the console will identify the sheet, column, and row containing the header "Address" (not case sensitive)
I've only tested the relative path bit on Rasbian, so I bet it works an any Debian Linux distro, but if anybody has easy access to a Mac/Windows machine they might want to give it a shot. I feel pretty confident absolute path would work on any platform.

Sorry about the slow progress. One of the speedbumps was getting ts-node to run in script mode with the main tsconfig.json file specifying "isolatedModules": true, but I found out you can override that setting by adding another tsconfig.json to a sub-directory, so I added scripts/ which can be a place where we want scripts to live, and excluded it from the build path in the main tsconfig.

edit: I made sure yarn build still runs after I did all that stuff I said up there ^^

[yeti-detective]

I got a little further this weekend. Next run, I'm going to see if I can get lat & long from the Google Maps API without registering api keys 🤞

[yeti-detective]

I have an update! So there doesn't appear to be an API that will convert an address string to latitude and longitude without registering with mapquest or Google or something. We can come back to that at a later time if we need to. What I currently have is a class that will scan through the worksheets of an XLSX file looking for something defined as 'content' (which I've currently defined as a header cell containing the text, "Address," non-case-sensitive, and then the data ).
So, to finish this out I'm going to make it configurable for the fields that the IBuildingFields interface wants (unless ILotFields would be better? It looks like it takes an IBuilding also).
I'll give it a default configuration, and also a method for changing the config in the event that is necessary.
I hope this comment makes sense.

[yeti-detective]

I've made progress yet again! I just need to finish it off with the post to Contentful.

[yeti-detective]

I am like 1/2 step away from successfully posting to Contentful, but I have to go to bed, so I will pick up later.

[yeti-detective]

Test Sample Buildings.xlsx
attaching the sample spreadsheet used in the Loom demo on PR 89