Fix bulk add writing wrong values and dropping rows and columns

[labkey-martyp]

Rationale

Fixes a set of bugs that let the EHR bulk add importer write wrong or incomplete data without reporting anything, in the UI, the browser console, or the server log.

Because nothing fails, the damage is only discoverable by diffing the loaded data back against the source, so an import can appear clean while carrying shifted dates, missing dates, lookup values swapped for unrelated ones, animal ids carrying stray whitespace, whole columns absent because their header was spelled differently, and — on tables whose key is assigned by the server — only the last of the pasted rows. The reporting added here echoes pasted text back to the user, so it is escaped; an import commonly starts from a spreadsheet someone else produced.

Related Pull Requests

• LabKey/johnsHopkinsEHRModules#670 — Selenium coverage for these fixes. Both branches share the name 26.7_fb_bulk_add_date_parse.

Changes

• Every date column is parsed like the form's primary date field. The others were read as UTC, so they landed a day early in a negative-offset timezone, and a date on the epoch was dropped as empty.
• Lookup and project values require an exact match rather than a leading substring, so a value can no longer resolve to an unrelated record that merely starts with the same text. Matching stays case-insensitive and accepts either the display value or the key.
• Every pasted cell is trimmed. A padded animal id previously went in as pasted, registering a second animal on forms that create the animals they name.
• A value that resolves to no lookup, project, or date is reported against its row instead of being written through as raw text or left empty, and the import stops so the source can be corrected first.
• Pasted text is escaped wherever it appears in an error message.
• Headers are matched by a field's name, label, or any import alias, as the rest of the product does. Only the exact name and a single alias were tried before, so any other spelling dropped the column silently.
• An unrecognized or duplicated header stops the import before any row is read. Note the behavior change: a spreadsheet carrying extra columns the form does not have must have them removed, where previously they were ignored.
• Trimming the pasted block no longer strips tabs, which were the final row's empty trailing cells and made an otherwise correct row look truncated.
• A line holding no values is skipped rather than reported as missing every required field, and no longer counts toward the 250-row limit.
• A row is measured against the last column a required field occupies rather than the number of required fields, so a row missing only optional trailing cells is no longer rejected.
• A problem belonging to the header row is reported once rather than restated on every one of up to 250 rows.
• Several rows pasted into a table keyed on a server-assigned column stay separate records instead of collapsing onto the last one.