Skip to content

data: add monitor category — 760 monitors - #105

Merged
Seungpyo1007 merged 4 commits into
mainfrom
data/import-staging
Jul 8, 2026
Merged

Seungpyo1007 merged 4 commits into
mainfrom
data/import-staging

Conversation

@Seungpyo1007

Copy link
Copy Markdown
Member

What & why

Adds the dataset's third new category and second non-mobile class: monitor — with 760 monitors. This is the TechAPI half; the engine half (model/schema/router/seed/dump/validate) merged in TechEngine PR #40 and the submodule pin was bumped to bfdd4d9, so monitors now validate, serve and dump like any other category.

  • Added: 760 monitor records (Acer 532, Asus 109, LG 31, Samsung 27, Dell 19, MSI, Lenovo, Gigabyte, HP, BenQ, NEC, Philips)
  • All verified: false, brand required FK. Display specs — size_inch, resolution, aspect_ratio (100%), refresh_hz (85%), panel_type, curvature, hdr, rating (100%), msrp_usd (100%) — extracted from the product titles.

Commits (each Refs #1): validator rule, 2 brand-group data commits, and the surgical dump refresh (new monitors collection).

Closes #1

Source

durjoychandrapaul/amazon-products-sales-monitor-dataset (Kaggle, CC BY 4.0). Resolution labels mapped to WxH (with explicit title WxH preferred); refresh_hz/panel_type/curvature/hdr parsed from the title; MSRP is USD. release_date is a placeholder (2023-01-01) — the source is current Amazon listings with no dates. 187 rows skipped (brands not in the catalog: ViewSonic, AOC, Sceptre, …).

Dump

Regenerated via TechEngine app.dump at the monitor-supporting pin bfdd4d9. Monitors are unscored — the dump adds v1/monitors/** + a manifest entry; only the new collection + manifest are committed.

Checklist

  • python -m app.validate — ✅ passed (full dataset incl. 760 monitors)
  • python TechEngine/integrity_check.py data --strict — ✅ no hard anomalies
  • git diff --check — ✅ clean
  • Correct data/monitor/<brand>/<year>/<base>/<slug>.json paths, kebab-case unique slugs, source_urls present

Mirror the TechEngine monitor validator: MONITOR_REQUIRED fields,
ranges (size_inch 5-120, refresh_hz 24-1000, ppi 20-1000, rating 0-5,
msrp 10-50000), brand FK, and the variant path convention.

Refs #1
New `monitor` category seeded from the Amazon monitor dataset
(durjoychandrapaul, Kaggle, CC BY 4.0). Acer line with size, resolution,
aspect ratio, refresh rate, panel, curvature, HDR, rating and MSRP
(extracted from the product titles). verified:false.

Refs #1
…l and others

Remaining Amazon monitor records (Asus, LG, Samsung, Dell, MSI, Lenovo,
Gigabyte, HP, BenQ, NEC, Philips). verified:false.

Refs #1
Add the 760 monitor records to the static v1 dump (new `monitors`
collection, unscored) and register it in the manifest. Regenerated via
TechEngine app.dump at the monitor-supporting submodule pin bfdd4d9;
only the new monitor collection + manifest are committed.

Refs #1
@Seungpyo1007 Seungpyo1007 added enhancement New feature or request data Dataset changes labels Jul 8, 2026
@Seungpyo1007 Seungpyo1007 self-assigned this Jul 8, 2026
@github-actions github-actions Bot added the app Validator or application code changes label Jul 8, 2026
@Seungpyo1007 Seungpyo1007 moved this from Todo to In Progress in TechAPI-Project Jul 8, 2026
@Seungpyo1007

Copy link
Copy Markdown
Member Author

🤖 Review — PASS

Check Result
python -m app.validate ✅ passed (full dataset incl. 760 monitors)
python TechEngine/integrity_check.py data --strict ✅ no hard anomalies
git diff --check ✅ clean
app.dump @ bfdd4d9 ✅ 108,366 records incl. monitors:760

Data-change summary

  • Added: 760 monitors (new category) · Modified/Deleted: 0
  • Wired end-to-end: engine landed in TechEngine PR data(mobile): import sady36 market variants #40 (merged); submodule pinned to bfdd4d9.
  • Specs extracted from Amazon titles — aspect/rating/msrp 100%, refresh 85%, plus panel/curvature/HDR where present.

Example records

  • data/monitor/acer/2023/acer-eda320q/…-amazonmon-90.json (Acer Nitro 31.5" 1920x1080, 165Hz, 1500R curved, $170, 4.4★)
  • data/monitor/lg/2023/… UltraGear QHD 240Hz IPS.

Site build

  • No site/src changes. Surgical dump — only the new v1/monitors/** collection + manifest (monitors are unscored).

@Seungpyo1007

Copy link
Copy Markdown
Member Author

📊 Dataset stats (post-merge projection)

Metric Count
Total records 108,366
verified: true 10,028
verified: false 98,332
missing verified 6
Verified ratio 9.25%

monitors: 760 — the dataset now spans 10 categories (brand, soc, smartphone, tablet, watch, pda, gpu, cpu, laptop, monitor).

@Seungpyo1007
Seungpyo1007 merged commit 4fc49b8 into main Jul 8, 2026
5 checks passed
@github-project-automation github-project-automation Bot moved this from In Progress to Done in TechAPI-Project Jul 8, 2026
Seungpyo1007 added a commit that referenced this pull request Sep 27, 2026
…ource

These records were green but never had their own citation checked (check-urls
frontier and dedupe bugs, fixed in GetTechAPI/TechEngine#104 and #105). Each now
has a live Tier-1/Tier-2 citation; cpubenchmark.net returns 404 for unknown or
near-miss CPU names, so a live page confirms the exact SKU.

Refs #296
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

app Validator or application code changes data Dataset changes enhancement New feature or request

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

TechAPI dataset roadmap and status: all categories (1989-2026)

1 participant