From 5ffc26f1770f826e6eb26518ca242fb728221bfd Mon Sep 17 00:00:00 2001 From: tiennm99 Date: Tue, 14 Apr 2026 23:30:12 +0700 Subject: [PATCH] docs: note data/ source URL; mark data-old/ and data-old2/ origin unrecorded --- 2017/README.md | 14 +++++++++++--- 2017/docs/data-pipeline.md | 15 ++++++++++++--- 2 files changed, 23 insertions(+), 6 deletions(-) diff --git a/2017/README.md b/2017/README.md index d05ac27..458be35 100644 --- a/2017/README.md +++ b/2017/README.md @@ -9,8 +9,8 @@ Three deployments, one per dataset: | URL | Data source | Rows | |---|---|---| | `/thptqg2017/` | `data/` — [baotintuc.vn](https://baotintuc.vn/tuyen-sinh/tra-cuu-diem-thi-thpt-2017-cua-63-tinh-thanh-pho-tren-baotintucvn-20170706073512672.htm) CDN, `.xls` | **861,068** | -| `/thptqg2017/old/` | `data-old/` — earlier xlsx collection | 847,348 | -| `/thptqg2017/old2/` | `data-old2/` — partial re-export (54 provinces) | 679,764 | +| `/thptqg2017/old/` | `data-old/` — earlier `.xlsx` collection from Vietnamese news sites at the time (exact origin no longer known) | 847,348 | +| `/thptqg2017/old2/` | `data-old2/` — partial re-export (54 provinces) also from contemporary news sites, exact origin unrecorded | 679,764 | ## Features @@ -92,4 +92,12 @@ See `LICENSE`. ## Source -Data collected from public Vietnamese news archives (2017). Intended for reference only. +- **`data/`** — scraped in full from the baotintuc.vn 2017 announcement article: + `https://baotintuc.vn/tuyen-sinh/tra-cuu-diem-thi-thpt-2017-cua-63-tinh-thanh-pho-tren-baotintucvn-20170706073512672.htm` + Reproducible via `node scripts/crawl-baotintuc.js`. +- **`data-old/`** and **`data-old2/`** — collected from Vietnamese news sites at the + time of the 2017 exam. The specific publisher URLs were not recorded and cannot + be recovered now. These datasets are preserved for comparison and historical + reference only; `data/` is the canonical source for the main deployment. + +Intended for reference only. diff --git a/2017/docs/data-pipeline.md b/2017/docs/data-pipeline.md index f3c62ad..589f7d4 100644 --- a/2017/docs/data-pipeline.md +++ b/2017/docs/data-pipeline.md @@ -2,9 +2,12 @@ From raw Excel files to a compressed SQLite file the browser can load. -## Canonical source +## Canonical source (data/) -63 Excel files from baotintuc.vn CDN. Re-download anytime: +63 Excel files from baotintuc.vn CDN. Source article: +`https://baotintuc.vn/tuyen-sinh/tra-cuu-diem-thi-thpt-2017-cua-63-tinh-thanh-pho-tren-baotintucvn-20170706073512672.htm` + +Re-download anytime: ```bash node scripts/crawl-baotintuc.js @@ -12,7 +15,13 @@ node scripts/crawl-baotintuc.js Idempotent — skips files already present. Saves to `data/.xls`. -Source article URL: `https://baotintuc.vn/tuyen-sinh/tra-cuu-diem-thi-thpt-2017-cua-63-tinh-thanh-pho-tren-baotintucvn-20170706073512672.htm` +## Reference sources (data-old/, data-old2/) + +Both were collected from Vietnamese news sites around the time of the 2017 exam. +Specific publisher URLs were not recorded and cannot be recovered, so these +datasets are **not reproducible** — the files committed in git are the only +copy. They are kept for historical comparison and to expose the deploy matrix; +the main deployment always uses the reproducible `data/` source. ## Source Excel shape