refactor: collapse the two projects into one tree and move to npm

Browse Source

The repo held two near-duplicate projects. 2016/ and 2017/ each carried their
own React frontend, their own copy of the same Rust crate, and their own
package manager setup. 2016/tools/sync-from-thptqg2017.sh existed purely to
copy the parser source between them.

New layout:

  index.html + src/  the 2017 frontend, now the only one
  data/<id>/         2016, 2017, 2017-old, 2017-old2
  parser/            the single Rust crate, configs renamed to <id>.toml
  docs/              both projects' docs, 2016 copies suffixed -2016-legacy
                     pending the merge pass

<id> is now one identifier end to end: data/<id>/ feeds parser/configs/<id>.toml
and produces db/<id>.db.gz.

pnpm gives way to npm. pnpm-workspace.yaml existed only to whitelist
better-sqlite3's native build, which npm permits by default, so it has no
equivalent and is simply gone. Lockfiles cannot be converted; package-lock.json
is generated fresh. The migration direction is safe — pnpm's strict layout
forbids phantom dependencies, so anything that resolved under pnpm resolves
under npm's flat tree.

Adds parser/scripts/build-db.js and src/datasets.js: the four dataset IDs are
declared once and read by both the build tooling and (from the next phase) the
frontend.

Follow-on fixes the move made necessary:
  - eslint's Node-globals override pointed at scripts/, now parser/scripts/
  - crawl-baotintuc.js wrote to <root>/data, now data/2017
  - golden tests loaded configs by their old thptqg*-data.toml names

Drops the #[ignore]d Rust-vs-Node golden test. It shelled out to pnpm to run
scripts/build-database.js, a file removed when the parser was ported to Rust,
so it could never pass. check-duplicates.js and diff-datasets.js were already
broken before this change and are annotated as such rather than half-fixed.

63 Rust tests pass and clippy is clean from the new location.

...

This commit is contained in:

tiennm99 committed 2026-08-13 11:27:01 +07:00

1 parent 82db8295bb

commit 6ff2ed99ec

396 files changed

+2753 -8720

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

No files matched your search

data/2017/an-giang.xls

BIN

Binary file not shown.

data/2017/ba-ria-vung-tau.xls

BIN

Binary file not shown.

data/2017/bac-giang.xls

BIN

Binary file not shown.

data/2017/bac-kan.xls

BIN

Binary file not shown.

data/2017/bac-lieu.xls

BIN

Binary file not shown.

data/2017/bac-ninh.xls

BIN

Binary file not shown.

data/2017/ben-tre.xls

BIN

Binary file not shown.

data/2017/binh-dinh.xls

BIN

Binary file not shown.

data/2017/binh-duong.xls

BIN

Binary file not shown.

data/2017/binh-phuoc.xls

BIN

Binary file not shown.

data/2017/binh-thuan.xls

BIN

Binary file not shown.

data/2017/ca-mau.xls

BIN

Binary file not shown.

data/2017/can-tho.xls

BIN

Binary file not shown.

data/2017/cao-bang.xls

BIN

Binary file not shown.

data/2017/da-nang.xls

BIN

Binary file not shown.

data/2017/dak-lak.xls

BIN

Binary file not shown.

data/2017/dak-nong.xls

BIN

Binary file not shown.

data/2017/dien-bien.xls

BIN

Binary file not shown.

data/2017/dong-nai.xls

BIN

Binary file not shown.

data/2017/dong-thap.xls

BIN

Binary file not shown.

data/2017/gia-lai.xls

BIN

Binary file not shown.

data/2017/ha-giang.xls

BIN

Binary file not shown.

data/2017/ha-nam.xls

BIN

Binary file not shown.

data/2017/ha-noi.xls

BIN

Binary file not shown.

data/2017/ha-tinh.xls

BIN

Binary file not shown.

data/2017/hai-duong.xls

BIN

Binary file not shown.

data/2017/hai-phong.xls

BIN

Binary file not shown.

data/2017/hau-giang.xls

BIN

Binary file not shown.

data/2017/ho-chi-minh.xls

BIN

Binary file not shown.

data/2017/hoa-binh.xls

BIN

Binary file not shown.

data/2017/hung-yen.xls

BIN

Binary file not shown.

data/2017/khanh-hoa.xls

BIN

Binary file not shown.

data/2017/kien-giang.xls

BIN

Binary file not shown.

data/2017/kon-tum.xls

BIN

Binary file not shown.

data/2017/lai-chau.xls

BIN

Binary file not shown.

data/2017/lam-dong.xls

BIN

Binary file not shown.

data/2017/lang-son.xls

BIN

Binary file not shown.

data/2017/lao-cai.xls

BIN

Binary file not shown.

data/2017/long-an.xls

BIN

Binary file not shown.

data/2017/nam-dinh.xls

BIN

Binary file not shown.

data/2017/nghe-an.xls

BIN

Binary file not shown.

data/2017/ninh-binh.xls

BIN

Binary file not shown.

data/2017/ninh-thuan.xls

BIN

Binary file not shown.

data/2017/phu-tho.xls

BIN

Binary file not shown.

data/2017/phu-yen.xls

BIN

Binary file not shown.

data/2017/quang-binh.xls

BIN

Binary file not shown.

data/2017/quang-nam.xls

BIN

Binary file not shown.

data/2017/quang-ngai.xls

BIN

Binary file not shown.

data/2017/quang-ninh.xls

BIN

Binary file not shown.

data/2017/quang-tri.xls

BIN

Binary file not shown.

data/2017/soc-trang.xls

BIN

Binary file not shown.

data/2017/son-la.xls

BIN

Binary file not shown.

data/2017/tay-ninh.xls

BIN

Binary file not shown.

data/2017/thai-binh.xls

BIN

Binary file not shown.

data/2017/thai-nguyen.xls

BIN

Binary file not shown.

data/2017/thanh-hoa.xls

BIN

Binary file not shown.

data/2017/thua-thien-hue.xls

BIN

Binary file not shown.

data/2017/tien-giang.xls

BIN

Binary file not shown.

data/2017/tra-vinh.xls

BIN

Binary file not shown.

data/2017/tuyen-quang.xls

BIN

Binary file not shown.

data/2017/vinh-long.xls

BIN

Binary file not shown.

data/2017/vinh-phuc.xls

BIN

Binary file not shown.

data/2017/yen-bai.xls

BIN

Binary file not shown.