mirror of
https://github.com/tiennm99/thptqg.git
synced 2026-10-11 03:13:48 +00:00
tiennm99
0eb174721d
Adds go-parser/, a Go reimplementation of the xlsxread parser, verified byte-for-byte against the Rust original before any cutover. Reader fidelity is exact across all 299 input files: the canonical cell dump of every sheet matches calamine's, locked in as a test against a committed hash oracle. Reaching that required replacing extrame/xls, which corrupted 69% of cells and dropped a further 28% on the BIFF corpus, with pbnjay/grate; correcting excelize's number-format application and trailing-cell trimming; restoring carriage returns that XML line-ending normalisation strips from 2,233 ten_cum_thi values; and gating numeric re-rendering on cell type so shared strings that merely look numeric keep their leading zeros. The differential gate compares both parsers over all four datasets: 3,265,641 rows with identical full-table SHA-256, identical per-column non-NULL counts, identical schema metadata and identical stdout. Config moves from TOML to YAML for both parsers, so they keep reading the same files and the gate stays meaningful. Verified by rebuilding 2016 and 2017-old2 with Rust under the new configs and matching the recorded counts. build-db.js now refuses to publish a database whose row count does not match the known figure, closing a path where an under-producing parser could ship a truncated public dataset with green CI. The deploy workflow gains a pull_request trigger and guards deploy to main, so branch verification can no longer publish to production.
26 lines
1.1 KiB
Go
26 lines
1.1 KiB
Go
// Package sqlitedb registers the SQLite driver the parser writes with and names
|
|
// it in one place.
|
|
//
|
|
// modernc.org/sqlite is a pure-Go SQLite, chosen so the whole module stays
|
|
// cgo-free — grate, excelize and yaml.v3 are pure Go too, so CI can compile with
|
|
// CGO_ENABLED=0 and no C toolchain.
|
|
//
|
|
// It is a machine-transpiled SQLite rather than the upstream C amalgamation that
|
|
// Rust's rusqlite --bundled vendors (libsqlite3-sys 0.30.1). Two things make that
|
|
// acceptable: this parser uses only plain SQL — no CTEs, window functions,
|
|
// triggers or extensions — and the differential gate compares a full-table
|
|
// SHA-256 plus PRAGMA table_info/index_list against live Rust output.
|
|
//
|
|
// Verified on linux/arm64 with v1.56.0 (SQLite 3.53.3): the full DDL including
|
|
// the partial idx_ten_cum_thi index, INSERT OR REPLACE, and VACUUM.
|
|
//
|
|
// Fallback if the differential gate ever implicates the driver: mattn/go-sqlite3
|
|
// is upstream C at the cost of cgo.
|
|
package sqlitedb
|
|
|
|
// Registers "sqlite" with database/sql.
|
|
import _ "modernc.org/sqlite"
|
|
|
|
// DriverName is the database/sql driver name to pass to sql.Open.
|
|
const DriverName = "sqlite"
|