0 Fork 0

mirror of https://github.com/tiennm99/thptqg.git synced 2026-10-11 12:28:58 +00:00

Files

T

tiennm99 c407130162 perf(db): write 4 KiB pages, because requests cost more than bytes

The 1 KiB page size optimised for the fewest bytes per seeked row. The
first real measurement says that is the wrong quantity: a name search
made 390 requests for 608 KB and took 16.9 seconds. The worker reads
with synchronous XHR (lazyFile.ts opens every GET with async=false), so
requests are strictly serial at roughly 40 ms each, and 390 x 40 ms is
the whole of that time. The bytes were never the problem.

Four times the page size means a quarter of the pages for the same
scan, and a shallower b-tree for each of the 100 result rows the search
seeks individually. It also costs about 5% less file.

2026-08-14 16:52:33 +07:00

data-pipeline.md

perf(db): write 4 KiB pages, because requests cost more than bytes

2026-08-14 16:52:33 +07:00

deployment-guide.md

fix(web): read the database in chunked mode so the length can be supplied

2026-08-14 16:02:57 +07:00

project-overview.md

feat: read the databases over HTTP range requests

2026-08-14 12:42:48 +07:00

README.md

refactor: one directory per pipeline stage, and an assembler to drive them

2026-08-13 22:50:05 +07:00

system-architecture.md

perf(db): write 4 KiB pages, because requests cost more than bytes

2026-08-14 16:52:33 +07:00

README.md

Docs

project-overview.md — goal, scope, constraints, the datasets, history
system-architecture.md — data flow, canonical schema, routing, how one frontend serves both exam years
data-pipeline.md — Excel parse quirks, per-dataset formats, overflow-sheet gotcha, expected row counts, verifying a rebuild
deployment-guide.md — GitHub Pages workflow, adding a dataset, rollback, troubleshooting