tiennm99/store-scraper-bot
1
0 Fork 0
mirror of https://github.com/tiennm99/store-scraper-bot.git synced 2026-10-11 12:29:01 +00:00
Code Issues Packages Projects Releases Wiki Activity
119 Commits 1 Branch 0 Tags
9eab9e07ba2499297768d2d0b0db956fedf27e31
Commit Graph
14 Commits
Author SHA1 Message Date
tiennm99 9eab9e07ba refactor: rename project to store-scraper-bot 
GitHub repo rename: js-store-scraper-bot becomes the canonical store-scraper-bot. The Java reference impl is renamed to legacy-store-scraper-bot in parallel.

Updates: package.json name + description, README header + reference link, wrangler.toml worker name (file slated for removal in cleanup phase but kept consistent in the interim).
 2026-05-09 17:18:50 +07:00
tiennm99 d33bfeae3d feat: add Atlas → KV one-shot migration script 
Operator runs `npm run migrate` (reads admin + group docs from Atlas)
followed by `npm run migrate:bulk` (uploads via wrangler kv bulk put).
Cache collections are skipped by default since they auto-rebuild from
upstream APIs; --include-cache flag migrates them with TTL preserved.

- mongodb is added as a devDependency only — never enters the Worker
  bundle, the Worker still talks to KV exclusively.
- scripts/.atlas-export.json is gitignored (contains exported state).
- README documents the one-time runbook.
 2026-05-05 21:15:18 +07:00
tiennm99 3c97553c69 feat: initial JavaScript port of store-scraper-bot 
Node.js 20+ ESM port mirroring Java/Go implementations.

- 13 Telegram commands matching Java identifiers
- MongoDB schema parity (common, group, apple_app, google_app collections)
- Apple/Google scrapers calling store-scraper.vercel.app with 10-min cache
- Daily 7am Vietnam-time cron with weekend-silent mode
- HTML table renderer matching Java/Go output
- Docker + Compose (prod and dev)

Untested end-to-end against live Telegram or upstream API.
 2026-04-26 20:16:00 +07:00
tiennm99 ca1a409610 Clear and rewrite 
Retire the Go port; history continues from the JavaScript implementation (store-scraper-bot).
 2026-08-04 23:00:01 +07:00
tiennm99 6bc7756596 docs: update reference to java-store-scraper-bot 2026-05-09 17:38:42 +07:00
tiennm99 a5cade43cf docs: point reference link at legacy-store-scraper-bot 
Java reference impl renamed from store-scraper-bot to legacy-store-scraper-bot. The new canonical store-scraper-bot is the JS implementation.
 2026-05-09 17:29:21 +07:00
tiennm99 fdb5bee896 docs: mark project as preview, AI-assisted, untested 2026-04-25 22:01:35 +07:00
tiennm99 f243bc9b88 Update README.md 2025-12-01 00:08:58 +07:00
Tien Nguyen Minh 165023f539 Initial commit 2025-11-15 18:52:19 +07:00
tiennm99 c5f3628f01 Clear and rewrite 
Retire the Java implementation; history continues from the Go port (store-scraper-bot-go).
 2026-08-04 22:59:44 +07:00
tiennm99 22a3f6bc5c feat(api): update base url 2025-11-11 20:59:56 +07:00
tiennm99 de1f84d278 feat(self scraper): try to crawl without country 
But fail
 2025-11-12 23:10:00 +07:00
tiennm99 35e88de99a feat(api): init 2025-10-26 09:19:36 +07:00
Tien Nguyen Minh 0efd277edb Initial commit 2025-10-26 00:02:49 +07:00