From c35a14f9bb8964a32ebc4972125cb4cadd79300b Mon Sep 17 00:00:00 2001
From: tiennm99 <tiennm99@outlook.com>
Date: Tue, 18 Aug 2026 21:39:32 +0700
Subject: [PATCH] fix(scripts): dedup URLs stored in markdown autolink form
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 8bit

The duplicate-check boundary set had '<' but not '>', so a URL stored
as <https://…> (autolink, used by older posts) was never detected as a
duplicate. Inherited from the JS engine; found while validating the Go
port against 2020-era posts.
---
 ...arity-260818-newsletter-go-migration-report.md | 15 +++++++++++++++
 scripts/newsletter/url_utils.go                   |  5 +++--
 2 files changed, 18 insertions(+), 2 deletions(-)

diff --git a/plans/reports/parity-260818-newsletter-go-migration-report.md b/plans/reports/parity-260818-newsletter-go-migration-report.md
index 76740f3..e41648f 100644
--- a/plans/reports/parity-260818-newsletter-go-migration-report.md
+++ b/plans/reports/parity-260818-newsletter-go-migration-report.md
@@ -34,3 +34,18 @@ Method: identical args to `node scripts/newsletter/<script>.js` and `go run ./sc
 ## Verdict
 
 All matrix cases pass. Go engine is behavior-equivalent for skill consumption. Proceed to cutover.
+
+## Post-cutover validation addendum (old-post URLs, 2026-08-18)
+
+Ran the Go engine against URLs stored in old posts (2020 and 2025/02):
+
+| Case | Result |
+|------|--------|
+| 2025/02 article, plain + tracker-variant | duplicate:true both, trackers stripped |
+| 2025/02 YouTube stored watch URL + youtu.be variant | both canonicalize, duplicate:true, oEmbed title |
+| 2025/02 S3 image (add-url + detect-image-source) | route:image, duplicate:true, uuid extracted |
+| 18-month-old uuid via find-substack-post | `{found:false}` — correct, outside RSS window |
+| 404 negative control | duplicate:false, http_status 404 |
+| 2020 URL stored as markdown autolink `<https://…>` | **duplicate:false — defect found** |
+
+Defect: the URL boundary set (`)]"'?#<_&,`, inherited verbatim from the JS) lacked `>`, so URLs stored in autolink form never dedup. Pre-existing JS behavior, not a port regression. Fixed post-cutover by adding `>` to the set in `url_utils.go`; regression-checked prefix-probe (still false), stored full URL (still true), deterministic outputs (unchanged).
diff --git a/scripts/newsletter/url_utils.go b/scripts/newsletter/url_utils.go
index b6728ca..305a2f3 100644
--- a/scripts/newsletter/url_utils.go
+++ b/scripts/newsletter/url_utils.go
@@ -196,7 +196,8 @@ func uuidBoundaryOK(text string, end int) bool {
 
 // urlBoundaryOK: an optional trailing slash (bareURL strips it, stored URLs may
 // keep it), then a path/punctuation delimiter, whitespace, or end of text — so
-// /p/foo does not match a stored /p/foo-bar.
+// /p/foo does not match a stored /p/foo-bar. The '>' delimiter covers URLs
+// stored in markdown autolink form <https://…>, which older posts use.
 func urlBoundaryOK(text string, end int) bool {
 	if end < len(text) && text[end] == '/' {
 		end++
@@ -208,7 +209,7 @@ func urlBoundaryOK(text string, end int) bool {
 	case ' ', '\t', '\n', '\r', '\f', '\v':
 		return true
 	default:
-		return strings.IndexByte(`)]"'?#<_&,`, c) != -1
+		return strings.IndexByte(`)]"'?#<>_&,`, c) != -1
 	}
 }