httrack

rms/httrack

Fork 0

mirror of https://github.com/xroche/httrack.git synced 2026-06-25 11:37:28 +03:00

Author	SHA1	Message	Date
Xavier Roche	82d1de5d06	tests: lock special-char URL naming across an update (#157 ) #157 reported accented URLs (pt-BR MediaWiki) losing their .html extension on an update pass, observed with 3.49-2 on Windows. It does not reproduce on current master: the update resolves the cached content-type and re-applies .html consistently, for UTF-8 and ISO-8859-1 sources, raw Latin-1 href bytes, either percent-encoding case, and dotted tails. The original symptom was a Windows codepage vs UTF-8 X-Save filename mismatch that cannot occur on a UTF-8 filesystem. Add a regression test that locks the invariant: a dotless, accented basename served as text/html, crawled then updated, must keep its .html name and not leave an extensionless sibling. Also assert in the --rerun harness that the update pass reported "files updated" (a fresh crawl never does), so a regression that bypasses the cache and silently re-crawls fresh can no longer pass the update tests. Closes #157 Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com> Signed-off-by: Xavier Roche <roche@httrack.com>	2026-06-24 22:16:30 +02:00

Author

SHA1

Message

Date

Xavier Roche

82d1de5d06

tests: lock special-char URL naming across an update (#157 )

#157 reported accented URLs (pt-BR MediaWiki) losing their .html extension
on an update pass, observed with 3.49-2 on Windows. It does not reproduce on
current master: the update resolves the cached content-type and re-applies
.html consistently, for UTF-8 and ISO-8859-1 sources, raw Latin-1 href bytes,
either percent-encoding case, and dotted tails. The original symptom was a
Windows codepage vs UTF-8 X-Save filename mismatch that cannot occur on a
UTF-8 filesystem.

Add a regression test that locks the invariant: a dotless, accented basename
served as text/html, crawled then updated, must keep its .html name and not
leave an extensionless sibling.

Also assert in the --rerun harness that the update pass reported "files
updated" (a fresh crawl never does), so a regression that bypasses the cache
and silently re-crawls fresh can no longer pass the update tests.

Closes #157

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Signed-off-by: Xavier Roche <roche@httrack.com>

2026-06-24 22:16:30 +02:00

Compare commits

1 Commits

master ... fix/update

Diff Content Not Available

Compare commits

1 Commits master ... fix/update

Diff Content Not Available

1 Commits

master ... fix/update