mirror of
https://github.com/xroche/httrack.git
synced 2026-07-23 09:09:05 +03:00
1ed8ffad64
The MSan job runs the offline 01_engine-* self-tests but must skip any that exercise the system zlib: uninstrumented libz floods MemorySanitizer with false positives (MSan can't see libz initialize its own internal state, so every byte deflate/inflate produces reads as "uninitialized"). That was a grep -v -- '-cache' exclusion, a list that would grow with each new zlib test. Rename the three cache tests to a 01_zlib-* prefix so the MSan job selects 01_engine-* with no exclusion list. They still run in the normal suite and under ASan+UBSan (full make check), where uninstrumented libz is fine. The deflate Accept-Encoding test (PR #459) follows the same convention. Signed-off-by: Xavier Roche <roche@httrack.com> Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
53 lines
2.1 KiB
Bash
Executable File
53 lines
2.1 KiB
Bash
Executable File
#!/bin/bash
|
|
#
|
|
# Keep this POSIX-portable: the harness runs it via $(BASH), which is a plain
|
|
# POSIX /bin/sh on some platforms (e.g. macOS), so avoid bashisms and GNU-only
|
|
# tool flags despite the #!/bin/bash above.
|
|
|
|
# Cache create/read/update logic (driven by 'httrack -#test=cache <dir>').
|
|
#
|
|
# The in-process self-test stores several hand-crafted edge entries (normal
|
|
# HTML, an empty redirect with a near-limit location, a non-HTML body kept via
|
|
# all-in-cache, a binary body with embedded NUL/high bytes), a few thousand
|
|
# small entries (index/lookup scale), and a few large compressible and
|
|
# incompressible bodies (zlib deflate/inflate). It reads everything back
|
|
# asserting every header field and the body round-trip byte for byte, then
|
|
# updates one entry and confirms the new value is read back. It exits non-zero
|
|
# on the first mismatch.
|
|
|
|
set -eu
|
|
|
|
dir=$(mktemp -d)
|
|
trap 'rm -rf "$dir"' EXIT
|
|
|
|
# The working directory is a required argument; without it the test prints a
|
|
# usage line to stderr and returns non-zero.
|
|
out=$(httrack -#test=cache "$dir")
|
|
|
|
# Match the exact success line, so the test cannot pass for an unrelated reason
|
|
# (e.g. the cache test being gone, which prints the registry to stderr but
|
|
# never prints this line).
|
|
test "$out" = "cache-selftest: OK" || {
|
|
echo "expected 'cache-selftest: OK', got: $out" >&2
|
|
exit 1
|
|
}
|
|
|
|
# The self-test must have actually produced a ZIP cache on disk.
|
|
test -e "$dir/hts-cache/new.zip" || {
|
|
echo "no ZIP cache was written by the self-test" >&2
|
|
exit 1
|
|
}
|
|
|
|
# Sanity-check the cache footprint: the few-thousand-entry pass is expected to
|
|
# weigh ~1-2 MB. Fail if it balloons well past that (e.g. a per-entry overhead
|
|
# regression or runaway growth), so the cache size stays bounded.
|
|
# du -sk (1024-byte units) is portable; GNU's -b (apparent bytes) is rejected
|
|
# by BSD/macOS du. Block-allocated size is an upper bound on apparent size,
|
|
# which is all a ceiling check needs.
|
|
ceiling=$((4 * 1024)) # KiB
|
|
kbytes=$(du -sk "$dir/hts-cache" | cut -f1)
|
|
test "$kbytes" -le "$ceiling" || {
|
|
echo "cache footprint ${kbytes} KiB exceeds ${ceiling} KiB ceiling" >&2
|
|
exit 1
|
|
}
|