mirror of
https://github.com/xroche/httrack.git
synced 2026-07-28 03:22:12 +03:00
--update already knows which resources were new, which changed and which the server called unchanged, and throws it away: the flags reach file_notify() and go no further than a log line, while deletions exist only as a side effect of purging. --changes (-%d) keeps all of it and writes hts-changes.json plus a one-line summary in the log. "Changed" means the bytes differ, not that the server re-sent the resource. Comparing the mirrored files directly would not work: HTTrack stamps every parsed page with the crawl date via the footer, so those bytes differ on every run. Payloads are compared instead, the previous one coming from the cache for parsed pages and from the local copy sampled just before it is overwritten for everything else. The mirror-relative path, not the URL, is the accumulator's key, so a redirect and its target that share a save name are one entry; and only the first notify for a file samples its pre-run state, so a retried transfer is not counted twice. What counts as already mirrored comes from the previous run's file index rather than from the file's presence on disk: a partial left by this crawl's own failed attempt is on disk but was never part of the previous mirror. The deleted set is now computed whether or not purging is enabled; unlinking still happens only under --purge-old. Closes #714 Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com> Signed-off-by: Xavier Roche <xroche@gmail.com>
162 lines
6.1 KiB
HTML
162 lines
6.1 KiB
HTML
<html xmlns="http://www.w3.org/1999/xhtml" lang="en">
|
|
|
|
<head>
|
|
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1" />
|
|
<meta name="description" content="HTTrack is an easy-to-use website mirror utility. It allows you to download a World Wide website from the Internet to a local directory,building recursively all structures, getting html, images, and other files from the server to your computer. Links are rebuiltrelatively so that you can freely browse to the local site (works with any browser). You can mirror several sites together so that you can jump from one toanother. You can, also, update an existing mirror site, or resume an interrupted download. The robot is fully configurable, with an integrated help" />
|
|
<meta name="keywords" content="httrack, HTTRACK, HTTrack, winhttrack, WINHTTRACK, WinHTTrack, offline browser, web mirror utility, aspirateur web, surf offline, web capture, www mirror utility, browse offline, local site builder, website mirroring, aspirateur www, internet grabber, capture de site web, internet tool, hors connexion, unix, dos, windows 95, windows 98, solaris, ibm580, AIX 4.0, HTS, HTGet, web aspirator, web aspirateur, libre, GPL, GNU, free software" />
|
|
<title>HTTrack Website Copier - Offline Browser</title>
|
|
|
|
<style type="text/css">
|
|
<!--
|
|
|
|
body {
|
|
margin: 0; padding: 0; margin-bottom: 15px; margin-top: 8px;
|
|
background: #77b;
|
|
}
|
|
body, td {
|
|
font: 14px "Trebuchet MS", Verdana, Arial, Helvetica, sans-serif;
|
|
}
|
|
|
|
#subTitle {
|
|
background: #000; color: #fff; padding: 4px; font-weight: bold;
|
|
}
|
|
|
|
#siteNavigation a, #siteNavigation .current {
|
|
font-weight: bold; color: #448;
|
|
}
|
|
#siteNavigation a:link { text-decoration: none; }
|
|
#siteNavigation a:visited { text-decoration: none; }
|
|
|
|
#siteNavigation .current { background-color: #ccd; }
|
|
|
|
#siteNavigation a:hover { text-decoration: none; background-color: #fff; color: #000; }
|
|
#siteNavigation a:active { text-decoration: none; background-color: #ccc; }
|
|
|
|
|
|
a:link { text-decoration: underline; color: #00f; }
|
|
a:visited { text-decoration: underline; color: #000; }
|
|
a:hover { text-decoration: underline; color: #c00; }
|
|
a:active { text-decoration: underline; }
|
|
|
|
#pageContent {
|
|
clear: both;
|
|
border-bottom: 6px solid #000;
|
|
padding: 10px; padding-top: 20px;
|
|
line-height: 1.65em;
|
|
background-image: url(images/bg_rings.gif);
|
|
background-repeat: no-repeat;
|
|
background-position: top right;
|
|
}
|
|
|
|
#pageContent, #siteNavigation {
|
|
background-color: #ccd;
|
|
}
|
|
|
|
|
|
.imgLeft { float: left; margin-right: 10px; margin-bottom: 10px; }
|
|
.imgRight { float: right; margin-left: 10px; margin-bottom: 10px; }
|
|
|
|
hr { height: 1px; color: #000; background-color: #000; margin-bottom: 15px; }
|
|
|
|
h1 { margin: 0; font-weight: bold; font-size: 2em; }
|
|
h2 { margin: 0; font-weight: bold; font-size: 1.6em; }
|
|
h3 { margin: 0; font-weight: bold; font-size: 1.3em; }
|
|
h4 { margin: 0; font-weight: bold; font-size: 1.18em; }
|
|
|
|
.blak { background-color: #000; }
|
|
.hide { display: none; }
|
|
.tableWidth { min-width: 400px; }
|
|
|
|
.tblRegular { border-collapse: collapse; }
|
|
.tblRegular td { padding: 6px; background-image: url(fade.gif); border: 2px solid #99c; }
|
|
.tblHeaderColor, .tblHeaderColor td { background: #99c; }
|
|
.tblNoBorder td { border: 0; }
|
|
|
|
|
|
// -->
|
|
</style>
|
|
|
|
</head>
|
|
|
|
<table width="76%" border="0" align="center" cellspacing="0" cellpadding="0" class="tableWidth">
|
|
<tr>
|
|
<td><img src="images/header_title_4.gif" width="400" height="34" alt="HTTrack Website Copier" title="" border="0" id="title" /></td>
|
|
</tr>
|
|
</table>
|
|
<table width="76%" border="0" align="center" cellspacing="0" cellpadding="3" class="tableWidth">
|
|
<tr>
|
|
<td id="subTitle">Open Source offline browser</td>
|
|
</tr>
|
|
</table>
|
|
<table width="76%" border="0" align="center" cellspacing="0" cellpadding="0" class="tableWidth">
|
|
<tr class="blak">
|
|
<td>
|
|
<table width="100%" border="0" align="center" cellspacing="1" cellpadding="0">
|
|
<tr>
|
|
<td colspan="6">
|
|
<table width="100%" border="0" align="center" cellspacing="0" cellpadding="10">
|
|
<tr>
|
|
<td id="pageContent">
|
|
<!-- ==================== End prologue ==================== -->
|
|
|
|
<h2 align="center"><em>HTTrack Programming page</em></h2>
|
|
|
|
<br>
|
|
|
|
HTTrack can be used as a third-party program in batch files, or as library.
|
|
Depending on your needs, you may look:
|
|
|
|
<br><br>
|
|
|
|
<h3>Programming</h3>
|
|
|
|
<ul>
|
|
<li><a href="scripting.html">Simple use: scripting examples using the httrack commandline program</a></li><br>
|
|
You can use tens of options (see <tt>httrack --help</tt>) to control precisely the mirror, and used embedded commands in httrack.
|
|
<br><br>
|
|
<li><a href="plug.html">More complex use: plugging external C functions to the httrack library</a></li><br>
|
|
For advanced functions, you may have to use external C wrappers ; for example when adding advanced crawl features, such as "tuned" filestructure type
|
|
<br><i>Important note: please read the license information of httrack before developing add-ons</i><br />
|
|
See also the page <a href="plug_330.html">for versions prior to 3.41</a>
|
|
<br><br>
|
|
<li><a href="library.html">Advanced use: using the library</a></li><br>
|
|
The library can be used to write graphical GUIs for httrack, or to run mirrors from a program.
|
|
<br><i>Important note: please read the license information of httrack before developing add-ons</i>
|
|
</ul>
|
|
|
|
<h3>Technical references</h3>
|
|
<ul>
|
|
<li><a href="cache.html">Cache format</a></li><br>
|
|
HTTrack stores original HTML data and references to downloaded files in a cache, located in the hts-cache directory.
|
|
This page describes the HTTrack cache format.
|
|
<li><a href="changes.html">Change report format</a></li><br>
|
|
With --changes, HTTrack writes hts-changes.json describing what the crawl left new, changed, unchanged and gone
|
|
compared to the previous mirror. This page describes that file.
|
|
</ul>
|
|
|
|
|
|
<br><br>
|
|
|
|
<!-- ==================== Start epilogue ==================== -->
|
|
</td>
|
|
</tr>
|
|
</table>
|
|
</td>
|
|
</tr>
|
|
</table>
|
|
</td>
|
|
</tr>
|
|
</table>
|
|
|
|
<table width="76%" border="0" align="center" valign="bottom" cellspacing="0" cellpadding="0">
|
|
<tr>
|
|
<td id="footer"><small>© 1998-2026 Xavier Roche & other contributors - Web Design: Leto Kauler.</small></td>
|
|
</tr>
|
|
</table>
|
|
|
|
</body>
|
|
|
|
</html>
|
|
|
|
|