[plug] mirroring and updating a remote http directory
Ben Jensz
plug at jensz.id.au
Fri Aug 6 11:59:47 WST 2004
http://www.vet.com.au/files/libad/sigs/ is the URL.
I figured its probably the easiest way of figuring out which is the
latest def, have the files locally first. Rather than trying to grep
out the latest filename out of the HTML directory listing.
/ Ben
James Devenish wrote:
>In message <4112FB02.8020906 at jensz.id.au>
>on Fri, Aug 06, 2004 at 11:29:06AM +0800, Ben Jensz wrote:
>
>
>>Now the problem is that for some reason the "Last-modified" header is
>>missing on the files,
>>
>>
>
>That sounds quite problematic. I wonder what is wrong with the server.
>
>I suppose one approach (which is full of hassles) is to look for
>other ways of pre-filtering each URL using HTTP HEAD. Are you able
>to give us the URLs of what you're mirroring, or the output of a
>typical HEAD request?
>
>
>
>
More information about the plug
mailing list