[plug] mirroring and updating a remote http directory

[Ben Jensz]

http://www.vet.com.au/files/libad/sigs/ is the URL.

I figured its probably the easiest way of figuring out which is the 
latest def, have the files locally first.  Rather than trying to grep 
out the latest filename out of the HTML directory listing.


/ Ben


James Devenish wrote:

>In message <4112FB02.8020906 at jensz.id.au>
>on Fri, Aug 06, 2004 at 11:29:06AM +0800, Ben Jensz wrote:
>  
>
>>Now the problem is that for some reason the "Last-modified" header is
>>missing on the files,
>>    
>>
>
>That sounds quite problematic. I wonder what is wrong with the server.
>
>I suppose one approach (which is full of hassles) is to look for
>other ways of pre-filtering each URL using HTTP HEAD. Are you able
>to give us the URLs of what you're mirroring, or the output of a
>typical HEAD request?
>
>
>  
>