[plug] mirroring and updating a remote http directory

[James Devenish]

In message <4112FB02.8020906 at jensz.id.au>
on Fri, Aug 06, 2004 at 11:29:06AM +0800, Ben Jensz wrote:
> Now the problem is that for some reason the "Last-modified" header is
> missing on the files,

That sounds quite problematic. I wonder what is wrong with the server.

I suppose one approach (which is full of hassles) is to look for
other ways of pre-filtering each URL using HTTP HEAD. Are you able
to give us the URLs of what you're mirroring, or the output of a
typical HEAD request?