[plug] ftp scripting?

Rob Davies rob at rjdarts.com
Wed May 21 17:09:13 WST 2003


At 04:00 pm Wednesday 21 0503, you wrote:
>Can anyone think of a nice easy way to download files that are sequentially
>numbered and only get those that you haven't already got?
>
>As an added complication, i'll be processing the files as they get
>downloaded and removing them from the download folder so i can't just do a
>simple wget --no-clobber... have to keep track of the number it's up to
>somehow.
>
>The files are basically 00000000.txt through to 99999999.txt (i'm guessing
>they'll loop back around to 0 once they get too high)
>
>Also i really should allow for if a file gets skipped on the server (ie 45
>isn't there but 46 is), or if those skipped files appear at a later date
>(ie, i've retreaved up to number 50, but 45 now becomes available).
>
>As an added confusion, i don't really want partially downloaded files
>appearing in my download directory, or at least if they are partially
>downloaded, lock them in some way so my processing programm can't get at
>them untill they're unlocked.
>
>This started out as being quite a simple one line wget command, but with all
>the added complexity it's gotten beyond my reach now i think.
>
>Any suggestions much appreaciated.

rsync
ciao

Rob Davies
rob at rjdarts.com
ICQ:10432219

' To converse is one strategy that separates us, from the Apes.' 



More information about the plug mailing list