[plug] creating up to date cds of Debian Woody

[James Bromberger]

On Sun, Oct 21, 2001 at 12:32:49PM +0800, Daniel wrote:
> As I understand it experienced Debian users can use a script to create 
> their own up to date cds from the appropriate files.

apt-get install debian-cd


> How 'up to date' are the individual files kept at aarnet - have they fallen 
> behind like the cd images appear to have?
> Is there a similar cd create script for Woody?

The mirrors are supposed to be up to date. ftp.au.debian.org, which is 
planetmirror.com, is updated twice daily @ 1am, 1pm AEST (+1000), sometimes 
more if Jason (the admin there, IIRC) 'finds any problems'. *shrug*


As to Woody: yes, use this script. I did this for the first time the night 
before the InstallFest; and thus not only was there a high speed local 
link to the UWA mirror, but a bootable Debian CD with woody as it has looked 
the night before. Oddly enough, I never saw that CD again... ;)  but I 
wasn't intending to keep it anyway. It was out of date within hours...

 
> If the local mirrors have up to date files - is it easy to copy the files 
> off the cds and put them into directories that correspond to file sources 
> on Debian sites and then rsync, later using a script to put together Woody 
> cds? [is the size of the files similar to that taken by the disks or much 
> greater?  And the volume of change ?]

You could reconstruct a mirror; but since the new package versions 
will be downloaded compleetly separately to any older versions, you 
won't save much. If you want to start a mirror, or just refresh an old one, 
you're best off coming to the UCC meeting with your computer (its 
tomorrow, Monday, at UCC, no?). 

I mirror using the following rsync script. The current size of my mirror 
is 8.3 GB. Change per day: errr, maybe 100 MB, more sometimes. Obviously 
the delta each day depends on who uploads what; ie, if Branden updates X, 
then you're in for a big download. The scripts to produce the three debian 
CDs with the debian-cd package requires 3 * 650 MB of disk space for the 
ISO images. To get started, you only really need the first image; the boot, 
base system, and a selection of packages.


> Hope I'm not to far off track here.
> Thanks for your help,


OK, you can stop reading here if you're not interested in my rsync scripts. 
Its only my .sig at the end, and you've seen that before. Press 'D' and 
move on.


Nick has a similar script, I have this one, they all acomplish the same 
thing. I am sure others on this list have other variants. Mine's not very 
sophisticated, but "it works for me".

Right... two files. One is my rsync script, and one is a list of excludes. 
There is a heap of stuff you *dont* want to mirror. The first file simply 
sets all the required paramters for rsync, end ensures you are only running 
one rsync at a time. Its all very crude; it could check `pidof $0` 
I suppose...

----BEGIN---"rsync-au.sh"--------
#!/bin/sh
if  ( pidof -x rsync > /dev/null ) ; then
  echo "Already running"
else

# Get the MAIN distribution
/usr/bin/rsync -rltvz --stats --max-delete=3000 --delete --delete-excluded --partial --exclude-from=/root/rsync-exclude.txt "ftp.au.debian.org::debian/*" /home/ftp/linux/debian/ > /tmp/rsync-au.log

# Get the Non-US distribution
/usr/bin/rsync -rltvz --stats --max-delete=3000 --delete --delete-excluded --partial --exclude-from=/root/rsync-exclude.txt "ftp.au.debian.org::debian-non-us/*" /home/ftp/linux/debian-non-us/ > /tmp/rsync-au-us.log
fi
----END------

Simple enough. Now, the excludes are in my rsync-exclude.txt. This list is 
probably out of date. I skip all the lanugage packs I don't want (eg, -ja-), 
and the architectures I am not intersted in (eg, I don't have an IBM s390):

----BEGIN---"rsync-exclude.sh"------
*_sparc.*deb
*_powerpc.*deb
*_m68k.*deb
*_hppa.*deb
*_mipsel.*deb
*_mips.*deb
*_arm.*deb
*_hurd-i386.*deb
*_sparc64.*deb
*_alpha.*deb
*.diff.gz
*.orig.tar.gz
*_s390.*deb
*_ia64.*deb
binary-alpha/
disks-alpha/
disks-s390/
disks-ia64/
Packages-alpha
binary-sparc/
disks-sparc/
Packages-sparc
binary-m68k/
disks-m68k/
Packages-m69k
binary-arm/
disks-arm/
Packages-arm
binary-s390/
binary-ia64/
Packages-Master-*gz
binary-hurd-i386/
disks-hurd-i386/
binary-powerpc/
disks-powerpc/
binary-mipsel/
disks-mipsel/
binary-sparc64/
disks-sparc64/
binary-hppa/
disks-hppa/
binary-sh/
disks-sh/
upgrade-alpha/
upgrade-m68k/
upgrade-sparc/
upgrade-i386/
source/
private/
orphaned/
proposed-updates/
local/
experimental/
incoming/
WebPages/
debian-bugs/
debian-lists/
indices/
binary-mips/
disks-mips/
core
Contents-alpha.gz
Contents-mipsel.gz
Contents-powerpc.gz
Contents-arm.gz
Contents-m68k.gz
Contents-sparc.gz
Contents-mips.gz
Contents-hurd-i386.gz
Contents-sh.gz
Contents-hppa.gz
Contents-ia64.gz
Contents-s390.gz
*-ja_*
*-proposed-updates/
*-ko_*
*-el_*
*-it_*
*-de_*
*-fr_*
*-es_*
kde-i18n-*
\.contents|\.new|\.in|\.notar|
*.dsc
----END----------


Done. See, only the sig at the end...

  James

PS: Michael B: I am sure you have something much better than this, no?
-- 
 James Bromberger <james_AT_rcpt.to> www.james.rcpt.to

 Remainder moved to http://www.james.rcpt.to/james/sig.html
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 232 bytes
Desc: not available
URL: <http://lists.plug.org.au/pipermail/plug/attachments/20011022/cb22b031/attachment.pgp>