netfilter.org mirror setup HOWTO <author>Harald Welte <tt>laforge@netfilter.org</tt> <date>$Revision: 4399 $ <abstract> This document describes how to set up a FTP and/or WWW mirror of the netfilter.org project. </abstract> <!-- Table of contents --> <toc> <!-- Begin the document --> <sect>Introduction<label id="intro"> <p> So you are interested in hosting a mirror of the netfilter.org project. This is good news, thank you for considering it. Please note that the netfilter/iptables project is quite popular, and the traffic to your website can be quite high. The netfilter.org main server <em>kashyyyk.netfilter.org</em> always has 100GB to 150GB per month, but that includes CVS and the mailinglists. <sect>Mirror of the www.netfilter.org homepage <sect1>Step zero: Do we need a mirror for your country? <p> The netfilter/iptables project issues names for mirror sites depending on the country you are located. Usually a mirror would have a name like <bf>www.ccTLD.netfilter.org</bf>, where ccTLD is to be replaced with your country code top level domain (e.g. www.de.netfilter.org for germany). <p> Please make sure that we don't already have a mirror for your country. At the moment we can only accept one mirror per country. <sect1>Step one: Prerequirements <sect2>rsync <p> The netfilter.org project offers the whole homepage directory via the <em>rsync</em> protocol. If you don't know what rsync is, or don't have rsync on your machine(s), we will not be able to use your mirror. Sorry. <p> More information about rsync can be found at the <url url="http://samba.org/rsync/" name="rsync homepage">. <sect2>Webserver <p>Apart from rsync, you will need a webserver that can server HTTP 1.1 name based virtual hosts. <sect2>Diskspace Requirements <p> The netfilter homepage is currently 50MB in size. I expect it to grow to 100, maybe 150MB in the future. Considering the size of today's hard drives, I don't think that anybody has problems with the size. <sect2>Traffic Requirements <p> Hard to tell. As we will not use any kind of load sharing, the distribution of the traffic happens 'manually'. This means, that the amount of traffic depends on the number of users that explicitly use <em>www.ccTLD.netfilter.org</em> instead of <em>www.netfilter.org</em>. <p> The total traffic of <em>www.netfilter.org</em> before we had any official mirrors was about 50GB per month. <sect1>Step two: Getting the netfilter homepage <p>You can download the netfilter homepage by using the following command: <tscreen><verb> rsync -av --delete rsync.netfilter.org::www/ target_directory/ </verb></tscreen> <sect1>Step three: Configuring the name based virtual host <p> You will need to configure a name based virtual host for the following hostnames: <tscreen><verb> www.ccTLD.netfilter.org www.ccTLD.iptables.org ccTLD.netfilter.org ccTLD.iptables.org mirror.netfilter.org mirror.iptables.org </verb></tscreen> <sect1>Step four: Telling us about your new mirror <p> Send a short email with the IP address of your new homepage mirror to <url url="mailto:mirrormaster@netfilter.org" name="mirrormaster@netfilter.org">. We will then inform you once the DNS record has been entered into the netfilter.org and iptables.org zone file. <sect>Mirror of the ftp.netfilter.org <sect1>Which type of mirror? Setting up a mirror of the ftp server can be done in two ways. <sect2>Mirror as ftp.ccTLD.netfilter.org <p> Since FTP doesn't have a concept of name based virtual hosts, you would need to allocate an extra IP address for this ftp server. <sect2>Mirror as ftp.something.do.main/pub/netfilter <p> This is the common case, where you mirror our FTP directory into a subdirectory of your FTP server. <p> If you can put the mirror in the path given above (<em>/pub/netfilter</em>), we can also provide you with a <em>ftp.ccTLD.netfilter.org</em> hostname. If the directory appears somewhere else in your directory tree, we will not give you this kind of hostname for consistency reasons. Sorry. <sect1>Step zero: Do we need a mirror for your country? <p> The netfilter/iptables project issues names for mirror sites depending on the country you are located. Usually a mirror would have a name like <bf>ftp.ccTLD.netfilter.org</bf>, where ccTLD is to be replaced with your country code top level domain (e.g. ftp.de.netfilter.org for germany). <p> Please make sure that we don't already have a mirror for your country. At the moment we can only accept one mirror per country. <sect1>Step one: Prerequirements <sect2>rsync <p> The netfilter.org project offers the whole homepage directory via the <em>rsync</em> protocol. If you don't know what rsync is, or don't have rsync on your machine(s), we will not be able to use your mirror. Sorry. <p> More information about rsync can be found at the <url url="http://samba.org/rsync/" name="rsync homepage">. <sect2>Diskspace Requirements <p> The netfilter FTP site is currently about 50MB in size. I expect it to grow to 150, maybe max. 250MB in the future. Considering the size of today's hard drives, I don't think that anybody has problems with the size. <sect2>Traffic Requirements <p> Hard to tell. As we will not use any kind of load sharing, the distribution of the traffic happens 'manually'. This means, that the amount of traffic depends on the number of users that explicitly use <em>ftp.ccTLD.netfilter.org</em> instead of <em>ftp.netfilter.org</em>. <p> The total traffic of <em>ftp.netfilter.org</em> before we had any official mirrors was about 50GB per month. <sect1>Step two: Getting the netfilter FTP tree <p>You can download the netfilter homepage by using the following command: <tscreen><verb> rsync -av --delete rsync.netfilter.org::ftp/ target_directory/ </verb></tscreen> <sect1>Step three: Telling us about your new mirror <p> Send a short email with the IP address of your new FTP mirror to <url url="mailto:mirrormaster@netfilter.org" name="mirrormaster@netfilter.org">. We will then inform you once the DNS record has been entered into the netfilter.org and iptables.org zone file. <sect>The netfilter-mirrors mailinglist <p> We have set up a mailinglist for discussion/announcements/questions/comments among the netfilter.org mirror administrators. If you want to host a mirror site, subscription to that list is mandatory. As soon as we put your IP address into our zone file, your email address will be subscribed to that mailinglist. Please note that posting to this list is restricted to members, so please don't send mails with a 'From' address different from the one subscribed. You can manage your list subscription at <url url="http://lists.netfilter.org/mailman/listinfo/netfilter-mirrors" name="the netfilter-mirrors@lists.netfilter.org admin interface">. <sect>Mirror of other netfilter.org services <p> The netfilter/iptables project provides a number of other services, such as anonymous CVS, mailing list archives, bugzilla, CVSweb. <p> At this time we are not looking for mirrors for any of those services. </article>