from small one page howto to huge articles all in one place
 

search text in:




Other .linuxhowtos.org sites: www.linuxhowtos.org
toolsntoys.linuxhowtos.org



Last additions:
How to make X listen on port 6000

How to make X listen on port 6000

words:

34

views:

45361

userrating:

average rating: 1.5 (4 votes) (1=very good 6=terrible)


May, 25th 2007:
April, 26th 2007:
Apr, 10th. 2007:
Druckversion . pdf icon
You are here: Installation Guides

Summary

This text describes the installation and configuration of a heavy duty internet server running a gentoo linux distribution. The server will have to run 24/7 with minimum downtime for maintenance and is connected to a 100MBit Internet backbone. I choose gentoo as distribution because of the really fast availability of new versions and security patches for all installed packages. Everything will be compiled for the special needs of this maschine with various security enhancement features which ship with the available glibc/gcc versions (like stack smashing protections).

Changelog

Previous versions used to split the swap space across the raid harddiscs and not to mirror it. In case of a hard disc failure your system might(will) crash. This is not intended... (Thanks to Nick Rosier to point this out).

Note

This howto is NOT suited for users who run their first linux (or gentoo) install. Previous linux knowledge is needed, not every detail will be explained here.

System descriptions

Hardware

The system is a dual Xeon 2.66 Ghz with 512KB cache size and enabled hyperthreading.

System storage will be 2 80 GB HDDs running in a raid 1 with network backup every night. The filesystem will be XFS on a software raid 1 (mirroring) system.

Memory: 1GB, build in network card, no sound used, onboard graphics.

The machine will have an UPS and external cooling and will be mounted in a 19" rack.

Software

The system will be a heavy duty webserver running at least the following services/daemons:

  • Apache 2 as webserver (with many virtual hosts)
  • openLDAP for authentication for smtp/imap/pop3 and other login services, but not for system login
  • postfix with sasl2 support as MTA (Mail Transfer Agent)
  • courier-imap for imap access
  • courier-pop3
  • mysql as database backend
  • php (hardened) for various web frontends
  • LeopardCMS (a highspeed content management system written in C) for websites
  • ldapphpadmin for administrating the ldap server
  • squirrelmail as webmail service
  • awstats for website statistics

Installation

The basic installation is explained in the wonderful gentoo installation handbook.

I will only describe the modification on each step.

I will use a stage 1 installation with the minimal boot CD.

Installation in quick style (refer to the handbook if you don't know how to do the individual step(s))

Booting:

  • Boot from the CD, load the right network drivers
  • Change root password to something we know.
  • Configure the network with the given ip address dns servers etc.
  • Start sshd (optional)

Partitioning the hdd(s)

I'm using fdisk to partition the hdds, use whatever you like best.

Attention: To be able to use the raid 1, both hdds must be partitioned exactly identical, so write down the setting when partitioning.

My HDD layout :

/dev/hda1 boot partition 10 MB,  partition type: fd (Linux raid autodetect)
/dev/hda2 swap partition 250 MB, partition type: 82 (Linux swap)
/dev/hda3 root partition remaining space, partition type: fd (Linux raid autodetect)
The same applies to the 2nd HDD.

Setting up the raid 1

edit/create the file /etc/raidtab and enter the following (adjust the devices if neccessary)

raiddev         /dev/md0
nr-raid-disks   2
persistent-superblock   1
device          /dev/hda1
raid-disk       0
device          /dev/hdc1
raid-disk       1

raiddev         /dev/md2
nr-raid-disks   2
persistent-superblock   1
device          /dev/hda3
raid-disk       0
device          /dev/hdc3
raid-disk       1

In case you want to mirror the swap:

raiddev         /dev/md1
nr-raid-disks   2
persistent-superblock   1
device          /dev/hda2
raid-disk       0
device          /dev/hdc2
raid-disk       1

Note: I do not use a raid for the swap, I will explain the swap setup a bit later.
Please also see the comment at the bottom of this page, why this may cause trouble on a harddisk failure.

start the raid by running

raidstart --all
enter "cat /proc/mdstat"

You should see something like this:

Personalities : [raid1]
md0 : active raid1 hda1[1] hdc1[1]
      XXX blocks [2/2] [UU]
md2 : active raid1 hda3[1] hdc3[1]
      YYY blocks [2/2] [UU]

Now, after your raid is up and running, don't think about touching /dev/hda or /dev/hdc directly again. Only use /dev/md0 or /dev/md2.

Applying a Filesystem to a Partition

create your filesystems like it is described in the handbook, only use /dev/md0 and /dev/md2 for the target devices.

Activate the Swap Partitions

Because we are using 2 identical hdds, we have 2 swap partitions that we enable both.

Later in the /etc/fstab config we can tune a bit to make our swap faster.

Mounting

Now we follow the handbook a bit for mounting and downloading the needed stage 1 tarball. Remember, use /dev/mdX as partitions.

Configuring the Compile Options

I prefer to to use the full make.conf.default for configuration, so I copy it over before editing.

cp /mnt/gentoo/etc/make.conf.default /mnt/gentoo/etc/make.conf
now we edit the file
nano -w /mnt/gentoo/etc/make.conf

CHOST is set to i686-pc-linux-gnu

I use the following CFLAGS:

CFLAGS="-march=pentium4 -O2 -pipe" be careful, if you enable the hardened toolchain, never use more than -O2 for compiling.

If you have an AMD cpu, or a pentium2/3 change the -march setting to your cpu.

I set the MAKEOPTS to -j5 (number of CPUs plus one) (2 x Xeon with HT enabled makes 4 virtual CPUs)

MAKEOPTS="-j5"

setting USE-Flags

I use the following line

USE="-X -gtk -gnome -alsa mysql apache2 ssl ssh openldap\
sasl2 pam pic pie hardened hardenedphp xml vhosts"
I don't want X, gtk, gnome or alsa. (This is a server)

But I want mysql, apache, a.s.o.

The flags pic, pie and hardened are used with the hardened toolchain provided by gentoo.

These make the executables less vulnerable to buffer overflow and other programming mistakes. As of the writing of this howto, the flags "pic, pie and hardened" cause some problems with some packages. Manual patching and fiddling may be needed.

UPDATE: I installed another server lately (Nov. 2005), no patching was needed any more.

Follow the installation manual including the Stage1 to Stage2 section.

It is always useful to download the packages first and after that, start the real bootstrapping process. There is nothing better than having a bootstrap failing after 60+ mins on the last package because the file was damaged on the ftp mirror.

Proceed from stage2 to stage3 the documented way.

This will take a while, in my case 71 packages will be installed.

Just keep yourself occupied with something, like writing a howto or something ;)

Now its time to configure the kernel as described in the manual

  • set the timezone
  • install a kernel. I used a hardened-sources kernel (version 2.6.7-r7)
  • check the symlink /usr/src/linnux
  • configure the kernel with make menuconfig
  • make sure to check SMP support in case of a multiple CPU machine.
  • If you use XFS and like to not loose parts of your filesystem data, disable preemptible kernel.
  • Think twice before enabling power management functions like software suspend.
  • You really don't want that your server goes into suspend mode during the night.
  • Warning: If you use MySQL, do not enable the PaX feature "Disallow ELF text relocations". Enabling this makes you unable to compile and run MySQL. *sniff*
  • compile the kernel (remember to use the -j5 flag like in the MAKEOPTS line).
  • install the kernel.

configuring /etc/fstab

enter the data as described in the manual, but use /dev/md0 and /dev/md2

for the swap line use the following 2 lines

/dev/hda2  none swap sw,pri=2 0 0
/dev/hdc2  none swap sw,pri=2 0 0
This way the kernel uses both hdds for swap with the same priority, this means some data will be swapped to one hdd, some to the other and both could be read/written at the same time. This gives a speed boost when you need swap (which should never happen on normal conditions...).
Or use
/dev/md2  none swap sw,pri=2 0 0
in case of a mirrored swap partion.

Enter the networking information as described in the handbook (ip, domainname, ...)

Continue with the installation manual until you got through the manual and

have the basic system running as you want.

While writing this howto, it was planned to have a part 2 to describe the installation of additional software like apache, postfix and others.

But since they are installed exactly as on a "normal" gentoo distribution, a part 2 is not really needed.

comments

Nick Rosier wrote in an email:
I just read this setup. IMHO there's a little flaw in the setup. Goal is to have as little downtime as possible. To gain maybe a bit more performance the author decided not to mirror swap. This is a bad idea. In case of a hard-disk failure part of your swapspace will be unavailable/corrupted meaning your system will possibly crash. I doubt that is what one wants.
Nick has a valid point.
In this setup I use ide harddisks. (yes, I know, SCSI would be better...)
If one of the hdds dies, its very likely that the system crashes any way. This is my experience with ide hdds.
If you use SCSI or SATA-drives, the situation might change. On those drives it might be better to use raid on the swap, too.
rate this article:
current rating: average rating: 1.8 (12 votes) (1=very good 6=terrible)
Your rating:
Very good (1) Good (2) ok (3) average (4) bad (5) terrible (6)

back



Other free services
toURL.org
Shorten long
URLs to short
links like
http://tourl.org/2
tourl.org
.
Reverse DNS lookup
Find out which hostname(s)
resolve to a
given IP or other hostnames for the server
www.reversednslookup.org

New Packages

- as rdf newsfeed
- as rss newsfeed
- as Atom newsfeed
2019-04-23
alacritty - 0.3.2
Ebuild name:

x11-terms/alacritty-0.3.2

Description

GPU-accelerated terminal emulator

Added to portage

2019-04-23

atftp - 0.7.2
Ebuild name:

net-ftp/atftp-0.7.2

Description

Advanced TFTP implementation client/server

Added to portage

2019-04-23

calibre - 3.41.3
Ebuild name:

app-text/calibre-3.41.3

Description

Ebook management application

Added to portage

2019-04-23

cdw - 0.8.1-r1
Ebuild name:

app-cdr/cdw-0.8.1-r1

Description

An ncurses based console frontend for cdrtools and dvd+rw-tools

Added to portage

2019-04-23

cmake - 3.14.3
Ebuild name:

dev-util/cmake-3.14.3

Description

Cross platform Make

Added to portage

2019-04-23

eduke32 - 20190419.7615
Ebuild name:

games-fps/eduke32-20190419.7615

Description

An open source engine port of the classic PC first person shooter D

Added to portage

2019-04-23

elfix - 0.9.5
Ebuild name:

sys-apps/elfix-0.9.5

Description

A suite of tools to work with ELF objects on Hardened Gentoo

Added to portage

2019-04-23

flannel - 0.11.0
Ebuild name:

app-emulation/flannel-0.11.0

Description

An etcd backed network fabric for containers

Added to portage

2019-04-23

fuse-python - 0.3.1
Ebuild name:

dev-python/fuse-python-0.3.1

Description

Python FUSE bindings

Added to portage

2019-04-23

fwupd - 1.2.8
Ebuild name:

sys-apps/fwupd-1.2.8

Description

Aims to make updating firmware on Linux automatic, safe and reliable

Added to portage

2019-04-23

gnuradio - 3.7.13.5
Ebuild name:

net-wireless/gnuradio-3.7.13.5

Description

Toolkit that provides signal processing blocks to implement software

Added to portage

2019-04-23

gssproxy - 0.7.0-r1
Ebuild name:

net-nds/gssproxy-0.7.0-r1

Description

daemon to proxy GSSAPI context establishment and channel handling

Added to portage

2019-04-23

gssproxy - 0.8.0
Ebuild name:

net-nds/gssproxy-0.8.0

Description

daemon to proxy GSSAPI context establishment and channel handling

Added to portage

2019-04-23

gssproxy - 0.8.2
Ebuild name:

net-nds/gssproxy-0.8.2

Description

daemon to proxy GSSAPI context establishment and channel handling

Added to portage

2019-04-23

hashdiff - 0.3.9
Ebuild name:

dev-ruby/hashdiff-0.3.9

Description

Simple Hash extension to make working with nested hashes easier

Added to portage

2019-04-23

karma-bin - 0.33
Ebuild name:

www-apps/karma-bin-0.33

Description

Alerts dashboard for Prometheus Alertmanager

Added to portage

2019-04-23

libfilezilla - 0.16.0
Ebuild name:

dev-libs/libfilezilla-0.16.0

Description

C++ library offering some basic functionality for platform-independent

Added to portage

2019-04-23

libgpg-error - 1.36
Ebuild name:

dev-libs/libgpg-error-1.36

Description

Contains error handling functions used by GnuPG software

Added to portage

2019-04-23

maim - 5.5.3
Ebuild name:

media-gfx/maim-5.5.3

Description

Commandline tool to take screenshots of the desktop

Added to portage

2019-04-23

mendeleydesktop - 1.19.4
Ebuild name:

sci-misc/mendeleydesktop-1.19.4

Description

Research management tool for desktop and web

Added to portage

2019-04-23

mercurial - 4.9.1
Ebuild name:

dev-vcs/mercurial-4.9.1

Description

Scalable distributed SCM

Added to portage

2019-04-23

multipath-tools - 0.8.1
Ebuild name:

sys-fs/multipath-tools-0.8.1

Description

Device mapper target autoconfig

Added to portage

2019-04-23

pypax - 0.9.5
Ebuild name:

dev-python/pypax-0.9.5

Description

Python module to get or set either PT_PAX and/or XATTR_PAX flags

Added to portage

2019-04-23

rinku - 2.0.6
Ebuild name:

dev-ruby/rinku-2.0.6

Description

A Ruby library that does autolinking

Added to portage

2019-04-23

signal-desktop-bin - 1.24.1
Ebuild name:

net-im/signal-desktop-bin-1.24.1

Description

Allows you to send and receive messages of Signal Messenger on you

Added to portage

2019-04-23

tortoisehg - 4.9.1
Ebuild name:

dev-vcs/tortoisehg-4.9.1

Description

Set of graphical tools for Mercurial

Added to portage

2019-04-23

unifi - 5.10.22
Ebuild name:

net-wireless/unifi-5.10.22

Description

A Management Controller for Ubiquiti Networks UniFi APs

Added to portage

2019-04-23

userspace-rcu - 0.10.2
Ebuild name:

dev-libs/userspace-rcu-0.10.2

Description

userspace RCU (read-copy-update) library

Added to portage

2019-04-23

wsmake - 0.6.4-r1
Ebuild name:

www-misc/wsmake-0.6.4-r1

Description

Website pre-processor features tag substitution and page ordering

Added to portage

2019-04-23

xchm - 1.29
Ebuild name:

app-text/xchm-1.29

Description

Utility for viewing Compiled HTML Help (CHM) files

Added to portage

2019-04-23

xfce4-notifyd - 0.4.4
Ebuild name:

xfce-extra/xfce4-notifyd-0.4.4

Description

Notification daemon for the Xfce desktop environment

Added to portage

2019-04-23

2019-04-22
acme-client - 2.0.2
Ebuild name:

dev-ruby/acme-client-2.0.2

Description

A Ruby client for the letsencrypt's ACME protocol.

Added to portage

2019-04-22

amule - 2.3.2-r3
Ebuild name:

net-p2p/amule-2.3.2-r3

Description

aMule, the all-platform eMule p2p client

Added to portage

2019-04-22

asio - 1.12.2
Ebuild name:

dev-cpp/asio-1.12.2

Description

Asynchronous Network Library

Added to portage

2019-04-22

asio - 1.13.0
Ebuild name:

dev-cpp/asio-1.13.0

Description

Asynchronous Network Library

Added to portage

2019-04-22

blogc - 0.16.1
Ebuild name:

app-text/blogc-0.16.1

Description

A blog compiler

Added to portage

2019-04-22

bmon - 999
Ebuild name:

net-analyzer/bmon-999

Description

interface bandwidth monitor

Added to portage

2019-04-22

bwping - 1.12
Ebuild name:

net-analyzer/bwping-1.12

Description

A tool to measure bandwidth and RTT between two hosts using ICMP

Added to portage

2019-04-22

ckb - 0.2.9-r1
Ebuild name:

app-misc/ckb-0.2.9-r1

Description

Corsair K65/K70/K95 Driver

Added to portage

2019-04-22

creduce - 2.9.0_pre20190414-r1
Ebuild name:

dev-util/creduce-2.9.0_pre20190414-r1

Description

C-Reduce - a plugin-based C program reducer

Added to portage

2019-04-22

curses - 1.3.1
Ebuild name:

dev-ruby/curses-1.3.1

Description

Ruby binding for curses, ncurses, and PDCurses

Added to portage

2019-04-22

drupal - 8.5.15
Ebuild name:

www-apps/drupal-8.5.15

Description

PHP-based open-source platform and content management system

Added to portage

2019-04-22

dvisvgm - 2.7
Ebuild name:

app-text/dvisvgm-2.7

Description

Converts DVI files to SVG

Added to portage

2019-04-22

efl - 1.22.1
Ebuild name:

dev-libs/efl-1.22.1

Description

Enlightenment Foundation Libraries all-in-one package

Added to portage

2019-04-22

fetchcommandwrapper - 0.8.1-r1
Ebuild name:

app-portage/fetchcommandwrapper-0.8.1-r1

Description

Wrapper integrating aria2 into portage's FETCHCOMMAND

Added to portage

2019-04-22

fraqtive - 0.4.8-r1
Ebuild name:

x11-misc/fraqtive-0.4.8-r1

Description

Open source, multi-platform generator of the Mandelbrot family fractals

Added to portage

2019-04-22

gertty - 9999
Ebuild name:

dev-util/gertty-9999

Description

Gertty is a console-based interface to the Gerrit Code Review system.

Added to portage

2019-04-22

gimp - 2.10.10
Ebuild name:

media-gfx/gimp-2.10.10

Description

GNU Image Manipulation Program

Added to portage

2019-04-22

git-remote-hg - 1.0.0
Ebuild name:

dev-vcs/git-remote-hg-1.0.0

Description

Semi-official Mercurial bridge from Git project

Added to portage

2019-04-22

git-sources - 5.1_rc6
Ebuild name:

sys-kernel/git-sources-5.1_rc6

Description

The very latest -git version of the Linux kernel

Added to portage

2019-04-22

gitea - 1.7.6
Ebuild name:

www-apps/gitea-1.7.6

Description

A painless self-hosted Git service

Added to portage

2019-04-22

go-bindata - 1.0.0
Ebuild name:

dev-go/go-bindata-1.0.0

Description

A small utility which generates Go code from any file

Added to portage

2019-04-22

i2p - 0.9.39
Ebuild name:

net-vpn/i2p-0.9.39

Description

A privacy-centric, anonymous network

Added to portage

2019-04-22

kdeclarative - 5.57.0-r1
Ebuild name:

kde-frameworks/kdeclarative-5.57.0-r1

Description

Framework providing integration of QML and KDE work spaces

Added to portage

2019-04-22

kmymoney - 5.0.4
Ebuild name:

app-office/kmymoney-5.0.4

Description

Personal finance manager based on KDE Frameworks

Added to portage

2019-04-22

kodi - 18.2
Ebuild name:

media-tv/kodi-18.2

Description

A free and open source media-player and entertainment hub

Added to portage

2019-04-22

kstars - 3.2.0
Ebuild name:

sci-astronomy/kstars-3.2.0

Description

Desktop Planetarium

Added to portage

2019-04-22

ktexteditor - 5.57.0-r1
Ebuild name:

kde-frameworks/ktexteditor-5.57.0-r1

Description

Framework providing a full text editor component

Added to portage

2019-04-22

labplot - 2.6.0
Ebuild name:

sci-visualization/labplot-2.6.0

Description

Scientific data analysis and visualisation based on KDE Frameworks

Added to portage

2019-04-22

libmwaw - 0.3.15
Ebuild name:

app-text/libmwaw-0.3.15

Description

Library parsing many pre-OSX MAC text formats

Added to portage

2019-04-22

lxc - 3.1.0-r1
Ebuild name:

app-emulation/lxc-3.1.0-r1

Description

LinuX Containers userspace utilities

Added to portage

2019-04-22

meson - 0.50.1
Ebuild name:

dev-util/meson-0.50.1

Description

Open source build system

Added to portage

2019-04-22

mono - 5.20.1.19
Ebuild name:

dev-lang/mono-5.20.1.19

Description

Mono runtime and class libraries, a C compiler/interpreter

Added to portage

2019-04-22

munin - 2.0.47
Ebuild name:

net-analyzer/munin-2.0.47

Description

Munin Server Monitoring Tool

Added to portage

2019-04-22

net-scp - 2.0.0
Ebuild name:

dev-ruby/net-scp-2.0.0

Description

A pure Ruby implementation of the SCP client protocol

Added to portage

2019-04-22

opera - 60.0.3255.59
Ebuild name:

www-client/opera-60.0.3255.59

Description

A fast and secure web browser

Added to portage

2019-04-22

poppler - 0.76.0
Ebuild name:

app-text/poppler-0.76.0

Description

PDF rendering library based on the xpdf-3.0 code base

Added to portage

2019-04-22

qtgui - 5.12.3-r1
Ebuild name:

dev-qt/qtgui-5.12.3-r1

Description

The GUI module and platform plugins for the Qt5 framework

Added to portage

2019-04-22

rack-attack - 6.0.0
Ebuild name:

dev-ruby/rack-attack-6.0.0

Description

A DSL for blocking & throttling abusive clients

Added to portage

2019-04-22

rspec-expectations - 3.8.3
Ebuild name:

dev-ruby/rspec-expectations-3.8.3

Description

A Behaviour Driven Development (BDD) framework for Ruby

Added to portage

2019-04-22

solid - 5.57.0-r1
Ebuild name:

kde-frameworks/solid-5.57.0-r1

Description

Provider for platform independent hardware discovery, abstraction an

Added to portage

2019-04-22

targetcli-fb - 2.1.49
Ebuild name:

sys-block/targetcli-fb-2.1.49

Description

Command shell for managing Linux LIO kernel target

Added to portage

2019-04-22

telegram-desktop-bin - 1.6.7
Ebuild name:

net-im/telegram-desktop-bin-1.6.7

Description

Official desktop client for Telegram (binary package)

Added to portage

2019-04-22

tox - 0.2.9
Ebuild name:

net-libs/tox-0.2.9

Description

Encrypted P2P, messaging, and audio/video calling platform

Added to portage

2019-04-22

translate-shell - 0.9.6.10
Ebuild name:

app-i18n/translate-shell-0.9.6.10

Description

Online command-line translator

Added to portage

2019-04-22

unicode-data - 12.0.0
Ebuild name:

app-i18n/unicode-data-12.0.0

Description

Unicode data from unicode.org

Added to portage

2019-04-22

upmpdcli - 1.4.2
Ebuild name:

media-sound/upmpdcli-1.4.2

Description

UPnP Media Renderer front-end for MPD, the Music Player Daemon

Added to portage

2019-04-22

vanilla-sources - 4.14.113
Ebuild name:

sys-kernel/vanilla-sources-4.14.113

Description

Full sources for the Linux kernel

Added to portage

2019-04-22

vanilla-sources - 4.19.36
Ebuild name:

sys-kernel/vanilla-sources-4.19.36

Description

Full sources for the Linux kernel

Added to portage

2019-04-22

vanilla-sources - 4.9.170
Ebuild name:

sys-kernel/vanilla-sources-4.9.170

Description

Full sources for the Linux kernel

Added to portage

2019-04-22

vanilla-sources - 5.0.9
Ebuild name:

sys-kernel/vanilla-sources-5.0.9

Description

Full sources for the Linux kernel

Added to portage

2019-04-22

rdf newsfeed | rss newsfeed | Atom newsfeed
- Powered by LeopardCMS - Running on Gentoo -
Copyright 2004-2018 Sascha Nitsch Unternehmensberatung UG(haftungsbeschänkt)
Valid XHTML1.1 : Valid CSS : buttonmaker
- Level Triple-A Conformance to Web Content Accessibility Guidelines 1.0 -
- Copyright and legal notices -
Time to create this page: 56.3 ms