Web Infrastructure Team Our Services and our Hardware Owen Le Blanc.

Web Infrastructure Team

Our Services and our Hardware

Owen Le Blanc

Outline

Services we provide Hardware we manage Virtual machines Software Managing it all

Summary of Services

Web services Portal service Information Publication Load balancing Databases

AFS Xen External Hosting Virtual Hosts Minor services Development

Web Services

Apache Software ESD Tomcat Content

Managemt User admin (ssl)

20 servers 2 servers 3 servers? 3 servers

+ devel + test

1 server

Portal service

Web servers Development Mysql

8 servers 9 servers 2 servers

Information Services

Anonymous FTP rsync ntp Request Tracker Web Log

processing, anal

1 server 2 servers 1 server 2 servers 2 servers

Publication Services

ssh sftp

ftp

3 servers

2 servers

Load Balancing

ipvsadm heartbeat,

pacemaker ssh

2 servers

Databases, etc

MySQL Postgres Subversion CVS

9 servers 2 servers 3 servers 1 server

Andrews File System

Kerberos servers Database servers

File servers special file servers

Backup servers

3 servers 12 servers

2 servers

2 servers

Xen

Xen hosts (ours) Portal EPS Manc City Art G

49 machines 4 machines 2 machines 1 machine

External Servers (1)

Ensembl Phoenix Access Grid

Recording service NCESS EMU

2 servers 1 server 1 server

1 server 1 server

External Servers (2)

MACE Azura Group EPS Intranet Equella project Genetic Research

Museum java devel

1 server 3? servers 6 servers 2 servers 1 server 1 server

Virtual Hosts

Email development

Physics web site Status web site

1 servers 1 server 2 servers

Minor Services

AFS mail Web Farm mail tftp administration cron jobs mirroring

1 server 1 server 1 server 1 server 1 server 1 server

Development

Compilation Testing

AFS Java MySQL Xen IPVS/Heartbeat

4 servers

3 servers 2 servers 1 server 2 servers 2 servers

Machines

Development Xen servers Other servers Portal servers External (!xen) Total

11 49 16 5 18 99 machines

Virtual Hosts

151 virtual hosts under Xen: 1 fully virtualised

Disk Format (Xen, standalone)

unmounted partition

/

/var

swap

LVM

Software

Debian lenny,squeeze ipvsadm, heartbeat, pacemaker Xen, LVM OpenAFS Closely parallel machines Rapid deployment “Daily” security patching

Documentation (1)

Mirrors of package documents http://orgs.man.ac.uk/documentation/

Wiki http://wiki.manchester.ac.uk/websupport/

My web site http://people.man.ac.uk/~zlsiial/docs/

Software and configuration area /afs/mcc.ac.gb/common/config/

Documentation (2)

System backup area /afs/mcc.ac.gb/ftp/.private/misc/backups/

admin folder .../web/farm/Admin/

Email various places in /afs/

Documentation (2)

System backup area /afs/mcc.ac.gb/ftp/.private/misc/backups/

admin folder .../web/farm/Admin/

Email various places in /afs/

Managing It All

Database of machines Automate as much as possible Use standard versions

As little local compilation as possible As little locally written software as possible

Revise and rethink