03/28/961 System Design of the Kennedy Space Center Toplevel World Wide Web (WWW) Server This talk covers the underlying system design and technical aspects.

03/28/96 1

System Design of the System Design of the Kennedy Space Center Kennedy Space Center

Toplevel World Wide Web Toplevel World Wide Web (WWW) Server(WWW) Server

This talk covers the underlying system design and This talk covers the underlying system design and technical aspects of KSC Top Level WWW server, technical aspects of KSC Top Level WWW server,

including hardware and software systems and including hardware and software systems and interfaces to external sources of information.interfaces to external sources of information.

Jim Dumoulin - NASA Payload OperationsJim Dumoulin - NASA Payload Operations

Internet Systems Lab - Kennedy Space CenterInternet Systems Lab - Kennedy Space Center

03/28/96 2

KSC’s WWW Toplevel KSC’s WWW Toplevel ServerServer DEC Alpha 2100/5000 ServersDEC Alpha 2100/5000 Servers

– Multiple DEC Alpha ProcessorsMultiple DEC Alpha Processors– 640Mbytes of RAM, 24Gbytes Disk (RAID 5 640Mbytes of RAM, 24Gbytes Disk (RAID 5

and RAID 1) on main Public server - and RAID 1) on main Public server - 160Gbytes total on cluster160Gbytes total on cluster

– Redundant hot-swappable power suppliesRedundant hot-swappable power supplies– Multiple Networks (1FDDI, 3 Ethernets)Multiple Networks (1FDDI, 3 Ethernets)– Workload spread across 13 other systemsWorkload spread across 13 other systems

Digital OSF/1 Unix, Apache HTTPDDigital OSF/1 Unix, Apache HTTPD

03/28/96 3

KSC’s server on Launch KSC’s server on Launch DayDay Saturates E-1 and Saturates E-1 and

Fractional T-3 Fractional T-3 Circuits into KSCCircuits into KSC

1.8 Million hits 1.8 Million hits within a few hours within a few hours around launch time.around launch time.

CPU capacity not the CPU capacity not the problem but network problem but network congestion requires congestion requires constant tweaking to constant tweaking to handle load.handle load.

WWW.KSC.NASA.GOVWWW.KSC.NASA.GOV

Cluster of 4 multi-processor Dec Alpha Servers ona 100Mb/s FDDI ring. Current Disk Capacity 160Gbytes

4

03/28/96 5

NOMAD01

Internet Lab System Internet Lab System HardwareHardware

TITAN01VMS 7.1128MB RAM(User Accounts)

16G Raid 5

TITAN03OSF/1 4.2128MB RAM(News/WAIS)

22G Raid 5

TITAN02OSF/1 4.2512MB RAM(User Accounts)

9-Track Tape

Exabyte 1204 Drive TapeJukebox System115 8mmTapes1 Robot

ZENO OSF/1 4.2WWW Hot Mirror

Parallel Search & ListServ Engine 14 DEC5000’s

FDDI ConcentratorCISCO 7000

NIVEN OSF/1 2.0News/Listserv

18G Raid 5

TITAN04OSF/1 4.2640MB RAM(WWW/FTP)

24G Raid 50 1 2 3

WWW Page creationWWW Page creation

70,000+ HTML pages on Server - most 70,000+ HTML pages on Server - most produced and hypertexed produced and hypertexed automatically thru a series of PERL automatically thru a series of PERL scriptsscripts

Interfaces to external systems for Interfaces to external systems for dynamic content thru Common dynamic content thru Common Gateway Interface (CGI) ScriptsGateway Interface (CGI) Scripts

Daily content and automatic backups Daily content and automatic backups done thru Unix Crontabsdone thru Unix Crontabs

03/28/96 7

Automatic HypertexingAutomatic Hypertexing

Treat HTML as a binary LanguageTreat HTML as a binary Language Keep original material in text filesKeep original material in text files Run all text thru Hypertext Perl Run all text thru Hypertext Perl

ProgramProgram Program searches for Regular Program searches for Regular

expressions in context and replaces expressions in context and replaces with Hypertexed URL’s from with Hypertexed URL’s from dictionarydictionary

03/28/96 8

Regular Expression Regular Expression ExampleExample The Regular Expression:The Regular Expression:

– ([\s,\.\(\)])([\s,\.\(\)])– (T-[minus ]*([\d]+)[hour]*[s]*[and (T-[minus ]*([\d]+)[hour]*[s]*[and

counting]*)counting]*)– ([\s,\.\(\)])([\s,\.\(\)])

Matches:Matches:– (T-minus 1 hour), T-1 hour, T-10 hours,(T-minus 1 hour), T-1 hour, T-10 hours,– T-43 hours and countingT-43 hours and counting

03/28/96 9

WWW Page.html

Flow of Hypertext ProgramFlow of Hypertext Program

Status Archive .txt files

WWW Disk Farm Information Archive (HTTP/FTP/Gopher/NFS/Samba)

RE to URL

WAIS - Full Text Index

Listserv

E-Mail USENETINN Overchan

mailtonews.py

.txt

.html

to archive

03/28/96 10

Image CreationImage Creation

Input is a Captions Text file and a series Input is a Captions Text file and a series of High Resolution Photos (digitally of High Resolution Photos (digitally transferred or manually scanned)transferred or manually scanned)

Output products:Output products:– Contact Sheet Page and Clickable MapContact Sheet Page and Clickable Map– Photo Index HTML PagePhoto Index HTML Page– Image converted and stored in multiple Image converted and stored in multiple

formats (Tiny, Low, Medium, High)formats (Tiny, Low, Medium, High)– Captions Hypertext FileCaptions Hypertext File

03/28/9611

Flow of Image CreationFlow of Image Creation

Contact SheetPhoto IndexCaptions

Tiny Low Med High

PhotoID (L,M,H) title

Tiny

Titan04 Titan02

NTPhoto Lab NT

Scanner Scanner

WritersGroup

Titan03

STS #

Image Converter High

build_contact.pl

samba

build_captions.pl

captions.txt

E-mail and List Server

scsi

build_images.pl NFS

PBM toolkit

PhotoID (L,M,H) title

Digital

Print

03/28/96 12

Movie/Video Capture Movie/Video Capture ProcessProcess Input comes from NASA TV, VCRs, RF-System or via Input comes from NASA TV, VCRs, RF-System or via

one of over 900 Cameras on KSC’s OTV System.one of over 900 Cameras on KSC’s OTV System. Have multi-input video capture cards in PC’s Have multi-input video capture cards in PC’s

(Creative Labs RT-300, SE-100, RealMajic Encoder)(Creative Labs RT-300, SE-100, RealMajic Encoder) Process is pipelined thru multiple CPU’s and stagesProcess is pipelined thru multiple CPU’s and stages

– RT-300 or SE-100 saves BMP or AVI file via SambaRT-300 or SE-100 saves BMP or AVI file via Samba– PBMtoolkit converts .BMP or .AVI to .GIF or JPEG. PBMtoolkit converts .BMP or .AVI to .GIF or JPEG. – AVI files are edited as small as possible.AVI files are edited as small as possible.– If MPEG is needed, AVI is riped into individual If MPEG is needed, AVI is riped into individual

Targa frames then Encoded into an MPEGTarga frames then Encoded into an MPEG

03/28/96 13

Movie Movie CreationCreation

1 2 3 4

RT-300

486PCs

SE-100

486PCs

Grass Valley Video Switch

OTVNASA Select

VCR

Titan02

Titan04 / WWW.KSC.NASA.GOVConvert BMP to GIF BMP to JPGAVI to TARGA AVIRIP

Pentium PentiumPC

RealMagicMPEG Encoderwith Sound

Samba

AVIto MPEGEditor(Adobe)

TranscodeEncode

SE-100 VideoGrabber

Dual Pentium

CMPEG

Live VideoPages

MPEG Movies

Samba

Samba

Samba

NFS viaFDDI

1 2 31 2 3

Video Capture DevicesVideo Capture Devices Creative Labs RT-300 -Creative Labs RT-300 -

– PC ISA Card, no longer in productionPC ISA Card, no longer in production– 4 Video Inputs (3 RCA/1 S-VIDEO)4 Video Inputs (3 RCA/1 S-VIDEO)

Creative Labs SE-100 -Creative Labs SE-100 -– PC ISA Card, Better quality than RT-300PC ISA Card, Better quality than RT-300– 3 Video Inputs (2 RCA/1 S-video)3 Video Inputs (2 RCA/1 S-video)

Sigma Designs Real Magic ProducerSigma Designs Real Magic Producer– Direct MPEG production but cannot Direct MPEG production but cannot

produce MPEGS at slow frame ratesproduce MPEGS at slow frame rates– ExpensiveExpensive

03/28/96 15

SummarySummary

The KSC Home Server The KSC Home Server – uses Regular Expressions to help uses Regular Expressions to help

maintainabilitymaintainability– uses RAID to help Availabilityuses RAID to help Availability– offloads processing to handle offloads processing to handle

exponential growthexponential growth– doesn’t worry about marketing since doesn’t worry about marketing since

NASA data belongs to the tax payersNASA data belongs to the tax payers