Top Banner
Advanced Techniques for HP-UX System Administrators Bill Hassell Director of IT Systems and Methods, Inc.
153

Advanced Techniques for HP-UX System · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

Mar 06, 2018

Download

Documents

docong
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

Advanced Techniques for HP-UX System AdministratorsBill HassellDirector of ITSystems and Methods, Inc.

Page 2: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

2

Agenda

• Setting up new systems

• Standardizing for easy administration

• Performance and Kernel Tuning

• Memory Management

• Disk space management

• Logfile management

• Useful tools

• Additional resources

Page 3: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

3

Setting up new systems• Disk layout

− Internal/external issues− VG00 design− Massive lvols, flat directories

• Networking− SAM, netconf, set_parms− 100BaseT issues

• Cron jobs− Logfiles, cleanup, backup

Page 4: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

4

Setting up new systems• Root’s shell

− /sbin/sh− POSIX /usr/bin/sh vs. Bourne− /usr/bin/sh vs. Korn shell− Users can change: chsh login-name /usr/bin/some_shell

• Login tty settings:− # is erase 1 char (backspace)− Fix all logins with a one-time command:���������������� ����������� ��� ����������� ��� ����������� ��� ����������� ��� ����������������������������

− Add others such as: ���������������� ���������������������������������������������������������������������������������������� ���������������������������� ��������������������������������������������������������������������

− Use to set tty defaults such as baud rate

Page 5: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

5

Setting up new systems• Basic security fixes

− ����� ����� ����� ����� ������������ ������ ������ ������ ������������������������������������������������������������������������������������������� !��� !��� !��� !�� "##�$%�"##�$%�"##�$%�"##�$%�&&&&''''

− umask is missing in /etc/profile and /etc/csh.login( �!����!����!����!��� )**)**)**)**

( �!����!����!����!��� )"")"")"")""

− Search for world-write permissions in important directories:( ����� ���� ����� ���� ����� ���� ����� ���� ������������ ���� ���� ���� ���� ���� ���� ���� ���� �+���+���+���+�� ������ ������ ������ �������������!����!����!����!�����))*))*))*))*

• Add: &&&&,�,�,�,�����������������������������������������������������������������������������&&&&---- to look at just files and directories• Add secure database mountpoints, etc

Page 6: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

6

Setting up new systems• Basic security fixes (continued)

( ��� ��� ��� ��� ��� ��� ��� ���

− World-writable directories− �.� (//////// or /0//0//0//0/ or /0/0/0/0)− Symlinks− Duplicate paths− Non-existent directories− scan-path script

• Password and group file checks− �.��

− 1����

• Check /etc/passwd for duplicate UID’s:− ��1�������

Page 7: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

7

Setting up new systems• Basic security fixes (continued)

( ��� ����0�2����0� ����

− World-writable?− Valid user?− Root?

• suid scripts/programs− No scripts allowed− Purpose− Owner− Location− ��� ����+: ������

Page 8: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

8

Standardizing for easy administration

• Login methods− telnet− remsh/rlogin− Xwindows− SSH

• Shells− POSIX (/usr/bin/sh)− Bourne (/usr/old/bin/sh)− Korn shell (/use/bin/ksh)− C shell− Bash, tcsh, etc

Page 9: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

9

Standardizing for easy administration

• Standard profiles− ������

− ulimit settings:���!�� ��

��!�,�������-������������!����

����,+�����-�������������!����

����,�+����-���������3##43

�����,�+����-��������567*

!�!���,�+����-�����������!����

������!�,+�����-�����)

�������,�����������-�3)

− Eliminate core files: ���!�� �8��)

Page 10: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

10

Standardizing for easy administration

• Standard profiles− Interactive versus batch

• Errors: ����/�����������.�����• Separate the interactive commands:

− Multiple �������������� statements− Or separate the interactive portion in a separate

script• Interactive commands: ���� ���� �������

• Interactive settings: 9:;�9�<8=>?@− Login controls: ��� ����1��

• 11.0 with security patches, standard on 11i• Add: AB>BC<AD6 to /etc/default/security

Page 11: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

11

Standardizing for easy administration

• Standard profiles− 9BEF 0�������

− ��� ���� to standardize new users, or replace− Can’t keep from being changed by users (9BEF must be writable

which means no file is safe)− Same interactive issues with batch logins− May want to have 9BEF 0������������ for user mods

• Download sample profiles:ftp://contrib:[email protected]/sysadmin/profiles

Page 12: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

12

Standardizing for easy administration

• Other /etc/skel files:− .���� (vi defaults)

( ��.� (don’t wrap searches around)( �� (ignore case on searches)( �� (follow prev left indent)( �. (update source at shell escapes: !)( .! (wrap to next line, =0 no wrap)( ������ (shows # of lines changed)( � �.!��� (INPUT or REPLACE MODE tag)

������.� �� ���������� ����.���� .���!��1��D*�G

Page 13: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

13

Standardizing for easy administration

• Restricted access methods− Restricted shells: rsh, rksh, rcsh

• $HOME is / for user• NO access to /usr or any other directrories• Must create a local bin with binaries and set $PATH

− Usually simpler to use a menu script (no shell)

• Backup procedures− Classic tools: tar cpio pax dump

• No index, no search, no error recovery, no changer support, no largefiles

− fbackup/frecover• Index on every tape, high speed search, error recovery, change hooks,

largefile-capable

Page 14: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

14

Standardizing for easy administration

• Backup procedures (cont’d)− Features:

• Largefiles, error recovery, changer support, parallel tape drives, network backup/restore, multi-platform, centralized indexing

− Commercial backup programs• OmniBack• Veritas• Legato

• Disaster recovery (loss of boot disk)− Mirroring− Ignite/UX

Page 15: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

15

Standardizing for easy administration

(�����H!������� (from Ignite/UX)

• from the contributed software archive:���/ ������+/7������5I ���0��������0 �0��!

− 1�� ����0�

− ��1 ��.�

− ������ (HTML generator)

• Webmin: ...0.�+!��0��! (Perl-based)− Included with HP’s Apache

Page 16: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

16

Standardizing for easy administration

(�����H!������� (from Ignite/UX)

Page 17: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

17

Standardizing for easy administration

• Centralized patching− Pick a central server− Create a hierarchical structure (test, pre-production,

production)− Use swcopy to add patches and patch depots− Use swreg to make the depot visible on the network (don’t

use NFS)− On clients, use swlist to view the remote depot(s)

swlist –l depot @ patch_servername− Network installs:

swinstall –s depot_name@patch_servername file_set (or \*)

Page 18: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

18

Standardizing for easy administration

• Spooler management− Connections

• Parallel, serial, SCSI, Network− Remote (Windows, Linux, solaris, AIX)

• RFC 1179• Control files and options• Printer scripts and filters

− Network (HP JetDirect)• Port 9100• Jetadmin now HP Printer Installer• addqueue, removequeue, transferqueue

− Troubleshooting• Spoolkick procedure

Page 19: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

19

Performance and Kernel Tuning

• What can be changed

• Performance measurement− Built-in tools− SarCheck− MetaView, Performance Gallery− Glance/gpm, Measureware

• Kernel parameters− Filesystems− Processes− RAM and virtual memory− Network

Page 20: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

20

Performance and Kernel Tuning• What can be changed

− Most kernel params size tables, provide limits or set behavior

− CPU bound• Multi-CPU features

− I/O bound• Disk• Swap (memory limited)• LAN

Page 21: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

21

Performance and Kernel Tuning

• nfile: 14min, no limit− Every opened file (including multiple opens)− Formula scales with maxusers− Every process has a minimum of 3

• nflocks: 2min, 200def, no limit− Maximum number of open file-locks− One file may have several locks− Application dependent− Databases may need hundreds

Filesystem parameters

Page 22: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

22

• ninode: 14min, no limit− In-memory cache of unique current and recent HFS file

locations− Speeds re-open, multi-process file access− Indirectly controls the size of the DNLC, ncsize, ncdnode and

vx_ninode.− 1000 to 8192, lower if ncsize is adjusted− Formula in SAM is not useful for large systems− Best recommendations are in NFS Performance book by Dave

Olker

Performance and Kernel Tuning

Filesystem parameters

Page 23: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

23

• ncdnode: 14min, no limit− In-memory cache of unique current and recent CDFS

file locations (CDROM)−Speeds re-open, multi-process file access−Usually OK unless multiple user access needed for

CDROM or multiple CDROM drives

Performance and Kernel Tuning

Filesystem parameters

Page 24: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

24

• maxfiles: 60 default− Maximum number of files opened by a single process− Used to control runaway processes− Override with setrlimit(2) system call or ulimit –n− Hard ceiling is maxfiles_lim− Commonly recommended too high (4096) by database vendors− Commonly recommended maxfiles = maxfiles_lim but not a good

idea (use ulimit as needed)

Performance and Kernel Tuning

Filesystem parameters

Page 25: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

25

• fs_async:− 0 = synchronous writes to directory structures− 1 = async

• Apx. 20-30% faster write speed (no read change)• Very high probability of data loss with a powerfail or system panic

(fsck fails to fix)

• Default_disk_ir:− 0 = no immediate reporting (waits for writes to complete− 1 = immediate reporting (disk buffers writes)

• Applies to all disks including raw devices

Performance and Kernel Tuning

Filesystem parameters

Page 26: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

26

• disksort_seconds:− HP-UX gives priority to serial rd/wt queues− Intense serial I/O slows random I/O− Value in seconds to wait before changing priority

Performance and Kernel Tuning

Filesystem parameters

Page 27: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

27

Performance and Kernel Tuning

• nproc:− Maximum processes to run at same time− Often way too low in servers

• maxuprc:− Maximum processes owned by a single UID− Collective, not per login− Generic logins can require hundreds or more

Process parameters

Page 28: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

28

• maxdsiz: 256 megs default (was 64megs)− 32bit programs only− Max can be 2Gb (SAM) but mapping limits are 960 and 1750

depending on compiler (or chatr) options. 3+ Gb with tricks.− ulimit –d to create a lower limit

• maxdsiz_64: 64 megs default− 64bit programs only− Max is 4000 Gb

Mem_mgt + proc_mgt note (/usr/share/doc – not 11i)

Performance and Kernel TuningProcess parameters

Page 29: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

29

• maxssiz: 8 megs default− 32bit programs only− Seldom needs changing− Exception for specialized programs or poor design (pass by data

not address/pointer)

• maxtsiz: 64megs default− Maximum for unchanging instructions− Directly related to executable’s file size− 2Gb max (32bit) or 4096Gb (64bit)

Performance and Kernel Tuning

Process parameters

Page 30: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

30

• maxswapchunks:− Used to size maximum swap (32Gb)− Useable swap is:

• maxswapchunks * swchunk * dev_bsize where: swchunk=2048 and dev_bsize=1024

• Leave swchunk as default• Formula simplifies to:

maxswapchunks=DESIRED-SWAP / 2097152

• nswapdev, nswapfs:− Maximum swap devices and filesystems

Performance and Kernel TuningProcess parameters

Page 31: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

31

SWAPSWAP

500 meg500 meg

RAMRAM

1 Gb1 Gb

Unusable forUnusable forprocessesprocesses

swapmem_on=0

In this example, only 500 megs is usable for processes since Virtual Memory is only 500 megs.

Performance and Kernel Tuning

Page 32: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

32

SWAPSWAP

1 Gb1 Gb

RAMRAM

1 Gb1 Gb

swapmem_on = 0

In this example, 1 Gb is usable for processes since Virtual Memory is 1 Gb too...but no paging will take place

Performance and Kernel Tuning

Page 33: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

33

Performance and Kernel Tuning

SWAPSWAP

2 Gb2 Gb

RAMRAM

1 Gb1 Gb

swapmem_on = 0

In this example, 2 Gb is usable for processes since Virtual Memory is 2 Gb too...some paging may be take place

Page 34: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

34

Performance and Kernel Tuning

SWAPSWAP

1 Gb1 Gb

RAMRAM

1 Gb1 Gb

swapmem_on = 1

In this example, 1.75 Gb is usable for processes since Virtual Memory is 1 Gb plus .75 Gb in RAM which is not pageable

Total Total VmemoryVmemory = = 1750 megs1750 megs

Page 35: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

35

• timezone, dst:− Default value for environments without $TZ (daemons)− dst controls a limited number of daylight saving rules

• npty nstrpty,nstrtel:− Controls maximum interactive network sessions− Must match device files (insf)− Use SAM to handle device files automatically

• maxusers:− Not a parameter but a formula adjustment− No relation to user licenses or session limits

Performance and Kernel TuningProcess parameters

Page 36: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

36

• Vocabulary− I/O Bound− Disk Thrashing− Swap Thrashing− Resource Limits

Performance and Kernel TuningPerformance tuning

Page 37: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

37

• Measurement:− uptime:

• User count (standard logins)• Load average (runqueue)

����!�

3/4"�!�����56�����J�*4/K4J��6)4������J�

����������1�/�)0)"J�)0)5J�)0)"

����!�

5/66�!�����656�����J�*4/K4J��7)"������J�

����������1�/�K40)"J�**0)5J�630)"

Performance and Kernel Tuning

Performance tuning

Page 38: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

38

Performance and Kernel Tuning

• sar (system activity reporter)-b buffer cache activity-c System Calls-d Block Device Activity-u CPU Utilization

Performance tuning

Page 39: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

39

Performance and Kernel Tuning

Page 40: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

40

Performance and Kernel Tuning

Page 41: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

41

Performance and Kernel Tuning

Page 42: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

42

Performance and Kernel Tuning

Page 43: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

43

• sar (system activity reporter)-a File Access-v Kernel Parameters

Performance and Kernel Tuning

Performance tuning

Page 44: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

44

Performance and Kernel Tuning

Page 45: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

45

Performance and Kernel Tuning

Page 46: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

46

• iostat - report I/O Statistics− Number of seeks per second− Kbytes transferred per second− Milliseconds per average seek

Performance and Kernel Tuning

Performance tuning

Page 47: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

47

Performance and Kernel Tuning

Run 1 = zerosRun 1 = zeros

Page 48: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

48

• vmstatvmstat [-dnS] [interval [count]]vmstat -f | -s | -z

• Virtual Memory Statistics• -d Adds disk transfers per second• -n Format for 80 columns• -S Processes swapped rather than paging

Performance and Kernel Tuning

Performance tuning

Page 49: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

49

Performance and Kernel Tuning

Page 50: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

50

Performance and Kernel Tuning

Page 51: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

51

• vmstat (cont)−-f fork and page summary:

vmstat -f

9043939 forks, 448300514 pages, average= 49.57

−-s Summary−-z Zero kernel sums

Performance and Kernel Tuning

Performance tuning

Page 52: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

52

Performance and Kernel Tuning

Page 53: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

53

• top: − System data - Summary

• name and time• Load Average 1,5,15 minutes• % time in user,nice,system,idle,etc

− Memory:Virtual and Real− Individual Processes

Performance and Kernel Tuning

Performance tuning

Page 54: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

54

Performance and Kernel TuningPerformance tuning

Page 55: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

55

Performance and Kernel TuningPerformance tuning

Page 56: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

56

• Glance/Plus− HP measurement package− midaemon for better metrics− character mode interface− gpm for Xwindcows− Extensive measurement options− Alarms

Performance and Kernel Tuning

Performance tuning

Page 57: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

57

Performance and Kernel Tuning

• Glance/PlusPerformance tuning

Page 58: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

58

Performance and Kernel Tuning

• Glance/PlusPerformance tuning

Page 59: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

59

Performance and Kernel Tuning

• Glance/PlusPerformance tuning

Page 60: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

60

Performance and Kernel Tuning

• Glance/PlusPerformance tuning

Page 61: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

61

Performance and Kernel Tuning

• Glance/PlusPerformance tuning

Page 62: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

62

Performance and Kernel Tuning

• Glance/PlusPerformance tuning

Page 63: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

63

Performance and Kernel Tuning

• Glance/PlusPerformance tuning

Page 64: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

64

Performance and Kernel Tuning

• Glance/PlusPerformance tuning

Page 65: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

65

Performance and Kernel Tuning

• Glance/PlusPerformance tuning

Page 66: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

66

Performance and Kernel Tuning

• Glance/PlusPerformance tuning

Page 67: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

67

Performance and Kernel Tuning

• Glance/PlusPerformance tuning

Page 68: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

68

Performance and Kernel Tuning

• Glance/PlusPerformance tuning

Page 69: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

69

• gpm: Xwindows interface

Performance and Kernel Tuning

Performance tuning

Page 70: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

70

Performance and Kernel Tuning

Page 71: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

71

Performance and Kernel Tuning

Page 72: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

72

Performance and Kernel Tuning

Page 73: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

73

Performance and Kernel Tuning

Page 74: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

74

Performance and Kernel Tuning

Page 75: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

75

Performance and Kernel Tuning

Page 76: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

76

• What can you change:− Move busy filesystems to other disks− Move disks to additional channels− Add more processors (and/or change processor speed)− Add more RAM (application dependent)− Change large data area programs to use large memory pages

(chatr) to reduce TLB misses− Use AutoPort Aggregation (APA) for parallel data transfers (and

fallback reliability)

Performance and Kernel Tuning

Performance tuning

Page 77: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

77

Memory Management

• 32/64 bit

• 32 bit Data area

• 32 bit Shared memory

• Memory windows

Page 78: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

78

Memory Management

• 32/64 bit− HP-UX operating system− Hardware dependent

• 32bit only• 32/64bit (either)• 64bit only (new machines)

− 32bit programs run in either− 64bit programs only for 64bit HP-UX− 64bit programs remove memory map limitations, not a

performance feature

Page 79: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

79

Memory Management• 32 bit Data area

− 32bit programs have four 1000meg quadrants− Default data area = 960megs apx.− Compiler or chatr options for EXEC_MAGIC allow

quadrant 1 and 2 to be combined for about 1750 megs total data area

− Adjust maxdsiz if necessary− Documentation in /usr/share/doc for mem_mgt and

proc_mgt (missing in 11i)

Page 80: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

80

Memory Management• 32 bit Shared memory

− Most common limitation for 32bit database programs• Oracle: SGA is shared memory

− Similar limits (960megs and 1750 megs)− Use SHMEM_MAGIC option for 1750 meg access

• (all sharing processes must match)− ALL 32bit shared memory processes have one map

(fragmentation, memory mapped files, shared libraries)− Use ipcs –bmop for a snapshot (does not show fragmentation)− Get shminfo from the hprc.external.hp.com ftp site:

ftp://contrib:[email protected]/sysadmin

Page 81: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

81

Memory Management• Memory windows

− Reserves a separate memory map to remove fragmentation issues

− Memory-mapped files, shared libraries are in memory window 0 (plus ‘normal’ shared memory processes)

− Need patches for 11.0 to enable− Set kernel param for quantity of windows− Start ALL sharing programs with memory window

startup command.

Page 82: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

82

Disk space management• Root filesystem

− VG00 size and management• HP-UX only, possibly user $HOME• 3-6Gb typical• New systems have 36/72Gb internal (too big)• Or use external disks

− SCSI vs. fibre channel− Boot issues for external arrays− NAS versus SAN

• Mirroring• Ignite/UX and VG00• Striping VG00

Page 83: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

83

Disk space management• Small versus large disks

− JBODs− Arrays

• Large lvols− Large files versus thousands of small files− Flat versus hierarchical directory structure

• Performance• System impact (from users)• Managing files and backups

Page 84: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

84

Disk space management• Filesystem types:

−HFS (Fast FileSystem - BSD, circa 1984)−VxFS (Veritas FileSystem, aka Journaled FileSystem)

or JFS−CDFS (CDROM FileSystem - ISO 9660 only)−NFS (Network FileSystem)

Page 85: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

85

Disk space management

• HFS (Fast FileSystem - BSD, circa 1984)− McKusick HPF and fragmentation− fsck proportional to directory size− Inode count fixed at creation− resizing

• up = umount, lvextend, extendfs• down = umount, backup, lvreduce, newfs,

reload from backup, mount

Page 86: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

86

Disk space management

• JFS (Veritas filesystem, not Volume Manager)− Aka: Journaled FileSystem or JFS− Inodes created as needed− Very busy filesystem may need defrag− Online (Advanced) JFS option needed for online

resizing and advanced options− Better overall performance than HFS

Page 87: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

87

Disk space management

• CDFS (CDROM filesystem)− ISO 9660 only (see below)− 8.3 UPPERCASE filenames plus ;1 version− 11.0 patch for –ocdcase to lower UPPERCASE and remove ;1

version (but no long filenanes− HP makes special (non-standard) CD’s for Core, Application,

SupportPlus, etc that have long filenames− PFS (Portable FileSystem) to perform RockRidge or long

filename translation− Recent patches add –orr to natively handle long filenames− No direct support for Joliet, audio, multimedia, DVD− No direct support for CD writers

Page 88: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

88

Disk space management• NFS (Network FileSystem)

− Network-based filesystem (server and clients)− Stateless so performance issues exist− Does require tuning for heavy usage− Version 2 = no largefiles− Version 3 = largefile-capable− nfsstat very useful

• biod and nfsd quantity• Network quality

− NFS Performance book by Dave Olker

Page 89: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

89

Disk space management

• VG00 filesystem design− / (root) lvol

• HP-UX only, rest = mountpoints• Static: size to about 256 megs• /etc /dev /sbin (that’s all!)

− /stand lvol• Only HFS filesystem• Holds bootable kernels (current and previous)• 60-200 megs

Page 90: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

90

Disk space management

• VG00 filesystem design - other HP-UX mountpoints− /usr = HP-UX and local executables, libraries

• /bin and /lib• /usr/local versus /usr/contrib• Perhaps 400-1000 megs

− /opt = application installation directories• /opt/app-name

− bin doc lib lbin etc man…• Perhaps 500-1500 megs

− /tmp = system temporary directory (note: system)• Not for users, scripts, etc• Perhaps 200-400 megs

Page 91: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

91

Disk space management• VG00 filesystem design - other HP-UX mountpoints

− /var = variable directory• Most critical directory in HP-UX• When full, daemons and processes abort• Used by many unrelated subsystems• Ideally, separate mountpoint lvols will be created for the most intrusive

directories:−/var/mail−/var/spool−/var/tmp−/var/adm−/var/adm/crash−/var/adm/sw

Page 92: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

92

Disk space management• VG00 filesystem design - other HP-UX mountpoints

− /home = user home directories• Highly variable• When full, cause little impact to production processes• May require active space management or quotas

Page 93: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

93

Disk space management• XVG

− Contributed Xwindow program− Visualize disk layout− Highlight swap, free space, filesystem types− Highlight non-contigous areas− Download from:

ftp://contrib:[email protected]/sysadmin

Page 94: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

94

Xvg Display Program

Page 95: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

95

Xvg Display Program

Page 96: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

96

Xvg Display Program

Page 97: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

97

Xvg Display Program

Page 98: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

98

Xvg Display Program

Page 99: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

99

Xvg Display Program

Page 100: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

100

Xvg Display Program

Page 101: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

101

Xvg Display Program

Page 102: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

102

Xvg Display Program

Page 103: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

103

Xvg Display Program

Page 104: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

104

Xvg Display Program

Page 105: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

105

Xvg - continued

Page 106: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

106

Xvg - continued

Page 107: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

107

Xvg - continued

Page 108: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

108

Xvg - continued

Page 109: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

109

Xvg - continued

Page 110: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

110

Xvg - continued

Page 111: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

111

Logfiles:Where did the space go?

• Don’t look for big files!

• Look for big directories (10,000 small files)

• Use du as in:������������������������

7������� ����L�����7������� ����L�����7������� ����L�����7������� ����L�����

635*���� ��� 635*���� ��� 635*���� ��� 635*���� ��� ��!������!������!������!����

K3K����� ��� ��*K))K3K����� ��� ��*K))K3K����� ��� ��*K))K3K����� ��� ��*K))

*������� ��� �.��� *������� ��� �.��� *������� ��� �.��� *������� ��� �.���

5������� ��� 5������� ��� 5������� ��� 5������� ��� ����������������

65������ ��� 65������ ��� 65������ ��� 65������ ��� ���������������� 0��! 0��! 0��! 0��!

6������� ��� 6������� ��� 6������� ��� 6������� ��� ���������������� E��� E��� E��� E��� (oops…not sorted)

Page 112: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

112

Where did the space go?

• Use du as in (sorted):������������������������ �M������ �M������ �M������ �M������������������ M�!���M�!���M�!���M�!���

43)K5��� 43)K5��� 43)K5��� 43)K5���

6#*6#��� 6#*6#��� 6#*6#��� 6#*6#��� �+���+���+���+��

6K673��� ���6K673��� ���6K673��� ���6K673��� ���

5)4*���� ��� 5)4*���� ��� 5)4*���� ��� 5)4*���� ��� ��������

"7*"���� ��� "7*"���� ��� "7*"���� ��� "7*"���� ��� �������� ��������� ��������� ��������� ���������

353K���� ��� 353K���� ��� 353K���� ��� 353K���� ��� �� ��������� !����0���1�� ��������� !����0���1�� ��������� !����0���1�� ��������� !����0���1

3#)7���� ����3#)7���� ����3#)7���� ����3#)7���� ����

4535���� 4535���� 4535���� 4535���� �+�� ���+�� ���+�� ���+�� ��

Page 113: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

113

Database directories

• Databases− files vs raw access− raw: document! ( ��� ����+ ��� ����+ ��� ����+ ��� ����+)

Page 114: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

114

Database directories

• Databases− files vs raw access− raw: document! ( ��� ����+ ��� ����+ ��� ����+ ��� ����+)− fixed file count and size

• minfree (10% and 0%)• inodes (HFS only)

Page 115: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

115

Database directories

• Databases− files vs raw access− raw: document! ( ��� ����+ ��� ����+ ��� ����+ ��� ����+)− fixed file count and size

• minfree (10% and 0%)• inodes (HFS only)

− Mount options (advanced VxFS)• Table space (/u01 /u02 …)

− minfree=direct,convosync=direct,nodatainlog

Page 116: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

116

Database directories

• Databases− files vs raw access− raw: document! ( ��� ����+ ��� ����+ ��� ����+ ��� ����+)− fixed file count and size

• minfree (10% and 0%)• inodes (HFS only)

− Mount options (advanced VxFS)• Table space (/u01 /u02 …)

− minfree=direct,convosync=direct,nodatainlog• Redo logs, archived redo logs, indexes• executables

Page 117: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

117

Growing directories• New application installs

− Ask vendor for inventory and size− Require all apps to install in /opt− Or create a symlink (ln -s)

• logfiles− Always grow− Require regular trim

• core (ulimit –Sc 0) and other files

Page 118: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

118

Log Files

• /var/adm:( rbootd.log• rpc.lockd.log• rpc.statd.log

• sbtab• shutdownlog@ -> /etc/shutdownlog• streams/

• sulog• sw/• syslog/

• vtdaemonlog• wtmp• wtmpold

• var/adm:• acct/• automount.log• btmp• crash/• cron/• diag/• dmesg.log• eisa/• inetd.sec• lp/• netstat_data• nettl.LOG00• ps_data• ptydaemonlog

Page 119: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

119

Core Files

• Identify with file command:

# sleep 999 &# ps11244 ttyp3 0:00 sleep# kill -SIGQUIT 11244# ll core-rw-------1 root sys 243140 Nov 27 16:16 core# file corecore: core file from 'sleep'-received SIGQUIT

Page 120: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

120

Core Files - cleanup

• Find and remove:− find / -fsonly vxfs -type f -name core -exec rm {} \;

• add -mtime for development (save for a while)-mtime +3 (older than 3 days)-mtime -3 (newer than 3 days)

Page 121: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

121

Cron Monitoring• diskspace.sh:

−monitors all mountpoints−selectable limits−automated notification− run from cron−Download from ftp site

Page 122: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

122

Logfiles

• Characteristics and locations

• syslog, the big one

• User Activity logs (*tmp)

• Miscellaneous logs

Page 123: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

123

Logfiles - what to do?

• Can’t live with ‘em, can’t live without ‘em

• Why?

• Where?

• How?

• Huh?

Page 124: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

124

Filesystem Full!

• White paper (9.x and 10.x/11.x)ftp://contrib:[email protected]

• find versus du− find = files only− du = directory sums:

du -x /home | sort -rn > /usr/tmp/du.home

Page 125: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

125

Where?

• /var/adm− Most system logfiles− diag logs

• /var/adm/lp− log, lpd.log, lpana.log

• (and others in /var/adm)

• applications!

Page 126: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

126

Syslog - everything’s here

• /var/adm/syslog/syslog.log− Bootup info− daemons, kernel, errors, info− applications− user-defined messages

Page 127: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

127

Logfiles and crash dumps• Example entries:

N���67�)*/))/)6N���67�)*/))/)6N���67�)*/))/)6N���67�)*/))/)6 +�!+�!+�!+�!+�!+�!+�!+�! ��!����!����!����!��OOOO4"7)4"7)4"7)4"7)P/�P/�P/�P/���������1���������1���������1���������1���!���������!���������!���������!�������

\ \ \ \___ message

\ \ \_process[PID]

\ \_machine

\_Date/time

Page 128: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

128

syslog boot messages

( �����1������1������1������1�/��������/��������/��������/��������

( �!�����!�����!�����!����/�5 63�+��H�������/�5 63�+��H�������/�5 63�+��H�������/�5 63�+��H�������

( �!�����!�����!�����!����/�>�1���������!��3KJ�)�4������1��������QBB:/�>�1���������!��3KJ�)�4������1��������QBB:/�>�1���������!��3KJ�)�4������1��������QBB:/�>�1���������!��3KJ�)�4������1��������QBB:

( �!�����!�����!�����!����/�E�!����<����!�����//�E�!����<����!�����//�E�!����<����!�����//�E�!����<����!�����/

( �!�����!�����!�����!����/������ ���������1����R��D�K)73�+����J���1�������1����R��D�/������ ���������1����R��D�K)73�+����J���1�������1����R��D�/������ ���������1����R��D�K)73�+����J���1�������1����R��D�/������ ���������1����R��D�K)73�+����J���1�������1����R��D�K)73K)73K)73K)73

( �!�����!�����!�����!����/�����= ������/�646)"*�S+����J������+��/�7))43�S+����J�/�����= ������/�646)"*�S+����J������+��/�7))43�S+����J�/�����= ������/�646)"*�S+����J������+��/�7))43�S+����J�/�����= ������/�646)"*�S+����J������+��/�7))43�S+����J�������+��������+��������+��������+��

Page 129: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

129

More syslog oneliners

( �����O#74P/������O#74P/������O#74P/������O#74P/��������������������� �������1���0�������1���0�������1���0�������1���0

( �����O"K7P/�Q�����1������1������������O"K7P/�Q�����1������1������������O"K7P/�Q�����1������1������������O"K7P/�Q�����1������1�������

( �����O"K7P/���� �����O"K7P/���� �����O"K7P/���� �����O"K7P/���� ������������/�?������������J�������� /�?������������J�������� /�?������������J�������� /�?������������J�������� ��� �+�� ������� �+�� ������� �+�� ������� �+�� ����

( �����O67"3)P/���� �����O67"3)P/���� �����O67"3)P/���� �����O67"3)P/���� ������������/���������������!��46*#�T!/���������������!��46*#�T!/���������������!��46*#�T!/���������������!��46*#�T!

( �����O53KP/�������������O53KP/�������������O53KP/�������������O53KP/������������)0))64K5����2�)0))64K5����2�)0))64K5����2�)0))64K5����2�����*30*46)4���!��3*30*46)4���!��3*30*46)4���!��3*30*46)4���!��3

( ����O5*)KP/����������O5*)KP/����������O5*)KP/����������O5*)KP/������ ������ ������ ������ ������/�>�1������������/�>�1������������/�>�1������������/�>�1������������

( �����1������1������1������1�/�1���1���.�������1����6/�1���1���.�������1����6/�1���1���.�������1����6/�1���1���.�������1����6

Page 130: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

130

Still more syslog

( ��!��O#")3P/�FU�F=:<BA8/�+����������/�6��!��O#")3P/�FU�F=:<BA8/�+����������/�6��!��O#")3P/�FU�F=:<BA8/�+����������/�6��!��O#")3P/�FU�F=:<BA8/�+����������/�6

( �����!����1�����������4���!�������!����1�����������4���!�������!����1�����������4���!�������!����1�����������4���!��

( ��H��!�����,-���H��!�����,-���H��!�����,-���H��!�����,-����� ������������������������������!������!������!������!���� UUU/ UUU/ UUU/ UUU/

( ��H��!�����,-�� ������H��!�����,-�� ������H��!�����,-�� ������H��!�����,-�� ������!������!������!������!���� ���UUU���UUU���UUU���UUU

( �������� ���+�������+�������+�������+�������� ������ ������������ ������������ ������������ ������ (automount -v msg)

( +�����O*33P/�������6#06"065306)#��46)7#37+�����O*33P/�������6#06"065306)#��46)7#37+�����O*33P/�������6#06"065306)#��46)7#37+�����O*33P/�������6#06"065306)#��46)7#37

( +�����O*33P/���2��������!� ���.������������#*K6#4*)�)KK+�����O*33P/���2��������!� ���.������������#*K6#4*)�)KK+�����O*33P/���2��������!� ���.������������#*K6#4*)�)KK+�����O*33P/���2��������!� ���.������������#*K6#4*)�)KK(bootp patch or /etc/syslog.conf)

Page 131: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

131

syslog.conf• facility:

− ����J�!���J�����J�!���J�����J�!���J�����J�!���J�������������J�J�J�J����!��J���� J����!��J���� J����!��J���� J����!��J���� J������)000�����"J�!��������)000�����"J�!��������)000�����"J�!��������)000�����"J�!���

• level:− ��+�1J�����J�������J���+�1J�����J�������J���+�1J�����J�������J���+�1J�����J�������J�

.�����1J����J������J�.�����1J����J������J�.�����1J����J������J�.�����1J����J������J��!��1�!��1�!��1�!��1J�J�J�J�����������������J�����J�����J�����J�����

• destination/action:− pathname/file:

��� ��� ��� ��� ��! !���1������! !���1������! !���1������! !���1����

− device: ��� ������� ��� ������� ��� ������� ��� �������

− usernames (logged in)− * (every user)

Page 132: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

132

syslog examples

( ����J!���0��+�1�����J!���0��+�1�����J!���0��+�1�����J!���0��+�1� ��� ������� ��� ������� ��� ������� ��� �������

( !���0��+�1!���0��+�1!���0��+�1!���0��+�1 ��� ��� ��� ��� ��! �����1 !���0��1��! �����1 !���0��1��! �����1 !���0��1��! �����1 !���0��1

( V0����'!���0����V0����'!���0����V0����'!���0����V0����'!���0���� ��� ��� ��� ��� ��! �����1 �����10��1��! �����1 �����10��1��! �����1 �����10��1��! �����1 �����10��1

( V0�����V0�����V0�����V0����� ��� ������� ��� ������� ��� ������� ��� �������

( V0�����V0�����V0�����V0����� ����J��������J��������J��������J����J�J�J�J� ������ ������ ������ ������

( V0V0V0V0�!��1�!��1�!��1�!��1 VVVV

( V0V0V0V0�!��1�!��1�!��1�!��1 I���!��0 �0��!I���!��0 �0��!I���!��0 �0��!I���!��0 �0��!

Page 133: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

133

logger

• shell script log entries:��11����O��11����O��11����O��11����O��������1P�O����1P�O����1P�O����1P�O������������������������P�OP�OP�OP�O����������P�������P�������P�������P�!�1!�1!�1!�1

− ��11�����11�����11�����11���������������E�8�����E�8�����E�8�����E�8����� ���������������0.������0.������0.������0.��� :�����1:�����1:�����1:�����1

− ��11�����11�����11�����11���������+� ��+� ��+� ��+� �������������������� ����������0������W�����4���X������0������W�����4���X������0������W�����4���X������0������W�����4���X

− ��11�����11�����11�����11��������������40�����WA�.��� �������X�������40�����WA�.��� �������X�������40�����WA�.��� �������X�������40�����WA�.��� �������X

• Test syslog.conf entries

• Debug scripts with no tty output

Page 134: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

134

Facility Logging• Idea: separate syslog files

− �����10���������10���������10���������10����

− �����10!���������10!���������10!���������10!����

− �����10��������10��������10��������10���

− �����10���!��������10���!��������10���!��������10���!���

− �����10��� �����10��� �����10��� �����10���

− etc...

Page 135: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

135

Summarizing syslog• Filtering syslog

− skipping uninteresting messages easier to filter− summarize similar messages:

E@B8:D9, �����!�-

���� ��� ��! �����1 �����10��1 &

M���� ����� 0V9E@B8: �����Y� &OO)�7PV&P Y�&

M�1�������������/���������&

M�1�������������/����� ����R����&

M�1���������� �/�?���������&

M�1��������=?EH:FU:H<AZB��&

M�1���������+����!����1�����������&

M������&

M����2 ���&

M���������

Page 136: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

136

Summarizing syslog• Example summary:

*74������/�Z:=���������������

4*������/�?ABA@EB�8�Z:=�>BC<A�ZQBE��������O67*06350604PJ����

4*������/�?ABA@EB�8�Z:=�>BC<A�ZQBE�����+� O67*0635060*7PJ����

4*������/�?ABA@EB�8�Z:=�>BC<A�ZQBE����+���� O67*0635060KPJ����

4*������/�?ABA@EB�8�Z:=�>BC<A�ZQBE������ O67*0635060"PJ����

4*������/�?ABA@EB�8�Z:=�>BC<A�ZQBE�1 ����O67*0635060#PJ����

4*������/�?ABA@EB�8�Z:=�>BC<A�ZQBE�1������� O67*06350603PJ����

4*������/�?ABA@EB�8�Z:=�>BC<A�ZQBE������� O67*06350605PJ����

4*��>[E/� ��� �+�� ����+��� ���

63���E��E�/��!1������ ���

6K������/�?ABA@EB�8�Z:=�>BC<A�ZQBE�+�+�� O67*0635060*PJ����

7������/�Z:=�>BC<A�ZQBE����+���� O67*0635060KPJ�����

7������/�Z:=�>BC<A�ZQBE�1 ����O67*0635060#PJ�����

7������/�Z:=�>BC<A�ZQBE�+�+�� O67*0635060*PJ�����

5���!����/�

5������/�Z:=�>BC<A�ZQBE��������O67*06350604PJ�����

5������/�Z:=�>BC<A�ZQBE������ O67*0635060"PJ�����

5������/�Z:=�>BC<A�ZQBE������� O67*06350605PJ�����

Page 137: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

137

User Activity Logs( ��!���!���!���!� (zeroed at reboot)

( .�!�.�!�.�!�.�!� (cumulative!)

( +�!�+�!�+�!�+�!� (create!)( ����J�. �J�.����J���1������J�. �J�.����J���1������J�. �J�.����J���1������J�. �J�.����J���1��

• �.�!��.�!��.�!��.�!� to decode ( ��� �+�� ���� �.�!���� �+�� ���� �.�!���� �+�� ���� �.�!���� �+�� ���� �.�!�)

Page 138: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

138

The *tmp files

• *tmp files are all in binary format( ��� ��� ��� ��� ��!���!���!���!�

− active login/logout− rebuilt at bootup− needs valid logouts− user programs or actions can corrupt(!������1��������.����������� ���!������1��������.����������� ���!������1��������.����������� ���!������1��������.����������� ���…)

Page 139: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

139

More *tmp files

( ��� ��� ��� ��� ��! .�!���! .�!���! .�!���! .�!�

− comprehensive and cumulative:• logins/logouts• init changes• boot time• accounting

− Always needs trimming!− View: ������������������������Q�Q�Q�Q������2��\���1���2��\���1���2��\���1���2��\���1��������!���!���!���!�

Page 140: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

140

Still more *tmp files

( ��� ��� ��� ��� ��! +�!���! +�!���! +�!���! +�!�:− Bad logins by UID and tty port− Never allow group/user readable− ����+����+����+����+ (section 1, not 1m, hence warning)− watch for sudden jumps in size and repeated failures for root or

other users

Page 141: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

141

fwtmp

• Program is hiding:− ��� �+�� ���� �.�!���� �+�� ���� �.�!���� �+�� ���� �.�!���� �+�� ���� �.�!�

• decodes ��!���!���!���!�J�J�J�J�.�!�.�!�.�!�.�!�J�J�J�J�+�!�+�!�+�!�+�!� into ASCII

• no errors!

• Converts either direction

Page 142: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

142

lp logfiles

( ��� ��� ��� ��� ��! ����! ����! ����! ��:− ��1��1��1��1 (���� ������ ������ ������ �� �������� for verbose entries)− ���0��1���0��1���0��1���0��1 (������!��������!��������!��������!�� �������� to enable logging)− �����0��1�����0��1�����0��1�����0��1 (���� ������ ������ ������ �� �������� to add �������������������� logging)

Page 143: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

143

JetDirect logfiles

( �!� � �!� � �!� � �!� �2������!�2������!�2������!�2������!�\\\\:− �������� ��������������+�1!��+�1!��+�1!��+�1!

• logs the output of the printer script

( ��� �!� ��� �!� ��� �!� ��� �!� ������1 ������1 ������1 ������1

− ���� ���� ���� ���� ������������������������\�\�\�\�����A�A�A�A������� ��!� �� ��!� �� ��!� �� ��!� ����������������������������������������

• logs the network protocol

Page 144: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

144

cron

( ��� ��� ��� ��� ��! ���� ��1��! ���� ��1��! ���� ��1��! ���� ��1

• Format:\��E�/���!!����������\��E�/���!!����������\��E�/���!!����������\��E�/���!!����������

\��.����=<��� ����������!�\��.����=<��� ����������!�\��.����=<��� ����������!�\��.����=<��� ����������!�

���.����=<��� ����������!����.����=<��� ����������!����.����=<��� ����������!����.����=<��� ����������!�

• Sample:\���E�/� \���E�/� \���E�/� \���E�/� ��� �+�� �!��1��� �+�� �!��1��� �+�� �!��1��� �+�� �!��1 ���� \\� ��� \\� ��� \\� ��� \\� ��� ��! �!��10��1��! �!��10��1��! �!��10��1��! �!��10��1

\�������6))4K���8���E����K�)6/66/))�F8:�*))6\�������6))4K���8���E����K�)6/66/))�F8:�*))6\�������6))4K���8���E����K�)6/66/))�F8:�*))6\�������6))4K���8���E����K�)6/66/))�F8:�*))6

��������6))4K���8���E����K�)6/66/))�F8:�*))6��������6))4K���8���E����K�)6/66/))�F8:�*))6��������6))4K���8���E����K�)6/66/))�F8:�*))6��������6))4K���8���E����K�)6/66/))�F8:�*))6

\���E�/�9BEF \���E�/�9BEF \���E�/�9BEF \���E�/�9BEF ��������� +�� +��+����������� +�� +��+����������� +�� +��+����������� +�� +��+��

\�������6)*)3���8���E����K�)6/6#/))�F8:�*))6\�������6)*)3���8���E����K�)6/6#/))�F8:�*))6\�������6)*)3���8���E����K�)6/6#/))�F8:�*))6\�������6)*)3���8���E����K�)6/6#/))�F8:�*))6

��������6)*)3���8���E����K�)6/6#/)6�F8:�*))6��������6)*)3���8���E����K�)6/6#/)6�F8:�*))6��������6)*)3���8���E����K�)6/6#/)6�F8:�*))6��������6)*)3���8���E����K�)6/6#/)6�F8:�*))6

Page 145: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

145

sulog

( ��� ��� ��� ��� ��! ����1��! ����1��! ����1��! ����1

− logs every su change (good or bad)− ��� ��� ��� ��� ������������������������������������ to force su - root

• Use: ���������������������������� (not ��� ������� ��� ������� ��� ������� ��� �������)• man ��1����1����1����1��

Page 146: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

146

/etc/shutdownlog

• Make sure it exists

• logs every normal shutdown

• logs abnormal restarts and can decode a panic (crash) if ��� ��� ��� ��� ��!��!��!��! ���� ���� ���� ���� is OK

Page 147: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

147

mail logs

( ��� ��� ��� ��� ��! �����1 !���0��1��! �����1 !���0��1��! �����1 !���0��1��! �����1 !���0��1

− email transactions− Sample:

N���67�**/#5/*5�N���67�**/#5/*5�N���67�**/#5/*5�N���67�**/#5/*5� ������ ������ ������ ������ ����!���O*#*KP/�����!���O*#*KP/�����!���O*#*KP/�����!���O*#*KP/�

??)*#*)6/�??)*#*)6/�??)*#*)6/�??)*#*)6/�!�1��!�1��!�1��!�1��D�6775)00D�6775)00D�6775)00D�6775)00

Page 148: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

148

more mail logs

( ���!D�+���*3I!����0��!0!����!D�+���*3I!����0��!0!����!D�+���*3I!����0��!0!����!D�+���*3I!����0��!0!�

( ��D����"I+�!+�!0���0 �0��!\J������D))/))/)#J���D����"I+�!+�!0���0 �0��!\J������D))/))/)#J���D����"I+�!+�!0���0 �0��!\J������D))/))/)#J���D����"I+�!+�!0���0 �0��!\J������D))/))/)#J�����D8���J�!�����D���������D8���J�!�����D���������D8���J�!�����D���������D8���J�!�����D�����

( ��D��D��D��DT�H�!�����1I �0��!T�H�!�����1I �0��!T�H�!�����1I �0��!T�H�!�����1I �0��!J������D6)/))/)KJ�J������D6)/))/)KJ�J������D6)/))/)KJ�J������D6)/))/)KJ�����D��������/�����D��������/�����D��������/�����D��������/��� ��H��H���I!�0�!���0�������0��!\000��� ��H��H���I!�0�!���0�������0��!\000��� ��H��H���I!�0�!���0�������0��!\000��� ��H��H���I!�0�!���0�������0��!\000����������+�����������+�����������+�����������+�� ������!��!�0�!���0�������0��!J� ��������� ������!��!�0�!���0�������0��!J� ��������� ������!��!�0�!���0�������0��!J� ��������� ������!��!�0�!���0�������0��!J� ��������������1�������0J�!�����D�����1�������0J�!�����D�����1�������0J�!�����D�����1�������0J�!�����D������������J�EU�J�EU�J�EU�J�EU� ���D ���D ���D ���D����!���0 �0��!����!���0 �0��!����!���0 �0��!����!���0 �0��!0J��������DO6#056065K06)P0J��������DO6#056065K06)P0J��������DO6#056065K06)P0J��������DO6#056065K06)P

Page 149: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

149

Install/SD logs

• Software Distributor− ��� ��� ��� ��� ��! �.��! �.��! �.��! �.

�.�1���0��1�.�1���0��1�.�1���0��1�.�1���0��1 �.�����10��1�.�����10��1�.�����10��1�.�����10��1 �.�������0��1�.�������0��1�.�������0��1�.�������0��1�.�����1�0��1�.�����1�0��1�.�����1�0��1�.�����1�0��1 �.��!���0��1�.��!���0��1�.��!���0��1�.��!���0��1 �.�1����0��1�.�1����0��1�.�1����0��1�.�1����0��1 �.����0��1�.����0��1�.����0��1�.����0��1�.!�����0��1�.!�����0��1�.!�����0��1�.!�����0��1 �.��10��1�.��10��1�.��10��1�.��10��1 �.������0��1�.������0��1�.������0��1�.������0��1

( ���������������������������� program ( �.�����.�����.�����.���� �������������������������������������������������������������������������������������������������������������������������������� H��������� H��������� H��������� H�����

( � �.H���� ��� �.H���� ��� �.H���� ��� �.H���� ��

( �.!������.!������.!������.!����� ���������� H��!!��D���������� H��!�\������ H��!!��D���������� H��!�\������ H��!!��D���������� H��!�\������ H��!!��D���������� H��!�\

Page 150: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

150

logtrim

• Trim common logfiles− archive older information

• log -> log.1• log.1 -> log.2 etc

− compress the archives− ensure no data loss− correct permissions/ownerships− available from:

���/ ������+/7������5I ���0��������0 �0��! ��������������/ ������+/7������5I ���0��������0 �0��! ��������������/ ������+/7������5I ���0��������0 �0��! ��������������/ ������+/7������5I ���0��������0 �0��! �����������

Page 151: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

151

Useful tools (ftp site)( ������!������!������!������!

( +��!�1�+��!�1�+��!�1�+��!�1�

( ���!���!���!���!����������������

( ���!���!���!���!����!�!!�!!�!!�!

( ���!���!���!���!��������� ����� ����� �����

( ���!���!���!���!����������������

( ��������������������

( T������T������T������T������

( ����������������������������

( �T��������T��������T��������T�������

( ������������

( ������������

( ������������������������

( ����!��������!��������!��������!����

( !�!�!�!�

( ��+���!���+���!���+���!���+���!�

( ��1�����1�����1�����1���J�J�J�J����1������1������1������1���

( ����!����!����!����!

( �.1����.1����.1����.1���

( ��!� �����!� �����!� �����!� ��� ,,,,��������������������������������----

( ����������������������������

( �����1�����������1�����������1�����������1������

( ��!����!����!����!��

Page 152: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

152

Additional resources• Web help:

?�/�?�/�?�/�?�/�����0 �0��!����0 �0��!����0 �0��!����0 �0��! ��� ���������� 747 S�=��!� ��� ���������� 747 S�=��!� ��� ���������� 747 S�=��!� ��� ���������� 747 S�=��!� S�����!�0B������.?��0 �!�S�����!�0B������.?��0 �!�S�����!�0B������.?��0 �!�S�����!�0B������.?��0 �!�

( ������������ � ��� ��� � ��� ��� � ��� ��� � ��� ��� (11.0, not 11i)

( ����0 �0��!����0 �0��!����0 �0��!����0 �0��! ����0 �0��!����0 �0��!����0 �0��!����0 �0��!

( ����.���0 �0��!����.���0 �0��!����.���0 �0��!����.���0 �0��! ��������10 �0��!��������10 �0��!��������10 �0��!��������10 �0��!

( ���������0 �0��!���������0 �0��!���������0 �0��!���������0 �0��! ����������0 �0��!����������0 �0��!����������0 �0��!����������0 �0��!

( ���������0 �0��!���������0 �0��!���������0 �0��!���������0 �0��!

• Interex-Netherlands: sysadmin mail list

�� ����+����+���� ����+����+���� ����+����+���� ����+����+�� ��� ��� ��� ���������!���M���!���M���!���M���!���M�

!����!����!����!���� �����8�+����+��8�+����+��8�+����+��8�+����+� !�T����!�I���� .����0��!�T����!�I���� .����0��!�T����!�I���� .����0��!�T����!�I���� .����0��

Page 153: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

Co-produced by: