Advanced Techniques for HP-UX System · PDF fileAdvanced Techniques for HP-UX System...

153
Advanced Techniques for HP-UX System Administrators Bill Hassell Director of IT Systems and Methods, Inc.

Transcript of Advanced Techniques for HP-UX System · PDF fileAdvanced Techniques for HP-UX System...

Page 1: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

Advanced Techniques for HP-UX System AdministratorsBill HassellDirector of ITSystems and Methods, Inc.

Page 2: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

2

Agenda

• Setting up new systems

• Standardizing for easy administration

• Performance and Kernel Tuning

• Memory Management

• Disk space management

• Logfile management

• Useful tools

• Additional resources

Page 3: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

3

Setting up new systems• Disk layout

− Internal/external issues− VG00 design− Massive lvols, flat directories

• Networking− SAM, netconf, set_parms− 100BaseT issues

• Cron jobs− Logfiles, cleanup, backup

Page 4: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

4

Setting up new systems• Root’s shell

− /sbin/sh− POSIX /usr/bin/sh vs. Bourne− /usr/bin/sh vs. Korn shell− Users can change: chsh login-name /usr/bin/some_shell

• Login tty settings:− # is erase 1 char (backspace)− Fix all logins with a one-time command:���������������� ����������� ��� ����������� ��� ����������� ��� ����������� ��� ����������������������������

− Add others such as: ���������������� ���������������������������������������������������������������������������������������� ���������������������������� ��������������������������������������������������������������������

− Use to set tty defaults such as baud rate

Page 5: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

5

Setting up new systems• Basic security fixes

− ����� ����� ����� ����� ������������ ������ ������ ������ ������������������������������������������������������������������������������������������� !��� !��� !��� !�� "##�$%�"##�$%�"##�$%�"##�$%�&&&&''''

− umask is missing in /etc/profile and /etc/csh.login( �!����!����!����!��� )**)**)**)**

( �!����!����!����!��� )"")"")"")""

− Search for world-write permissions in important directories:( ����� ���� ����� ���� ����� ���� ����� ���� ������������ ���� ���� ���� ���� ���� ���� ���� ���� �+���+���+���+�� ������ ������ ������ �������������!����!����!����!�����))*))*))*))*

• Add: &&&&,�,�,�,�����������������������������������������������������������������������������&&&&---- to look at just files and directories• Add secure database mountpoints, etc

Page 6: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

6

Setting up new systems• Basic security fixes (continued)

( ��� ��� ��� ��� ��� ��� ��� ���

− World-writable directories− �.� (//////// or /0//0//0//0/ or /0/0/0/0)− Symlinks− Duplicate paths− Non-existent directories− scan-path script

• Password and group file checks− �.��

− 1����

• Check /etc/passwd for duplicate UID’s:− ��1�������

Page 7: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

7

Setting up new systems• Basic security fixes (continued)

( ��� ����0�2����0� ����

− World-writable?− Valid user?− Root?

• suid scripts/programs− No scripts allowed− Purpose− Owner− Location− ��� ����+: ������

Page 8: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

8

Standardizing for easy administration

• Login methods− telnet− remsh/rlogin− Xwindows− SSH

• Shells− POSIX (/usr/bin/sh)− Bourne (/usr/old/bin/sh)− Korn shell (/use/bin/ksh)− C shell− Bash, tcsh, etc

Page 9: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

9

Standardizing for easy administration

• Standard profiles− ������

− ulimit settings:���!�� ��

��!�,�������-������������!����

����,+�����-�������������!����

����,�+����-���������3##43

�����,�+����-��������567*

!�!���,�+����-�����������!����

������!�,+�����-�����)

�������,�����������-�3)

− Eliminate core files: ���!�� �8��)

Page 10: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

10

Standardizing for easy administration

• Standard profiles− Interactive versus batch

• Errors: ����/�����������.�����• Separate the interactive commands:

− Multiple �������������� statements− Or separate the interactive portion in a separate

script• Interactive commands: ���� ���� �������

• Interactive settings: 9:;�9�<8=>?@− Login controls: ��� ����1��

• 11.0 with security patches, standard on 11i• Add: AB>BC<AD6 to /etc/default/security

Page 11: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

11

Standardizing for easy administration

• Standard profiles− 9BEF 0�������

− ��� ���� to standardize new users, or replace− Can’t keep from being changed by users (9BEF must be writable

which means no file is safe)− Same interactive issues with batch logins− May want to have 9BEF 0������������ for user mods

• Download sample profiles:ftp://contrib:[email protected]/sysadmin/profiles

Page 12: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

12

Standardizing for easy administration

• Other /etc/skel files:− .���� (vi defaults)

( ��.� (don’t wrap searches around)( �� (ignore case on searches)( �� (follow prev left indent)( �. (update source at shell escapes: !)( .! (wrap to next line, =0 no wrap)( ������ (shows # of lines changed)( � �.!��� (INPUT or REPLACE MODE tag)

������.� �� ���������� ����.���� .���!��1��D*�G

Page 13: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

13

Standardizing for easy administration

• Restricted access methods− Restricted shells: rsh, rksh, rcsh

• $HOME is / for user• NO access to /usr or any other directrories• Must create a local bin with binaries and set $PATH

− Usually simpler to use a menu script (no shell)

• Backup procedures− Classic tools: tar cpio pax dump

• No index, no search, no error recovery, no changer support, no largefiles

− fbackup/frecover• Index on every tape, high speed search, error recovery, change hooks,

largefile-capable

Page 14: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

14

Standardizing for easy administration

• Backup procedures (cont’d)− Features:

• Largefiles, error recovery, changer support, parallel tape drives, network backup/restore, multi-platform, centralized indexing

− Commercial backup programs• OmniBack• Veritas• Legato

• Disaster recovery (loss of boot disk)− Mirroring− Ignite/UX

Page 15: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

15

Standardizing for easy administration

(�����H!������� (from Ignite/UX)

• from the contributed software archive:���/ ������+/7������5I ���0��������0 �0��!

− 1�� ����0�

− ��1 ��.�

− ������ (HTML generator)

• Webmin: ...0.�+!��0��! (Perl-based)− Included with HP’s Apache

Page 16: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

16

Standardizing for easy administration

(�����H!������� (from Ignite/UX)

Page 17: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

17

Standardizing for easy administration

• Centralized patching− Pick a central server− Create a hierarchical structure (test, pre-production,

production)− Use swcopy to add patches and patch depots− Use swreg to make the depot visible on the network (don’t

use NFS)− On clients, use swlist to view the remote depot(s)

swlist –l depot @ patch_servername− Network installs:

swinstall –s depot_name@patch_servername file_set (or \*)

Page 18: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

18

Standardizing for easy administration

• Spooler management− Connections

• Parallel, serial, SCSI, Network− Remote (Windows, Linux, solaris, AIX)

• RFC 1179• Control files and options• Printer scripts and filters

− Network (HP JetDirect)• Port 9100• Jetadmin now HP Printer Installer• addqueue, removequeue, transferqueue

− Troubleshooting• Spoolkick procedure

Page 19: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

19

Performance and Kernel Tuning

• What can be changed

• Performance measurement− Built-in tools− SarCheck− MetaView, Performance Gallery− Glance/gpm, Measureware

• Kernel parameters− Filesystems− Processes− RAM and virtual memory− Network

Page 20: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

20

Performance and Kernel Tuning• What can be changed

− Most kernel params size tables, provide limits or set behavior

− CPU bound• Multi-CPU features

− I/O bound• Disk• Swap (memory limited)• LAN

Page 21: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

21

Performance and Kernel Tuning

• nfile: 14min, no limit− Every opened file (including multiple opens)− Formula scales with maxusers− Every process has a minimum of 3

• nflocks: 2min, 200def, no limit− Maximum number of open file-locks− One file may have several locks− Application dependent− Databases may need hundreds

Filesystem parameters

Page 22: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

22

• ninode: 14min, no limit− In-memory cache of unique current and recent HFS file

locations− Speeds re-open, multi-process file access− Indirectly controls the size of the DNLC, ncsize, ncdnode and

vx_ninode.− 1000 to 8192, lower if ncsize is adjusted− Formula in SAM is not useful for large systems− Best recommendations are in NFS Performance book by Dave

Olker

Performance and Kernel Tuning

Filesystem parameters

Page 23: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

23

• ncdnode: 14min, no limit− In-memory cache of unique current and recent CDFS

file locations (CDROM)−Speeds re-open, multi-process file access−Usually OK unless multiple user access needed for

CDROM or multiple CDROM drives

Performance and Kernel Tuning

Filesystem parameters

Page 24: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

24

• maxfiles: 60 default− Maximum number of files opened by a single process− Used to control runaway processes− Override with setrlimit(2) system call or ulimit –n− Hard ceiling is maxfiles_lim− Commonly recommended too high (4096) by database vendors− Commonly recommended maxfiles = maxfiles_lim but not a good

idea (use ulimit as needed)

Performance and Kernel Tuning

Filesystem parameters

Page 25: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

25

• fs_async:− 0 = synchronous writes to directory structures− 1 = async

• Apx. 20-30% faster write speed (no read change)• Very high probability of data loss with a powerfail or system panic

(fsck fails to fix)

• Default_disk_ir:− 0 = no immediate reporting (waits for writes to complete− 1 = immediate reporting (disk buffers writes)

• Applies to all disks including raw devices

Performance and Kernel Tuning

Filesystem parameters

Page 26: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

26

• disksort_seconds:− HP-UX gives priority to serial rd/wt queues− Intense serial I/O slows random I/O− Value in seconds to wait before changing priority

Performance and Kernel Tuning

Filesystem parameters

Page 27: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

27

Performance and Kernel Tuning

• nproc:− Maximum processes to run at same time− Often way too low in servers

• maxuprc:− Maximum processes owned by a single UID− Collective, not per login− Generic logins can require hundreds or more

Process parameters

Page 28: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

28

• maxdsiz: 256 megs default (was 64megs)− 32bit programs only− Max can be 2Gb (SAM) but mapping limits are 960 and 1750

depending on compiler (or chatr) options. 3+ Gb with tricks.− ulimit –d to create a lower limit

• maxdsiz_64: 64 megs default− 64bit programs only− Max is 4000 Gb

Mem_mgt + proc_mgt note (/usr/share/doc – not 11i)

Performance and Kernel TuningProcess parameters

Page 29: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

29

• maxssiz: 8 megs default− 32bit programs only− Seldom needs changing− Exception for specialized programs or poor design (pass by data

not address/pointer)

• maxtsiz: 64megs default− Maximum for unchanging instructions− Directly related to executable’s file size− 2Gb max (32bit) or 4096Gb (64bit)

Performance and Kernel Tuning

Process parameters

Page 30: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

30

• maxswapchunks:− Used to size maximum swap (32Gb)− Useable swap is:

• maxswapchunks * swchunk * dev_bsize where: swchunk=2048 and dev_bsize=1024

• Leave swchunk as default• Formula simplifies to:

maxswapchunks=DESIRED-SWAP / 2097152

• nswapdev, nswapfs:− Maximum swap devices and filesystems

Performance and Kernel TuningProcess parameters

Page 31: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

31

SWAPSWAP

500 meg500 meg

RAMRAM

1 Gb1 Gb

Unusable forUnusable forprocessesprocesses

swapmem_on=0

In this example, only 500 megs is usable for processes since Virtual Memory is only 500 megs.

Performance and Kernel Tuning

Page 32: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

32

SWAPSWAP

1 Gb1 Gb

RAMRAM

1 Gb1 Gb

swapmem_on = 0

In this example, 1 Gb is usable for processes since Virtual Memory is 1 Gb too...but no paging will take place

Performance and Kernel Tuning

Page 33: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

33

Performance and Kernel Tuning

SWAPSWAP

2 Gb2 Gb

RAMRAM

1 Gb1 Gb

swapmem_on = 0

In this example, 2 Gb is usable for processes since Virtual Memory is 2 Gb too...some paging may be take place

Page 34: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

34

Performance and Kernel Tuning

SWAPSWAP

1 Gb1 Gb

RAMRAM

1 Gb1 Gb

swapmem_on = 1

In this example, 1.75 Gb is usable for processes since Virtual Memory is 1 Gb plus .75 Gb in RAM which is not pageable

Total Total VmemoryVmemory = = 1750 megs1750 megs

Page 35: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

35

• timezone, dst:− Default value for environments without $TZ (daemons)− dst controls a limited number of daylight saving rules

• npty nstrpty,nstrtel:− Controls maximum interactive network sessions− Must match device files (insf)− Use SAM to handle device files automatically

• maxusers:− Not a parameter but a formula adjustment− No relation to user licenses or session limits

Performance and Kernel TuningProcess parameters

Page 36: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

36

• Vocabulary− I/O Bound− Disk Thrashing− Swap Thrashing− Resource Limits

Performance and Kernel TuningPerformance tuning

Page 37: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

37

• Measurement:− uptime:

• User count (standard logins)• Load average (runqueue)

����!�

3/4"�!�����56�����J�*4/K4J��6)4������J�

����������1�/�)0)"J�)0)5J�)0)"

����!�

5/66�!�����656�����J�*4/K4J��7)"������J�

����������1�/�K40)"J�**0)5J�630)"

Performance and Kernel Tuning

Performance tuning

Page 38: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

38

Performance and Kernel Tuning

• sar (system activity reporter)-b buffer cache activity-c System Calls-d Block Device Activity-u CPU Utilization

Performance tuning

Page 39: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

39

Performance and Kernel Tuning

Page 40: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

40

Performance and Kernel Tuning

Page 41: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

41

Performance and Kernel Tuning

Page 42: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

42

Performance and Kernel Tuning

Page 43: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

43

• sar (system activity reporter)-a File Access-v Kernel Parameters

Performance and Kernel Tuning

Performance tuning

Page 44: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

44

Performance and Kernel Tuning

Page 45: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

45

Performance and Kernel Tuning

Page 46: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

46

• iostat - report I/O Statistics− Number of seeks per second− Kbytes transferred per second− Milliseconds per average seek

Performance and Kernel Tuning

Performance tuning

Page 47: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

47

Performance and Kernel Tuning

Run 1 = zerosRun 1 = zeros

Page 48: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

48

• vmstatvmstat [-dnS] [interval [count]]vmstat -f | -s | -z

• Virtual Memory Statistics• -d Adds disk transfers per second• -n Format for 80 columns• -S Processes swapped rather than paging

Performance and Kernel Tuning

Performance tuning

Page 49: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

49

Performance and Kernel Tuning

Page 50: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

50

Performance and Kernel Tuning

Page 51: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

51

• vmstat (cont)−-f fork and page summary:

vmstat -f

9043939 forks, 448300514 pages, average= 49.57

−-s Summary−-z Zero kernel sums

Performance and Kernel Tuning

Performance tuning

Page 52: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

52

Performance and Kernel Tuning

Page 53: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

53

• top: − System data - Summary

• name and time• Load Average 1,5,15 minutes• % time in user,nice,system,idle,etc

− Memory:Virtual and Real− Individual Processes

Performance and Kernel Tuning

Performance tuning

Page 54: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

54

Performance and Kernel TuningPerformance tuning

Page 55: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

55

Performance and Kernel TuningPerformance tuning

Page 56: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

56

• Glance/Plus− HP measurement package− midaemon for better metrics− character mode interface− gpm for Xwindcows− Extensive measurement options− Alarms

Performance and Kernel Tuning

Performance tuning

Page 57: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

57

Performance and Kernel Tuning

• Glance/PlusPerformance tuning

Page 58: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

58

Performance and Kernel Tuning

• Glance/PlusPerformance tuning

Page 59: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

59

Performance and Kernel Tuning

• Glance/PlusPerformance tuning

Page 60: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

60

Performance and Kernel Tuning

• Glance/PlusPerformance tuning

Page 61: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

61

Performance and Kernel Tuning

• Glance/PlusPerformance tuning

Page 62: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

62

Performance and Kernel Tuning

• Glance/PlusPerformance tuning

Page 63: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

63

Performance and Kernel Tuning

• Glance/PlusPerformance tuning

Page 64: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

64

Performance and Kernel Tuning

• Glance/PlusPerformance tuning

Page 65: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

65

Performance and Kernel Tuning

• Glance/PlusPerformance tuning

Page 66: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

66

Performance and Kernel Tuning

• Glance/PlusPerformance tuning

Page 67: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

67

Performance and Kernel Tuning

• Glance/PlusPerformance tuning

Page 68: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

68

Performance and Kernel Tuning

• Glance/PlusPerformance tuning

Page 69: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

69

• gpm: Xwindows interface

Performance and Kernel Tuning

Performance tuning

Page 70: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

70

Performance and Kernel Tuning

Page 71: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

71

Performance and Kernel Tuning

Page 72: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

72

Performance and Kernel Tuning

Page 73: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

73

Performance and Kernel Tuning

Page 74: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

74

Performance and Kernel Tuning

Page 75: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

75

Performance and Kernel Tuning

Page 76: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

76

• What can you change:− Move busy filesystems to other disks− Move disks to additional channels− Add more processors (and/or change processor speed)− Add more RAM (application dependent)− Change large data area programs to use large memory pages

(chatr) to reduce TLB misses− Use AutoPort Aggregation (APA) for parallel data transfers (and

fallback reliability)

Performance and Kernel Tuning

Performance tuning

Page 77: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

77

Memory Management

• 32/64 bit

• 32 bit Data area

• 32 bit Shared memory

• Memory windows

Page 78: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

78

Memory Management

• 32/64 bit− HP-UX operating system− Hardware dependent

• 32bit only• 32/64bit (either)• 64bit only (new machines)

− 32bit programs run in either− 64bit programs only for 64bit HP-UX− 64bit programs remove memory map limitations, not a

performance feature

Page 79: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

79

Memory Management• 32 bit Data area

− 32bit programs have four 1000meg quadrants− Default data area = 960megs apx.− Compiler or chatr options for EXEC_MAGIC allow

quadrant 1 and 2 to be combined for about 1750 megs total data area

− Adjust maxdsiz if necessary− Documentation in /usr/share/doc for mem_mgt and

proc_mgt (missing in 11i)

Page 80: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

80

Memory Management• 32 bit Shared memory

− Most common limitation for 32bit database programs• Oracle: SGA is shared memory

− Similar limits (960megs and 1750 megs)− Use SHMEM_MAGIC option for 1750 meg access

• (all sharing processes must match)− ALL 32bit shared memory processes have one map

(fragmentation, memory mapped files, shared libraries)− Use ipcs –bmop for a snapshot (does not show fragmentation)− Get shminfo from the hprc.external.hp.com ftp site:

ftp://contrib:[email protected]/sysadmin

Page 81: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

81

Memory Management• Memory windows

− Reserves a separate memory map to remove fragmentation issues

− Memory-mapped files, shared libraries are in memory window 0 (plus ‘normal’ shared memory processes)

− Need patches for 11.0 to enable− Set kernel param for quantity of windows− Start ALL sharing programs with memory window

startup command.

Page 82: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

82

Disk space management• Root filesystem

− VG00 size and management• HP-UX only, possibly user $HOME• 3-6Gb typical• New systems have 36/72Gb internal (too big)• Or use external disks

− SCSI vs. fibre channel− Boot issues for external arrays− NAS versus SAN

• Mirroring• Ignite/UX and VG00• Striping VG00

Page 83: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

83

Disk space management• Small versus large disks

− JBODs− Arrays

• Large lvols− Large files versus thousands of small files− Flat versus hierarchical directory structure

• Performance• System impact (from users)• Managing files and backups

Page 84: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

84

Disk space management• Filesystem types:

−HFS (Fast FileSystem - BSD, circa 1984)−VxFS (Veritas FileSystem, aka Journaled FileSystem)

or JFS−CDFS (CDROM FileSystem - ISO 9660 only)−NFS (Network FileSystem)

Page 85: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

85

Disk space management

• HFS (Fast FileSystem - BSD, circa 1984)− McKusick HPF and fragmentation− fsck proportional to directory size− Inode count fixed at creation− resizing

• up = umount, lvextend, extendfs• down = umount, backup, lvreduce, newfs,

reload from backup, mount

Page 86: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

86

Disk space management

• JFS (Veritas filesystem, not Volume Manager)− Aka: Journaled FileSystem or JFS− Inodes created as needed− Very busy filesystem may need defrag− Online (Advanced) JFS option needed for online

resizing and advanced options− Better overall performance than HFS

Page 87: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

87

Disk space management

• CDFS (CDROM filesystem)− ISO 9660 only (see below)− 8.3 UPPERCASE filenames plus ;1 version− 11.0 patch for –ocdcase to lower UPPERCASE and remove ;1

version (but no long filenanes− HP makes special (non-standard) CD’s for Core, Application,

SupportPlus, etc that have long filenames− PFS (Portable FileSystem) to perform RockRidge or long

filename translation− Recent patches add –orr to natively handle long filenames− No direct support for Joliet, audio, multimedia, DVD− No direct support for CD writers

Page 88: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

88

Disk space management• NFS (Network FileSystem)

− Network-based filesystem (server and clients)− Stateless so performance issues exist− Does require tuning for heavy usage− Version 2 = no largefiles− Version 3 = largefile-capable− nfsstat very useful

• biod and nfsd quantity• Network quality

− NFS Performance book by Dave Olker

Page 89: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

89

Disk space management

• VG00 filesystem design− / (root) lvol

• HP-UX only, rest = mountpoints• Static: size to about 256 megs• /etc /dev /sbin (that’s all!)

− /stand lvol• Only HFS filesystem• Holds bootable kernels (current and previous)• 60-200 megs

Page 90: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

90

Disk space management

• VG00 filesystem design - other HP-UX mountpoints− /usr = HP-UX and local executables, libraries

• /bin and /lib• /usr/local versus /usr/contrib• Perhaps 400-1000 megs

− /opt = application installation directories• /opt/app-name

− bin doc lib lbin etc man…• Perhaps 500-1500 megs

− /tmp = system temporary directory (note: system)• Not for users, scripts, etc• Perhaps 200-400 megs

Page 91: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

91

Disk space management• VG00 filesystem design - other HP-UX mountpoints

− /var = variable directory• Most critical directory in HP-UX• When full, daemons and processes abort• Used by many unrelated subsystems• Ideally, separate mountpoint lvols will be created for the most intrusive

directories:−/var/mail−/var/spool−/var/tmp−/var/adm−/var/adm/crash−/var/adm/sw

Page 92: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

92

Disk space management• VG00 filesystem design - other HP-UX mountpoints

− /home = user home directories• Highly variable• When full, cause little impact to production processes• May require active space management or quotas

Page 93: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

93

Disk space management• XVG

− Contributed Xwindow program− Visualize disk layout− Highlight swap, free space, filesystem types− Highlight non-contigous areas− Download from:

ftp://contrib:[email protected]/sysadmin

Page 94: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

94

Xvg Display Program

Page 95: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

95

Xvg Display Program

Page 96: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

96

Xvg Display Program

Page 97: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

97

Xvg Display Program

Page 98: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

98

Xvg Display Program

Page 99: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

99

Xvg Display Program

Page 100: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

100

Xvg Display Program

Page 101: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

101

Xvg Display Program

Page 102: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

102

Xvg Display Program

Page 103: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

103

Xvg Display Program

Page 104: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

104

Xvg Display Program

Page 105: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

105

Xvg - continued

Page 106: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

106

Xvg - continued

Page 107: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

107

Xvg - continued

Page 108: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

108

Xvg - continued

Page 109: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

109

Xvg - continued

Page 110: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

110

Xvg - continued

Page 111: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

111

Logfiles:Where did the space go?

• Don’t look for big files!

• Look for big directories (10,000 small files)

• Use du as in:������������������������

7������� ����L�����7������� ����L�����7������� ����L�����7������� ����L�����

635*���� ��� 635*���� ��� 635*���� ��� 635*���� ��� ��!������!������!������!����

K3K����� ��� ��*K))K3K����� ��� ��*K))K3K����� ��� ��*K))K3K����� ��� ��*K))

*������� ��� �.��� *������� ��� �.��� *������� ��� �.��� *������� ��� �.���

5������� ��� 5������� ��� 5������� ��� 5������� ��� ����������������

65������ ��� 65������ ��� 65������ ��� 65������ ��� ���������������� 0��! 0��! 0��! 0��!

6������� ��� 6������� ��� 6������� ��� 6������� ��� ���������������� E��� E��� E��� E��� (oops…not sorted)

Page 112: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

112

Where did the space go?

• Use du as in (sorted):������������������������ �M������ �M������ �M������ �M������������������ M�!���M�!���M�!���M�!���

43)K5��� 43)K5��� 43)K5��� 43)K5���

6#*6#��� 6#*6#��� 6#*6#��� 6#*6#��� �+���+���+���+��

6K673��� ���6K673��� ���6K673��� ���6K673��� ���

5)4*���� ��� 5)4*���� ��� 5)4*���� ��� 5)4*���� ��� ��������

"7*"���� ��� "7*"���� ��� "7*"���� ��� "7*"���� ��� �������� ��������� ��������� ��������� ���������

353K���� ��� 353K���� ��� 353K���� ��� 353K���� ��� �� ��������� !����0���1�� ��������� !����0���1�� ��������� !����0���1�� ��������� !����0���1

3#)7���� ����3#)7���� ����3#)7���� ����3#)7���� ����

4535���� 4535���� 4535���� 4535���� �+�� ���+�� ���+�� ���+�� ��

Page 113: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

113

Database directories

• Databases− files vs raw access− raw: document! ( ��� ����+ ��� ����+ ��� ����+ ��� ����+)

Page 114: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

114

Database directories

• Databases− files vs raw access− raw: document! ( ��� ����+ ��� ����+ ��� ����+ ��� ����+)− fixed file count and size

• minfree (10% and 0%)• inodes (HFS only)

Page 115: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

115

Database directories

• Databases− files vs raw access− raw: document! ( ��� ����+ ��� ����+ ��� ����+ ��� ����+)− fixed file count and size

• minfree (10% and 0%)• inodes (HFS only)

− Mount options (advanced VxFS)• Table space (/u01 /u02 …)

− minfree=direct,convosync=direct,nodatainlog

Page 116: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

116

Database directories

• Databases− files vs raw access− raw: document! ( ��� ����+ ��� ����+ ��� ����+ ��� ����+)− fixed file count and size

• minfree (10% and 0%)• inodes (HFS only)

− Mount options (advanced VxFS)• Table space (/u01 /u02 …)

− minfree=direct,convosync=direct,nodatainlog• Redo logs, archived redo logs, indexes• executables

Page 117: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

117

Growing directories• New application installs

− Ask vendor for inventory and size− Require all apps to install in /opt− Or create a symlink (ln -s)

• logfiles− Always grow− Require regular trim

• core (ulimit –Sc 0) and other files

Page 118: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

118

Log Files

• /var/adm:( rbootd.log• rpc.lockd.log• rpc.statd.log

• sbtab• shutdownlog@ -> /etc/shutdownlog• streams/

• sulog• sw/• syslog/

• vtdaemonlog• wtmp• wtmpold

• var/adm:• acct/• automount.log• btmp• crash/• cron/• diag/• dmesg.log• eisa/• inetd.sec• lp/• netstat_data• nettl.LOG00• ps_data• ptydaemonlog

Page 119: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

119

Core Files

• Identify with file command:

# sleep 999 &# ps11244 ttyp3 0:00 sleep# kill -SIGQUIT 11244# ll core-rw-------1 root sys 243140 Nov 27 16:16 core# file corecore: core file from 'sleep'-received SIGQUIT

Page 120: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

120

Core Files - cleanup

• Find and remove:− find / -fsonly vxfs -type f -name core -exec rm {} \;

• add -mtime for development (save for a while)-mtime +3 (older than 3 days)-mtime -3 (newer than 3 days)

Page 121: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

121

Cron Monitoring• diskspace.sh:

−monitors all mountpoints−selectable limits−automated notification− run from cron−Download from ftp site

Page 122: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

122

Logfiles

• Characteristics and locations

• syslog, the big one

• User Activity logs (*tmp)

• Miscellaneous logs

Page 123: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

123

Logfiles - what to do?

• Can’t live with ‘em, can’t live without ‘em

• Why?

• Where?

• How?

• Huh?

Page 124: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

124

Filesystem Full!

• White paper (9.x and 10.x/11.x)ftp://contrib:[email protected]

• find versus du− find = files only− du = directory sums:

du -x /home | sort -rn > /usr/tmp/du.home

Page 125: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

125

Where?

• /var/adm− Most system logfiles− diag logs

• /var/adm/lp− log, lpd.log, lpana.log

• (and others in /var/adm)

• applications!

Page 126: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

126

Syslog - everything’s here

• /var/adm/syslog/syslog.log− Bootup info− daemons, kernel, errors, info− applications− user-defined messages

Page 127: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

127

Logfiles and crash dumps• Example entries:

N���67�)*/))/)6N���67�)*/))/)6N���67�)*/))/)6N���67�)*/))/)6 +�!+�!+�!+�!+�!+�!+�!+�! ��!����!����!����!��OOOO4"7)4"7)4"7)4"7)P/�P/�P/�P/���������1���������1���������1���������1���!���������!���������!���������!�������

\ \ \ \___ message

\ \ \_process[PID]

\ \_machine

\_Date/time

Page 128: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

128

syslog boot messages

( �����1������1������1������1�/��������/��������/��������/��������

( �!�����!�����!�����!����/�5 63�+��H�������/�5 63�+��H�������/�5 63�+��H�������/�5 63�+��H�������

( �!�����!�����!�����!����/�>�1���������!��3KJ�)�4������1��������QBB:/�>�1���������!��3KJ�)�4������1��������QBB:/�>�1���������!��3KJ�)�4������1��������QBB:/�>�1���������!��3KJ�)�4������1��������QBB:

( �!�����!�����!�����!����/�E�!����<����!�����//�E�!����<����!�����//�E�!����<����!�����//�E�!����<����!�����/

( �!�����!�����!�����!����/������ ���������1����R��D�K)73�+����J���1�������1����R��D�/������ ���������1����R��D�K)73�+����J���1�������1����R��D�/������ ���������1����R��D�K)73�+����J���1�������1����R��D�/������ ���������1����R��D�K)73�+����J���1�������1����R��D�K)73K)73K)73K)73

( �!�����!�����!�����!����/�����= ������/�646)"*�S+����J������+��/�7))43�S+����J�/�����= ������/�646)"*�S+����J������+��/�7))43�S+����J�/�����= ������/�646)"*�S+����J������+��/�7))43�S+����J�/�����= ������/�646)"*�S+����J������+��/�7))43�S+����J�������+��������+��������+��������+��

Page 129: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

129

More syslog oneliners

( �����O#74P/������O#74P/������O#74P/������O#74P/��������������������� �������1���0�������1���0�������1���0�������1���0

( �����O"K7P/�Q�����1������1������������O"K7P/�Q�����1������1������������O"K7P/�Q�����1������1������������O"K7P/�Q�����1������1�������

( �����O"K7P/���� �����O"K7P/���� �����O"K7P/���� �����O"K7P/���� ������������/�?������������J�������� /�?������������J�������� /�?������������J�������� /�?������������J�������� ��� �+�� ������� �+�� ������� �+�� ������� �+�� ����

( �����O67"3)P/���� �����O67"3)P/���� �����O67"3)P/���� �����O67"3)P/���� ������������/���������������!��46*#�T!/���������������!��46*#�T!/���������������!��46*#�T!/���������������!��46*#�T!

( �����O53KP/�������������O53KP/�������������O53KP/�������������O53KP/������������)0))64K5����2�)0))64K5����2�)0))64K5����2�)0))64K5����2�����*30*46)4���!��3*30*46)4���!��3*30*46)4���!��3*30*46)4���!��3

( ����O5*)KP/����������O5*)KP/����������O5*)KP/����������O5*)KP/������ ������ ������ ������ ������/�>�1������������/�>�1������������/�>�1������������/�>�1������������

( �����1������1������1������1�/�1���1���.�������1����6/�1���1���.�������1����6/�1���1���.�������1����6/�1���1���.�������1����6

Page 130: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

130

Still more syslog

( ��!��O#")3P/�FU�F=:<BA8/�+����������/�6��!��O#")3P/�FU�F=:<BA8/�+����������/�6��!��O#")3P/�FU�F=:<BA8/�+����������/�6��!��O#")3P/�FU�F=:<BA8/�+����������/�6

( �����!����1�����������4���!�������!����1�����������4���!�������!����1�����������4���!�������!����1�����������4���!��

( ��H��!�����,-���H��!�����,-���H��!�����,-���H��!�����,-����� ������������������������������!������!������!������!���� UUU/ UUU/ UUU/ UUU/

( ��H��!�����,-�� ������H��!�����,-�� ������H��!�����,-�� ������H��!�����,-�� ������!������!������!������!���� ���UUU���UUU���UUU���UUU

( �������� ���+�������+�������+�������+�������� ������ ������������ ������������ ������������ ������ (automount -v msg)

( +�����O*33P/�������6#06"065306)#��46)7#37+�����O*33P/�������6#06"065306)#��46)7#37+�����O*33P/�������6#06"065306)#��46)7#37+�����O*33P/�������6#06"065306)#��46)7#37

( +�����O*33P/���2��������!� ���.������������#*K6#4*)�)KK+�����O*33P/���2��������!� ���.������������#*K6#4*)�)KK+�����O*33P/���2��������!� ���.������������#*K6#4*)�)KK+�����O*33P/���2��������!� ���.������������#*K6#4*)�)KK(bootp patch or /etc/syslog.conf)

Page 131: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

131

syslog.conf• facility:

− ����J�!���J�����J�!���J�����J�!���J�����J�!���J�������������J�J�J�J����!��J���� J����!��J���� J����!��J���� J����!��J���� J������)000�����"J�!��������)000�����"J�!��������)000�����"J�!��������)000�����"J�!���

• level:− ��+�1J�����J�������J���+�1J�����J�������J���+�1J�����J�������J���+�1J�����J�������J�

.�����1J����J������J�.�����1J����J������J�.�����1J����J������J�.�����1J����J������J��!��1�!��1�!��1�!��1J�J�J�J�����������������J�����J�����J�����J�����

• destination/action:− pathname/file:

��� ��� ��� ��� ��! !���1������! !���1������! !���1������! !���1����

− device: ��� ������� ��� ������� ��� ������� ��� �������

− usernames (logged in)− * (every user)

Page 132: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

132

syslog examples

( ����J!���0��+�1�����J!���0��+�1�����J!���0��+�1�����J!���0��+�1� ��� ������� ��� ������� ��� ������� ��� �������

( !���0��+�1!���0��+�1!���0��+�1!���0��+�1 ��� ��� ��� ��� ��! �����1 !���0��1��! �����1 !���0��1��! �����1 !���0��1��! �����1 !���0��1

( V0����'!���0����V0����'!���0����V0����'!���0����V0����'!���0���� ��� ��� ��� ��� ��! �����1 �����10��1��! �����1 �����10��1��! �����1 �����10��1��! �����1 �����10��1

( V0�����V0�����V0�����V0����� ��� ������� ��� ������� ��� ������� ��� �������

( V0�����V0�����V0�����V0����� ����J��������J��������J��������J����J�J�J�J� ������ ������ ������ ������

( V0V0V0V0�!��1�!��1�!��1�!��1 VVVV

( V0V0V0V0�!��1�!��1�!��1�!��1 I���!��0 �0��!I���!��0 �0��!I���!��0 �0��!I���!��0 �0��!

Page 133: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

133

logger

• shell script log entries:��11����O��11����O��11����O��11����O��������1P�O����1P�O����1P�O����1P�O������������������������P�OP�OP�OP�O����������P�������P�������P�������P�!�1!�1!�1!�1

− ��11�����11�����11�����11���������������E�8�����E�8�����E�8�����E�8����� ���������������0.������0.������0.������0.��� :�����1:�����1:�����1:�����1

− ��11�����11�����11�����11���������+� ��+� ��+� ��+� �������������������� ����������0������W�����4���X������0������W�����4���X������0������W�����4���X������0������W�����4���X

− ��11�����11�����11�����11��������������40�����WA�.��� �������X�������40�����WA�.��� �������X�������40�����WA�.��� �������X�������40�����WA�.��� �������X

• Test syslog.conf entries

• Debug scripts with no tty output

Page 134: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

134

Facility Logging• Idea: separate syslog files

− �����10���������10���������10���������10����

− �����10!���������10!���������10!���������10!����

− �����10��������10��������10��������10���

− �����10���!��������10���!��������10���!��������10���!���

− �����10��� �����10��� �����10��� �����10���

− etc...

Page 135: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

135

Summarizing syslog• Filtering syslog

− skipping uninteresting messages easier to filter− summarize similar messages:

E@B8:D9, �����!�-

���� ��� ��! �����1 �����10��1 &

M���� ����� 0V9E@B8: �����Y� &OO)�7PV&P Y�&

M�1�������������/���������&

M�1�������������/����� ����R����&

M�1���������� �/�?���������&

M�1��������=?EH:FU:H<AZB��&

M�1���������+����!����1�����������&

M������&

M����2 ���&

M���������

Page 136: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

136

Summarizing syslog• Example summary:

*74������/�Z:=���������������

4*������/�?ABA@EB�8�Z:=�>BC<A�ZQBE��������O67*06350604PJ����

4*������/�?ABA@EB�8�Z:=�>BC<A�ZQBE�����+� O67*0635060*7PJ����

4*������/�?ABA@EB�8�Z:=�>BC<A�ZQBE����+���� O67*0635060KPJ����

4*������/�?ABA@EB�8�Z:=�>BC<A�ZQBE������ O67*0635060"PJ����

4*������/�?ABA@EB�8�Z:=�>BC<A�ZQBE�1 ����O67*0635060#PJ����

4*������/�?ABA@EB�8�Z:=�>BC<A�ZQBE�1������� O67*06350603PJ����

4*������/�?ABA@EB�8�Z:=�>BC<A�ZQBE������� O67*06350605PJ����

4*��>[E/� ��� �+�� ����+��� ���

63���E��E�/��!1������ ���

6K������/�?ABA@EB�8�Z:=�>BC<A�ZQBE�+�+�� O67*0635060*PJ����

7������/�Z:=�>BC<A�ZQBE����+���� O67*0635060KPJ�����

7������/�Z:=�>BC<A�ZQBE�1 ����O67*0635060#PJ�����

7������/�Z:=�>BC<A�ZQBE�+�+�� O67*0635060*PJ�����

5���!����/�

5������/�Z:=�>BC<A�ZQBE��������O67*06350604PJ�����

5������/�Z:=�>BC<A�ZQBE������ O67*0635060"PJ�����

5������/�Z:=�>BC<A�ZQBE������� O67*06350605PJ�����

Page 137: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

137

User Activity Logs( ��!���!���!���!� (zeroed at reboot)

( .�!�.�!�.�!�.�!� (cumulative!)

( +�!�+�!�+�!�+�!� (create!)( ����J�. �J�.����J���1������J�. �J�.����J���1������J�. �J�.����J���1������J�. �J�.����J���1��

• �.�!��.�!��.�!��.�!� to decode ( ��� �+�� ���� �.�!���� �+�� ���� �.�!���� �+�� ���� �.�!���� �+�� ���� �.�!�)

Page 138: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

138

The *tmp files

• *tmp files are all in binary format( ��� ��� ��� ��� ��!���!���!���!�

− active login/logout− rebuilt at bootup− needs valid logouts− user programs or actions can corrupt(!������1��������.����������� ���!������1��������.����������� ���!������1��������.����������� ���!������1��������.����������� ���…)

Page 139: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

139

More *tmp files

( ��� ��� ��� ��� ��! .�!���! .�!���! .�!���! .�!�

− comprehensive and cumulative:• logins/logouts• init changes• boot time• accounting

− Always needs trimming!− View: ������������������������Q�Q�Q�Q������2��\���1���2��\���1���2��\���1���2��\���1��������!���!���!���!�

Page 140: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

140

Still more *tmp files

( ��� ��� ��� ��� ��! +�!���! +�!���! +�!���! +�!�:− Bad logins by UID and tty port− Never allow group/user readable− ����+����+����+����+ (section 1, not 1m, hence warning)− watch for sudden jumps in size and repeated failures for root or

other users

Page 141: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

141

fwtmp

• Program is hiding:− ��� �+�� ���� �.�!���� �+�� ���� �.�!���� �+�� ���� �.�!���� �+�� ���� �.�!�

• decodes ��!���!���!���!�J�J�J�J�.�!�.�!�.�!�.�!�J�J�J�J�+�!�+�!�+�!�+�!� into ASCII

• no errors!

• Converts either direction

Page 142: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

142

lp logfiles

( ��� ��� ��� ��� ��! ����! ����! ����! ��:− ��1��1��1��1 (���� ������ ������ ������ �� �������� for verbose entries)− ���0��1���0��1���0��1���0��1 (������!��������!��������!��������!�� �������� to enable logging)− �����0��1�����0��1�����0��1�����0��1 (���� ������ ������ ������ �� �������� to add �������������������� logging)

Page 143: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

143

JetDirect logfiles

( �!� � �!� � �!� � �!� �2������!�2������!�2������!�2������!�\\\\:− �������� ��������������+�1!��+�1!��+�1!��+�1!

• logs the output of the printer script

( ��� �!� ��� �!� ��� �!� ��� �!� ������1 ������1 ������1 ������1

− ���� ���� ���� ���� ������������������������\�\�\�\�����A�A�A�A������� ��!� �� ��!� �� ��!� �� ��!� ����������������������������������������

• logs the network protocol

Page 144: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

144

cron

( ��� ��� ��� ��� ��! ���� ��1��! ���� ��1��! ���� ��1��! ���� ��1

• Format:\��E�/���!!����������\��E�/���!!����������\��E�/���!!����������\��E�/���!!����������

\��.����=<��� ����������!�\��.����=<��� ����������!�\��.����=<��� ����������!�\��.����=<��� ����������!�

���.����=<��� ����������!����.����=<��� ����������!����.����=<��� ����������!����.����=<��� ����������!�

• Sample:\���E�/� \���E�/� \���E�/� \���E�/� ��� �+�� �!��1��� �+�� �!��1��� �+�� �!��1��� �+�� �!��1 ���� \\� ��� \\� ��� \\� ��� \\� ��� ��! �!��10��1��! �!��10��1��! �!��10��1��! �!��10��1

\�������6))4K���8���E����K�)6/66/))�F8:�*))6\�������6))4K���8���E����K�)6/66/))�F8:�*))6\�������6))4K���8���E����K�)6/66/))�F8:�*))6\�������6))4K���8���E����K�)6/66/))�F8:�*))6

��������6))4K���8���E����K�)6/66/))�F8:�*))6��������6))4K���8���E����K�)6/66/))�F8:�*))6��������6))4K���8���E����K�)6/66/))�F8:�*))6��������6))4K���8���E����K�)6/66/))�F8:�*))6

\���E�/�9BEF \���E�/�9BEF \���E�/�9BEF \���E�/�9BEF ��������� +�� +��+����������� +�� +��+����������� +�� +��+����������� +�� +��+��

\�������6)*)3���8���E����K�)6/6#/))�F8:�*))6\�������6)*)3���8���E����K�)6/6#/))�F8:�*))6\�������6)*)3���8���E����K�)6/6#/))�F8:�*))6\�������6)*)3���8���E����K�)6/6#/))�F8:�*))6

��������6)*)3���8���E����K�)6/6#/)6�F8:�*))6��������6)*)3���8���E����K�)6/6#/)6�F8:�*))6��������6)*)3���8���E����K�)6/6#/)6�F8:�*))6��������6)*)3���8���E����K�)6/6#/)6�F8:�*))6

Page 145: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

145

sulog

( ��� ��� ��� ��� ��! ����1��! ����1��! ����1��! ����1

− logs every su change (good or bad)− ��� ��� ��� ��� ������������������������������������ to force su - root

• Use: ���������������������������� (not ��� ������� ��� ������� ��� ������� ��� �������)• man ��1����1����1����1��

Page 146: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

146

/etc/shutdownlog

• Make sure it exists

• logs every normal shutdown

• logs abnormal restarts and can decode a panic (crash) if ��� ��� ��� ��� ��!��!��!��! ���� ���� ���� ���� is OK

Page 147: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

147

mail logs

( ��� ��� ��� ��� ��! �����1 !���0��1��! �����1 !���0��1��! �����1 !���0��1��! �����1 !���0��1

− email transactions− Sample:

N���67�**/#5/*5�N���67�**/#5/*5�N���67�**/#5/*5�N���67�**/#5/*5� ������ ������ ������ ������ ����!���O*#*KP/�����!���O*#*KP/�����!���O*#*KP/�����!���O*#*KP/�

??)*#*)6/�??)*#*)6/�??)*#*)6/�??)*#*)6/�!�1��!�1��!�1��!�1��D�6775)00D�6775)00D�6775)00D�6775)00

Page 148: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

148

more mail logs

( ���!D�+���*3I!����0��!0!����!D�+���*3I!����0��!0!����!D�+���*3I!����0��!0!����!D�+���*3I!����0��!0!�

( ��D����"I+�!+�!0���0 �0��!\J������D))/))/)#J���D����"I+�!+�!0���0 �0��!\J������D))/))/)#J���D����"I+�!+�!0���0 �0��!\J������D))/))/)#J���D����"I+�!+�!0���0 �0��!\J������D))/))/)#J�����D8���J�!�����D���������D8���J�!�����D���������D8���J�!�����D���������D8���J�!�����D�����

( ��D��D��D��DT�H�!�����1I �0��!T�H�!�����1I �0��!T�H�!�����1I �0��!T�H�!�����1I �0��!J������D6)/))/)KJ�J������D6)/))/)KJ�J������D6)/))/)KJ�J������D6)/))/)KJ�����D��������/�����D��������/�����D��������/�����D��������/��� ��H��H���I!�0�!���0�������0��!\000��� ��H��H���I!�0�!���0�������0��!\000��� ��H��H���I!�0�!���0�������0��!\000��� ��H��H���I!�0�!���0�������0��!\000����������+�����������+�����������+�����������+�� ������!��!�0�!���0�������0��!J� ��������� ������!��!�0�!���0�������0��!J� ��������� ������!��!�0�!���0�������0��!J� ��������� ������!��!�0�!���0�������0��!J� ��������������1�������0J�!�����D�����1�������0J�!�����D�����1�������0J�!�����D�����1�������0J�!�����D������������J�EU�J�EU�J�EU�J�EU� ���D ���D ���D ���D����!���0 �0��!����!���0 �0��!����!���0 �0��!����!���0 �0��!0J��������DO6#056065K06)P0J��������DO6#056065K06)P0J��������DO6#056065K06)P0J��������DO6#056065K06)P

Page 149: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

149

Install/SD logs

• Software Distributor− ��� ��� ��� ��� ��! �.��! �.��! �.��! �.

�.�1���0��1�.�1���0��1�.�1���0��1�.�1���0��1 �.�����10��1�.�����10��1�.�����10��1�.�����10��1 �.�������0��1�.�������0��1�.�������0��1�.�������0��1�.�����1�0��1�.�����1�0��1�.�����1�0��1�.�����1�0��1 �.��!���0��1�.��!���0��1�.��!���0��1�.��!���0��1 �.�1����0��1�.�1����0��1�.�1����0��1�.�1����0��1 �.����0��1�.����0��1�.����0��1�.����0��1�.!�����0��1�.!�����0��1�.!�����0��1�.!�����0��1 �.��10��1�.��10��1�.��10��1�.��10��1 �.������0��1�.������0��1�.������0��1�.������0��1

( ���������������������������� program ( �.�����.�����.�����.���� �������������������������������������������������������������������������������������������������������������������������������� H��������� H��������� H��������� H�����

( � �.H���� ��� �.H���� ��� �.H���� ��� �.H���� ��

( �.!������.!������.!������.!����� ���������� H��!!��D���������� H��!�\������ H��!!��D���������� H��!�\������ H��!!��D���������� H��!�\������ H��!!��D���������� H��!�\

Page 150: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

150

logtrim

• Trim common logfiles− archive older information

• log -> log.1• log.1 -> log.2 etc

− compress the archives− ensure no data loss− correct permissions/ownerships− available from:

���/ ������+/7������5I ���0��������0 �0��! ��������������/ ������+/7������5I ���0��������0 �0��! ��������������/ ������+/7������5I ���0��������0 �0��! ��������������/ ������+/7������5I ���0��������0 �0��! �����������

Page 151: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

151

Useful tools (ftp site)( ������!������!������!������!

( +��!�1�+��!�1�+��!�1�+��!�1�

( ���!���!���!���!����������������

( ���!���!���!���!����!�!!�!!�!!�!

( ���!���!���!���!��������� ����� ����� �����

( ���!���!���!���!����������������

( ��������������������

( T������T������T������T������

( ����������������������������

( �T��������T��������T��������T�������

( ������������

( ������������

( ������������������������

( ����!��������!��������!��������!����

( !�!�!�!�

( ��+���!���+���!���+���!���+���!�

( ��1�����1�����1�����1���J�J�J�J����1������1������1������1���

( ����!����!����!����!

( �.1����.1����.1����.1���

( ��!� �����!� �����!� �����!� ��� ,,,,��������������������������������----

( ����������������������������

( �����1�����������1�����������1�����������1������

( ��!����!����!����!��

Page 152: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

152

Additional resources• Web help:

?�/�?�/�?�/�?�/�����0 �0��!����0 �0��!����0 �0��!����0 �0��! ��� ���������� 747 S�=��!� ��� ���������� 747 S�=��!� ��� ���������� 747 S�=��!� ��� ���������� 747 S�=��!� S�����!�0B������.?��0 �!�S�����!�0B������.?��0 �!�S�����!�0B������.?��0 �!�S�����!�0B������.?��0 �!�

( ������������ � ��� ��� � ��� ��� � ��� ��� � ��� ��� (11.0, not 11i)

( ����0 �0��!����0 �0��!����0 �0��!����0 �0��! ����0 �0��!����0 �0��!����0 �0��!����0 �0��!

( ����.���0 �0��!����.���0 �0��!����.���0 �0��!����.���0 �0��! ��������10 �0��!��������10 �0��!��������10 �0��!��������10 �0��!

( ���������0 �0��!���������0 �0��!���������0 �0��!���������0 �0��! ����������0 �0��!����������0 �0��!����������0 �0��!����������0 �0��!

( ���������0 �0��!���������0 �0��!���������0 �0��!���������0 �0��!

• Interex-Netherlands: sysadmin mail list

�� ����+����+���� ����+����+���� ����+����+���� ����+����+�� ��� ��� ��� ���������!���M���!���M���!���M���!���M�

!����!����!����!���� �����8�+����+��8�+����+��8�+����+��8�+����+� !�T����!�I���� .����0��!�T����!�I���� .����0��!�T����!�I���� .����0��!�T����!�I���� .����0��

Page 153: Advanced Techniques for HP-UX System  · PDF fileAdvanced Techniques for HP-UX System Administrators ... 256 megs default ... plus .75 Gb in RAM which is not pageable

Co-produced by: