Power Systems Stuff

Power Systems Stuff

Compiled by Michael Fryman @ IBM

Table of Contents

IBM DeveloperWorks Wikis

IBM Redbooks

Power and Planning

Power Systems Stuff

JS22 POWER Blade Stuff

AIX Stuff

NIM Server Stuff

VIO Server Stuff

HMC Stuff

AIX command

Linux on Power

Appendix A: Full HMC and System Setup Procedure

 ======== <End Table of Contents> =============================================

IBM DeveloperWorks Wikis

·        AIX – Home

·        AIX 5.3 Best Practices

·        AIX 5.3 Installation Best Practices

·        AIX6 & POWER6 Hands-On Technical Demo Movies

·        PowerVM - Home

·        PowerVM – HMC 

·        PowerVM – HMC Hints

·        HMC Command Line

·        HMC Command Line man pages PDF

·        Service & Support Best Practices Website

 

IBM Redbooks

·        PowerVM Best Practices

·        Hardware Management Console V7 Handbook

·        Integrated Virtual Ethernet Adapter Technical Overview and Introduction

·        PowerVM Virtualization on IBM System p: Introduction and Configuration Fourth Edition

·        PowerVM Live Partition Mobility on IBM System p

·        IBM AIX Version 6.1 Differences Guide

·        PowerVM Virtualization on IBM System p: Managing and Monitoring

·        IBM System p Advanced POWER Virtualization (PowerVM) Best Practices

·        Advanced POWER Virtualization on IBM System p Virtual I/O Server Deployment Examples

·        IBM Electronic Services Support using Automation and Web Tools

·        Utility Capacity on Demand: What Utility CoD Is and How to Use It

 

Power and Planning

·        7109 intelligent pdu

·        same as 7188 load value

·        no more than 80% load

·        so at 30amps no more than 24amps

·        at 60 amps line cord then no more than 48amps

·        9854 30amp line cord

Power Systems Stuff

ASMI - Advanced System Management Interface

ASMI Default logins and passwords

As soon as you login to ASMI, you are asked to change the default password.

You will not be allowed to proceed unless you change the password.

User ID

Default Password

Authority Level               

General

general

general user

Admin

admin

administrator

Celogin

contact ibm for password

Authorized service provider

The HMC access password is usually set from the HMC during initial login. If you change this password using the ASMI, the change takes effect immediately.

Note: As a security measure, you are required to enter the current user’s password into the Current password for current user field. This password is not the password for the user ID you want to change.

 

ASMI Default IP Addresses

Every firmware service processor on a Power5 or Power6 box has 2 Ethernet interfaces used for connection to the Hardware Management Console (HMC). Immediately after the power cord is connected to the Power system, the service processor (FSP) sends a DHCP request through both interfaces.   If no DHCP address is received it falls back to the default addresses:

HMC1 Port: 192.168.2.147 / 255.255.255.0

HMC2 Port: 192.168.3.147 / 255.255.255.0

You can connect to ASMI webinterface through the browser.

 

ASMI IP Address from Operator Panel

If the default IPs for the ASMI interface are not accessible and you do not have access to any DHCPd logs which may have provided an adress you can use following procedure to determine the adress through 3 white buttons at the operation panel below the led:

1.      Select function 02

2.      Change "N" to "M" (for manual)

3.      Select function 30

4.      Change "**" to "00" and press Enter

5.      See the adress of HMC1 at "00" and HMC2 at "01"

6.      Select function 02

7.      Change "M" back to "N"

How to setup hw-raid before installing the operating system

Download the latest Diagnostics ISO Image from: Diagnostic CD burn it onto a CD and then boot this CD.

Once booted this will bring up the AIX diag which enables you to set the SCSI disk RAID settings as you like. Basically you have to modify all disks which should belong to a RAID configuration from a regular 512-byte block size to a 522-byte block size array candidate disk as only such candidate disks can be included in a RAID setting. Once the RAID settings are done, the OS will not see the single disks of the RAID setting anymore, just your RAID disks.

JS22 POWER Blade Stuff

 

How to use SOL (Serial Over Lan)

 

How to Enable Serial Over LAN on the AMM

1.      Login to your BladeCenter Advanced Management Module:    http://yourBladeCenter or https://yourBladeCenter

2.      Navigate to Serial Over LAN (BladeTasks -> Serial Over LAN)

3.      Enable SOL for your specific server

1.      Locate the section “Serial Over LAN Status”. It should show a table of your bays and blade servers.

2.      Check the server(s) for which you’d like to enable SOL

3.      Click Enable Serial Over LAN link

4.      Enable Serial Over LAN service by using the drop down box under Serial Over LAN Configuration

5.      Click Save

6.      Ensure that either Telnet or SSH is enabled.

7.      To enable SSH (the more secure option)

1.      Navigate to MM Control -> Security

2.      Enable SSH Server using the drop down box

3.      Select Save

8.      To enable Telnet (the less secure option)

1.      Navigate to MM Control -> Network Protocols

2.      Scroll down to Telnet Protocol

3.      Enable Telnet mode using the drop down box

4.      Save

You should be good to go. Note: SSH and Telnet can be assigned to non-standard ports in the BladeCenter. This can be checked under MM Control -> Port Assignments.

 

How to Connect to the Console

1. SSH or Telnet into your BladeCenter

2. Set the timeout to zero (i.e. no timeout) for this session

    system> telnetcfg -t 0 -T system:mm[1]

Set the environment variable to your blade bay number, then type console.   If you don’t know your bay number, log into the BladeCenter GUI, http://yourBladeCenter.   An example for connecting to the blade on bay 1:

    system> env -T system:blade[1]

    system:blade[1]> console -o

    or just enter this command
    system> console -o -T system:blade[x]

    Console login:

 To escape back into the BladeCenter CLI, use the escape sequence listed under SOL in the Blade Center GUI. The default sequence is ^[(. That is

    ESC  and then   Shift + (

    or

    Ctrl + [     and then     Shift + (

Remove all LPAR config info on blade (or other POWER) server using VIOS/IVM command line

Note: If you are reinstalling VIOS on the same blade and want to remove the previous logical partition information and return the blade to an original unconfigured state prior to making any configuration changes, execute the following command:

 lpcfgop -o clear

The LPAR information will now be cleared on the next system restart.

The help function in the IVM CLI does not display the lpcfgop command. However, you can obtain the command's description by using:

 man lpcfgop

Special SEA setup on POWER Blade servers

Install your VIO/IVM from DVD or NIM. Then follow these steps:

$ license -accept

$ mkgencfg -o init

$ lsdev |grep ent
ent0             Available   Logical Host Ethernet Port (lp-hea)
ent1             Available   Logical Host Ethernet Port (lp-hea)
ent2            Available   Virtual I/O Ethernet Adapter (l-lan)
ent3            Available   Virtual I/O Ethernet Adapter (l-lan)
ent4            Available   Virtual I/O Ethernet Adapter (l-lan)
ent5            Available   Virtual I/O Ethernet Adapter (l-lan)
ibmvmc0          Available   Virtual Management Channel
 

You can get further information about the ethernet adapters by running this command for each one.
$ lsdev -dev ent2 -vpd
  ent4             U7778.23X.1099999-V1-C3-T1  Virtual I/O Ethernet Adapter (l-lan)

       Network Address.............012345678903
       Displayable Message.........Virtual I/O Ethernet Adapter (l-lan)
       Hardware Location Code......U7778.23X.1099999-V1-C3-T1


  PLATFORM SPECIFIC

  Name:  l-lan
   Node:  l-lan@30000003
   Device Type: network
   Physical Location: U7778.23X.1099999-V1-C3-T1
 

Note: On a JS43 or PS702 blade server, i.e. a “double wide” blade, you’ll have 4 built-in adapters, i.e. the “lp-hea” Logical Host Ethernet (LHEA) ports shown above.  So you’d see ent0,ent1,ent2,ent3 as LHEA ports and then you’d see ent4,ent5,ent6,ent7 as virtual I/O Ethernet adapters. In fact you might well want to setup NIB (network interface backup) link aggregation on the adapters in slots P1-T6 and 2-T6 in one LNAGG (likely to be ent0 and ent2 on your VIO server), and then the adapters in slots P1-T7 and P2-T7 in the other LNAGG.  So those commands would like this:

$ mkvdev -lnagg ent0 -attr backup_adapter=ent2
ent98 available  (your 98 will be the next adapter index number like 8,9,10,11, etc.)
$ mkvdev -lnagg ent1 -attr backup_adapter=ent3
ent99 available  (your 99 will be the next adapter index number like 8,9,10,11, etc.)
 

Note: On any POWER rack-mount server (i.e. not a blade server with special attributes around the network adapters and switch modules and wiring inside the chassis) you could run this command to create a 2-adapter link aggregation and assign a third adapter as a backup adapter.
$ mkvdev -lnagg ent4,ent5 -attr backup_adapter=ent6 mode=8023ad
The system displays a message similar to the following:
ent10 available

To list the current ethernet adapter info like PCI slot used, default vlan, additional vlans, ieee virtual adapter (i.e. bridged), trunking info, MAC address, etc. then enter this command (my values shown are tweaked to look generic).  This is important because if you want to use vlan 1,2,3 or 4 you must use the corresponding virtual adapter that has already been created.  I haven’t found a way to change the default vlan ID or add additional vlan ID’s once this virtual adapter has been created. This is a painful issue if you need to add/change/delete vlans very often. If you do, currently the only option I know of is to delete the SEA adapter, delete the virtual ethernet adapter and then recreate it with the desired vlans (default and additional).  So if you want to use vlan 2, use what is ent3 below, the 2nd virtual adapter:
$ lshwres -r virtualio --rsubtype eth --level lpar
lpar_name=10-99999,lpar_id=1,slot_num=3,state=1,ieee_virtual_eth=0,port_vlan_id=1,addl_vlan_ids=none,is_trunk=1,trunk_priority=1,is_required=0,mac_addr=012345678903
lpar_name=10-99999,lpar_id=1,slot_num=4,state=1,ieee_virtual_eth=0,port_vlan_id=2,addl_vlan_ids=none,is_trunk=1,trunk_priority=1,is_required=0,mac_addr=012345678904
lpar_name=10-99999,lpar_id=1,slot_num=5,state=1,ieee_virtual_eth=0,port_vlan_id=3,addl_vlan_ids=none,is_trunk=1,trunk_priority=1,is_required=0,mac_addr=012345678905
lpar_name=10-99999,lpar_id=1,slot_num=6,state=1,ieee_virtual_eth=0,port_vlan_id=4,addl_vlan_ids=none,is_trunk=1,trunk_priority=1,is_required=0,mac_addr=012345678906
 

$ chhwres -r virtualio --rsubtype eth -o a --id 1 -s 10 -a port_vlan_id=9,ieee_virtual_eth=1,\"addl_vlan_ids=50,63\",is_trunk=1,trunk_priority=1
(these next 2 lines are output from the command, not something you need to type in)
/usr/ios/lpm/sbin/lpmdrmgr drmgr -c slot -s 'U8233.E8B.1099999-V1-C21' -a
U8233.E8B.1099999-V1-C21

(this makes a new adapter ent6, but it doesn't tell you that)
$ lsdev |grep ent
ent0             Available   Logical Host Ethernet Port (lp-hea)
ent1             Available   Logical Host Ethernet Port (lp-hea)
ent2            Available   Virtual I/O Ethernet Adapter (l-lan)
ent3            Available   Virtual I/O Ethernet Adapter (l-lan)
ent4            Available   Virtual I/O Ethernet Adapter (l-lan)
ent5            Available   Virtual I/O Ethernet Adapter (l-lan)
ent6            Available   Virtual I/O Ethernet Adapter (l-lan)
ibmvmc0          Available   Virtual Management Channel
 

$ mkvdev -sea ent0 -vadapter ent3 -default ent3 -defaultid 2 (we use ent3 because we want to use vlan2, see notes above)
ent7 Available
en7
et7
 

$ mkvdev -sea ent1 -vadapter ent6 -default ent6 -defaultid 9
ent8 Available
en8
et8
 

$ mkvdev -vlan ent8 -tagid 50
ent9 Available
en9
et9
 

$ mktcpip -hostname testvio1 -inetaddr 10.100.100.125 -interface en7 -start -netmask 255.255.255.0 -gateway 10.100.100.1 -nsrvaddr 10.100.100.1 -nsrvdomain test99.xyz.org

then ping 10.100.100.1 to make sure it is working,
 

Not sure what this command to create a new vSCSI adapter is needed for at this time (came from another admin’s notes). You’d use your system drawer, model, serial number information (i.e. full location code preamble) below. You may have to run this as root (oem_setup_env).
$
 

Abbreviated procedure including initial AMM commands for JS43 and PS702 double wide POWER blade servers.

telnetcfg -t 0 -T system:mm[1]
console -o -T system:blade[9]

Just to be safe let’s clear the lpar config if it’s a new server or one we are re-using or just inherited
$ lpcfgop -o clear
Now go into “root” mode, reset all devices (i.e. clear or delete them) and then reboot
$ oem_setup_env
# devreset
# shutdown -Fr
<reboot here>

Setup initial 4 virtual ethernet adapters for IVM
$ mkgencfg -o init

$ lsdev | grep ent
ent0             Available   Logical Host Ethernet Port (lp-hea)
ent1             Available   Logical Host Ethernet Port (lp-hea)
ent2             Available   Logical Host Ethernet Port (lp-hea)
ent3             Available   Logical Host Ethernet Port (lp-hea)
ent4             Available   Virtual I/O Ethernet Adapter (l-lan)
ent5             Available   Virtual I/O Ethernet Adapter (l-lan)
ent6             Available   Virtual I/O Ethernet Adapter (l-lan)
ent7             Available   Virtual I/O Ethernet Adapter (l-lan)
ibmvmc0          Available   Virtual Management Channel

same results as above, just showing another command to get same result
$ lstcpip -adapters

Now create new virtual adapter that has all the vlan settings we need.
$ chhwres -r virtualio --rsubtype eth -o a --id 1 -s 10 -a port_vlan_id=172,ieee_virtual_eth=1,\"addl_vlan_ids=9,50\",is_trunk=1,trunk_priority=1
<makes ent8>
$ lshwres -r virtualio --rsubtype eth --level lpar
lpar_name=10-99999,lpar_id=1,slot_num=3,state=1,ieee_virtual_eth=0,port_vlan_id=1,addl_vlan_ids=none,is_trunk=1,trunk_priority=1,is_required=0,mac_addr=012345678903
lpar_name=10-99999,lpar_id=1,slot_num=4,state=1,ieee_virtual_eth=0,port_vlan_id=2,addl_vlan_ids=none,is_trunk=1,trunk_priority=1,is_required=0,mac_addr=012345678904
lpar_name=10-99999,lpar_id=1,slot_num=5,state=1,ieee_virtual_eth=0,port_vlan_id=3,addl_vlan_ids=none,is_trunk=1,trunk_priority=1,is_required=0,mac_addr=012345678905
lpar_name=10-99999,lpar_id=1,slot_num=6,state=1,ieee_virtual_eth=0,port_vlan_id=4,addl_vlan_ids=none,is_trunk=1,trunk_priority=1,is_required=0,mac_addr=012345678906
lpar_name=10-99999,lpar_id=1,slot_num=10,state=1,ieee_virtual_eth=1,port_vlan_id=172,"addl_vlan_ids=9,50",is_trunk=1,trunk_priority=1,is_required=0,mac_addr=01234567890A

$ mkvdev -lnagg ent0 -attr backup_adapter=ent2
<makes ent9>
$ mkvdev -lnagg ent1 -attr backup_adapter=ent3
<makes ent10>

$ mktcpip -hostname cmtivvios01 -inetaddr 172.16.2.4 -interface en10 -netmask 255.255.0.0 -gateway 172.16.1.1
now go into IVM GUI via web browser at 172.16.2.4 and set all LHEA adapters to "bridging" (i.e. promiscuous) via checkbox
for each adapter on HEA properties

now remove tcp/ip settings to do more CLI work first
$ rmtcpip -all

now make your SEA adapters
$ mkvdev -sea ent10 -vadapter ent8 -default ent8 -defaultid 172
<makes ent11>
$ mkvdev -sea ent9 -vadapter ent5 -default ent5 -defaultid 2
<makes ent12>

now setup tcp/ip again, note we use en11 this time which we just created which has vlan 172 as the default vlan
$ mktcpip -hostname cmtivvios01 -inetaddr 172.16.2.4 -interface en11 -netmask 255.255.0.0 -gateway 172.16.1.1

test tcp/ip connectivity by pinging gateway
$ ping 172.16.1.1

 

AIX Stuff

 

Using USB drives in AIX

Using USB flash drive in AIX 5.3.9

USB Flash Drive Information

Requires AIX 5.3 TL9

Supports USB 2.0 devices, but only capable of USB 1.1 speeds.   Write speeds are roughly .25 MB/s or 1 MB every 4 seconds.  Currently can not boot from flash drives (firmware support to be added at a later date) and you cannot use a flash drive in AIX for Volume Groups, Logical Volumes, JFS or JFS2 filesystems. You can, however, use it like a CDROM filesystem (CDRFS).

After insertion of flash drive into USB port, run

# cfgmgr -l usb0.

Device shows up in lsdev as flashdrive0.    This also creates device special files /dev/flashdrive0 and /dev/rflashdrive0.  Can be read/written with backup/restore, tar, cpio, dd.   Note: Destroys any previous Windows formatting if any existed (FAT32, NTFS, etc.)   Also, you will not be able read the contents of the flash drive on a Windows system once you have written to it from an AIX system.

Example using "tar":

# tar cvf /dev/flashdrive0 /tmp/myfile

Example using "cpio":

# find /tmp/myfile | cpio -ov > /dev/flashdrive0 (write)

# cpio -itv < /dev/flashdrive0 (view or list)

# cpio -iv < /dev/flashdrive0 (read or restore)

ISO file system (created by mkisofs) is written to flashdrive with dd command,

# dd if=myimage.iso of=/dev/flashdrive0

ISO file system can be mounted with

# mount -rv cdrfs /dev/flashdrive0 /mnt

 

Example iso file system creation and backup to USB drive:

# mkisofs -o /tmp/myimage.iso -J -R -U /myfs

# dd if=myimage.iso of=/dev/flashdrive0

# mount -rv cdrfs /dev/flashdrive0 /mnt

# ls -l /mnt (to view contents of /myfs)

 

Supported devices:

Lenovo 2GB Essential Memory Key

Kingston 4GB Data Traveller

SanDisk 4GB Cruzer

Warning: I had some issues using tar and the SanDisk 4GB. Cpio works better.

Configuring NTP time synchronization on AIX

The following information outlines the steps necessary to configure a basic NTP setup between an NTP client and server on AIX 5L.

On server

  1. Verify that you have a suitable NTP server. Enter:
# lssrc -ls xntpd

NOTE:Sys peer should show a valid server or 127.127.1.0.

If the server is "insane", you will need to correct it by adding a server line to /etc/ntp.conf and restarting xntpd. This can be done by following these steps:

# vi /etc/ntp.conf

Add:
server 127.127.1.0
Double check that "broadcast client" is commented out.

# stopsrc -s xntpd
# startsrc -s xntpd

NOTE: If the server runs databases, use the -x flag to prevent the clock from changing in a negative direction. Enter the following:

# startsrc -s xntpd -a "-x"
  1. Repeat Step 1 to verify that the server is synched. This process can take up to 12 minutes.

On client

  1. Verify that you have a server suitable for synchronization. Enter:
# ntpdate -d ip.address.of.server

The offset must be less than 1000 seconds for xntpd to synch. If the offset is greater than 1000 seconds, change the time manually on the client and run the ntpdate -d again.

If you get the message, "no server suitable for synchronization found", verify xntpd is running on the server (see above) and that no firewalls are blocking port 123.

  1. Specify your xntp server in /etc/ntp.conf, enter:
# vi /etc/ntp.conf

(Comment out the "broadcastclient" line and add server ip.address.of.server prefer.)

Leave the driftfile and tracefile at their defaults.

  1. Start the xntpd daemon:
# startsrc -s xntpd

(Use the -x flag if it is appropriate for your environment.)

  1. Uncomment xntpd from/etc/rc.tcpip so it will start on a reboot.
# vi /etc/rc.tcpip

Uncomment the following line:

start /usr/sbin/xntpd "$src_running"

If using the -x flag, add "-x" to the end of the line. You must include the quotes around the -x.

  1. Verify that the client is synched.
# lssrc -ls xntpd

NOTE: Sys peer should display the IP address or name of your xntp server. This process may take up to 12 minutes.

To delete all the devices allocated to an LPAR , i.e. reset all devices and start clean

To delete all devices to prepare for reboot and rediscovery

 # devreset

Answer “yes” and reboot the server immediately after with “shutdown -Fr” (if you dare!) or “no” if you lack confidence. 

(keywords for doc search: alt disk install config configuration reset clear devices )

To list all the PCI slots allocated to an LPAR

 # lsslot -c pci

 # lsslot -c pci -a

 

To dynamically reallocate an adapter

1.      Determine the PCI slot for the adapter using lsslot -c slot and get the "pciX' device name

2.      Remove the device from AIX using rmdev -l pciX -R (-R to remove all the child to parent)

3.      On HMC dynamically allocate the device to another

4.      On the destination box, run 'cfgmgr' to configure the allocated device

Mounting ISO images on AIX

Starting with AIX 6.1 TL 4, AIX offers a new command to directly mount an ISO file. The loopmount command will mount any ISO image directly into the filesystem without the need to copy it into a raw LV as before. The command requires a new fileset:

devices.loopback.rte 6.1.4.0.

When the fileset is installed, the loopmount command is able to perform the mount of any ISO file residing in your filesystem:

Example:

# loopmount -i POWERHA_Std_Edition_6_1.ISO -o "-o ro -v cdrfs" /mnt

Prior to the loopmount command, the only way of mounting ISO images on the AIX platform was to complete the following instructions:

 Obtain the size of the image.

For example:

 # ls -al

total 731594

drwxr-xr-x   2 root     system          512 Aug 18 11:33 .

drwxr-xr-x   6 root     system          512 Aug 18 11:32 ..

-rw-r--r--   1 root     system    374575104 Apr 29 02:59 fim_console_rios_aix_5.iso

 

Identify the nearest multiple of 128 MB that will provide enough space for the image.   In the above example, the image is approximately 374 MB, so use 384 MB as an image size.

 

Make a logical volume of this size.   Ensure that there is enough space on the physical volume. For example, hdisk0.

 

# mklv -y cdlv -s n -L /dev/cdlv rootvg 384M hdisk0

 

If the command fails, increase the volume size by a multiple of 128.

 

Use the dd command to create a pseudo-device.   Ensure that the partition has enough space for the pseudo-device.  

 

In the following example command, the pseudo-device is /dev/cdlv.

 

# dd if=/opt/software/iso/fim_console_rios_aix_5.iso of=/dev/cdlv

 

Note that this command may take a long time and will create two dd processes.

 

Mount the device like a CD-ROM in AIX.  Ensure that the mount point exists.

 

# mount -v cdrfs -o ro /dev/cdlv /mnt/iso

 

Change directory into /mnt/iso.

 

Alternate description for Mounting ISO images on AIX

 

How to mount a ISO image on AIX V5.3

The following instructions were cribbed from the Howto mount an ISO image in AIX UNIX http://www.ibm.com/developerworks/wikis/images/icons/linkext7.gif article. My thanks to Vivek Gite for posting it. Any errors in this article are, of course, notMr. Gite's responsibility. And Richard Brader published a very similar How to Mount an ISO File in AIX and Linux http://www.ibm.com/developerworks/wikis/images/icons/linkext7.gif article which I tripped across after I publshed this one.

1.     Create a logical volume which is large enough to hold the ISO image:

2.  p520-sr4:/ # /usr/sbin/mklv -y testiso -t jfs rootvg 1
3.  testiso
4.  p520-sr4:/ #

where:
testiso is the name of the logical volume,
rootvg is the name of the volume group in which the logical volume is to be created, and
1 is the size of the logical volume in logical partitions. 

 

 Use the command lsvg rootvg http://www.ibm.com/developerworks/wikis/images/icons/linkext7.gif to display (among many other things) the (logical and physical) partition size which will be used in rootvg. See here http://www.ibm.com/developerworks/wikis/images/icons/linkext7.gif for more information about the AIX V5.3 mklv command.

5.     Define a read-only JFS filesystem on the logical volume:

6.  p520-sr4:/ # /usr/sbin/crfs -v jfs -d testiso -m /testiso -An -pro -tn -a frag=4096 -a nbpi=4096 -a ag=8
7.  Based on the parameters chosen, the new /testiso JFS file system
8.  is limited to a maximum size of 134217728 (512 byte blocks)
9.   
10.New File System size is 65536
11.p520-sr4:/ #

where:
testiso is the name of the logical volume created in the first step and
/testiso is the mount point of the filesystem. 

 

 See here http://www.ibm.com/developerworks/wikis/images/icons/linkext7.gif for more information about the AIX V5.3 crfs command.

12.  Copy the contents of the ISO image to the logical volume:

13.p520-sr4:/ # /usr/bin/dd if=/tmp/bestprac.iso of=/dev/rtestiso bs=1m
14.0+1 records in.
15.0+1 records out.
16.p520-sr4:/ #

where:
testiso is the name of the logical volume created in the first step, prefixed with the character r and
/tmp/bestprac.tar is the ISO image file to be examined. 

 

 It may be necessary to use a block size (bs=1m) of less than a megabyte if the logical partition size is less than a megabyte. See here http://www.ibm.com/developerworks/wikis/images/icons/linkext7.gif for more information about the AIX V5.3 dd command.

17.  Change the filesystem type to cdrfs:

18.p520-sr4:/ # chfs -a vfs=cdrfs /testiso
19.p520-sr4:/ #

http://www.ibm.com/developerworks/wikis/images/icons/emoticons/information.gif

Note

It is possible to mount the filesystem by overriding the filesystem type http://www.ibm.com/developerworks/wikis/images/icons/linkext7.gif with mount -v cdrfs /testiso, but other problems occur when the time comes to remove the filesystem:

p520-sr4:/ # rmfs -ir /testiso
rmfs: Warning, all data contained on /testiso will be destroyed.
rmfs: Remove filesystem: /testiso? y(es) n(o)? y
rmfs:  0506-933  /dev/testiso is not recognized as a JFS filesystem.
rmfs:  0506-936  Cannot read superblock on /testiso.
rmfs: Unable to clear superblock on /testiso
rmlv: Logical volume testiso is removed.
p520-sr4:/ #

20.  Mount the filesystem:

21.p520-sr4:/ # /usr/sbin/mount /testiso
22.p520-sr4:/ #

The filesystem contains the files which are in the ISO image file /tmp/bestprac.tar:

p520-sr4:/ # cd /testiso
p520-sr4:/testiso # ls
bestprac.tar.gz
p520-sr4:/testiso #

23.  When the filesystem is no longer needed, unmount and remove it and then remove the testiso logical volume:

24.p520-sr4:/testiso # cd
25.p520-sr4:/ # /usr/sbin/umount /testiso
26.p520-sr4:/ # /usr/sbin/rmfs -ir /testiso
27.rmfs: Warning, all data contained on /testiso will be destroyed.
28.rmfs: Remove filesystem: /testiso? y(es) n(o)? y
29.p520-sr4:/ # /usr/sbin/rmlv testiso
30.Warning, all data contained on logical volume testiso will be destroyed.
31.rmlv: Do you wish to continue? y(es) n(o)? y
32.rmlv: Logical volume testiso is removed.
33.p520-sr4:/ #

where:
testiso is the name of the logical volume created in the first step and
/testiso is the mount point of the filesystem. 

http://www.ibm.com/developerworks/wikis/images/icons/emoticons/warning.gif Be very careful with rmfs. Like the UNIX rm command, rmfs without the -i flag does not prompt for confirmation. It immediately destroys the specified filesystem! 

 Notes:

  • The rmfs -r flag will cause the mount point directory to be removed only if the directory is empty.
  • The rmfs command will remove the underlying logical volume when removing a JFS or JFS2 filesystem http://www.ibm.com/developerworks/wikis/images/icons/linkext7.gif, but will not do so when removing a CDRFS filesystem http://www.ibm.com/developerworks/wikis/images/icons/linkext7.gif.

To Help speed up AIX filesystem mounts

The AIX mount command has a "noatime" option. This avoids the need to update access times on files and can give you a considerable performance boost if you have lots of files being accessed.

To mount Linux NFS shares (servers) on AIX systems (clients)

root@cmtecanim1 on pts/0[/]# nfso -o nfs_use_reserved_ports=1

Setting nfs_use_reserved_ports to 1

root@cmtecanim1 on pts/0[/]# mount cmtecsamba10:/share/cmtec /mnt/cmtec

<success!>

Mounting w/Filesys Logging Disabled

 

# mount –o log=NULL

 

DISABLES metadata logging.   Performance gains are very significant.    NOT a general purpose feature/option.

 

Working with Fibre Channel adapters and SAN storage

 

To make changes from AL (Arbitrated Loop, which is when you’re directly attached to the SAN Controller) to Pt2Pt (Point-to-Point, when you’re attached to a SAN switch), you must first remove all child devices of fcs0, fcs1, …. Etc.

 

# rmdev –dl fcnet0

# rmdev –dl fc0

# rmdev –dl fscsi0

# chdev –l fcs0 –a init_link=pt2pt

 

Or to set it back to Arbitrated Loop

# chdev –l fcs0 –a init_link=al

 

Introduction

As you know, AIX® has a vast array of commands that enable you to do a multitude of tasks. Depending on what you need to accomplish, you use only a certain subset of these commands. These subsets differ from user to user and from need to need. However, there are a few core commands that you commonly use. You need these commands either to answer your own questions or to provide answers to the queries of the support professionals.

In this article, I'll discuss some of these core commands. The intent is to provide a list that you can use as a ready reference. While the behavior of these commands should be identical in all releases of AIX, they have been only tested under AIX 5.3.

Note:
The bootinfo command discussed in the following paragraphs is NOT a user-level command and is NOT supported in AIX 4.2 or later.


Back to top

Commands

Kernel

How would I know if I am running a 32-bit kernel or 64-bit kernel?

To display if the kernel is 32-bit enabled or 64-bit enabled, type:

bootinfo -K

 

How do I know if I am running a uniprocessor kernel or a multiprocessor kernel?

/unix is a symbolic link to the booted kernel. To find out what kernel mode is running, enter ls -l /unix and see what file /unix it links to. The following are the three possible outputs from the ls -l /unix command and their corresponding kernels:

/unix -> /usr/lib/boot/unix_up              # 32 bit uniprocessor kernel 
/unix -> /usr/lib/boot/unix_mp              # 32 bit multiprocessor kernel
/unix -> /usr/lib/boot/unix_64              # 64 bit multiprocessor kernel       

 

Note:
AIX 5L Version 5.3 does not support a uniprocessor kernel.

How can I change from one kernel mode to another?

During the installation process, one of the kernels, appropriate for the AIX version and the hardware in operation, is enabled by default. Let us use the method from the previous question and assume the 32-bit kernel is enabled. Let us also assume that you want to boot it up in the 64-bit kernel mode. This can be done by executing the following commands in sequence:

ln -sf /usr/lib/boot/unix_64    /unix
ln -sf /usr/lib/boot/unix_64    /usr/lib/boot/unix
 
bosboot -ad  /dev/hdiskxx
shutdown -r

 

The /dev/hdiskxx directory is where the boot logical volume /dev/hd5 is located. To find out what xx is in hdiskxx, run the following command:

lslv -m hd5
 

 

Note:
In AIX 5.2, the 32-bit kernel is installed by default. In AIX 5.3, the 64-bit kernel is installed on 64-bit hardware and the 32-bit kernel is installed on 32-bit hardware by default.

Hardware

How would I know if my machine is capable of running AIX 5L Version 5.3?

AIX 5L Version 5.3 runs on all currently supported CHRP (Common Hardware Reference Platform)-based POWER hardware.

How would I know if my machine is CHRP-based?

Run the prtconf command. If it's a CHRP machine, the string chrp appears on the Model Architecture line.

How would I know if my System p machine (hardware) is 32-bit or 64-bit?

To display if the hardware is 32-bit or 64-bit, type:

bootinfo -y

 

How much real memory does my machine have?

To display real memory in kilobytes (KB), type one of the following:

bootinfo -r    

 

lsattr -El sys0 -a realmem 

 

How big are my disks, even fibre channel LUNs?

# bootinfo -s hdisk7

102400

This means you have a 100G LUN.

Can my machine run the 64-bit kernel?

64-bit hardware is required to run the 64-bit kernel.

What are the values of attributes for devices in my system?

To list the current values of the attributes for the tape device, rmt0, type:

lsattr -l rmt0 -E

 

To list the default values of the attributes for the tape device, rmt0, type:

lsattr -l rmt0 -D

 

To list the possible values of the login attribute for the TTY device, tty0, type:

lsattr -l tty0 -a login -R

 

To display system level attributes, type:

lsattr -E -l sys0

 

How many processors does my system have?

To display the number of processors on your system, type:

lscfg | grep proc

 

How many hard disks does my system have and which ones are in use?

To display the number of hard disks on your system, type:

lspv

 

How do I list information about a specific physical volume?

To find details about hdisk1, for example, run the following command:

lspv hdisk1          
                     

 

How do I get a detailed configuration of my system?

Type the following:

lscfg

 

The following options provide specific information:

-p

Displays platform-specific device information. The flag is applicable to AIX 4.2.1 or later.

-v

Displays the VPD (Vital Product Database) found in the customized VPD object class.

For example, to display details about the tape drive, rmt0, type:

lscfg -vl rmt0

 

You can obtain very similar information by running the prtconf command.

How do I find out the chip type, system name, node name, model number, and so forth?

The uname command provides details about your system.

uname -p

Displays the chip type of the system. For example, PowerPC.

uname -r

Displays the release number of the operating system.

uname -s

Displays the system name. For example, AIX.

uname -n

Displays the name of the node.

uname -a

Displays the system name, nodename, version, machine ID.

uname -M

Displays the system model name. For example, IBM, 9114-275.

uname -v

Displays the operating system version.

uname -m

Displays the machine ID number of the hardware running the system.

uname -u

Displays the system ID number.

AIX

What version, release, and maintenance level of AIX is running on my system?

Type one of the following:

oslevel -r

 

lslpp -h bos.rte

 

How can I determine which fileset updates are missing from a particular AIX level?

To determine which fileset updates are missing from 5300-04, for example, run the following command:

oslevel -rl 5300-04

 

What SP (Service Pack) is installed on my system?

To see which SP is currently installed on the system, run the oslevel -s command. Sample output for an AIX 5L Version 5.3 system, with TL4, and SP2 installed would be:

oslevel –s
5300-04-02
                     

 

Is a CSP (Concluding Service Pack) installed on my system?

To see if a CSP is currently installed on the system, run the oslevel -s command. Sample output for an AIX 5L Version 5.3 system, with TL3, and CSP installed would be:

oslevel –s
5300-03-CSP
                     

 

How do I create a file system?

The following command will create, within volume group testvg, a jfs file system of 10MB with mounting point /fs1:

crfs -v jfs -g testvg -a size=10M -m /fs1 
                     

 

The following command will create, within volume group testvg, a jfs2 file system of 10MB with mounting point /fs2 and having read only permissions:

crfs -v jfs2 -g testvg -a size=10M -p ro -m /fs2    
                     

 

How do I change the size of a file system?

To increase the /usr file system size by 1000000 512-byte blocks, type:

chfs -a size=+1000000 /usr

 

Note:
In AIX 5.3, the size of a JFS2 file system can be shrunk as well.

How do I mount a CD?

Type the following:

mount -V cdrfs -o ro /dev/cd0  /cdrom

 

How do I mount a file system?

The following command will mount file system /dev/fslv02 on the /test directory:

mount /dev/fslv02 /test 

 

How do I mount all default file systems (all standard file systems in the /etc/filesystems file marked by the mount=true attribute)?

The following command will mount all such file systems:

mount {-a|all}

 

How do I unmount a file system?

Type the following command to unmount /test file system:

umount /test

 

How do I display mounted file systems?

Type the following command to display information about all currently mounted file systems:

mount

 

How do I remove a file system?

Type the following command to remove the /test file system:

rmfs /test

 

How can I defragment a file system?

The defragfs command can be used to improve or report the status of contiguous space within a file system. For example, to defragment the file system /home, use the following command:

defragfs /home

 

Which fileset contains a particular binary?

To show bos.acct contains /usr/bin/vmstat, type:

lslpp -w /usr/bin/vmstat

 

Or to show bos.perf.tools contains /usr/bin/svmon, type:

which_fileset svmon

 

How do I display information about installed filesets on my system?

Type the following:

lslpp -l                     
                     

 

How do I determine if all filesets of maintenance levels are installed on my system?

Type the following:

instfix -i | grep ML

 

How do I determine if a fix is installed on my system?

To determine if IY24043 is installed, type:

instfix -ik IY24043

 

How do I install an individual fix by APAR?

To install APAR IY73748 from /dev/cd0, for example, enter the command:

instfix -k IY73748 -d /dev/cd0                      
                     

 

How do I verify if filesets have required prerequisites and are completely installed?

To show which filesets need to be installed or corrected, type:

lppchk -v

 

How do I get a dump of the header of the loader section and the symbol entries in symbolic representation?

Type the following:

dump -Htv

 

How do I determine the amount of paging space allocated and in use?

Type the following:

lsps -a

 

How do I increase a paging space?

You can use the chps -s command to dynamically increase the size of a paging space. For example, if you want to increase the size of hd6 with 3 logical partitions, you issue the following command:

chps -s 3 hd6                
                     

 

How do I reduce a paging space?

You can use the chps -d command to dynamically reduce the size of a paging space. For example, if you want to decrease the size of hd6 with four logical partitions, you issue the following command:

chps -d 4 hd6                
                     

 

How would I know if my system is capable of using Simultaneous Multi-threading (SMT)?

Your system is capable of SMT if it's a POWER5-based system running AIX 5L Version 5.3.

How would I know if SMT is enabled for my system?

If you run the smtctl command without any options, it tells you if it's enabled or not.

Is SMT supported for the 32-bit kernel?

Yes, SMT is supported for both 32-bit and 64-bit kernel.

How do I enable or disable SMT?

You can enable or disable SMT by running the smtctl command. The following is the syntax:

smtctl [ -m off | on [ -w boot | now]]

 

The following options are available:

-m off

Sets SMT mode to disabled.

-m on

Sets SMT mode to enabled.

-w boot

Makes the SMT mode change effective on next and subsequent reboots if you run the bosboot command before the next system reboot.

-w now

Makes the SMT mode change immediately but will not persist across reboot.

If neither the -w boot or the -w now options are specified, then the mode change is made immediately. It persists across subsequent reboots if you run the bosboot command before the next system reboot.

How do I get partition-specific information and statistics?

The lparstat command provides a report of partition information and utilization statistics. This command also provides a display of Hypervisor information.

Volume groups and logical volumes

How do I know if my volume group is normal, big, or scalable?

Run the lsvg command on the volume group and look at the value for MAX PVs. The value is 32 for normal, 128 for big, and 1024 for scalable volume group.

How to create a volume group?

Use the following command, where spartition_size sets the number of megabytes (MB) in each physical partition where the partition_size is expressed in units of MB from 1 through 1024. (It's 1 through 131072 for AIX 5.3.) The partition_size variable must be equal to a power of 2 (for example: 1, 2, 4, 8). The default value for standard and big volume groups is the lowest value to remain within the limitation of 1016 physical partitions per physical volume. The default value for scalable volume groups is the lowest value to accommodate 2040 physical partitions per physical volume.

mkvg -y name_of_volume_group -s partition_size list_of_hard_disks

 

How can I change the characteristics of a volume group?

You use the following command to change the characteristics of a volume group:

chvg

 

How do I create a logical volume?

Type the following:

mklv -y name_of_logical_volume name_of_volume_group number_of_partition

 

How do I increase the size of a logical volume?

To increase the size of the logical volume represented by the lv05 directory by three logical partitions, for example, type:

extendlv lv05 3
                     

 

How do I display all logical volumes that are part of a volume group (for example, rootvg)?

You can display all logical volumes that are part of rootvg by typing the following command:

lsvg -l rootvg

 

How do I list information about logical volumes?

Run the following command to display information about the logical volume lv1:

lslv lv1

 

How do I remove a logical volume?

You can remove the logical volume lv7 by running the following command:

rmlv lv7

 

The rmlv command removes only the logical volume, but does not remove other entities, such as file systems or paging spaces that were using the logical volume.

How do I mirror a logical volume?

  1. mklvcopy LogicalVolumeName Numberofcopies
  2. syncvg VolumeGroupName

How do I remove a copy of a logical volume?

You can use the rmlvcopy command to remove copies of logical partitions of a logical volume. To reduce the number of copies of each logical partition belonging to logical volume testlv, enter:

rmlvcopy testlv 2

 

Each logical partition in the logical volume now has at most two physical partitions.

Queries about volume groups

To show volume groups in the system, type:

lsvg

 

To show all the characteristics of rootvg, type:

lsvg rootvg

 

To show disks used by rootvg, type:

lsvg -p rootvg

 

How to add a disk to a volume group?

Type the following:

extendvg   VolumeGroupName   hdisk0 hdisk1 ... hdiskn 

 

How do I find out what the maximum supported logical track group (LTG) size of my hard disk?

You can use the lquerypv command with the -M flag. The output gives the LTG size in KB. For instance, the LTG size for hdisk0 in the following example is 256 KB.

/usr/sbin/lquerypv -M hdisk0
256

 

You can also run the lspv command on the hard disk and look at the value for MAX REQUEST.

What does syncvg command do?

The syncvg command is used to synchronize stale physical partitions. It accepts names of logical volumes, physical volumes, or volume groups as parameters.

For example, to synchronize the physical partitions located on physical volumes hdisk6 and hdisk7, use:

syncvg -p hdisk4 hdisk5                     
                     

 

To synchronize all physical partitions from volume group testvg, use:

syncvg -v testvg                    
                     

 

How do I replace a disk?

  1. extendvg VolumeGroupName hdisk_new
  2. migratepv hdisk_bad hdisk_new
  3. reducevg -d VolumeGroupName hdisk_bad

How can I clone (make a copy of ) the rootvg?

You can run the alt_disk_copy command to copy the current rootvg to an alternate disk. The following example shows how to clone the rootvg to hdisk1.

alt_disk_copy -d  hdisk1

 

Network

How can I display or set values for network parameters?

The no command sets or displays current or next boot values for network tuning parameters.

How do I get the IP address of my machine?

Type one of the following:

ifconfig -a
 
host Fully_Qualified_Host_Name

 

For example, type host cyclop.austin.ibm.com.

How do I identify the network interfaces on my server?

Either of the following two commands will display the network interfaces:

lsdev -Cc if

 

ifconfig -a

 

To get information about one specific network interface, for example, tr0, run the command:

ifconfig tr0

 

How do I activate a network interface?

To activate the network interface tr0, run the command:

ifconfig tr0 up

 

How do I deactivate a network interface?

For example, to deactivate the network interface tr0, run the command:

ifconfig tr0 down

 

Working with AIO in AIX

Notes on installing, verifying installation of, and setting up AIO (Asynchronous I/O) in AIX.

The first thing to check is the necessary fileset. This is part of the base install, so it should be there:

To make use of AIO the following fileset must be installed:

 bos.rte.aio

To determine if this fileset is installed, enter:

#  lslpp -l bos.rte.aio

 

Presuming the fileset is installed, the notes I have say to do the following to configure AIO:

Enable asynchronous IO

Execute the following commands to enable asynchronous I/O:

chdev -l aio0 -P -a autoconfig='available'

mkdev -l aio0

lsdev -F status -t aio

 

lsdev -F status -t aio must return the following:

Available

 

On the SMIT side, I think it's "# smit aio".

In your note, you have "#smit aio0" (w/ the trailing zero).

 

You can tell how many AIO servers you have running using:

To determine how many POSIX AIO Servers are currently running, type the following information on the command line:

# pstat -a | grep posix_aioserver | wc -l

To determine how many LEGACY AIO Servers are currently running, type the following information on the

command line:

# pstat -a | egrep ' aioserver' | wc -l

 

You can then monitor AIO (for example) using

# iostat -A 1 5

The following list is a description of parameters used to monitor the AIO subsystem.

 

    * avfc: This reports back the average fastpath request count per second for your interval.

    * avgc: This reports back the average global asynchronous I/O request per second of the interval you specified.

    * maxgc: This reports back the max global asynchronous I/O request since the last time this value was fetched.

    * maxfc: This reports back the maximum fastpath request count since the last time this value was fetched.

    * maxreqs: This is the maximum asynchronous I/O requests allowed.

 

NIM Server Stuff

0042-008 NIMState: Request Denied

y0042-008 NIMState: Request denied method_req - These messages appear during client install when the cpuid (uname -m) of the client machine does not match the cpuid that the nim master "remembers" for this client. "lsnim -l machine | grep cpuid" on the nim master will show what uname the master retains for this client. You can change the uname value on the nim master to match the new client machine, "nim -o change -a cpuid=<newvalue> client"

 

Debugging NIM network connections

1.      On the NIM server, change bootpd's arguments to "-d -d -d" on /etc/inetd.conf. So you go from this default entry

bootps  dgram   udp        wait       root       /usr/sbin/bootpd            bootpd /etc/bootptab

to this entry

bootps  dgram   udp        wait       root       /usr/sbin/bootpd –d –d –d         bootpd /etc/bootptab

2.      # refresh -s inetd

3.      in /etc/syslog.conf add "*.info /dev/console"

4.      # refresh -s syslogd

5.      # swcons `tty`

6.      check for the bootptab messages

7.      check MAC addresses.

To put things back the way they were, or to “normal”

1.      # swcons

2.      Put entry in /etc/inetd.conf back to default

3.      Put /etc/syslog.conf back to default

 

VIO Server Stuff

Working with Virtual Optical

using virtual optical drives in VIOS (IBM virtual I/O server), also known as: using an iso-file as virtual cd-rom for your LPAR

 

This requires at least VIOS 1.5.

 

1.      first, create a logical volume in which you want the iso-files to be stored:

a.      mkrep -sp rootvg -size 20G

b.      instead of rootvg you can also use a different volume group

2.      the created logical volume is mounted under /var/vio/VMLibrary

a.       copy your iso-files to this location or use
 # mkvopt -name filename.iso -dev cd0 -ro
to copy the contents of what is in your cd-drive to filename.iso

3.      create a virtual optical drive connected to virtual scsi adapter vhost4 (the virtual scsi host for the LPAR to which you want to connect the new virtual optical drive):
# mkvdev -fbo -vadapter vhost4
which will give: "vtopt0 Available"

4.      connect an iso-file to your virtual optical drive (for example the 'vtopt0' you created with the mkvdev command in the previous step)
# loadopt -vtd vtopt0 -disk filename.iso

5.      disconnect the iso-file (as if you were unloading a cd from the drive):
# unloadopt -vtd vtopt0

How to install AIX from a Virtual Optical Device

1. Introduction

IOS version 1.5 introduced virtual optical drives. This small article shows how to make use of this feature when installing an LPAR. This might be handy if you want to upgrade a NIM server without the need to spend a day in the datacenter or when there is no CD drive available to assign to an LPAR.

2. Getting the ISO Image

Before we can start creating our virtual optical device we need an ISO image.

Sometimes ISO images can be found on the web - in this case you can simply download the image and copy it to some space on your VIO server. But we want to install from an AIX installation DVD - the AIX 6.1 installation ISO of course cannot be found on the web - so we have to create an ISO image from our physical AIX installation CD or DVD.

There are multiple ways to create ISO images. The easiest way to create an ISO image from the AIX Installation CD or DVD is to insert it in the DVD drive of a Linux box and just dump the CD/DVD to a file:

 linux# cat /dev/cdrom > aix61inst.iso

This creates a file that can be used for the virtual optical device on the VIO server. The below examples assume that this is copied to /tmp on the VIO server.

 

3. Creating a DVD Repository

With the command lsrep we check if there is already a repository on our VIO server:

 padmin$ lsrep
 The DVD repository has not been created yet.
 

As we see, this is not the case. Let's check available storage pools then:

 padmin$ lssp
 Pool              Size(mb)   Free(mb)  Alloc Size(mb)    BDs Type
 rootvg              139776      86016             128      0 LVPOOL

The above output shows about 85 GB free space in the default storage pool - that should be sufficient. So we can go on creating a repository. The below command creates a repository of 8GB - enough for two DVDs:

 padmin$ mkrep -sp rootvg -size 8G
 Virtual Media Repository Created
 Repository created within "VMLibrary_LV" logical volume
 padmin$ lsrep
 Size(mb) Free(mb) Parent Pool         Parent Size      Parent Free
     8158     8158 rootvg                   139776            77824

 

4. Creating the Virtual Optical Device

Now we are ready to load our AIX 6.1 ISO image into the repository:

 padmin$ mkvopt -name aix_61 -file /tmp/aix61inst.iso

We check with lsrep:

 padmin$ lsrep
 Size(mb) Free(mb) Parent Pool         Parent Size      Parent Free
     8159      951 rootvg                   139776            77824
 
 Name                                    File Size Optical         Access
 aix_61                                       3679 None            rw

At this point we don't need the original ISO image in /tmp anymore...

 padmin$ rm -f /tmp/aix61inst.iso

To use the AIX CD for installing an LPAR we need to connect a virtual optical device to the virtual SCSI hostadapter (vhost3 here) of the LPAR:

 padmin$ mkvdev -fbo -vadapter vhost3
 vtopt0 Available

Now we are ready to load the AIX 6.1 DVD into the virtual drive ...

 padmin$ loadopt -disk aix_61 -vtd vtopt0

Checking ...

 padmin$ lsmap -vadapter vhost3
 
 SVSA            Physloc                                      Client Partition ID
 --------------- -------------------------------------------- ------------------
 vhost3          U9117.MMA.F54DD01-V3-C103                    0x00000000
 
 VTD                   vtopt0
 Status                Available
 LUN                   0x8300000000000000
 Backing device        /var/vio/VMLibrary/aix_61
 Physloc
 
 VTD                   vtscsi4
 Status                Available
 LUN                   0x8100000000000000
 Backing device        hdisk8
 Physloc               U7314.G30.110FFBA-P1-C2-T1-L59
 
 VTD                   vtscsi5
 Status                Available
 LUN                   0x8200000000000000
 Backing device        hdisk9
 Physloc               U7314.G30.110FFBA-P1-C2-T1-L60

 

5. Installing an LPAR from the Virtual DVD

Starting up the LPAR and entering the SMS menu we see our virtual device as a regular SCSI CD-ROM:

 
 Version EM320_076
 SMS 1.7   Copyright IBM Corp. 2000,2008 All rights reserved.
-------------------------------------------------------------------------------
 Select Device
 Device  Current  Device
 Number  Position  Name
 1.        3      Interpartition Logical LAN
                  ( loc=U9117.MMA.F54DD01-V13-C20-T1 )
 2.        -      Interpartition Logical LAN
                  ( loc=U9117.MMA.F54DD01-V13-C25-T1 )
 3.        -      Interpartition Logical LAN
                  ( loc=U9117.MMA.F54DD01-V13-C30-T1 )
 4.        -      Interpartition Logical LAN
                  ( loc=U9117.MMA.F54DD01-V13-C35-T1 )
 5.        -      SCSI CD-ROM
                  ( loc=U9117.MMA.F54DD01-V13-C103-T1-W8300000000000000-L0 )
 
 
 -------------------------------------------------------------------------------
 Navigation keys:
 M = return to Main Menu
 ESC key = return to previous screen         X = eXit System Management Services
 -------------------------------------------------------------------------------

We select the SCSI CD-ROM and start up the installation as usual.

 

6. Cleaning up

After AIX is installed we can unload the AIX DVD from the virtual drive:

 padmin$ unloadopt -release -vtd vtopt0

 

To see attributes of SEA adapter

$ lsdev –dev ent0 -attr

 

To make VIO Server and then VIO clients

1.      Define VIOS LPAR with enough virtual Ethernet and virtual SCSI adapters for disks, cdrom, etc.

2.      Install VIO server

3.      Setup SEA adapters

4.      Install OpenSSL and OpenSSH

5.      Configure TCP/IP on the SEA adapter(s)

6.      Create LV for VIO client

a.       # mklv –lv vioc1_rootvg

 

To make SEA adapters with failover

Create SEA on VIO server 1 with failover attribute:

$ mkvdev -sea ent0 -vadapter ent2 -default ent2 -defaultid 1 -attr ha_mode=auto ctl_chan=ent3

(OPTIONAL) Assign an ip address to SEA on VIOS1:

$ mktcpip -hostname vio1 -interface en4 -inetaddr 9.3.5.136 -netmask 255.255.255.0 -gateway 9.3.5.41 -nsrvaddr 9.3.4.2 -nsrvdomain itsc.austin.ibm.com -start

To make and remove physical or logical backing device virtual devices

To make the device mapping

# mkvdev -vdev hdisk8 -vadapter vhost5

 

To remove a

# rmdev -dev vhost5 -recursive

tsmdb_vg deleted

tsmdisk1_vg deleted

tsmdisk2_vg deleted

vhost5 deleted

 

To remove a backing device mapping from a vhost adapter

# rmvdev  -vdev hdisk8

 

Then remove the device altogether

# rmdev  -pdev hdisk8

 

Working with virtual media in VIOS

$ lsvopt

To load a new image to the virtual DVD drive, using the –f to basically say “remove the existing one anyway, if any, and load this new image”

$ loadopt -f -disk aix530009011 -vtd vtopt0

$ rmopt -vtd vtopt0

 

Manually Creating VIOS NIM Resources

From Wikistix

After having many problems attempting to use installios, the following steps were used to build the necessary NIM resources to allow the installation of IBM's Virtual I/O Server:

 

First, define shell variables pointing to the mounted CD or copied CD contents, and the destination for the NIM objects:

# SRC=/junk/vios-1.2-cd

# DST=/csminstall/eznim/vios-1.2

 

Define NIM client. Substitute appropriate client name, ethernet hardware address, interface name, cable type, subnet mask, client gateway and speed/duplex:

# nim -o define -t standalone -a if1="find_net CLIENTNAME 000a0b0c0d0e ent1" \

> -a cable_type1=N/A \

> -a netboot_kernel=mp -a net_definition="ent 255.255.255.0 192.168.0.1" \

> -a net_settings1="100 half" CLIENTNAME

 

Define NIM mksysb:

# mkdir ${DST}/mksysb

# cp ${SRC}/nimol/ioserver_res/mksysb ${DST}/mksysb/installios_mksysb

# nim -o define -t mksysb -a server=master -a location=${DST}/mksysb/installios_mksysb \

> installios_mksysb

 

Define NIM bundle:

# mkdir ${DST}/bundle

# cp ${SRC}/installp/ppc/en_US.bnd ${DST}/bundle

# nim -o define -t installp_bundle -a server=master -a location=${DST}/bundle/en_US.bnd \

> installios_bundle

 

Define NIM lppsource:

# mkdir ${DST}/lpp_source

# gencopy -X -d ${SRC}/installp/ppc -t ${DST}/lpp_source/installios_lpp_source \

> $(/usr/bin/cat ${DST}/bundle/en_US.bnd)

# nim -o define -t lpp_source -a server=master \

> -a location=${DST}/lpp_source/installios_lpp_source \

> -a source=${DST}/lpp_source/installios_lpp_source installios_lpp_source

Preparing to copy install images (this will take several minutes)...

 

0503-114 gencopy: RPM Product cdrecord* does not exist.

0503-114 gencopy: RPM Product mkisofs* does not exist.

 

Now checking for missing install images...

warning: 0042-265 c_mk_lpp_source: The image source "/csminstall/eznim/vios-1.2/lpp_source/installios_lpp_source"

        that was used to define the lpp_source is missing one or more

        of the following from the list of default packages:

                bos.64bit

                bos

                bos.acct

...

warning: 0042-267 c_mk_lpp_source: The defined lpp_source does not have the

        "simages" attribute because one or more of the following

        packages are missing:

                bos

                bos.net

                bos.diag

...

 

Define NIM VIOS SPOT resource:

# mkdir ${DST}/spot

# nim -o define -t spot -a location=${DST}/spot -a server=master \

> -a source=installios_mksysb installios_spot

 

 Creating SPOT in "/csminstall/eznim/vios-1.2/spot" on machine "master" from "installios_mksysb" ...

 

 Restoring files from BOS image.  This may take several minutes ...

 

 

 Checking filesets and network boot images for SPOT "installios_spot".

 This may take several minutes ...

 

Define NIM bosinst:

# cp ${SRC}/nimol/ioserver_res/bosinst.data ${DST}/installios_bosinst.data

# nim -o define -t bosinst_data -a server=master -a location=${DST}/installios_bosinst.data \

> installios_bosinst

 

Configure NIM ready for client install:

# nim -o bos_inst -a source=mksysb -a spot=installios_spot -a mksysb=installios_mksysb \

> -a bosinst_data=installios_bosinst -a boot_client=no CLIENTNAME

warning: 0042-360 m_bos_inst: The SPOT level is older than the mksysb level. Therefore,

        the BOS installation may encounter problems.

        Update the SPOT to match the mksysb level or create a

        new SPOT that has the same level.

 

Now, the LPAR may be net booted via any method (eg. SMS via HMC).

 

Working with network devices

$ mkvdev -sea ent2 -vadapter ent4 -default ent4 -defaultid 1

ent12 available

et12

en12

$ mkvdev -sea ent3 -vadapter ent5 -default ent5 -defaultid 1

 

$ rmtcpip -interface en3

Working with MPIO in VIOS and Vio Clients

fscsi devices on VIOS

· dyntrk=yes

· fc_err_recov=fast_fail

 

hdisk devices on VIOS

· algorithm=load_balance

· reserve_policy=no_reserve

· hcheck_mode=nonactive

· hcheck_interval=20

 

vscsi devices in client

· vscsi_path_to=30

 

hdisk devices in client

· algorithm=failover

· reserve_policy=no_reserve

· hcheck_mode=nonactive

· hcheck_interval=20

 

 

On VIOS

$ chdev -dev fscsi0 -attr fc_err_recov=fast_fail dyntrk=yes -perm

fscsi0 changed

$ chdev -dev hdisk9 -attr reserve_policy=no_reserve

hdisk9 changed

$ chdev -dev hdisk9 -attr algorithm=round_robin

hdisk9 changed

$ chdev -dev hdisk9 -attr hcheck_interval=20

hdisk9 changed

$ chdev –dev hdisk9 –attr hcheck_mode=nonactive

hdisk9 changed

 

or in a couple lines

 

chdev -dev fscsi0 -attr fc_err_recov=fast_fail dyntrk=yes -perm

chdev -dev fscsi1 -attr fc_err_recov=fast_fail dyntrk=yes -perm

 

chdev -dev hdisk5 -attr reserve_policy=no_reserve algorithm=round_robin hcheck_interval=20 hcheck_mode=nonactive

chdev -dev hdisk6 -attr reserve_policy=no_reserve algorithm=round_robin hcheck_interval=20 hcheck_mode=nonactive

 

 

$ lsdev -dev hdisk9 -attr

attribute       value                           description

user_settable

 

PCM             PCM/friend/scsiscsd            Path Control Module             False

algorithm       round_robin                     Algorithm                       True

dist_err_pcnt   0                               Distributed Error Percentage      True

dist_tw_width   50                              Distributed Error Sample Time      True

hcheck_interval 0                               Health Check Interval           True

hcheck_mode     nonactive                       Health Check Mode               True

max_transfer    0x40000                         Maximum TRANSFER Size           True

pvid            0021768a0151feb40000000000000000 Physical volume identifier          False

queue_depth     3                               Queue DEPTH False

reserve_policy no_reserve                      Reserve Policy True

size_in_mb 18200 Size in Megabytes False

 

 

On VIO Client

 $ chdev -l hdisk0 -a hcheck_interval=20 -a hcheck_mode=nonactive -P

 

to only look for SCSI devices on channel scsi0

# cfgmgr -l scsi0

To only look for devices on fibre channel SCSI 0

# cfgmgr -l fcs0

IVE, HEA, LHEA and VIOS

Using LHEA devices on VIOS

To use the HEA or IVE Ethernet adapters built into all modern Power6 and Power7 systems for the VIOS SEA port(s), do the following.

1.    Create your VIOS LPAR, but don’t worry about LHEA yet.

2.    After creating theVIOS LPAR, set the server attributes for the HEA/LHEA to have the ports as promiscuous and assign it to the VIOS LPAR.  This dedicates the port to that LPAR.  You can’t assign other LHEA ports based on that physical port to any other LPARs. If you have 2 or 4 LHEA ports you want to assign to the VIOS to do link aggregration, then do this same setting on all LHEA ports.

3.    Now go back to VIOS and create a single virtual Ethernet adapter in slot 11.  Set it to the following:

a.    Adapter ID = 11

b.    VLAN ID = 1

c.    It’s of debate whether to set this adapter to required, so I leave it up to you.  If you make it required you can’t remove it dynamically using DLPAR.

d.    Set IEEE 802.1q compatible adapter = CHECK, and add all the VLANs you know you want like 1, 16,17,18, 262, 99, 999, 399, etc., whatever.  But you can only have 20 total VLANs here, so use them sparingly.

e.    Set “Access external network” = CHECK

4.    Assume you have the following Ethernet adapters showing up in your VIOS with 2 LHEA ports assigned.

$ lsdev | grep ent

ent0     Available        Logical Host Ethernet Port (lp-hea)

ent1     Available        Logical Host Ethernet Port (lp-hea)

ent2     Available        Virtual I/O Ethernet Adapter (l-lan)

5.    On VIOS, run this command to create the link aggregated (etherchanneled, trunked, bonded) Ethernet adapter

$ mkvdev –lnagg ent0 ent1                   (or “mkvdev –lnagg ent0 ent1 ent2 ent3”  if you have 4 ports)

This will make a new Ethernet adapter and interfaces like ent3.

6.    Now create the shared Ethernet adapter (SEA) on the VIOS

$ mkvdev –sea ent3 –vadapter ent2 –default ent2 –defaultid 1

This will make a new Ethernet adapter and interfaces like ent4.

7.    You can list your Ethernet adapters again and should see this:

$ lsdev | grep ent

ent0     Available        Logical Host Ethernet Port (lp-hea)

ent1     Available        Logical Host Ethernet Port (lp-hea)

ent2     Available        Virtual I/O Ethernet Adapter (l-lan)

ent3     Available        EtherChannel / IEEE 802.3ad Link Aggregation

ent4     Available        Shared Ethernet Adapter

8.    Now you must create a new adapter for each VLAN the VIOS is going to have an actual IP address assigned on itself. Use this command:

$ mkvdev –vlan ent4 –tagid 16

ent5 Available

en5

et5

$ mkvdev –vlan ent4 –tagid 262

ent6 Available

en6

et6

9.    You can list your Ethernet adapters again and should see this:

$ lsdev | grep ent

ent0     Available        Logical Host Ethernet Port (lp-hea)

ent1     Available        Logical Host Ethernet Port (lp-hea)

ent2     Available        EtherChannel / IEEE 802.3ad Link Aggregation

ent3     Available        Shared Ethernet Adapter

ent4     Available        Virtual I/O Ethernet Adapter (l-lan)

ent5     Available        VLAN

ent6     Available        VLAN

10.Now you can assign IP addresses.

$ mktcpip –hostname cmtecvios9 –inetaddr 10.75.16.234 –interface en5 –netmask 255.255.255.0 –gateway 10.75.16.1

For the other network interfaces I find it easier to go into the “oem_setup_env” to get root, then do “smitty tcpip” and go to further configuration to set the IP address on the subsequent interfaces.  The reason for this is that the mktcpip command as the padmin account *REQUIRES* you to put the hostname, and so every time you set an IP address it wants to set the hostname.

 

 

HMC Stuff

HMC networking

In p59x servers, each HMC port is connected to an internal Ethernet hub, which is in turn connected to Flexible Service Processors and Bulk Power Controllers http://www.ibm.com/developerworks/wikis/images/icons/linkext7.gif within the p59x. Because each FSP and BPC connected to the hub has its own MAC address, implementing Port Security http://www.ibm.com/developerworks/wikis/images/icons/linkext7.gif will cause problems. Do not implement Port Security http://www.ibm.com/developerworks/wikis/images/icons/linkext7.gif on switch ports to which p59x HMC ports are connected. There are likely other Ethernet switch security measures that will also cause problems if they are enabled on switch ports connected to HMC ports on p59x servers.

 

Configuring a switch port for 100 Mbps full duplex can create a duplex mismatch, according to Cisco's Troubleshooting Cisco Catalyst Switches to NIC Compatibility Issues http://www.ibm.com/developerworks/wikis/images/icons/linkext7.gif web page. As noted on the web page, "A duplex mismatch may result in performance issues, intermittent connectivity, and loss of communication." Since there is no way to configure an FSP for anything other than autonegotiate, Ethernet switch ports used for FSPs (and used for an HMC, if the HMC's network interface is configured for autonegotiate) must be configured for autonegotiate to avoid a duplex mismatch.

 

http://www.ibm.com/developerworks/wikis/images/icons/emoticons/check.gifHint: Issue the command lsrsrc IBM.ManagementServer on an AIX LPAR to determine which HMC(s) are managing DLPAR http://www.ibm.com/developerworks/wikis/images/icons/linkext7.gif operations for that LPAR.

 

If SCAN_ERROR_CHRP errors are found in AIX errpt http://www.ibm.com/developerworks/wikis/images/icons/linkext7.gif and the entries refer to Maintainence Procedure FSPSP33 ("A problem has been detected in the connection with the HMC") http://www.ibm.com/developerworks/wikis/images/icons/linkext7.gif, a prime suspect is the duplex mismatch issue described above.

 

To list All the managed systems attached to the HMC and some information about them

 

 $ lssyscfg -r sys

 name=Server-9119-595-SN02898EB,type_model=9119-595,serial_num=02898EB,ipaddr=10.128.253

 ndary=10.128.255.252,state=Operating,sys_time=10/13/2006 20:15:55,power_off_policy=1,co

 cod_proc_capable=1,hca_capable=1,huge_page_mem_capable=unavailable,micro_lpar_capable=1

 ,5250_application_capable=0,redundant_err_path_reporting_capable=1,shared_eth_failover

 g_passing_capable=1,sp_failover_capable=1,vet_activation_capable=1,virtual_io_server_c

 250_cpw_percent=0,max_lpars=254,max_power_ctrl_lpars=1,service_lpar_id=3,service_lpar_n

 ...............................

 ...............................

 ,pend_mfg_default_boot_mode=norm,sp_failover_enabled=1,sp_failover_state=Ready

To list only name, Serial number, IP address and state alone,

 

 $ lssyscfg -r sys -F name,type_model,serial_num,ipaddr,state --header

 name,type_model,serial_num,ipaddr,state

 Server-9119-595-SN02898EB,9119-595,02898EB,10.128.253.255,Operating

 Server-9119-595-SN02898BB,9119-595,02898BB,10.128.255.250,Operating

To list all the Lpar in the managed system

 $ lssyscfg -r lpar -m Server-9119-595-SN02898EB

lssyscfg -r lpar -m Server-9119-595-SN02898EB

name=eraprci0,lpar_id=8,lpar_env=aixlinux,state=Running,resource_config=1,os_version=0.

0.0.0.0.0,logical_serial_num=02898EB8,default_profile=eraprci0,curr_profile=eraprci0,

work_group_id=none,shared_proc_pool_util_auth=0,power_ctrl_lpar_ids=none,boot_mode=norm,

lpar_keylock=norm,auto_start=0,redundant_err_path_reporting=0

 

name=eraptci0,lpar_id=7,lpar_env=aixlinux,state=Running,resource_config=1,os_version=0.

0.0.0.0.0,logical_serial_num=02898EB7,default_profile=eraptci0,curr_profile=eraptci0,

work_group_id=none,shared_proc_pool_util_auth=0,power_ctrl_lpar_ids=none,boot_mode=norm,

lpar_keylock=norm,auto_start=0,redundant_err_path_reporting=0

 

name=erep2ci0,lpar_id=6,lpar_env=aixlinux,state=Running,resource_config=1,os_version=0.

0.0.0.0.0,logical_serial_num=02898EB6,default_profile=erep2ci0,curr_profile=erep2ci0,

work_group_id=none,shared_proc_pool_util_auth=0,power_ctrl_lpar_ids=none,boot_mode=norm,

lpar_keylock=norm,auto_start=0,redundant_err_path_reporting=0

 

For nicer output, look at this:

==================================================================================================

Before:

==================================================================================================

hscroot@CIBERHMC1:~> lshwres -m Server-9117-570-SN10B6E3E -r proc --level lpar

lpar_name=Ceridian,lpar_id=3,curr_proc_mode=ded,curr_min_procs=1,curr_procs=2,curr_max_procs=2,curr_sharing_mode=share_idle_procs,pend_proc_mode=ded,pend_min_procs=1,pend_procs=2,pend_max_procs=2,pend_sharing_mode=share_idle_procs,run_procs=2

lpar_name=Lawson,lpar_id=2,curr_proc_mode=ded,curr_min_procs=1,curr_procs=2,curr_max_procs=2,curr_sharing_mode=share_idle_procs,pend_proc_mode=ded,pend_min_procs=1,pend_procs=2,pend_max_procs=2,pend_sharing_mode=share_idle_procs,run_procs=2

lpar_name=10-B6E3E,lpar_id=1,curr_proc_mode=ded,curr_min_procs=0,curr_procs=0,curr_max_procs=0,curr_sharing_mode=share_idle_procs,pend_proc_mode=ded,pend_min_procs=0,pend_procs=0,pend_max_procs=0,pend_sharing_mode=share_idle_procs,run_procs=0

 

==================================================================================================

After:

==================================================================================================

hscroot@CIBERHMC1:~> lshwres -m Server-9117-570-SN10B6E3E -r proc --level lpar | sed 's/,/\n/g'

lpar_name=Ceridian

lpar_id=3

curr_proc_mode=ded

curr_min_procs=1

curr_procs=2

curr_max_procs=2

curr_sharing_mode=share_idle_procs

pend_proc_mode=ded

pend_min_procs=1

pend_procs=2

pend_max_procs=2

pend_sharing_mode=share_idle_procs

run_procs=2

lpar_name=Lawson

lpar_id=2

curr_proc_mode=ded

curr_min_procs=1

curr_procs=2

curr_max_procs=2

curr_sharing_mode=share_idle_procs

pend_proc_mode=ded

pend_min_procs=1

pend_procs=2

pend_max_procs=2

pend_sharing_mode=share_idle_procs

run_procs=2

lpar_name=10-B6E3E

lpar_id=1

curr_proc_mode=ded

curr_min_procs=0

curr_procs=0

curr_max_procs=0

curr_sharing_mode=share_idle_procs

pend_proc_mode=ded

pend_min_procs=0

pend_procs=0

pend_max_procs=0

pend_sharing_mode=share_idle_procs

run_procs=0

 

 $ lssyscfg -r lpar -m Server-9119-595-SN02898EB -Fname,curr_profile,state

 eraprci0,eraprci0,Running

 eraptci0,eraptci0,Running

 erep2ci0,erep2ci0,Running

 

Let's have a look at the installed HW resources in a system and please forgive me that I didn't show you all possible queries available.  Just some nice ones.

hscroot@hmc-op:~> lshwres -r mem -m op720-1-SN100486A --level sys
configurable_sys_mem=8192,curr_avail_sys_mem=448,pend_avail_sys_mem=448,
installed_sys_mem=8192,max_capacity_sys_mem=8192,deconfig_sys_mem=0,
sys_firmware_mem=576,mem_region_size=32
 
hscroot@hmc-op:~> lshwres -m op720-1-SN100486A -r io --rsubtype slot -F description,unit_phys_loc,bus_id,phys_loc,lpar_id
Universal Serial Bus UHC Spec,U787B.001.DNW1733,2,T7,none
Other Mass Storage Controller,U787B.001.DNW1733,2,T16,none
PCI Fibre Channel Disk Controller,U787B.001.DNW1733,2,C3,1
PCI RAID Disk Unit Controller,U787B.001.DNW1733,2,C4,2
PCI Fibre Channel Disk Controller,U787B.001.DNW1733,2,C5,2
PCI 10/100/1000Mbps Ethernet UTP 2-port,U787B.001.DNW1733,3,T9,1
PCI RAID Disk Unit Controller,U787B.001.DNW1733,3,T14,1
PCI 10/100/1000Mbps Ethernet UTP 2-port,U787B.001.DNW1733,3,C1,2
PCI 10/100/1000Mbps Ethernet UTP 2-port,U787B.001.DNW1733,3,C2,none
 
hscroot@hmc-op:~> lshwres -m op720-1-SN100486A -r io --rsubtype slot -F description,drc_index,lpar_id
Universal Serial Bus UHC Spec,21010002,none
Other Mass Storage Controller,21020002,none
PCI Fibre Channel Disk Controller,21030002,1
PCI RAID Disk Unit Controller,21040002,2
PCI Fibre Channel Disk Controller,21050002,2
PCI 10/100/1000Mbps Ethernet UTP 2-port,21010003,1
PCI RAID Disk Unit Controller,21020003,1
PCI 10/100/1000Mbps Ethernet UTP 2-port,21030003,2
PCI 10/100/1000Mbps Ethernet UTP 2-port,21040003,none

 

Find MAC address on LPAR Ethernet adapter from HMC

 

hscroot@hmc-op:~> lpar_netboot -M -n -t ent "linux_test" "normal" "op710-2-SN1008B2A"

# Connecting to linux_test

# Connected

# Checking for power off.

# Power off complete.

# Power on linux_test to Open Firmware.

# Power on complete.

# Getting adapter location codes.

# Type  Location Code          MAC Address

ent U9123.710.1008B2A-V7-C4-T1 0a67e0007004

 

Now you can use the MAC address in your dhcpd.conf.  

IMPORTANT: By the way -n means "do not really boot the LPAR" which is very important as you probably don’t want to boot/reboot your LPAR every time you want to use this command.

 

Create LPAR using a SSH script

Now this example is based on a little script.  In fact I am using two files - one for the configuration values and one for the remote SSH command execution.

 

Here's my config file:

 

# ----- Config File for mksyscfg -----

USERID="hscroot"

HMC='hmc-570.stuttgart.de.ibm.com'

SYSTEM="Server-9110-510-SN100129A"

 

# ----- Client LPAR default values -----

CLIENT_NAME="linux_test"        # Name of the partition

CLIENT_PROFIL="client_default"  # Name of the profile

CLIENT_ENV="aixlinux"           # Operating environment

CLIENT_MINMEM="512"             # Minimum memory in megabyte

CLIENT_DESMEM="512"             # Desired memory in megabyte

CLIENT_MAXMEM="512"             # Maximum memory in megabyte

CLIENT_PMODE="shared"           # shared or ded

CLIENT_SMODE="uncap"            # cap or uncap

CLIENT_SWEIGHT="128"            # Value between 0 and 255

CLIENT_MINPU="0.1"              # Min processing units

CLIENT_DESPU="0.4"              # Des processing units

CLIENT_MAXPU="2.0"              # Max processing units

CLIENT_MINVP="1"                # Min virtual CPU

CLIENT_DESVP="2"                # Des virtual CPU

CLIENT_MAXVP="4"                # Max virtual CPU

CLIENT_VSLOT="10"               # Number of virtual slots

CLIENT_VETH="2/1/1//0/1"        # Virtual Ethernet adapter

CLIENT_VSCSI="3/client/1//4/1"  # Virtual SCSI client adapter

CLIENT_START="0"                # Start with manages system or not

CLIENT_BOOT="norm"              # Boot mode = normal

CLIENT_PWR="none"               # Power controlling partition

CLIENT_CON="0"                  # Connection monitoring

CLIENT_IOPOOL="none"            # IOPOOL

 

And here's the little script:

 

#! /bin/bash

 

. /home/pjuerss/files/scripts/hmc/lpar.conf

 

echo -n "Creating LPAR..."

ssh $USERID@$HMC mksyscfg -m $SYSTEM -r lpar -i \"name=$CLIENT_NAME,\

profile_name=$CLIENT_PROFIL,lpar_env=$CLIENT_ENV,min_mem=$CLIENT_MINMEM,\

desired_mem=$CLIENT_DESMEM,max_mem=$CLIENT_MAXMEM,proc_mode=$CLIENT_PMODE,\

sharing_mode=$CLIENT_SMODE,min_proc_units=$CLIENT_MINPU,\

desired_proc_units=$CLIENT_DESPU,max_proc_units=$CLIENT_MAXPU,\

min_procs=$CLIENT_MINVP,desired_procs=$CLIENT_DESVP,max_procs=$CLIENT_MAXVP,\

uncap_weight=$CLIENT_SWEIGHT,lpar_io_pool_ids=$CLIENT_IOPOOL,\

max_virtual_slots=$CLIENT_VSLOT,auto_start=$CLIENT_START,\

boot_mode=$CLIENT_BOOT,power_ctrl_lpar_ids=$CLIENT_PWR,\

conn_monitoring=$CLIENT_CON,max_virtual_slots=$CLIENT_VSLOT,\

virtual_eth_adapters=$CLIENT_VETH,virtual_scsi_adapters=$CLIENT_VSCSI\"

echo "done"

 

And here're both at work - by the way it takes <12 sec. to finish:

 

[pjuerss@ankh-morpork hmc]$ ./createLPAR.sh

Creating LPAR...done

{none}

 

And here's the output on the HMC:

 

{code:none}

hscroot@hmc-570:~> lssyscfg -m Server-9110-510-SN100129A -r prof --filter "lpar_ids=2"

name=client_default,lpar_name=linux_test,lpar_id=2,lpar_env=aixlinux,all_resourc

es=0,min_mem=512,desired_mem=512,max_mem=512,proc_mode=shared,min_proc_units=0.1

,desired_proc_units=0.4,max_proc_units=2.0,min_procs=1,desired_procs=2,max_procs

=4,sharing_mode=uncap,uncap_weight=128,io_slots=none,lpar_io_pool_ids=none,max_v

irtual_slots=10,"virtual_serial_adapters=1/server/1/any//any/1,0/server/1/any//a

ny/1",virtual_scsi_adapters=3/client/1/VIOS1.3FP8.0/4/1,virtual_eth_adapters=2/1

/1//0/1,hca_adapters=none,boot_mode=norm,conn_monitoring=0,auto_start=0,power_ct

rl_lpar_ids=none,work_group_id=none,redundant_err_path_reporting=0

 

Rebooting the HMC via CLI

 

The HMC itself can be rebooted by logging to HMC with SSH, as user hscroot, and issueing the command

 

 $ hmcshutdown -r -t0

To shutdown a LPAR

 

 chsysstate -r lpar -m MACHINE_NAME -o shutdown --immed --restart --id LPARID (or -n LPARNAME)

 

Console or virtual terminals

 

A menu-driven selection of attached machines and pertitions can be gotten via

 

vtmenu

An escape sequence to leave vtmenu terminal session is:

 

~.

To open a console terminal:

 

  $ mkvterm -m <machine> -p <partition>

This can be exited with ~~.

To remove a terminal someone else is using:

 

 $ rmvterm -m <machine> -p <partition>

 

List devices on a PCI bus

 

# lsslot -c phb

 PHB Name  Description               Device(s)

 PHB 1     Logical PCI Host Bridge   pci0

          U7879.001.DQDGTGK-P1-T14  pci3 sisscsia0

          U7879.001.DQDGTGK-P1-T4   pci4 usbhc0 usbhc1

          U7879.001.DQDGTGK-P1-T6   pci5 ent0 ent1

 PHB 2     Logical PCI Host Bridge   pci1

          U7879.001.DQDGTGK-P1-C3   pci6 ent2 ent3

          U7879.001.DQDGTGK-P1-C4   pci7 ent4 ent5

          U7879.001.DQDGTGK-P1-C5   pci8 fcs0

 PHB 3     Logical PCI Host Bridge   pci2

          U7879.001.DQDGTGK-P1-T12  pci10 sisscsia1

          U7879.001.DQDGTGK-P1-T15  pci11 ide0

          U7879.001.DQDGTGK-P1-C1   pci12 fcs1

 

How to find out what HMC(s) your AIX LPAR and system are managed by

 

AIX command

# lsrsrc IBM.ManagementServer  

 Resource Persistent Attributes for IBM.ManagementServer

 resource 1:

        Name             = "10.253.1.21"

        Hostname         = "10.253.1.21"

        ManagerType      = "HMC"

        LocalHostname    = "10.253.1.54"

        ClusterTM        = "9078-160"

        ClusterSNum      = ""

        ActivePeerDomain = ""

        NodeNameList     = {"hmc01 "}

 resource 2:

        Name             = "10.253.1.22"

        Hostname         = "10. 253.1.22"

        ManagerType      = "HMC"

        LocalHostname    = "10.253.1.54"

        ClusterTM        = "9078-160"

        ClusterSNum      = ""

        ActivePeerDomain = ""

        NodeNameList     = {"hmc02 "}

 

Name and Hostname are HMC's Name and hostname of HMC

 

 

Linux on Power

How to setup hw-raid before installing the operating system

Download the latest Diagnostics ISO Image from: Diagnostic CD burn it onto a CD and then boot this CD.

 

Once booted this will bring up the AIX diag which enables you to set the SCSI disk RAID settings as you like. Basically you have to modify all disks which should belong to a RAID configuration from a regular 512-byte block size to a 522-byte block size array candidate disk as only such candidate disks can be included in a RAID setting. Once the RAID settings are done, the OS will not see the single disks of the RAID setting anymore, just your RAID disks.

 

If you are using SUSE SLES9 you can also boot a CD or network, select "Boot a rescue system" and run iprconfig utility.

 

How to setup hardware raid after installing OS

Use iprconfig command. Discs are going to be formatted for Raid, so all data is lost afterwards.

 

1.      run iprconfig

2.      Select 2: Work with disk arrays

3.      Select: 5. Format device for advanced function (522)

4.      Select all disks you want use pressing 1, enter

5.      confirm pressing c

6.      Select 2: Create a disk array

7.      Press 1 Create a disk array

8.      Press 1 for each disk you are going to use, press enter

9.      Select protection level (0, 10, 5)

10.  Select stripe size (default for raid5 64k), press enter

 

SLES 11 installation

Start install with this command for VNC:

Boot: install vnc=1 vncpassword=<your_password_here>

So the prompt is “boot:” and you type the “install vnc=1 vncpassword=<your_password_here>” and just pick some password to use for the VNC connection.  This lets you do a full graphic install using VNC.  You will later be prompted during the installation setup for which adapter and either DHCP or static IP configuration.

 

Doing this typical install took about 2 hours though.   A long time. It was on a slow VPN network connection, and I had to create all the LVM LV’s for the various filesystems, and I was using the virtual optical DVDROM from the VIOS, so perhaps all that accounted for the slowness and length of time it took.

Create PrEP partition

Create a partition of type PREP of about 32MB to 128MB in size.  Not sure what this is used for, but it definitely was needed when trying the IBM Installation Toolkit mentioned below.

IBM Installation Toolkit for Linux Does More Than Just Install Linux

 

Does not support SLES 11 (as of 10/31/2009)

Does not support LVM (as of 10/31/2009)

Don't be taken in by the title -- the IBM Installation Toolkit for Linux isn't just for installing Linux. From IBM: "The IBM Installation Toolkit for Linux provides a set of tools that simplifies the installation of Linux on IBM Power Systems. The toolkit also provides IBM value-added software that you can install, so that you can take advantage of Power Systems capabilities, such as Dynamic Logical Partitioning (DLPAR). The toolkit also supports Web-based updates, providing immediate access to the latest offerings.

 

"The Toolkit can also be used as a rescue bootable DVD to run diagnostic tools and repair previously installed operating systems. It also provides a wealth of IBM documentation for configuring and managing Power systems.

 

"The Toolkit is available as a single ISO image that that you can download from this website. This image can be used to create a bootable DVD or to create a network installation server, which makes multiple and parallel Linux installations over the network possible."

 

While I plan on using it to install Linux, I first wanted to check out the Toolkit's other features. First, I downloaded the .iso image. As always, I prefer virtual optical instead of physical media. So I went to my virtual I/O (VIO) server and ran:

 

mkrep -sp datavg -size 16G

 

Then I ran:

 

oem_setup_env

cd /var/vio/VMLibrary/

scp source_machine:/path/to/iso.image ./

 

This copied the .iso image to my VIO server so that I could assign it as a virtual optical device.

 

I did a DLPAR operation on my HMC to add a virtual SCSI adapter to my VIO server. Then I ran cfgdev on my VIO server so that I could see the adapter.

 

And then I ran:

 

mkvdev -fbo -vadapter vhost3

loadopt -vtd vtopt0 -disk IBM_Installation_Toolkit.iso

 

lsmap showed me:

 

vhost3

 

VTD                  vtopt0

Status               Available

LUN                  0x8100000000000000

Backing device       /var/vio/VMLibrary/IBM_Installation_Toolkit.iso

Physloc

 

After assigning the virtual SCSI adapter to my client LPAR, I was then able to boot from this CD image.

 

Once I booted the machine, I got a root prompt. Then I entered:

 

WelcomeCenter

 

After accepting the license, I was presented with these options:

 

Install Linux

Utilities

Help

 

I went into the Utilities and saw:

 

Configure network

Eject Media

Reboot System

System Diagnostics

Firmware Update

 

The System Diagnostics has:

 

System Properties

System Inventory

Error Log

Service Configuration

Boot Configuration

 

These look like useful tools, and if I boot from this CD image I don't need to have an OS installed to run the utilities. Once I've had more time to explore them, I'll report back with more findings.

 

More from IBM:

 

"The server consolidation tool provided by the Toolkit tackles the most time-consuming and error-prone aspect of server consolidation: the migration of OS stack and user and application data. With the Toolkit, the administrator can quickly put a new server into production. The tool targets the migration and customization of LAMP stack (Linux - Apache - mySQL - Perl, Python, and PHP) and data from

X86 servers running RHEL 4, RHEL5, SLES9 and SLES10 to Power Systems.

 

"The administrator has complete control over the installation and migration process. He chooses the level of the OS and whether additional RPMs should be installed as well as whether to migrate user accounts and data. So whether you intend to migrate one or more servers, the new server consolidation tool is sure to save you a lot of time.

 

"The IBM Installation Toolkit is intended for customers who want to:

 

Install and configure Linux on a non-virtualized Power System.

Install and configure Linux on machines with previously configured Logical Partitions (virtualized machines).

Install IBM RAS Tools along with Linux or on a previously installed system.

Upgrade firmware level on Power Systems.

Perform diagnostics or maintenance operations on previously installed systems.

Improve application performance using the latest Power Systems optimizations available in the Advance Toolchain.

Migrate LAMP stack from X86 RHEL and SLES servers to Power Systems.

Browse and search Linux documentation included on the Toolkit ISO. "

 

 

 

Appendix A: Full HMC and System Setup Procedure

 

http://www.ibm.com/developerworks/wikis/display/virtualization/HMC+and+system+setup

Mid-range and larger p5 and i5 servers need an HMC to create and manage logical partitions, dynamically reallocate resources, invoke Capacity on Demand, utilize Service Focal Point and facilitate hardware control.

High-end servers with Bulk Power Controllers (BPC), such as the IBM System p5 model 590, p5-595 and p5-575 systems, require at least one HMC acting as a DHCP (Dynamic Host Configuration Protocol) server. Two HMCs are recommended for enhanced availability.

Mission critical solutions, even those hosted on entry or mid-range servers, may benefit from having dual HMCs.

There are many factors to be considered when planning and seeting up the HMC and managed server environment. For more information, please see the IBM HMC best Practices http://www.ibm.com/developerworks/wikis/images/icons/linkext7.gifwhitepaper.

The basic setup requirements are relatively simple, however there are several key points related to the network between the HMC and Managed Server, and between the HMC and the Logical Partitions (LPARS).

This document is an informal collection of Hints & Tips intended to provide a simple worked-example. Although there are alternative setup arrangements, this example illustrates the most common environment for IBM System p, and eServer p5 systems.

Please Note that this document has not been updated since Aprli 17 2007, it should be considered as mostly covering the concepts. Please always refer to the official documentation.

Introduction.

HMC attached to the Flexible Service Processor (FSP) of the Managed Server via a "private" Ethernet, and to each Logical Partition (LPAR) via an "open" Ethernet network.

http://www.ibm.com/developerworks/wikis/download/attachments/51773462/HMC1.jpg

Private Network

"Private" network means the use of a selected range of non-routable IP-addresses. It is intended that the only devices on the HMC private network will be the HMC itself, and the Managed Servers. To be precise, the HMC is connected to the FSP (Flexible Service Processor) of the Managed Server(s).

On most System p, and eServer p5 systems, the FSP provides two ethernet ports labelled HMC1 and HMC2, allowing for the connection of 1 or 2 HMCs. However, on certain "high-end" systems (e.g. p590/595 and p575) which have a Bulk Power controller, the HMC private network connects to a small hub within the Managed Server frame.

Some systems (e.g. p590/p595) have dual-FSP, the second FSP being a "redundant" backup. It is also possible to order a redundant FSP for p570 systems. The basic setup requirements are essentially the same - the HMC must be connected to each FSP, so additional network hardware will be required (e.g. LAN switch) when there is more than 1 FSP or there are multiple Managed Servers.

Also important - each FSP port on the managed server should be connected to ONLY ONE HMC.

Open Network

"Open" Network means a network connection from the HMC to the Logical Partitions and, potentially, to other systems on your regular network infrastucture. If desired, the open network could also be connected to suitable Firewall/Router for connection to the Internet. Such a connection to the Internet would enable the HMC to "Call-Home" when there are any hardware errors to report.

The HMC itself provides its own Firewall (using iptables) on each of its network Interfaces. The basic firewall configuration is automatically setup when the HMC code is installed, but further configuration may be necessary.

The IBM Systems Hardware Information Center http://publib.boulder.ibm.com/infocenter/eserver/v1r3s/index.jsp http://www.ibm.com/developerworks/wikis/images/icons/linkext7.gif provides basic setup information - Setting up the HMC http://publib.boulder.ibm.com/infocenter/eserver/v1r3s/topic/iphai/installhmc.htm http://www.ibm.com/developerworks/wikis/images/icons/linkext7.gif

HMC as a DHCP Server

http://www.ibm.com/developerworks/wikis/download/attachments/51773462/HMC2.jpg

Figure 2, shows a dual-HMC environment with two Managed Servers. The Primary HMC is connected to the first port on each FSP, and the redundant HMC is connected to the second port on each FSP. Each HMC is configured as a DHCP server, utilizing a different range of addresses. The connections are on separate private networks - it is important to ensure that no FSP port accidentally ends up being connected to more than one HMC.

For each Managed Server on any given network, each FSP port (which is connected to an HMC) requires a unique IP-address. The easiest way to achieve this is to make use of the HMC built-in DHCP server capability. When the FSP detects the network link as being active, it will issue a broadcast request to locate a DHCP server. When properly configured, the HMC will respond to that request by allocating one of a selected range of addresses. Subsequent requests from the same FSP will be allocated the same IP-address.

When there are multiple Managed Servers, a LAN switch will need to be provided for the HMC to FSP private network. Alternatively, this private segment could be provided as several ports in a private VLAN on a larger managed switch. With potentially multiple "private VLANS", take care to ensure that they really are isolated - i.e. no possible cross-over traffic.

Because this is an entirely private network, this use of HMC as a DHCP server should not have any impact on existing network infrastructure. However, there are some implications regarding LAN switches which will be described later in this document.

If DHCP is NOT used, the network configuration settings for each FSP would need to be changed from "dynamic" to "stactic" addressing, and a specific IP-address would need to be defined for each port. This configuration can be achieved by using the ASMI (Advanced Systems Management Interface) of the FSP. Whilst that may not be a significant amount of work with only one or two servers, it becomes a more difficult task when there are many servers attached to an HMC. Also there are several implications - for example, if an FSP needed to be replaced for some reason, the replacement FSP would be configured to use the default "dynamic" addresses, and would need to be reconfigured using ASMI before it could be attached to an HMC on a network using "static" addresses.

For a dual-HMC environment, each HMC would also be connected to the LPARs, and to each other, on the same open network.

http://www.ibm.com/developerworks/wikis/download/attachments/51773462/HMC3.jpg
Figure 3 shows an HMC connected to a single managed server on the private network, and to three LPARs on the Open network. It is possible to order an additional Ethernet adapter for the HMC, and thus to have three (or more) network interfaces. If desired, this third network could be used as a "management" network. Or - in the case of a Cluster system - the third network would be connected to the CSM (Cluster Systems Manager) Management Server.

http://www.ibm.com/developerworks/wikis/download/attachments/51773462/HMC4.jpg

Figure 4 shows the HMC User Interface panels for configuring the Private network
In this example, I have selected the first interface (eth0) for the Private network, and enabled the HMC as a DHCP server for that network. I have also selected one of the ranges of addresses which are provided for the Private network. Note: The HMC takes the FIRST address within that range - in this example, 10.0.255.1

Adapter settings

Figure 3 shows that the default for the adapter settings is "Autodetection". Whilst this is appropriate in most cases, there are some occasions when it may be necessary to configure the required settings manually (for example, 100Mbps Full Duplex). Manual setting would be required if this adapter is connected to a LAN switch which does not produce the desired behaviour for "Autodetection". There are several methods to determine the actual port "Media Speed" one the link has become active. These will be described shortly.

http://www.ibm.com/developerworks/wikis/download/attachments/51773462/HMC5.jpg
Figure 5 shows the HMC User Interface panels for configuring the Open network
I have selected the second interface (eth1) for the Open network, and also specified that this network will be used for communication to the LPARS ("Partition communication" option). It is very unlikely that we would want the HMC to obtain an IP-address from some other DHCP server which is on the Open network, so I have selected the "Specify an IP address" button, and entered the desired IP-address on the Open network.

For the Open Network, we may also wish to configure the HMC Firewall. For example, to allow remote access to the HMC using webSM (Web-based System Manager) and SSH, we would enable "WebSM" and "Secure Shell". The currently-defined iptables (Firewall settings) are displayed in the lower panel. I have chosen to highlight a couple which are particularly important. "RMC" is used for the communication between the HMC and the LPARs (for Service Focal Point and Dynamic Reconfiguration options), and "FCS" is used for the communication between HMCs which are on the same subnet.

This panel also shows the TCP/IP ports and protocols which are used. This is very useful information if you are considering installing an additional Firewall on the open network.

http://www.ibm.com/developerworks/wikis/download/attachments/51773462/HMC6.jpg
Figure 6 shows the other network setup which is required - i.e. specify a DNS server if one is available on the Open network, and specify any routing requirements. In particular, we should specify a default GATEWAY if one is available and if it is required for access from the Open network to other corporate network(s) or to the Internet.

Note: If configured to use the Internet for "Call Home" (Service Agent), that traffic will use whichever network has the default GATEWAY defined, and will attempt to use that network to reach the Internet.

HMC - identifying the network ports.

Clearly, it is essential to connect the Private and Open networks to the appropriate network Interface on the HMC. These ports will be eth0 and eth1, but the physical ports (connectors) an the HMC become assigned as eth0 or eth1 depending on the hardware configuration and the type of HMC.

IBM Systems Hardware Information Center provides a description of the possibilities, "Identifying the Ethernet port defined as eth0" at http://publib.boulder.ibm.com/infocenter/eserver/v1r3s/topic/iphai/ethernetrules.htm http://www.ibm.com/developerworks/wikis/images/icons/linkext7.gif
After identifying the Ethernet ports from that description, a simple test can be performed to quickly determine the correct ports. For this test, it is only necessary to for the link to become active - therefore an unused LAN switch could be used for this purpose. Connect an ethernet cable between the LAN switch and one o fthe HMC Ethernet ports. Then, using a terminal session on the HMC, run the command
tail -f /var/log/messages
Assuming that the link becomes active (indicated by lights next to the port on the HMC, and on the LAN switch) we should see something like this:

     Oct 30 16:55:28 daihmc kernel: bcm5700:
     eth1 NIC Link is Up, 100Mbps full duplex;
     receive & transmit flow control ON.

Which is a clear indication of the actual port that has just been selected, and also confirmation of the Media speed (in this example 100MBs full duplex). If the Media Speed result was not as expected, may need to manually configure adapter settings using the HMC User Interface panels.

Now that we have configured the Private and Open Network interfaces, and identified/confirmed the respective ports on the HMC, we can connect the Managed Server.

Connecting the Managed Server

Note: the following description applies to servers excluding p590, p595 and p575
Establish an Ethernet connection between the first FSP port on the managed server (usually labelled HMC1) and the first HMC's Private Network interface. Connect power to the Managed Server (if it is not already connected).

Then, using a terminal session on the HMC, run the command
tail -f /var/log/messages | grep DHCP
Eventually, we should see something like this:

DHCPDISCOVER                    from 00:0d:60:4d:73:d8 via eth0
DHCPOFFER on    192.168.255.254 to   00:0d:60:4d:73:d8 via eth0
DHCPREQUEST for 192.168.255.254 from 00:0d:60:4d:73:d8 via eth0
DHCPACK on      192.168.255.254 to   00:0d:60:4d:73:d8 via eth0

Note: Obviously the messages will not be formated like that, I have simply re-arranged the text slightly to improve clarity.
The first message is a DHCPDISCOVER broadcast from the FSP to determine if any DHCP server will respond, and including the MAC address of the FSP Ethernet port (e.g. 00:0d:60:4d:73:d8).
The second message is from the HMC, DHCPOFFER - offering an IP-address (e.g. 192.168.255.254).
The third message is the response from the FSP, DHCPREQUEST - requesting to use that address.
The fourth message is the HMC, DHCPACK - acknowledging that the FSP now has that address.

Any subsequent DHCP request from the same FSP port will be re-issued the same address.

http://www.ibm.com/developerworks/wikis/images/icons/emoticons/check.gif

Handy Hint
If the server already has power connected, and is at standby state (01 N V=F shown on the operator panel), we can cause a new DHCP request by briefly dropping the link at the FSP. If there are LAN switches between the FSP and the HMC, remove the Ethernet cable from the FSP itself for about 1 minute, then re-connect it. Return to HMC and observe the output from /var/log/messages. Within a couple of minutes, we should see the DHCP messages.
Note: This tip does NOT apply to p590/p595 or p575 systems


We can see which addresses have been issued by the HMC
lshmc -n
The last part of the output "clients=" shows the addresses which have been issued by the DHCP server.

What if we do NOT see a DHCP request ?

  • Check the Private network / LAN (try a direct cable if possible)
  • Investigate any LAN switch settings which may prevent DHCP request
  • Check the Managed Server has power connected ( op-panel shows "01")
  • disconnect Ethernet cable from FSP for approx 1 minute, then reconnect
  • Determine whether FSP has been set to use static addresses
  • Reset FSP
    Each of these items is described in later sections of this document.

The Hardware Server Manager (software which is running on the HMC) "polls" the addresses which have been issued by the HMC. So, it may take several minutes before a newly-attached server appears on the HMC in the "Server Management" section, or as shown by the line-mode command:
lssysconn -r all

   hscroot@daihmc:~> lssysconn -r all
   resource_type=sys,type_model_serial_num=9111-520*10DE9BC,
   sp=primary,sp_phys_loc=unavailable,ipaddr=192.168.255.254,
   alt_ipaddr=unavailable,state=Connected

Connecting the HMC to the Open network.

Establish an Ethernet connection from the HMC port - which has been defined as the Open network Interface - to the appropriate LAN switch. When TCP/IP is configured in any LPARS, they will attempt to contact the HMC over this network.

Confirming HMC network adapter "Media Speed"

To confirm the actual port settings (once they have been connected to a LAN switch or directly to the FSP), use the HMC "Network Topology" option as shown in Figure 7.
Service Applications / Service Focal Point / Service Utilities / Actions / View Network Topology

http://www.ibm.com/developerworks/wikis/download/attachments/51773462/HMC7.jpg
Selecting one of the HMC network Interfaces (e.g. eth0 selected at "A") allows us to view the media settings which were specified ("Advertised link modes") and the actual link setting ("Speed" / "Duplex")
Note: Under the Open Network Interface (shown at "B") will be a list of LPARS which are currently connected, and other HMCs which have been automatically discovered on the same Open subnet.

Secure connection from HMC to FSP

IMPORTANT: New p520/p550/p560 system connections to HMC!

The FSP has several "userids" defined, including: HMC; admin and general.
For a new machine (or one which has been reset to "Factory Configuration"), a password must be set for each of those userids. The HMC will use the userid "HMC" and the password which you have set, in order to establish a secure (SSL) connection to the FSP.

A new machine attached to the HMC will appear first as an IP-address, with the message "Pending Authentication", as shown in Figure 8. Right-click the IP-address, and select "Update Managed System Password".

http://www.ibm.com/developerworks/wikis/download/attachments/51773462/HMC8.jpg

The HMC wizard will prompt for passwords to be SET for the userids "HMC"; "admin"; and "general". The passwords will be set in the FSP itself. The "admin" and "general" userids can then be used to login to the FSP using the ASMI interface. Clearly it is important to keep a safe record of the passwords which have been set.

Typical problems on Private network.

http://www.ibm.com/developerworks/wikis/download/attachments/51773462/HMC9.jpg
See Reliable communication between the HMC and managed p5/p6 servers.

FSP set to use Static Address.

If the FSP had been previously configured to use a static address, it will not issue a DHCP request when connected to an HMC. The ASMI interface may be used to connect to the FSP and check/set the Network Configuration. If using Web-browser to access ASMI, obviously we need to know the current IP-address of the FSP port. The Operator panel (function "30") may be used to display the current IP-address of each of the FSP ports.

Login to FSP using ASMI

The userd "admin" has a default password "admin". However the password may have been changed (either after attachment to an HMC,or through the ASMI interface). If the admin password is NOT known, place a hardware call and request a temporary celogin password. The password for "celogin" is generated for a specific machine serial number and a specific date.

Once logged-in as "celogin", the password for the admin and general users can be reset.
Figure 10 shows examples of the ASMI interface. (Note: ASCII termnal connection is not possible on p570/p590/p595 systems)

http://www.ibm.com/developerworks/wikis/download/attachments/51773462/HMC10.jpg
If the managed Server is already attached to an HMC, the ASMI interface is available through Service Applications / Service Utilities.

Setting FSP Network Configuration using ASMI

Figure 11 shows the network configuration settings using ASMI through a Web-browser (the panels are similar when using ASCII terminal connection)
http://www.ibm.com/developerworks/wikis/download/attachments/51773462/HMC11.jpg
When attached to an HMC which is setup as a DHCP server, the "Type of IP Address" should be set to "Dynamic".

 

[Home] [Linux] [AIX] [Power Systems Stuff]