Digimer at 01:02, 22 September 2011

2011-09-22T01:02:55Z

← Older revision		Revision as of 01:02, 22 September 2011
Line 43:		Line 43:
	== Download and Install the HP-Provided RPMs ==		== Download and Install the HP-Provided RPMs ==

	[http://h20000.www2.hp.com/bizsupport/TechSupport/~~SoftwareDescription~~.jsp?lang=en&cc=us&prodTypeId=15351&prodSeriesId=3884319~~&swItem=MTX-0fcb2f1331034568b60b4061f1&prodNameId=3884320&swEnvOID=4103~~&swLang=8&taskId=135&~~mode=4&idx~~=~~0 foo~~]		'''Note''': This guide was written using a pair of [http://h20000.www2.hp.com/bizsupport/TechSupport/SoftwareIndex.jsp?lang=en&cc=us&prodNameId=3884320&prodTypeId=15351&prodSeriesId=3884319&swLang=8&taskId=135&swEnvOID=4004#113213 Proliant GL360 G6] servers using iLO 2.

	~~'''Note''': This guide was written using a pair of~~ [http://h20000.www2.hp.com/bizsupport/TechSupport/~~SoftwareIndex~~.jsp?lang=en&cc=us&~~prodNameId~~=~~3884320~~&~~prodTypeId~~=~~15351~~&~~prodSeriesId~~=~~3884319~~&swLang=8&taskId=135&~~swEnvOID~~=~~4004#113213~~ Proliant ~~GL360 G6~~] ~~servers using iLO 2~~.		* Download the [http://h20000.www2.hp.com/bizsupport/TechSupport/SoftwareDescription.jsp?lang=en&cc=us&prodTypeId=18964&prodSeriesId=3716246&prodNameId=3716247&swEnvOID=4103&swLang=8&mode=2&taskId=135&swItem=MTX-d50539fd28b442ed812eea8a27 Proliant Support Pack].



			=== Old ===

	Download the following RPMs from HP directly. Note that these link outside of AN!Wiki and may go stale.		Download the following RPMs from HP directly. Note that these link outside of AN!Wiki and may go stale.

	* HP iLO [http://h20000.www2.hp.com/bizsupport/TechSupport/SoftwareDescription.jsp?lang=en&cc=us&prodTypeId=15351&prodSeriesId=3884319&prodNameId=3884320&swEnvOID=4004&swLang=8&mode=2&taskId=135&swItem=MTX-3cf1ada22d374e2ebce729337d Channel Interface Device Driver]		* HP iLO [ Channel Interface Device Driver]
	* HP [http://h20000.www2.hp.com/bizsupport/TechSupport/SoftwareDescription.jsp?lang=en&cc=us&prodTypeId=15351&prodSeriesId=3884319&prodNameId=3884320&swEnvOID=4004&swLang=8&mode=2&taskId=135&swItem=MTX-7ec4fff1bc1344a58e1b413083 OpenIPMI Device Driver]		* HP [ OpenIPMI Device Driver]
	* HP [http://h20000.www2.hp.com/bizsupport/TechSupport/SoftwareDescription.jsp?lang=en&cc=us&prodTypeId=15351&prodSeriesId=3884319&prodNameId=3884320&swEnvOID=4004&swLang=8&mode=2&taskId=135&swItem=MTX-e79b1a2c964848a888e26ab38e System Health Application and Command Line Utilities]		* HP [ System Health Application and Command Line Utilities]
	* HP [http://h20000.www2.hp.com/bizsupport/TechSupport/SoftwareDescription.jsp?lang=en&cc=us&prodTypeId=15351&prodSeriesId=3884319&prodNameId=3884320&swEnvOID=4004&swLang=8&mode=2&taskId=135&swItem=MTX-c1c27ee0daa449a099349aae04 Lights-Out Online Configuration Utility]		* HP [ Lights-Out Online Configuration Utility]

	Now install the RPMs:		Now install the RPMs:

Digimer: Created page with "{{howto_header}} = HP iLO Setup = HP uses a variant on IPMI called iLO, Integrated Lights-Out management. This will cover how to install and configure it for use in our..."

2011-09-21T23:24:39Z

Created page with "{{howto_header}} = HP iLO Setup = HP uses a variant on IPMI called iLO, Integrated Lights-Out management. This will cover how to install and configure it for use in our..."

Páàjì titun

{{howto_header}}

= HP iLO Setup =

HP uses a variant on [[IPMI]] called [[iLO]], Integrated Lights-Out management. This will cover how to install and configure it for use in our cluster.

== Install iLO Dependencies ==

The iLO tools will try to compile against all installed kernels. For this reason, remove old kernels and then ensure that the kernel sources are available.

<source lang="bash">
yum list installed | grep -i kernel
</source>
<source lang="text">
dracut-kernel.noarch 004-33.2.el6_0 @updates
kernel.x86_64 2.6.32-71.el6 @CentOS/6.0
kernel.x86_64 2.6.32-71.29.1.el6 @updates
kernel-devel.x86_64 2.6.32-71.el6 @CentOS/6.0
kernel-devel.x86_64 2.6.32-71.29.1.el6 @updates
kernel-firmware.noarch 2.6.32-71.29.1.el6 @updates
kernel-headers.x86_64 2.6.32-71.29.1.el6 @updates
</source>

<source lang="bash">
rpm -e kernel-2.6.32-71.el6 kernel-devel-2.6.32-71.el6
yum list installed | grep -i kernel
</source>
<source lang="text">
abrt-addon-kerneloops.x86_64 1.1.13-4.el6 @CentOS/6.0
dracut-kernel.noarch 004-33.2.el6_0 @updates
kernel.x86_64 2.6.32-71.29.1.el6 @updates
kernel-devel.x86_64 2.6.32-71.29.1.el6 @updates
kernel-firmware.noarch 2.6.32-71.29.1.el6 @updates
kernel-headers.x86_64 2.6.32-71.29.1.el6 @updates
</source>

Now we can install the kernel source and build programs.

<source lang="bash">
yum install kernel-headers kernel-xen-devel kernel-devel gcc pyOpenSSL
</source>

== Download and Install the HP-Provided RPMs ==

[http://h20000.www2.hp.com/bizsupport/TechSupport/SoftwareDescription.jsp?lang=en&cc=us&prodTypeId=15351&prodSeriesId=3884319&swItem=MTX-0fcb2f1331034568b60b4061f1&prodNameId=3884320&swEnvOID=4103&swLang=8&taskId=135&mode=4&idx=0 foo]

'''Note''': This guide was written using a pair of [http://h20000.www2.hp.com/bizsupport/TechSupport/SoftwareIndex.jsp?lang=en&cc=us&prodNameId=3884320&prodTypeId=15351&prodSeriesId=3884319&swLang=8&taskId=135&swEnvOID=4004#113213 Proliant GL360 G6] servers using iLO 2.

Download the following RPMs from HP directly. Note that these link outside of AN!Wiki and may go stale.

* HP iLO [http://h20000.www2.hp.com/bizsupport/TechSupport/SoftwareDescription.jsp?lang=en&cc=us&prodTypeId=15351&prodSeriesId=3884319&prodNameId=3884320&swEnvOID=4004&swLang=8&mode=2&taskId=135&swItem=MTX-3cf1ada22d374e2ebce729337d Channel Interface Device Driver]
* HP [http://h20000.www2.hp.com/bizsupport/TechSupport/SoftwareDescription.jsp?lang=en&cc=us&prodTypeId=15351&prodSeriesId=3884319&prodNameId=3884320&swEnvOID=4004&swLang=8&mode=2&taskId=135&swItem=MTX-7ec4fff1bc1344a58e1b413083 OpenIPMI Device Driver]
* HP [http://h20000.www2.hp.com/bizsupport/TechSupport/SoftwareDescription.jsp?lang=en&cc=us&prodTypeId=15351&prodSeriesId=3884319&prodNameId=3884320&swEnvOID=4004&swLang=8&mode=2&taskId=135&swItem=MTX-e79b1a2c964848a888e26ab38e System Health Application and Command Line Utilities]
* HP [http://h20000.www2.hp.com/bizsupport/TechSupport/SoftwareDescription.jsp?lang=en&cc=us&prodTypeId=15351&prodSeriesId=3884319&prodNameId=3884320&swEnvOID=4004&swLang=8&mode=2&taskId=135&swItem=MTX-c1c27ee0daa449a099349aae04 Lights-Out Online Configuration Utility]

Now install the RPMs:

'''Note''': This will likely compile some drivers, generating a lot of output to the screen during the RPM install. Make sure your terminal's scroll-back buffer is sufficiently large so that you can scroll back and check for compile errors. Generally, I set my scroll-back to 5000 lines.

<source lang="bash">
rpm -ivh hp-ilo-*.rhel5.x86_64.rpm hp-OpenIPMI-*.rhel5.x86_64.rpm hp-health-*.rhel5.x86_64.rpm hponcfg-*.noarch.rpm
</source>
<source lang="text">
</source>

Now check the status of the hp-ilo, hp-health and hp-asrd daemons.

<source lang="bash">
/etc/init.d/hp-ilo status
</source>
<source lang="text">
Status of hp-ilo:
hpilo driver is loaded...
</source>

It's running by default.

<source lang="bash">
/etc/init.d/hp-health status
</source>
<source lang="text">
Using Proliant High Performance
IPMI based System Health Monitor

hp-OpenIPMI Status:
Module Size Used by
WARNING: The hp-OpenIPMI driver does not appear to be loaded!

(hpasmxld) is stopped... [ OK ]
</source>

It is not, so start it.

<source lang="bash">
/etc/init.d/hp-health start
</source>
<source lang="text">
Using Proliant High Performance
IPMI based System Health Monitor
Starting hp-OpenIPMI:
Starting Proliant High Performance
IPMI based System Health Monitor (hpasmxld): [ OK ]
</source>

Now check it again.

<source lang="bash">
/etc/init.d/hp-health status
</source>
<source lang="text">
Using Proliant High Performance
IPMI based System Health Monitor

hp-OpenIPMI Status:
Module Size Used by
ipmi_si 78156 2
ipmi_devintf 44944 4
ipmi_msghandler 73560 2 ipmi_si,ipmi_devintf

(hpasmxld) is running... [ OK ]
</source>

Good, now check the HP advanced service recovery daemon.

<source lang="bash">
/etc/init.d/hp-asrd status
</source>
<source lang="text">
Not Running [FAILED]
</source>

It, also, doesn't start on install so we will start it now.

<source lang="bash">
/etc/init.d/hp-asrd start
</source>
<source lang="text">
Starting HP Advanced Server Recovery Daemon [ OK ]
</source>

Check that it's now running. This time we'll see it print it's [[PID]] as well as the notice that it's running.

<source lang="bash">
/etc/init.d/hp-asrd status
</source>
<source lang="text">
7422
Running [ OK ]
</source>

Now make sure that they are set to start with the system.

<source lang="bash">
chkconfig --list |grep -i hp
</source>
<source lang="text">
hp-asrd 0:off 1:off 2:on 3:on 4:on 5:on 6:off
hp-health 0:off 1:off 2:on 3:on 4:on 5:on 6:off
hp-ilo 0:off 1:off 2:on 3:on 4:on 5:on 6:off
</source>

== Configuring The iLO BMC ==

Now we will configure the iLO baseboard management controller using the hp command line tools.

=== Basic Configuration ===

If all went well, you should now be able to dump the current iLO configuration to an [[XML]] file using hponcfg. What you name the file is up to you, but I like to use the system's hostname with the .xml suffix.

<source lang="bash">
hponcfg -w hostname.xml
</source>
<source lang="text">
Firmware Revision = 2.05 Device type = iLO 2 Driver name = hpilo
RILOE II/iLO configuration successfully written to file "foo"
</source>

We will edit this file to set the values we want and then write the file out to the iLO BMC.

<source lang="bash">
vim hostname.xml
</source>
<source lang="xml">


<RIBCL VERSION="2.1">
<LOGIN USER_LOGIN="Administrator" PASSWORD="secret">
<DIR_INFO MODE="write">
<MOD_DIR_CONFIG>
<DIR_AUTHENTICATION_ENABLED VALUE = "N"/>
<DIR_LOCAL_USER_ACCT VALUE = "Y"/>
<DIR_SERVER_ADDRESS VALUE = ""/>
<DIR_SERVER_PORT VALUE = "636"/>
<DIR_OBJECT_DN VALUE = ""/>
<DIR_OBJECT_PASSWORD VALUE = ""/>
<DIR_USER_CONTEXT_1 VALUE = ""/>
<DIR_USER_CONTEXT_2 VALUE = ""/>
<DIR_USER_CONTEXT_3 VALUE = ""/>
</MOD_DIR_CONFIG>
</DIR_INFO>
<RIB_INFO MODE="write">
<MOD_NETWORK_SETTINGS>
<SPEED_AUTOSELECT VALUE = "Y"/>
<NIC_SPEED VALUE = "10"/>
<FULL_DUPLEX VALUE = "N"/>
<IP_ADDRESS VALUE = "10.249.129.48"/>
<SUBNET_MASK VALUE = "255.255.0.0"/>
<GATEWAY_IP_ADDRESS VALUE = "0.0.0.0"/>
<DNS_NAME VALUE = "ILOFOOBARBAZ"/>
<PRIM_DNS_SERVER value = "0.0.0.0"/>
<DHCP_ENABLE VALUE = "N"/>
<DOMAIN_NAME VALUE = ""/>
<DHCP_GATEWAY VALUE = "Y"/>
<DHCP_DNS_SERVER VALUE = "Y"/>
<DHCP_STATIC_ROUTE VALUE = "Y"/>
<DHCP_WINS_SERVER VALUE = "Y"/>
<REG_WINS_SERVER VALUE = "Y"/>
<PRIM_WINS_SERVER value = "0.0.0.0"/>
<STATIC_ROUTE_1 DEST = "0.0.0.0" GATEWAY = "0.0.0.0"/>
<STATIC_ROUTE_2 DEST = "0.0.0.0" GATEWAY = "0.0.0.0"/>
<STATIC_ROUTE_3 DEST = "0.0.0.0" GATEWAY = "0.0.0.0"/>
</MOD_NETWORK_SETTINGS>
</RIB_INFO>
<USER_INFO MODE="write">
</USER_INFO>
</LOGIN>
</RIBCL>
</source>

Once you've edited the file to suit your network, you can write it back to the iLO BMC and the changes will then take effect. Don't bother trying to set the administrator password, it won't take. Just update the network settings. Advanced configuration will be done in the next step.

'''Note''': This will take a minute or so to complete.

<source lang="bash">
hponcfg -f hostname.xml
</source>
<source lang="text">
Firmware Revision = 2.05 Device type = iLO 2 Driver name = hpilo
<INFORM>Integrated Lights-Out will reset at the end of the script.</INFORM>

Please wait while the firmware is reset. This might take a minute
Script succeeded
</source>

== Advanced Configuration of the iLO BMC ==

By default, you can run the initial configuration of the iLO BMC over [[SSH]] or [[HTTPS]]. We will use the web interface for this tutorial.

'''Note''': The default iLO username is Administrator and the password will be written on a sticker on top of your server.

[[Image:HP_Proliant_ML360_G6_iLO_Stickers_01.png|center|thumb|700px|Picture showing what the iLO stickers with the default passwords look like.]]

Open up a browser from a machine with access to the network connected to the iLO BMCs. If you [[ssh]]'ed with X-Forwarding to a server, you can start a browser like [[firefox]].

Once connected to the browser, browse to the IP address you set either in the iLO BIOS at boot time or using the XML dump/load in the prior step.

[[Image:HP_iLO2_login_screen_01.png|center|thumb|700px|HP iLO 2 Login Screen.]]

'''Note''': The username and password are case sensitive.

One you log in, you will have access to all of the advanced configuration options.

[[Image:HP_iLO2_home_screen_01.png|center|thumb|700px|HP iLO 2 Home Screen.]]

== Some Common Tasks ==

This will not be an exhaustive tutorial, but we will take a look at a few common values you might want to change.

=== Advanced Networking ===

To enable the iLO interface to act as a shared network interface, click on the '''Administration''' tab and browse to ''Settings'' > ''Network'' and click to select '''Shared Network Port'''. You can also configure a [[VLAN]] tag in this section.

[[Image:HP_iLO2_network_screen_01.png|center|thumb|700px|HP iLO 2 Network Screen.]]

'''Note''': Saving the changes will disconnect any open iLO sessions.

=== Adding the root User ssh Public Keys ===

'''Note''': I've not been able to get the ssh key to be accepted.

This will allow for the root user to access the iLO BMC over ssh without needing to enter a password. This will be useful in some cases, like cluster fence device scripts.

First, we need to add a user account called root to the system. I generally set this user's account to the same password as is used on the server's operating system.

Click on the '''Administration''' tab, click on ''User Administration'' and then on the '''Local Accounts''' tab.

[[Image:HP_iLO2_local_users_screen_01.png|center|thumb|700px|HP iLO 2 Local Users Screen.]]

Click on the '''New''' and then fill out the form. Once done, click on the ''Save User Information'' button.

[[Image:HP_iLO2_local_users_screen_02.png|center|thumb|700px|HP iLO 2 New User Form Screen.]]

Now, copy the ~/.ssh/id_rsa.pub (or equiv.) from all hosts you want to give access to into a given directory. I generally use rsync to pull them into a file called hostname.rsa_pub_key.

Here I copy the RSA public key from two nodes.

<source lang="bash">
rsync -av root@10.255.129.48:/root/.ssh/id_rsa.pub ~/cc0048.rsa_pub_key
</source>
<source lang="text">
receiving file list ... done
id_rsa.pub

sent 42 bytes received 513 bytes 1110.00 bytes/sec
total size is 410 speedup is 0.74
</source>
<source lang="bash">
rsync -av root@10.255.129.49:/root/.ssh/id_rsa.pub ~/cc0049.rsa_pub_key
</source>
<source lang="text">
receiving file list ... done
id_rsa.pub

sent 42 bytes received 513 bytes 370.00 bytes/sec
total size is 410 speedup is 0.74
</source>

Now browse to the '''Administration''' tab, browse to ''Settings'' > ''Security'' and click on the '''SSH''' tab.

[[Image:HP_iLO2_ssh_key_screen_01.png|center|thumb|700px|HP iLO 2 SSH key Screen.]]

Click on the ''Browse'' button, locate and select the public key file and then click on ''Authorize Key''.

'''Note''': I've not been able to get the ssh key to be accepted.

=== Enabling Telnet Access ===

To enable [[telnet]] access, click on the '''Administration''' tab, ''Settings'' > ''Access'' and click to '''Enable''' telnet.

[[Image:HP_iLO2_access_screen_01.png|center|thumb|700px|HP iLO 2 Access Screen.]]

= Using fence_ilo =

'''Warning''': By default, fence_ilo uses [[HTTPs]] to connect to the iLO BMC. Under [[EL5]], this requires that the pyOpenSSL python module be installed. If it is missing, it will fail silently. Under [[EL6]], this is not the case.

== Manually Testing fence_ilo ==

If everything went well, you should now be able to confirm that iLO is working by calling fence_ilo directly. In a case of a cluster, try calling status against all other nodes in the cluster.

'''Note''': The example below resolves cc0049.ilo to the actual IP address of the iLO BMC on the target node via /etc/hosts.

<source lang="bash">
fence_ilo -l Administrator -p secret -a cc0049.ilo -o status
</source>
<source lang="text">
Status: ON
</source>

Once this works from all nodes to all other nodes, you will be ready to actually use the fence_ilo fence agent.

== Adding fence_ilo to /etc/cluster/cluster.conf ==

This is quite similar to a normal IPMI setup, if you are familiar with them. The <fencedevice ... /> tag will be similar to the example below.

<source lang="xml">
<?xml version="1.0"?>
<cluster name="kp-cluster1" config_version="1">
<cman expected_votes="1" two_node="1"/>
<clusternodes>
<clusternode name="an-node01.alteeve.com" nodeid="1">
<fence>
<method name="ilo">
<device name="an1_ilo" action="reboot"/>
</method>
</fence>
</clusternode>
<clusternode name="an-node02.alteeve.com" nodeid="2">
<fence>
<method name="ilo">
<device name="an2_ilo" action="reboot"/>
</method>
</fence>
</clusternode>
</clusternodes>
<fencedevices>
<fencedevice name="an1_ilo" agent="fence_ilo" ipaddr="an-node01.ilo" login="Administrator" passwd="secret" />
<fencedevice name="an2_ilo" agent="fence_ilo" ipaddr="an-node02.ilo" login="Administrator" passwd="secret" />
</fencedevices>
<fence_daemon clean_start="0" post_fail_delay="0" post_join_delay="60"/>
</cluster>
</source>

All done! Once the cluster is up, test fencing it using the usual fence_node command.

{{footer}}

Configuring HP iLO 2 on EL6 - Revision history

Digimer at 01:02, 22 September 2011

Digimer: Created page with "{{howto_header}} = HP iLO Setup = HP uses a variant on IPMI called iLO, Integrated Lights-Out management. This will cover how to install and configure it for use in our..."