All nodes are configured with BMC ip address. Below is the table with all IP address (Including the compute nodes of the Power Edge M1000e)
==== Add main switch to Bright Cluster Manager ====
Adding Dell Networking N2048 Switch management IP address. This is the BMC network all nodes will be using for IPMI communications.
Connect to the switch using the console and issue the following commands
==== Mangement Nodes ====
^Node Names ^BMC IP's ^
|bright1 |172.17.0.1 |
|bright2 |172.17.0.2 |
|login01 |172.17.0.3 |
|login02 |172.17.0.4 |
|sched |172.17.0.5 |
|imlnode |172.17.0.6 |
|nfs01 |172.17.0.7 |
|nfs02 |172.17.0.8 |
|mds01 |172.17.0.9 |
|mds02 |172.17.0.10|
|oss01 |172.17.0.11|
|oss02 |172.17.0.12|
After plugging nodes on the switch, bright discovers mac address through switch ports
[bright1->device]% newnodes
MAC First appeared Detected on switch port
-------------------- -------------------------------- ----------------------------
10:98:36:B5:66:93 Fri, 11 Aug 2017 17:51:00 SAST switch01:2
10:98:36:B5:66:A3 Fri, 11 Aug 2017 17:51:29 SAST switch01:3
10:98:36:B5:66:1F Fri, 11 Aug 2017 17:51:29 SAST switch01:4
10:98:36:B5:6D:DB Fri, 11 Aug 2017 17:51:59 SAST switch01:5
10:98:36:B5:6A:FF Fri, 11 Aug 2017 17:51:59 SAST switch01:6
18:66:DA:94:D4:33 Fri, 11 Aug 2017 17:51:59 SAST switch01:7
18:66:DA:94:D8:D1 Fri, 11 Aug 2017 17:51:00 SAST switch01:8
18:66:DA:94:D3:8B Fri, 11 Aug 2017 17:51:29 SAST switch01:9
18:66:DA:94:D2:C1 Fri, 11 Aug 2017 17:51:29 SAST switch01:10
84:7B:EB:F5:CA:46 Fri, 11 Aug 2017 17:51:59 SAST switch01:11
84:7B:EB:F5:D9:02 Fri, 11 Aug 2017 17:51:59 SAST switch01:12
For each node the following is done. Only the procedure for adding "sched" is shown below. "sched" node is connected on switch port 5:
**Define "sched"**
[bright1->device]% add physicalnode sched
[bright1->device*[sched*]]%
**Link the node to the switch port**
[bright1->device*[sched*]]% set ethernetswitch switch01:5
==== Define network interfaces for the node ====
**Configure IPMI Interface**
[bright1->device*[sched*]]% interfaces
[bright1->device*[sched*]->interfaces]% add bmc ipmi0
Switched power control for this node to: ipmi0
[bright1->device*[sched*]->interfaces*[ipmi0*]]% set network ipminet
[bright1->device*[sched*]->interfaces*[ipmi0*]]% set ip 172.17.0.5
[bright1->device*[sched*]->interfaces*[ipmi0*]]% exit
**Configure Ethernet interface called "bootif" **
[bright1->device*[sched*]->interfaces*]% add physical BOOTIF
[bright1->device*[sched*]->interfaces*[BOOTIF*]]% set network internalnet
[bright1->device*[sched*]->interfaces*[BOOTIF*]]% set dhcp yes
[bright1->device*[sched*]->interfaces*[BOOTIF*]]% exit
**Configure Infinabnd Interface**
[bright1->device*[sched*]->interfaces*]% add physical ib0
[bright1->device*[sched*]->interfaces*[ib0*]]% set network ibnet
[bright1->device*[sched*]->interfaces*[ib0*]]% set dhcp yes
[bright1->device*[sched*]->interfaces*[ib0*]]% exit
**List defined Network interfaces**
[bright1->device[sched]->interfaces]% list
Type Network device name IP Network
------------ -------------------- ---------------- ----------------
bmc ipmi0 172.17.0.5 ipminet
physical BOOTIF [prov,dhcp] 172.18.0.221 internalnet
physical ib0 [dhcp] 0.0.0.0 ibnet
[bright1->device[sched]->interfaces]%
NB: ib network ip is issued when OFED is installed. Click Infiniband [[Install and Configure]] to view the steps
**Set provisioning Interface**
[bright1->device*[sched*]]% set provisioninginterface bootif
**Set node category. (node categories are linked to software images)**
[bright1->device*[sched*]]% set category scheduler
**Commit all the chages**
[bright1->device*[sched*]]% commit
The node begins to install after the "commit" command
==== Compute Node ====
^Node Names ^BMC IP's ^
|cnode01 |172.17.0.15|
|cnode02 |172.17.0.16|
|cnode03 |172.17.0.17|
|cnode04 |172.17.0.18|
|cnode05 |172.17.0.19|
|cnode06 |172.17.0.20|
|cnode07 |172.17.0.21|
|cnode08 |172.17.0.22|
|cnode09 |172.17.0.23|
|cnode10 |172.17.0.24|
|cnode11 |172.17.0.25|
|cnode12 |172.17.0.26|
|cnode13 |172.17.0.27|
|cnode14 |172.17.0.28|
|cnode15 |172.17.0.29|
|cnode16 |172.17.0.30|