Difference between revisions of "Nortel 4548GT switches"

From PDP/Grid Wiki
Jump to navigationJump to search
 
(5 intermediate revisions by one other user not shown)
Line 1: Line 1:
−
= Valentine subcluster switches (Nortel 4548GT) =
+
= Luilak/Bulldozer subcluster switches (Nortel 4548GT) =
  
 
The 4500 series Nortel switches are different from all others. A few hints:
 
The 4500 series Nortel switches are different from all others. A few hints:
  
 
* The serial port setting is 9600 8N1 with NO flow control
 
* The serial port setting is 9600 8N1 with NO flow control
−
* Before the serial port will work, the dip switch on the back of the unit MUST be set to "BASE". If it is set to "Unit select" you will never get any reasonable response out of the serial port!
+
* Before the serial port will work, the dip switch on the back of the unit may need to be set to "BASE". If it is set to "Unit select" you may not get any reasonable response out of the serial port
−
* Configuration of the unit, except for its own IP address, initally proceeds ONLY over the IP interfaces, NOT the serial console. However, starting the QuickConfiguration utility and then interrupting it with ^C gets you to a reasonable state. Use ^Y again to enter the console mode.
 
 
* <b>If nothing seems to happen, press <tt>^Y</tt></b>
 
* <b>If nothing seems to happen, press <tt>^Y</tt></b>
 
* The local user names (for the web interface) are "RO" and "RW", respectively.
 
* The local user names (for the web interface) are "RO" and "RW", respectively.
Line 25: Line 24:
 
== Proposed Configuration ==
 
== Proposed Configuration ==
  
−
Configure trunk using MLT (LACP?) on ports 47 and 48 (the two right-most ports) and run both VLAN 9 and VLAN 4 tagged over this trunk. All other ports 1-44 are be be untagged ports in VLAN 9.
+
Configure trunk using LACP on ports 47 and 48 (the two right-most ports) and run both VLAN 9 and VLAN 4 tagged over this trunk. All other ports 1-44 are be be untagged ports in VLAN 9. Except on sw-03, which is a 24 port switch!
 +
 
 +
Preliminary configuration
  
 
  ena
 
  ena
 
  conf t
 
  conf t
 
  autosave enable
 
  autosave enable
−
  mlt 1 name uplink enable member 47-48
+
  cli password switch serial local
 +
cli password switch telnet local
 +
cli password switch read-only "IPMILOW"
 +
cli password switch read-write "IPMI"
 +
cli password stack read-only "IPMILOW"
 +
cli password stack read-write "IPMI"
 +
snmp-server community "public" ro
 +
snmp-server community "COMPLEXHASH" rw
 +
snmp-server contact "grid.sysadmin@nikhef.nl"
 +
snmp-server name "farmnet-sw-valentine-<i>XX</i>"
 +
snmp-server location "H139"
 +
 
 +
Disable spanning tree for safety
 +
 
 +
interface FastEthernet ALL
 +
spanning-tree port 1-48 learning fast
 +
  spanning-tree port 1-48 cost 1 priority 80
 +
exit
 +
 
 +
Create the appropriate vlans
 +
 
 
  vlan create 4 name IPMI type port
 
  vlan create 4 name IPMI type port
 
  vlan create 9 name FARMNET type port
 
  vlan create 9 name FARMNET type port
 
  vlan configcontrol automatic
 
  vlan configcontrol automatic
 +
vlan members remove 1 1-48
 
  vlan ports 1-46 tagging disable
 
  vlan ports 1-46 tagging disable
 
  vlan ports 47-48 tagging enable
 
  vlan ports 47-48 tagging enable
−
  vlan members remove 1 1-48
+
  vlan ports 47-48 tagging tagAll
−
  vlan members 9 1-44
+
  vlan members 9 1-46
 
  vlan members add 4 47-48
 
  vlan members add 4 47-48
 
  vlan members add 9 47-48
 
  vlan members add 9 47-48
 +
 +
Configure the proper type of trunking:
 +
 +
no mlt 1
 +
int FastEthernet 47-48
 +
lacp aggregation port 47-48 enable
 +
lacp mode port 47-48 active
 +
exit
  
 
The management interface of the switch can be assigned to VLAN4 now and then configured with the ip address of the switch using:
 
The management interface of the switch can be assigned to VLAN4 now and then configured with the ip address of the switch using:
  
−
conf t
 
 
  vlan mgmt 4
 
  vlan mgmt 4
−
  ip address 172.20.X.Y
+
  ip address 172.20.1.YYY
 
  ip address netmask 255.255.0.0
 
  ip address netmask 255.255.0.0
 
  ip default-gateway 172.20.255.254
 
  ip default-gateway 172.20.255.254
−
cli password switch serial local
 
−
cli password switch telnet local
 
−
cli password switch read-only "LOWIPMIPASSWD"
 
−
cli password switch read-write "IPMIPASSWD"
 
−
cli password stack read-only "LOWIPMIPASSWD"
 
−
cli password stack read-write "IPMIPASSWD"
 
−
snmp-server community "public" ro
 
−
snmp-server community "COMPLEXHASH" rw
 
−
snmp-server contact "grid.sysadmin@nikhef.nl"
 
−
snmp-server name "farmnet-sw-valentine-XX"
 
−
snmp-server location "H139"
 
  
−
where farmnet-sw-valentine-01.ipmi.nikhef.nl = 172.20.1.248, -02 = 172.20.1.249, and -03 = 172.20.1.250.
+
where
 +
{|style="background:silver; color:black"
 +
| farmnet-sw-valentine-01.ipmi.nikhef.nl || 172.20.1.248
 +
|-
 +
| farmnet-sw-valentine-02.ipmi.nikhef.nl || 172.20.1.249
 +
|-
 +
| farmnet-sw-valentine-03.ipmi.nikhef.nl || 172.20.1.250
 +
|-
 +
| farmnet-sw-valentine-01S.ipmi.nikhef.nl || 172.20.1.245
 +
|-
 +
| farmnet-sw-valentine-02S.ipmi.nikhef.nl || 172.20.1.246
 +
|-
 +
| farmnet-sw-valentine-03S.ipmi.nikhef.nl || 172.20.1.247
 +
|}
  
−
Set the STP leaning mode to fast
+
Try and save the configuration:
  
−
interface FastEthernet ALL
 
−
spanning-tree port 1-48 learning fast
 
−
spanning-tree port 1-48 cost 1 priority 80
 
 
  exit
 
  exit
 +
copy config nvram
 +
 +
and check the LACP status with
 +
 +
sho lacp debug member 47-48
 +
 +
== Deel configuration ==
 +
 +
The link aggregation group on deel should also be LACP (802.3ad, i.e., dynamic)
  
−
Try and save the configuration:
+
lag "farmnet-sw-valentine-01" dynamic
 +
  ports e 13/3 to 13/4
 +
  primary-port 13/3
 +
  deploy
 +
  port-name "farmnet-sw-valentine-01-A" ethernet 13/3
 +
  port-name "farmnet-sw-valentine-01-A" ethernet 13/4
 +
  exit
 +
 
 +
lag "farmnet-sw-valentine-02" dynamic
 +
  ports e 13/5 to 13/6
 +
  primary-port 13/5
 +
  deploy
 +
  port-name "farmnet-sw-valentine-02-A" ethernet 13/5
 +
  port-name "farmnet-sw-valentine-02-A" ethernet 13/6
 +
  exit
 +
 
 +
lag "farmnet-sw-valentine-03" dynamic
 +
  ports e 13/11 to 13/12
 +
  primary-port 13/11
 +
  deploy
 +
  port-name "farmnet-sw-valentine-03-A" ethernet 13/11
 +
  port-name "farmnet-sw-valentine-03-A" ethernet 13/12
 +
  exit
  
−
copy config nvram
+
and update the cricket configuration ...

Latest revision as of 15:55, 3 September 2009

Luilak/Bulldozer subcluster switches (Nortel 4548GT)

The 4500 series Nortel switches are different from all others. A few hints:

  • The serial port setting is 9600 8N1 with NO flow control
  • Before the serial port will work, the dip switch on the back of the unit may need to be set to "BASE". If it is set to "Unit select" you may not get any reasonable response out of the serial port
  • If nothing seems to happen, press ^Y
  • The local user names (for the web interface) are "RO" and "RW", respectively.

Vendor documentation

What You Should See

4548GT>
Exec commands:
 enable    Turn on privileged commands
 exit      Exit from the EXEC
...

Proposed Configuration

Configure trunk using LACP on ports 47 and 48 (the two right-most ports) and run both VLAN 9 and VLAN 4 tagged over this trunk. All other ports 1-44 are be be untagged ports in VLAN 9. Except on sw-03, which is a 24 port switch!

Preliminary configuration 

ena
conf t
autosave enable
cli password switch serial local
cli password switch telnet local
cli password switch read-only "IPMILOW"
cli password switch read-write "IPMI"
cli password stack read-only "IPMILOW"
cli password stack read-write "IPMI"
snmp-server community "public" ro
snmp-server community "COMPLEXHASH" rw
snmp-server contact "grid.sysadmin@nikhef.nl"
snmp-server name "farmnet-sw-valentine-XX"
snmp-server location "H139"

Disable spanning tree for safety 

interface FastEthernet ALL
spanning-tree port 1-48 learning fast
spanning-tree port 1-48 cost 1 priority 80
exit

Create the appropriate vlans 

vlan create 4 name IPMI type port
vlan create 9 name FARMNET type port
vlan configcontrol automatic
vlan members remove 1 1-48
vlan ports 1-46 tagging disable
vlan ports 47-48 tagging enable
vlan ports 47-48 tagging tagAll
vlan members 9 1-46
vlan members add 4 47-48
vlan members add 9 47-48

Configure the proper type of trunking: 

no mlt 1
int FastEthernet 47-48
lacp aggregation port 47-48 enable
lacp mode port 47-48 active
exit

The management interface of the switch can be assigned to VLAN4 now and then configured with the ip address of the switch using: 

vlan mgmt 4
ip address 172.20.1.YYY
ip address netmask 255.255.0.0
ip default-gateway 172.20.255.254

where

farmnet-sw-valentine-01.ipmi.nikhef.nl 172.20.1.248
farmnet-sw-valentine-02.ipmi.nikhef.nl 172.20.1.249
farmnet-sw-valentine-03.ipmi.nikhef.nl 172.20.1.250
farmnet-sw-valentine-01S.ipmi.nikhef.nl 172.20.1.245
farmnet-sw-valentine-02S.ipmi.nikhef.nl 172.20.1.246
farmnet-sw-valentine-03S.ipmi.nikhef.nl 172.20.1.247

Try and save the configuration: 

exit
copy config nvram

and check the LACP status with 

sho lacp debug member 47-48

Deel configuration

The link aggregation group on deel should also be LACP (802.3ad, i.e., dynamic) 

lag "farmnet-sw-valentine-01" dynamic
 ports e 13/3 to 13/4
 primary-port 13/3
 deploy
 port-name "farmnet-sw-valentine-01-A" ethernet 13/3
 port-name "farmnet-sw-valentine-01-A" ethernet 13/4
 exit

lag "farmnet-sw-valentine-02" dynamic
 ports e 13/5 to 13/6
 primary-port 13/5
 deploy
 port-name "farmnet-sw-valentine-02-A" ethernet 13/5
 port-name "farmnet-sw-valentine-02-A" ethernet 13/6
 exit

lag "farmnet-sw-valentine-03" dynamic
 ports e 13/11 to 13/12
 primary-port 13/11
 deploy
 port-name "farmnet-sw-valentine-03-A" ethernet 13/11
 port-name "farmnet-sw-valentine-03-A" ethernet 13/12
 exit

and update the cricket configuration ...

Retrieved from "https://wiki.nikhef.nl/grid/index.php?title=Nortel_4548GT_switches&oldid=7177"