Difference between revisions of "Nortel 4548GT switches"

From PDP/Grid Wiki
Jump to navigationJump to search
m
 
(19 intermediate revisions by one other user not shown)
Line 1: Line 1:
−
= Valentine subcluster switches (Nortel 4548GT) =
+
= Luilak/Bulldozer subcluster switches (Nortel 4548GT) =
  
 
The 4500 series Nortel switches are different from all others. A few hints:
 
The 4500 series Nortel switches are different from all others. A few hints:
  
 
* The serial port setting is 9600 8N1 with NO flow control
 
* The serial port setting is 9600 8N1 with NO flow control
−
* Before the serial port will work, the dip switch on the back of the unit MUST be set to "BASE". If it is set to "Unit select" you will never get any reasonable response out of the serial port!
+
* Before the serial port will work, the dip switch on the back of the unit may need to be set to "BASE". If it is set to "Unit select" you may not get any reasonable response out of the serial port
−
* Configuration of the unit, except for its own IP address, initally proceeds ONLY over the IP interfaces, NOT the serial console. However, starting the QuickConfiguration utility and then interrupting it with ^C gets you to a reasonable state. Use ^Y again to enter the console mode.
+
* <b>If nothing seems to happen, press <tt>^Y</tt></b>
 +
* The local user names (for the web interface) are "RO" and "RW", respectively.
 +
 
 +
== Vendor documentation ==
  
 
* The documentation for the 4547GT Nortel switches is at [http://support.nortel.com/go/main.jsp?cscat=DOCUMENTATION&poid=18122 http://support.nortel.com/go/main.jsp?cscat=DOCUMENTATION&poid=18122]
 
* The documentation for the 4547GT Nortel switches is at [http://support.nortel.com/go/main.jsp?cscat=DOCUMENTATION&poid=18122 http://support.nortel.com/go/main.jsp?cscat=DOCUMENTATION&poid=18122]
−
 
+
* Product page [http://products.nortel.com/go/product_content.jsp?prod_id=60960 http://products.nortel.com/go/product_content.jsp?prod_id=60960]
−
Net conclusion: avoid these switches if you can, since their config options are weird and nonstandard, and documentation is ... well, what about documentation?!
+
* Picture of 4548GT [http://www.nortel.com/products/01/passport/4500/images/ers_4548gt_1000x284.jpg at http://www.nortel.com/products/01/passport/4500/images/ers_4548gt_1000x284.jpg]
  
 
== What You Should See ==
 
== What You Should See ==
Line 17: Line 20:
 
   enable    Turn on privileged commands
 
   enable    Turn on privileged commands
 
   exit      Exit from the EXEC
 
   exit      Exit from the EXEC
−
  help      Description of the interactive help system
+
  ...
−
  logout    Exit from the EXEC and end the current session
 
−
  ping      Send echo messages
 
−
  show      Show running system information
 
−
  telnet    Telnet to another host
 
−
  terminal Set terminal line parameters
 
  
 
== Proposed Configuration ==
 
== Proposed Configuration ==
  
−
Configure trunk using LACP, and run both VLAN 9 and VLAN 4 tagged over this trunk. The management interface of the switch can be assigned to VLAN4 and then configured with the ip address of the switch using:
+
Configure trunk using LACP on ports 47 and 48 (the two right-most ports) and run both VLAN 9 and VLAN 4 tagged over this trunk. All other ports 1-44 are be be untagged ports in VLAN 9. Except on sw-03, which is a 24 port switch!
 +
 
 +
Preliminary configuration
 +
 
 +
ena
 +
conf t
 +
autosave enable
 +
cli password switch serial local
 +
cli password switch telnet local
 +
cli password switch read-only "IPMILOW"
 +
cli password switch read-write "IPMI"
 +
cli password stack read-only "IPMILOW"
 +
cli password stack read-write "IPMI"
 +
snmp-server community "public" ro
 +
snmp-server community "COMPLEXHASH" rw
 +
snmp-server contact "grid.sysadmin@nikhef.nl"
 +
snmp-server name "farmnet-sw-valentine-<i>XX</i>"
 +
snmp-server location "H139"
 +
 
 +
Disable spanning tree for safety
 +
 
 +
interface FastEthernet ALL
 +
spanning-tree port 1-48 learning fast
 +
spanning-tree port 1-48 cost 1 priority 80
 +
exit
 +
 
 +
Create the appropriate vlans
 +
 
 +
vlan create 4 name IPMI type port
 +
vlan create 9 name FARMNET type port
 +
vlan configcontrol automatic
 +
vlan members remove 1 1-48
 +
vlan ports 1-46 tagging disable
 +
vlan ports 47-48 tagging enable
 +
vlan ports 47-48 tagging tagAll
 +
vlan members 9 1-46
 +
vlan members add 4 47-48
 +
vlan members add 9 47-48
 +
 
 +
Configure the proper type of trunking:
 +
 
 +
no mlt 1
 +
int FastEthernet 47-48
 +
lacp aggregation port 47-48 enable
 +
lacp mode port 47-48 active
 +
exit
 +
 
 +
The management interface of the switch can be assigned to VLAN4 now and then configured with the ip address of the switch using:
  
 
  vlan mgmt 4
 
  vlan mgmt 4
−
  ip address 172.20.X.Y
+
  ip address 172.20.1.YYY
 
  ip address netmask 255.255.0.0
 
  ip address netmask 255.255.0.0
 
  ip default-gateway 172.20.255.254
 
  ip default-gateway 172.20.255.254
 +
 +
where
 +
{|style="background:silver; color:black"
 +
| farmnet-sw-valentine-01.ipmi.nikhef.nl || 172.20.1.248
 +
|-
 +
| farmnet-sw-valentine-02.ipmi.nikhef.nl || 172.20.1.249
 +
|-
 +
| farmnet-sw-valentine-03.ipmi.nikhef.nl || 172.20.1.250
 +
|-
 +
| farmnet-sw-valentine-01S.ipmi.nikhef.nl || 172.20.1.245
 +
|-
 +
| farmnet-sw-valentine-02S.ipmi.nikhef.nl || 172.20.1.246
 +
|-
 +
| farmnet-sw-valentine-03S.ipmi.nikhef.nl || 172.20.1.247
 +
|}
 +
 +
Try and save the configuration:
 +
 +
exit
 +
copy config nvram
 +
 +
and check the LACP status with
 +
 +
sho lacp debug member 47-48
 +
 +
== Deel configuration ==
 +
 +
The link aggregation group on deel should also be LACP (802.3ad, i.e., dynamic)
 +
 +
lag "farmnet-sw-valentine-01" dynamic
 +
  ports e 13/3 to 13/4
 +
  primary-port 13/3
 +
  deploy
 +
  port-name "farmnet-sw-valentine-01-A" ethernet 13/3
 +
  port-name "farmnet-sw-valentine-01-A" ethernet 13/4
 +
  exit
 +
 +
lag "farmnet-sw-valentine-02" dynamic
 +
  ports e 13/5 to 13/6
 +
  primary-port 13/5
 +
  deploy
 +
  port-name "farmnet-sw-valentine-02-A" ethernet 13/5
 +
  port-name "farmnet-sw-valentine-02-A" ethernet 13/6
 +
  exit
 +
 +
lag "farmnet-sw-valentine-03" dynamic
 +
  ports e 13/11 to 13/12
 +
  primary-port 13/11
 +
  deploy
 +
  port-name "farmnet-sw-valentine-03-A" ethernet 13/11
 +
  port-name "farmnet-sw-valentine-03-A" ethernet 13/12
 +
  exit
 +
 +
and update the cricket configuration ...

Latest revision as of 17:55, 3 September 2009

Luilak/Bulldozer subcluster switches (Nortel 4548GT)

The 4500 series Nortel switches are different from all others. A few hints:

  • The serial port setting is 9600 8N1 with NO flow control
  • Before the serial port will work, the dip switch on the back of the unit may need to be set to "BASE". If it is set to "Unit select" you may not get any reasonable response out of the serial port
  • If nothing seems to happen, press ^Y
  • The local user names (for the web interface) are "RO" and "RW", respectively.

Vendor documentation

What You Should See

4548GT>
Exec commands:
 enable    Turn on privileged commands
 exit      Exit from the EXEC
...

Proposed Configuration

Configure trunk using LACP on ports 47 and 48 (the two right-most ports) and run both VLAN 9 and VLAN 4 tagged over this trunk. All other ports 1-44 are be be untagged ports in VLAN 9. Except on sw-03, which is a 24 port switch!

Preliminary configuration 

ena
conf t
autosave enable
cli password switch serial local
cli password switch telnet local
cli password switch read-only "IPMILOW"
cli password switch read-write "IPMI"
cli password stack read-only "IPMILOW"
cli password stack read-write "IPMI"
snmp-server community "public" ro
snmp-server community "COMPLEXHASH" rw
snmp-server contact "grid.sysadmin@nikhef.nl"
snmp-server name "farmnet-sw-valentine-XX"
snmp-server location "H139"

Disable spanning tree for safety 

interface FastEthernet ALL
spanning-tree port 1-48 learning fast
spanning-tree port 1-48 cost 1 priority 80
exit

Create the appropriate vlans 

vlan create 4 name IPMI type port
vlan create 9 name FARMNET type port
vlan configcontrol automatic
vlan members remove 1 1-48
vlan ports 1-46 tagging disable
vlan ports 47-48 tagging enable
vlan ports 47-48 tagging tagAll
vlan members 9 1-46
vlan members add 4 47-48
vlan members add 9 47-48

Configure the proper type of trunking: 

no mlt 1
int FastEthernet 47-48
lacp aggregation port 47-48 enable
lacp mode port 47-48 active
exit

The management interface of the switch can be assigned to VLAN4 now and then configured with the ip address of the switch using: 

vlan mgmt 4
ip address 172.20.1.YYY
ip address netmask 255.255.0.0
ip default-gateway 172.20.255.254

where

farmnet-sw-valentine-01.ipmi.nikhef.nl 172.20.1.248
farmnet-sw-valentine-02.ipmi.nikhef.nl 172.20.1.249
farmnet-sw-valentine-03.ipmi.nikhef.nl 172.20.1.250
farmnet-sw-valentine-01S.ipmi.nikhef.nl 172.20.1.245
farmnet-sw-valentine-02S.ipmi.nikhef.nl 172.20.1.246
farmnet-sw-valentine-03S.ipmi.nikhef.nl 172.20.1.247

Try and save the configuration: 

exit
copy config nvram

and check the LACP status with 

sho lacp debug member 47-48

Deel configuration

The link aggregation group on deel should also be LACP (802.3ad, i.e., dynamic) 

lag "farmnet-sw-valentine-01" dynamic
 ports e 13/3 to 13/4
 primary-port 13/3
 deploy
 port-name "farmnet-sw-valentine-01-A" ethernet 13/3
 port-name "farmnet-sw-valentine-01-A" ethernet 13/4
 exit

lag "farmnet-sw-valentine-02" dynamic
 ports e 13/5 to 13/6
 primary-port 13/5
 deploy
 port-name "farmnet-sw-valentine-02-A" ethernet 13/5
 port-name "farmnet-sw-valentine-02-A" ethernet 13/6
 exit

lag "farmnet-sw-valentine-03" dynamic
 ports e 13/11 to 13/12
 primary-port 13/11
 deploy
 port-name "farmnet-sw-valentine-03-A" ethernet 13/11
 port-name "farmnet-sw-valentine-03-A" ethernet 13/12
 exit

and update the cricket configuration ...

Retrieved from "https://wiki.nikhef.nl/grid/index.php?title=Nortel_4548GT_switches&oldid=7177"