Exalogic Elastic Cloud IB(InfiniBand) Switch Ports State Shown as Down Status Showing AutomaticHighErrorRate Message

Oracle Exalogic Elastic Cloud
I encountered such an error in cloud control: Port IBPort[14] is polling for peer port. This could happen when the cable is unplugged from one of the ends or the other end port is disabled.

In the Exalogic Elastic Cloud racks, you may see issue of IB ports showing status as “Down” when running “ibstat” command.

This issue can of happen on Compute Nodes,İnifiniband Switch or Storage heads. IB port being down on Compute Node can be confirmed by running below command

[root@sp000exl-gwn01 ~]# listlinkup
Connector 0A Present <-> Switch Port 20 down (Enabled)
Connector 1A Present <-> Switch Port 22 up (Enabled)
Connector 2A Present <-> Switch Port 24 up (Enabled)
Connector 3A Present <-> Switch Port 26 down (Enabled)
Connector 4A Present <-> Switch Port 28 up (Enabled)
Connector 5A Present <-> Switch Port 30 up (Enabled)
Connector 6A Present <-> Switch Port 35 up (Enabled)
Connector 7A Present <-> Switch Port 33 down (Enabled)
Connector 8A Present <-> Switch Port 31 down (AutomaticHighErrorRate)
Connector 9A Present <-> Switch Port 14 down (Enabled)
Connector 10A Present <-> Switch Port 16 down (Enabled)
Connector 11A Present <-> Switch Port 12 down (Enabled)
Connector 12A Present <-> Switch Port 18 up (Enabled)
Connector 13A Present <-> Switch Port 9 up (Enabled)
Connector 14A Present <-> Switch Port 7 up (Enabled)
Connector 15A Present <-> Switch Port 5 up (Enabled)
Connector 0A-ETH Present
Bridge-0 Port 0A-ETH-1 (Bridge-0-2) up (Enabled)
Bridge-0 Port 0A-ETH-2 (Bridge-0-2) down (Enabled)
Bridge-0 Port 0A-ETH-3 (Bridge-0-1) down (Enabled)
Bridge-0 Port 0A-ETH-4 (Bridge-0-1) down (Enabled)
Connector 1A-ETH Present
Bridge-1 Port 1A-ETH-1 (Bridge-1-2) up (Enabled)
Bridge-1 Port 1A-ETH-2 (Bridge-1-2) down (Enabled)
Bridge-1 Port 1A-ETH-3 (Bridge-1-1) down (Enabled)
Bridge-1 Port 1A-ETH-4 (Bridge-1-1) down (Enabled)
Connector 0B Present <-> Switch Port 19 down (Enabled)
Connector 1B Present <-> Switch Port 21 up (Enabled)
Connector 2B Present <-> Switch Port 23 up (Enabled)
Connector 3B Present <-> Switch Port 25 down (Enabled)
Connector 4B Present <-> Switch Port 27 up (Enabled)
Connector 5B Present <-> Switch Port 29 up (Enabled)
Connector 6B Present <-> Switch Port 36 up (Enabled)
Connector 7B Present <-> Switch Port 34 down (Enabled)
Connector 8B Present <-> Switch Port 32 up (Enabled)
Connector 9B Present <-> Switch Port 13 down (Enabled)
Connector 10B Present <-> Switch Port 15 down (Enabled)
Connector 11B Present <-> Switch Port 17 down (Enabled)
Connector 12B Present <-> Switch Port 11 up (Enabled)
Connector 13B Present <-> Switch Port 10 up (Enabled)
Connector 14B Present <-> Switch Port 8 up (Enabled)
Connector 15B Present <-> Switch Port 6 up (Enabled)

[root@sp000exl-gwn01 ~]# enableswitchport 8A
Connector 8a switch port 31 not enabled with reason: Disabled but reason: AutomaticHighErrorRate

Verify the Port Status of the Port iba01 you just activated in the iba 01 Switch by running the following command in the Iba 01 Switch.

[root@sp000exl-gwn01 ~]# getportstatus 8A
Port status for connector 8A Switch port 31
Adminstate:………………….Disabled (AutomaticHighErrorRate)
LinkWidthEnabled:…………….1X or 4X
LinkWidthSupported:…………..1X or 4X
LinkWidthActive:……………..4X
LinkSpeedSupported:…………..2.5 Gbps or 5.0 Gbps or 10.0 Gbps
LinkState:…………………..Down
PhysLinkState:……………….Disabled
LinkSpeedActive:……………..2.5 Gbps
LinkSpeedEnabled:…………….2.5 Gbps or 5.0 Gbps or 10.0 Gbps
NeighborMTU:…………………4096
OperVLs:…………………….VL0-7

Step to resolve the IB Port Issue Fix

It can be disabled automatically, it is a feature that can display connectors in the presence of high error rates or insufficient connection speed or width.
This feature does not cause any problems, it just warns the customer with the abnormal condition of the connectors.
The auto-disabled feature is only available in firmware 2.1 and does not apply to firmware 1.3.
The right way to take this into account is to check and ensure that there are automatically disabled ports, and re-enable fwportport – autotomatic ‘before’ up / down by downloading fw to a different version. This will provide compatible settings when moving between different fw.

To re-enable an auto-disabled connector or IB switch port

[root@sp000exl-gwn01 ~]# enableswitchport –automatic Switch 31


Connector 8a switch port 31 already enabled

[root@sp000exl-gwn01 ~]# listlinkup
Connector 0A Present <-> Switch Port 20 down (Enabled)
Connector 1A Present <-> Switch Port 22 up (Enabled)
Connector 2A Present <-> Switch Port 24 up (Enabled)
Connector 3A Present <-> Switch Port 26 down (Enabled)
Connector 4A Present <-> Switch Port 28 up (Enabled)
Connector 5A Present <-> Switch Port 30 up (Enabled)
Connector 6A Present <-> Switch Port 35 up (Enabled)
Connector 7A Present <-> Switch Port 33 down (Enabled)
Connector 8A Present <-> Switch Port 31 up (Enabled)
Connector 9A Present <-> Switch Port 14 down (Enabled)
Connector 10A Present <-> Switch Port 16 down (Enabled)
Connector 11A Present <-> Switch Port 12 down (Enabled)
Connector 12A Present <-> Switch Port 18 up (Enabled)
Connector 13A Present <-> Switch Port 9 up (Enabled)
Connector 14A Present <-> Switch Port 7 up (Enabled)
Connector 15A Present <-> Switch Port 5 up (Enabled)
Connector 0A-ETH Present
Bridge-0 Port 0A-ETH-1 (Bridge-0-2) up (Enabled)
Bridge-0 Port 0A-ETH-2 (Bridge-0-2) down (Enabled)
Bridge-0 Port 0A-ETH-3 (Bridge-0-1) down (Enabled)
Bridge-0 Port 0A-ETH-4 (Bridge-0-1) down (Enabled)
Connector 1A-ETH Present
Bridge-1 Port 1A-ETH-1 (Bridge-1-2) up (Enabled)
Bridge-1 Port 1A-ETH-2 (Bridge-1-2) down (Enabled)
Bridge-1 Port 1A-ETH-3 (Bridge-1-1) down (Enabled)
Bridge-1 Port 1A-ETH-4 (Bridge-1-1) down (Enabled)
Connector 0B Present <-> Switch Port 19 down (Enabled)
Connector 1B Present <-> Switch Port 21 up (Enabled)
Connector 2B Present <-> Switch Port 23 up (Enabled)
Connector 3B Present <-> Switch Port 25 down (Enabled)
Connector 4B Present <-> Switch Port 27 up (Enabled)
Connector 5B Present <-> Switch Port 29 up (Enabled)
Connector 6B Present <-> Switch Port 36 up (Enabled)
Connector 7B Present <-> Switch Port 34 down (Enabled)
Connector 8B Present <-> Switch Port 32 up (Enabled)
Connector 9B Present <-> Switch Port 13 down (Enabled)
Connector 10B Present <-> Switch Port 15 down (Enabled)
Connector 11B Present <-> Switch Port 17 down (Enabled)
Connector 12B Present <-> Switch Port 11 up (Enabled)
Connector 13B Present <-> Switch Port 10 up (Enabled)
Connector 14B Present <-> Switch Port 8 up (Enabled)
Connector 15B Present <-> Switch Port 6 up (Enabled)

We control it through Ilom.

Congrats, have a nice day.

Detailed information link for the command

Link to other similar topic

Comments