Troubleshooting steps for SFP/QSFP interfaces on EX/QFX devices.
These steps should be executed on the FPC that contains the interface. For example, if the port is xe-0/0/46, the FPC is 0.
The commands are executed from the PFE shell. To enter the shell of FPC 0:
start shell pfe network fpc0
Note the below commands vary for QSFP and SFP form factors; they have been split into two separate headings.
To get information for a transceiver, first show the list of SFP's to get the interface index:
show sfp list
Example output (taken from an EX4650):
{master:0}
me@host> start shell pfe network fpc0
Switching platform (2199 Mhz Pentium processor, 639MB memory, 0KB flash)
FPC0(host vty)# show sfp list
SFP Toolkit summary:
wakeup count: 19287880, debug: 0, periodic enabled: 1, diagnostics enabled: 1
thread: 0xaf8f3d30, itable: 0xaf8e15d0, itable iterator: 0, sem: 0xaf91e650
polling interval delay: 1000 ms, polling max cpu: 100 ms
poll for diags every 3 wakeups , SFPs polled for diags last time: 15
last periodic CPU time: 104 ms, maximum periodic CPU time: 10082 ms
max SFPs to poll per interval: 8
SFP Toolkit syslog throttling parameters:
period: 120 samples , disable threshold: 10, enable threshold 0
SFP periodic diagnostics polling count: 4
diag
Index Name Presence ID Eprom PNO SNO calibr Toxic
----- -------------- ---------- -------- ---------- ----------- ------- -------
2 sfp-0/0/1(1) Present Complete NON-JNPR UKA0F5F int Unknown
3 sfp-0/0/2(2) Present Complete NON-JNPR AUA0B8T int Unknown
4 sfp-0/0/3(3) Present Complete NON-JNPR AUA0B7H int Unknown
6 sfp-0/0/5(5) Present Complete 740-021310 C2003129187 int Unknown
7 sfp-0/0/6(6) Present Complete NON-JNPR AUA0AGE int Unknown
8 sfp-0/0/7(7) Present Complete NON-JNPR CN053HVN55K5LE5 Unknown
9 sfp-0/0/8(8) Present Complete NON-JNPR E2007050166 int Unknown
10 sfp-0/0/9(9) Present Complete NON-JNPR E2007050162 int Unknown
12 sfp-0/0/11(11) Present Complete NON-JNPR E2007050169 int Unknown
14 sfp-0/0/13(13) Present Complete NON-JNPR APC0QEM int Unknown
15 sfp-0/0/14(14) Present Complete NON-JNPR ALP04JV int Unknown
16 sfp-0/0/16(16) Present Complete NON-JNPR E2007050125 int Unknown
17 sfp-0/0/17(17) Present Complete NON-JNPR E2007050122 int Unknown
18 sfp-0/0/19(19) Present Complete NON-JNPR CN053HVN7CL6U60 Unknown
19 sfp-0/0/20(20) Present Complete NON-JNPR APM0QLW int Unknown
20 sfp-0/0/21(21) Present Complete NON-JNPR APC0QH9 int Unknown
21 sfp-0/0/22(22) Present Complete NON-JNPR N0602240045 int Unknown
22 sfp-0/0/23(23) Present Complete NON-JNPR APA0PBZ int Unknown
23 sfp-0/0/32(32) Present Complete 740-031980 S2101318213 int Unknown
24 sfp-0/0/34(34) Present Complete 740-031980 S2101318212 int Unknown
25 sfp-0/0/4(4) Present Complete NON-JNPR AUA0AKT int Unknown
26 sfp-0/0/10(10) Present Complete NON-JNPR E2007050212 int Unknown
28 sfp-0/0/12(12) Present Complete 740-021310 C2003129184 int Unknown
29 sfp-0/0/0(0) Present Complete NON-JNPR UK90MS6 int Unknown
30 sfp-0/0/46(46) Present Complete 740-011782 F2010956657 int Unknown
I2C Acceleration table
Index Name Presence ID Eprom Reg ID I2C Master I2C Group
----- -------------- ---------- -------- -------- ------------ -------
To get the information for the interface xe-0/0/23, the interface index needs to be looked up from the above output. In this case, the index for the interface is 22.
Use the show sfp command to get the information for the supplied interface index:
show sfp 22 info
Example output:
FPC0(host vty)# show sfp 22 info
index: 0x16
sfp name: sfp-0/0/23
pic context: 0xb09f36c0
id mem scanned: true
linkstate: Up
sfp_present: true
sfp_changed: false
i2c failure count: 0x0
diag polling count: 0x3BC1
no diag polling from RE:0x0
run_periodic: false
Use with caution; this may cause unexpected behaviour and the interface will be taken offline.
To soft reseat port 46 on PIC 0, first virtually remove the interface:
set cmqfx xcvr remove pic 0 port 46
Example output:
FPC0(host vty)# set cmqfx xcvr remove pic 0 port 46
Soft removing pic/port: 0/46!!!
FPC0(host vty)# [Wed Mar 2 11:50:52.927 LOG: Info] sfp-0/0/46 SFP unplugged
[Wed Mar 2 11:50:52.927 LOG: Info] optic_sfp_check_sfp_destory: Detaching sfp-0/0/46
The interface can then be virtually plugged in again using the insert command:
set cmqfx xcvr insert pic 0 port 46
Example output:
FPC0(host vty)# set cmqfx xcvr insert pic 0 port 46
Soft inserting pic/port: 0/46!!!
FPC0(host vty)# [Wed Mar 2 11:51:06.255 LOG: Info] sfp-0/0/46 SFP plugged in
[Wed Mar 2 11:51:07.871 LOG: Info] PORTDEV: 1G cable_type for 0/0/46 port_type 7
To get information for a transceiver, first show the list of SFP's to get the interface index:
show qsfp list
Example output (taken from a QFX5120-32C):
FPC0(host vty)# show qsfp list
QSFP Toolkit summary:
wakeup count: 431, debug: 0
thread: 0xcf9da690, itable: 0xcf9c8238
Index Name State
----- ---- -----
1 qsfp-0/0/0 Present
2 qsfp-0/0/1 Present
3 qsfp-0/0/30 Present
4 qsfp-0/0/31 Present
To get the information for the interface et-0/0/30 (known as qsfp-0/0/30 in the list output), the interface index needs to be looked up from the above output. In this case, the index for the interface is 3.
Use the show qsfp command to get the information for the supplied interface index:
show qsfp 3 info
Example output:
FPC0(host vty)# show qsfp 3 info
index: 0x03
link_id: 0x1E
qsfp name: qsfp-0/0/30
hw_initialized: true
pic context: 0xD0BF1E50
last_status: true
hi (id) mem scanned: true
laser config missing: false
tx_laser_on_off[0]: NA
tx_laser_on_off[1]: NA
tx_laser_on_off[2]: NA
tx_laser_on_off[3]: NA
low (diag) mem scanned: true
qsfp_present: true
qsfp_changed: false
i2c failure count: 0x0
pwr failure count: 0x0
periodic count: 0x223
consec fail count: 0x0
run_periodic: true
id scan iteration: 0
max_i2c_failures: 10
max_pwr_failures: 3
init_delay_secs: 2
Diag poll interval: 30
fast_id_scan: true
is_load_qsfp: false
diag_periodic_interval: 30
aw_alarm_enable: 0x00000000 0x00000000 0x00000000 0x00000000
aw_alarm_action: 0x00000000 0x00000000 0x00000000 0x00000000
QSFP IDEEPROM:
Address 0x00: 11 00 23 88 00 00 00 00 00 00 00 05 ff 00 00 00
Address 0x10: 00 00 01 a0 46 53 20 20 20 20 20 20 20 20 20 20
Address 0x20: 20 20 20 20 1f 00 00 00 51 32 38 2d 50 43 30 31
Address 0x30: 20 20 20 20 20 20 20 20 41 20 00 00 00 00 55 6b
Address 0x40: 0b 00 00 00 46 32 30 32 30 34 30 36 30 32 30 2d
Address 0x50: 31 20 20 20 32 30 31 32 32 31 20 20 00 00 67 ce
Address 0x60: 37 34 30 2d 30 36 31 30 30 30 20 52 45 56 20 30
Address 0x70: 31 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
QSFP IDEEPROM (diagnostics):
Address 0x00: 11 00 06 ff ff ff ff ff ff ff ff ff ff ff ff ff
Address 0x10: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff
Address 0x20: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff
Address 0x30: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff
Address 0x40: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff
Address 0x50: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff
Address 0x60: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff
Address 0x70: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff 00
Use with caution; this may cause unexpected behaviour and the interface will be taken offline.
To soft reseat port 0 on PIC 0, first virtually remove the interface:
set cmqfx xcvr remove pic 0 port 0
Example output:
FPC0(host vty)# set cmqfx xcvr remove pic 0 port 0
Soft removing pic/port: 0/0!!!
[Tue Apr 5 08:01:30.313 LOG: Notice] qsfp-0/0/0 set to not present
[Tue Apr 5 08:01:30.313 LOG: Info] qsfp-0/0/0 QSFP unplugged
[Tue Apr 5 08:01:30.631 LOG: Info] cos_ifd_cmd: Delete interface et-0/0/0
[Tue Apr 5 08:01:30.693 LOG: Debug] dcbcm_port_resource_multi_set_on_quad no change needed for user_port:0 speed: 0 encap: 0
[Tue Apr 5 08:01:30.694 LOG: Debug] L2_PORT_SET_L2_FEATURE: L2_DEBUG : brcm_port_init_def1298:Setting L2 Learn (unit 0, port_num 1), learn_flg 0
[Tue Apr 5 08:01:30.694 LOG: Info] DCBCM: Detaching ifd et-0/0/0
[Tue Apr 5 08:01:30.694 LOG: Info] PORTDEV: DEVSTOP for et-0/0/0
[Tue Apr 5 08:01:30.694 LOG: Debug] Disabled FEC for port 0 with ret 0
[Tue Apr 5 08:01:30.724 LOG: Debug] dcbcm_port_resource_multi_set_on_quad no change needed for user_port:0 speed: 100000 encap: 0
The interface can then be virtually plugged in again using the insert command:
set cmqfx xcvr insert pic 0 port 0
Example output:
FPC0(host vty)# set cmqfx xcvr insert pic 0 port 0
Soft inserting pic/port: 0/0!!!
FPC0(host vty)#
[Tue Apr 5 08:02:11.315 LOG: Notice] qsfp-0/0/0 plugged in
[Tue Apr 5 08:02:12.784 LOG: Info] qsfp-0/0/0: DAC - No HW init
[Tue Apr 5 08:02:13.789 LOG: Info] qsfp_tk_laser_control_channel: qsfp-0/0/0 does not support laser control for channel 0
[Tue Apr 5 08:02:13.789 LOG: Info] qsfp_tk_laser_control_channel: qsfp-0/0/0 does not support laser control for channel 1
[Tue Apr 5 08:02:13.789 LOG: Info] qsfp_tk_laser_control_channel: qsfp-0/0/0 does not support laser control for channel 2
[Tue Apr 5 08:02:13.789 LOG: Info] qsfp_tk_laser_control_channel: qsfp-0/0/0 does not support laser control for channel 3
[Tue Apr 5 08:02:13.928 LOG: Err] dcbcm_get_port_cable_type: invalid ifd ptr
[Tue Apr 5 08:02:13.928 LOG: Debug] dcbcm_port_resource_multi_set_on_quad no change needed for user_port:0 speed: 0 encap: 0
[Tue Apr 5 08:02:13.929 LOG: Debug] L2_PORT_SET_L2_FEATURE: L2_DEBUG : brcm_port_init_def1298:Setting L2 Learn (unit 0, port_num 1), learn_flg 0
[Tue Apr 5 08:02:13.936 LOG: Info] DCBCM: Attaching ifd et-0/0/0
[Tue Apr 5 08:02:13.936 LOG: Debug] Disabled FEC for port 0 with ret 0
[Tue Apr 5 08:02:13.936 LOG: Info] flip settings not required -1
[Tue Apr 5 08:02:13.936 LOG: Err] dcbcm_get_port_cable_type: invalid ifd ptr
[Tue Apr 5 08:02:13.936 LOG: Debug] dcbcm_port_resource_multi_set_on_quad no change needed for user_port:0 speed: 0 encap: 0
[Tue Apr 5 08:02:13.937 LOG: Debug] L2_PORT_SET_L2_FEATURE: L2_DEBUG : brcm_port_init_def1298:Setting L2 Learn (unit 0, port_num 1), learn_flg 0
[Tue Apr 5 08:02:13.943 LOG: Debug] dcbcm_xle_port_init Enabling port:1 for XLAUI, 40G and an=off
[Tue Apr 5 08:02:13.944 LOG: Info] dcbcm_opus_get_linkscan_mode: link scan mode 2 for ifd et-0/0/0 eth_phy_speed 6
[Tue Apr 5 08:02:13.955 LOG: Debug] dcbcm_init_routing_port: ifd et-0/0/0 is inited
[Tue Apr 5 08:02:13.955 LOG: Debug] PORTDEV: DEVINIT for PIC: 0 PORT: 0
[Tue Apr 5 08:02:14.079 LOG: Info] ifp et-0/0/0 ifd_set_flapped
[Tue Apr 5 08:02:14.079 LOG: Info] dcbcm_ifd_attach:Applying retimer cfg on port 0 rtmr_cfg = 8 port_cable_type = 190
[Tue Apr 5 08:02:14.584 LOG: Info] PORTDEV: DEVSTART for port: et-0/0/0
[Tue Apr 5 08:02:14.584 LOG: Info] FEC CL91 is enabled on port:0
[Tue Apr 5 08:02:14.584 LOG: Debug] Enabled fec for port:0 with ret 0