Determining PCIe device link information using pcitool under Solaris 11

Asset ID:	1-71-1366058.1
Update Date:	2011-12-01
Keywords:

Solution Type Technical Instruction Sure

Solution 1366058.1 : Determining PCIe device link information using pcitool under Solaris 11

Applies to:

SPARC T3-1 - Version: Not Applicable to Not Applicable - Release: N/A to N/A
SPARC T3-4 - Version: Not Applicable to Not Applicable   [Release: N/A to N/A]
SPARC T3-2 - Version: Not Applicable to Not Applicable   [Release: N/A to N/A]
SPARC T4-4 - Version: Not Applicable to Not Applicable   [Release: N/A to N/A]
SPARC T4-2 - Version: Not Applicable to Not Applicable   [Release: N/A to N/A]
Information in this document applies to any platform.

Goal

Verify the link-train speed negotiated between the PCIe root complex switch and attached end-point device on Solaris 11 based CMT systems.

Solution

Install 'pcitool' - this tool is not installed by default under Solaris 11 and can be installed from the respository

root@cmt-host:~# pkg install pcitool
Packages to install: 1
Create boot environment: No
Create backup boot environment: No

DOWNLOAD PKGS FILES XFER (MB)
Completed 1/1 8/8 0.0/0.0

PHASE ACTIONS
Install Phase 21/21

PHASE ITEMS
Package State Update Phase 1/1
Image State Update Phase 2/2
root@cmt-host:~#

For each root complex (PCIe Switch, for example /pci@400) use pcitool to probe the bus;

root@cmt-host:~# pcitool /pci@400 -p

*********** Probing buses 0 through eb ***********

B D F Vend Dev Cmd Stat Rv Class Ca LT Hd BI LS LW
00 01 0 108e 8186 0007 0010 01 060400 00 00 01 00 02 08
00 02 0 108e 8186 0007 0010 01 060400 00 00 01 00 02 08
01 00 0 111d 8077 0147 0010 02 060400 10 00 01 00 02 08
02 00 0 111d 8077 0147 0010 02 060400 10 00 01 00 02 08
02 02 0 111d 8077 0147 0010 02 060400 10 00 01 00 01 04
02 04 0 111d 8077 0147 0010 02 060400 10 00 01 00 01 00
02 07 0 111d 8077 0147 0010 02 060400 10 00 01 00 01 01
02 08 0 111d 8077 0147 0010 02 060400 10 00 01 00 01 01
03 00 0 1000 0072 0146 0010 03 010700 80 00 00 00 02 08
04 00 0 8086 10c9 0147 0010 01 020000 10 00 80 00 01 04
04 00 1 8086 10c9 0147 0010 01 020000 10 00 80 00 01 04
3d 00 0 1a03 1150 0147 0010 02 060400 10 00 01 00 01 01
3e 00 0 1a03 2000 0003 0210 10 030000 00 00 00 00 00 00
3f 00 0 10b5 8112 0547 0010 aa 060400 10 00 01 00 01 01
40 00 0 1033 0035 0146 0210 43 0c0310 10 40 80 00 00 00
40 00 1 1033 0035 0146 0210 43 0c0310 10 40 00 00 00 00
40 00 2 1033 00e0 0146 0210 04 0c0320 10 40 00 00 00 00
41 00 0 111d 8077 0147 0010 02 060400 10 00 01 00 02 08
42 00 0 111d 8077 0147 0010 02 060400 10 00 01 00 01 00
42 01 0 111d 8077 0147 0010 02 060400 10 00 01 00 01 00
42 02 0 111d 8077 0147 0010 02 060400 10 00 01 00 01 00
42 03 0 111d 8077 0147 0010 02 060400 10 00 01 00 01 00
root@cmt-host:~#

B = BUS, the unique identifier number assigned to each PCI bus.
D = DEVICE, the unique identifier number assigned to each device on any given PCI bus
F = FUNCTION, identifies the functions supported by the card (multi function devices such as combination cards will have multiple functions)

BDF is also used to identify devices in a geographical sense within the system as they are unique.

Vend = identifies the vendor identifier for each attached device, included in this will be the PCIe switch itself as well as all attached devices.

Dev = Unique identifier for each device on the PCI bus.

These can be cross referenced against prtconf -vp output to confirm the exact device. Additionally the PCIe vendor and device IDs can be verified using various internet sites.

Cmd and Stat = report the features supported on each device.

The last two fields represent the link speed (LS) and link width (LW) for each attached device - with width being the number of negotiated lanes trained between the two devices.

Refer to the product documentation to verify the link speed supported on each PCIe slot - T3-x and T4-x based systems provide x8 lane PCIe slots.

Attachments

This solution has no attachment