Sun Microsystems, Inc.  Sun System Handbook - ISO 3.4 June 2011 Internal/Partner Edition
   Home | Current Systems | Former STK Products | EOL Systems | Components | General Info | Search | Feedback

Asset ID: 1-71-1012185.1
Update Date:2011-06-06
Keywords:

Solution Type  Technical Instruction Sure

Solution  1012185.1 :   Sun Fire[TM] 4800, 4810, 6800, E4900, and E6900: Physical Device Mapping for 8 slot PCI+ I/O boards with XMITS  


Related Items
  • Sun Fire E6900 Server
  •  
  • Sun Fire 6800 Server
  •  
  • Sun Fire E4900 Server
  •  
  • Sun Fire 4800 Server
  •  
  • Sun Fire 4810 Server
  •  
Related Categories
  • GCS>Sun Microsystems>Servers>Midrange Servers
  •  

PreviouslyPublishedAs
216796


Description
The intention if this article is to:
  • Aid engineers and administrators in the identification of the correct I/O boards and slots within Sun Fire[TM] 4800, 4810, 6800, E4900, and E6900 systems with an 8 slot PCI IO board.
  • Help to demystify how to best lay out cards within the I/O board to maximize the number of 66MHz devices and to reduce bus contention.


Steps to Follow
The line of XMITS based I/O boards (PCI+ IB) can be installed in Sun Fire[TM] 4800, E4900, 6800, and E6900 servers.
These boards are expected to deliver a higher level of performance than original SCHIZO based PCI IB. 
  • The PCI+ IB provides six 66MHz slots, versus the PCI IB's 2 slots. 
  • It should be noted that the XMITS based boards remove support for the older 5 volt signaling cards.
In the new board layout, the hardware path to the XMITS ASIC and Busses A and B are the same, however, the scheme for naming the path to the specific PCI Slot scheme has changed somewhat.  The same methods of calculating the position of the boards, which I/O Controller (IOC) and which BUS on the IOC remains.
eg: /ssm@0,0/pci@18,600000   ---> IO6, Bus A
      /ssm@0,0/pci@18,700000   ---> IO6, Bus B
      /ssm@0,0/pci@19,600000   ---> IO6, Bus A
      /ssm@0,0/pci@19,700000   ---> IO6, Bus B
Existing method for determining which board / ASIC / Bus remains.

To restate the procedure:

Start by breaking the hardware address down into parts
              /ssm@0,0/pci@19,700000/pci@3/SUNW,isptwo@4/sd (block)
                   ^       ^^    ^       ^
Node Id  __________|       |     |       |________ Device #
                           |     |
                     Schizo AID  |________Bus # (A=600000 or B=700000)

  To locate IO board number, divide Schizo AID by 2 and subtract 6
  Note that the AID is in HEX.
            Hex: (19/2) - 6 = 6.5
Alternately:
            Hex 0x19 = 25
            thus        
            (25/2) - 6 = 6.5
The result tells us that the device resides on I/O boat in slot 6 (IB6).
The fact that the result has a fraction indicates that this is an odd numbered AID.  
  • An odd AID indicates XMITS 1
  • An even AID indicates XMITS 0.
In the above example, it is XMITS 1.

Alternatively, one can look up the AID in the Safari AID Allocation table listed at the end of this Technical Instruction.

For the Slot Numbering, we can use the below table for the XMITS I/O boards:
   |==============================================================|
   |XMITS # | BUS    | PCI# | Physical | Capability               |
   |        |        |      |  Slot #  |                          |
   |==============================================================|
   |    0   | 600000 |  1   |    3     | 33+66Mhz/64Bit/Long/Short|
   |    0   | 600000 |  2   |    2     | 33+66Mhz/64Bit/Long/Short|
   |    0   | 700000 |  1   |    0     | 33Mhz/64Bit/Short        |
   |    0   | 700000 |  2   |    1     | 33Mhz/64Bit/Short        |
   |    1   | 600000 |  1   |    7     | 33+66Mhz/64Bit/Long/Short|
   |    1   | 600000 |  2   |    6     | 33+66Mhz/64Bit/Long/Short|
   |    1   | 700000 |  1   |    4     | 33+66Mhz/64Bit/Long/Short|
   |    1   | 700000 |  2   |    5     | 33+66Mhz/64Bit/Long/Short|
   ===============================================================|
To draw this out logically, it looks something like this:
 pci@XX  XMITS0   __________Bus B (700000)________PCI@1   <--- Slot 0
 no remainder            |                  |
  after (XX/2)-6         |                  |_____PCI@2   <--- Slot 1
                         |
                         |__Bus A (600000)________PCI@1   <--- Slot 3
                                            |
                                            |_____PCI@2   <--- Slot 2


 pci@XX  XMITS1   __________Bus B (700000)________PCI@1   <--- Slot 4
 remainder after         |                  |
 (XX/2) - 6              |                  |_____PCI@2   <--- Slot 5
                         |
                         |__Bus A (600000)________PCI@1   <--- Slot 7
            Sun Fire E6900 Server
Sun Fire 6800 Server
Sun Fire 4810 Server
Sun Fire 4800 Server

Internal Comments Internal Information
The XMITS was originally planned to support 33/66 MHz PCI and 66/100 PCI-X. At the time of writing this document, it was not known when the 100 MHz PCI-X support will be added/enabled in the I/O boards for Serengeti/Amazon.
Regardless of this current omission, the XMITS ASIC should still perform significantly faster than the SCHIZO counterpart, through increases in some of buffers and queues which allow for many more DMA transfers to be in flight simultaneously.
Useful Prior reading: For some background on Sun Fire Scalable Shared Memory (SSM) and general path nomenclature, see Internal <Document: 1008674.1> . xmits, serengeti, pci, slot, device, layout, physical, pci+
Previously Published As
76507

Attachments
This solution has no attachment
  Copyright © 2011 Sun Microsystems, Inc.  All rights reserved.
 Feedback