Memory information and FRU identification from prtdiag on the Sun Fire[TM] V440

Asset ID:	1-71-1012312.1
Update Date:	2012-07-31
Keywords:

Solution Type Technical Instruction Sure

Solution 1012312.1 : Memory information and FRU identification from prtdiag on the Sun Fire[TM] V440

Applies to:

Sun Netra 440 Server - Version Not Applicable to Not Applicable [Release N/A]
Sun Fire V440 Server - Version Not Applicable to Not Applicable [Release N/A]
All Platforms

Goal

The Sun Fire[TM] V440 prior to Solaris 10, reports memory information very differently in prtdiag, which can lead to the wrong FRU being sent out when a DIMM bank has been determined faulty. This document will help explain the display.

Fix

An example of the memory section of "prtdiag -v" from a v440:

System Configuration: Sun Microsystems  sun4u Sun Fire V440

System clock frequency: 183 MHZ

Memory size: 16GB



==================================== CPUs ====================================

               E$          CPU                  CPU     Temperature

CPU  Freq      Size        Implementation       Mask    Die   Amb.  Status      Location

---  --------  ----------  ---------------------  -----   ----  ----  ------      --------

  0  1281 MHz  1MB         SUNW,UltraSPARC-IIIi     3.4     -     -    online       -

  1  1281 MHz  1MB         SUNW,UltraSPARC-IIIi     3.4     -     -    online       -

  2  1281 MHz  1MB         SUNW,UltraSPARC-IIIi     3.4     -     -    online       -

  3  1281 MHz  1MB         SUNW,UltraSPARC-IIIi     3.4     -     -    online       -







---   Snip Additional output -----







============================ Memory Configuration ============================

Segment Table:

-----------------------------------------------------------------------

Base Address       Size       Interleave Factor  Contains

-----------------------------------------------------------------------

0x0                4GB               16          BankIDs 0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15

0x1000000000       4GB               16          BankIDs 16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31

0x2000000000       4GB               16          BankIDs 32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47

0x3000000000       4GB               16          BankIDs 48,49,50,51,52,53,54,55,56,57,58,59,60,61,62,63



Bank Table:

-----------------------------------------------------------

           Physical Location

ID       ControllerID  GroupID   Size       Interleave Way

-----------------------------------------------------------

0        0             0         256MB           0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15

1        0             0         256MB

2        0             1         256MB

3        0             1         256MB

4        0             0         256MB

5        0             0         256MB

6        0             1         256MB

7        0             1         256MB

8        0             1         256MB

9        0             1         256MB

10       0             0         256MB

11       0             0         256MB

12       0             1         256MB

13       0             1         256MB

14       0             0         256MB

15       0             0         256MB

16       1             0         256MB           0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15

17       1             0         256MB

18       1             1         256MB

19       1             1         256MB

20       1             0         256MB

21       1             0         256MB

22       1             1         256MB

23       1             1         256MB

24       1             1         256MB

25       1             1         256MB

26       1             0         256MB

27       1             0         256MB

28       1             1         256MB

29       1             1         256MB

30       1             0         256MB

31       1             0         256MB

32       2             0         256MB           0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15

33       2             0         256MB

34       2             1         256MB

35       2             1         256MB

36       2             0         256MB

37       2             0         256MB

38       2             1         256MB

39       2             1         256MB

40       2             1         256MB

41       2             1         256MB

42       2             0         256MB

43       2             0         256MB

44       2             1         256MB

45       2             1         256MB

46       2             0         256MB

47       2             0         256MB

48       3             0         256MB           0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15

49       3             0         256MB

50       3             1         256MB

51       3             1         256MB

52       3             0         256MB

53       3             0         256MB

54       3             1         256MB

55       3             1         256MB

56       3             1         256MB

57       3             1         256MB

58       3             0         256MB

59       3             0         256MB

60       3             1         256MB

61       3             1         256MB

62       3             0         256MB

63       3             0         256MB



Memory Module Groups:

--------------------------------------------------

ControllerID   GroupID  Labels         Status

--------------------------------------------------

0              0        C0/P0/B0/D0

0              0        C0/P0/B0/D1

0              1        C0/P0/B1/D0

0              1        C0/P0/B1/D1

1              0        C1/P0/B0/D0

1              0        C1/P0/B0/D1

1              1        C1/P0/B1/D0

1              1        C1/P0/B1/D1

2              0        C2/P0/B0/D0

2              0        C2/P0/B0/D1

2              1        C2/P0/B1/D0

2              1        C2/P0/B1/D1

3              0        C3/P0/B0/D0

3              0        C3/P0/B0/D1

3              1        C3/P0/B1/D0

3              1        C3/P0/B1/D1

In this output, we see that the memory is interleaved 16-way (default) for each board. There are four boards on this system. Sometimes an attempt is made to replace a failed DIMM location with the logical interleaved segment size (in this case, 256MB) instead of the physical DIMM size (1G in this case).

The only supported DIMM sizes currently for the V440 are 512MB, 1GB, and 2GB, and the FRU consists of two memory modules. There are 4 internal banks per pair which are interleaved by default. To determine the physical sizes of the DIMMs in the FRU, divide the total memory per board (as seen in the "size" section of the segment table in prtdiag) by 4 if there 2 banks installed, or by 2 if there is one bank installed on that particular board.

Further detailed information about the V440 memory:

JEDEC Industry Standard Double Data Rate (DDR-1) SDRAM memory sub-system with ECC protection
Nominal speed operates up to 133MHz frequency, providing 266MHz DDR-1 (PC2100) support
Supports Industry Standard 1.2" high 184-pin DDR-1 SDRAM Registered ECC DIMM's (Note: Per the DDR Memory Big Rules, only Sun tested and approved DIMM's are officially supported by Sun)
Total of 4 DIMM slots per CPU/Memory Module; 16 slots per system with 4 CPU/Memory Modules
DIMM sizes supported at RR/GA are 512MB, 1GB & 2 GB (Note: 256MB DIMM's are NOT supported in V440)
System Min/Max Memory is 1 GB/32 GB
Each module DIMM slots are arranged in 2 physical groups of 2 DIMM's
Each DIMM group (pair) provides 1 or 2 external logical banks depending on whether the DIMM's are single-sided or double-sided, and 4 internal banks per pair which are interleaved by default.
XOR is a new type of interleaving that distributes memory areas into the CPU L2$ more optimally, increasing the CPU L2$ hit rate, and maximizing utilization of the L2$
Maximum performance per CPU/Memory module occurs when using 4 double-sided DIMM's of the same type and size. This is visible in "prtdiag" as Interleave Factor "16"
Interleaving and XOR occurs between DIMM pairs that are the same capacity and type installed on the same CPU. "prtdiag" Interleave Factor of "16" if the DIMM's are double-sided and "4" if the DIMM's are single-sided
If only 1 pair of DIMM's is installed, XOR is always enabled and interleaving occurs between the 2 external logical banks if the DIMM's are both double-sided. "prtdiag" Interleave Factor "2" if double-sided, "1" if single-sided
No memory interleaving or XOR between DIMM pairs of different capacity installed on the same CPU. Interleaving may still occur within the pair if either pair has double-sided DIMM's installed showing in "prtdiag" as Interleave Factor "2". If either pair is single-sided DIMM's, "prtdiag" will show Interleave Factor "1"
No memory interleaving between CPU/Memory modules.
Automatic System Recovery support for automatic offlining of failed DIMM banks
72 data bits per memory DIMM; 2 DIMM's (144 bits) min per group (Note: DIMM's MUST be installed/removed in PAIRS; the FRU is the PAIR)
At least 1 pair must be present and functioning for the system to boot.
2.1 GB/s transfer rate per pair; 4.2 GB/s per module

Attachments

This solution has no attachment