Origin 350, 8xR16K 700MHz, 16GB RAM, SAS3041X-R, 4TB disk

[jan-jaap]

As promised before, let me introduce my new workhorse:

hinv -mv

Code: Select all

Location: /hw/module/001c01/node
       IP53_4CPU Board: barcode MXM746     part 030-1868-001 rev -C
Location: /hw/module/001c01/IXbrick/xtalk/15
       2U_INT_53 Board: barcode MTZ549     part 030-1809-003 rev -B
Location: /hw/module/001c01/IXbrick/xtalk/15/pci-x/0/1/ioc4
             IO9 Board: barcode MTS559     part 030-1771-005 rev -A
Location: /hw/module/001c02/node
       IP53_4CPU Board: barcode MTA291     part 030-1868-001 rev -C
Location: /hw/module/001c02/IXbrick/xtalk/15
       2U_INT_53 Board: barcode MTV599     part 030-1809-003 rev -A
8 700 MHZ IP35 Processors
CPU: MIPS R16000 Processor Chip Revision: 2.1
FPU: MIPS R16010 Floating Point Chip Revision: 2.1
CPU 0 at Module 001c01/Slot 0/Slice A: 700 Mhz MIPS R16000 Processor Chip (enabled)
  Processor revision: 2.1. Scache: Size 4 MB Speed 350 Mhz  Tap 0xc
CPU 1 at Module 001c01/Slot 0/Slice B: 700 Mhz MIPS R16000 Processor Chip (enabled)
  Processor revision: 2.1. Scache: Size 4 MB Speed 350 Mhz  Tap 0xc
CPU 2 at Module 001c01/Slot 0/Slice C: 700 Mhz MIPS R16000 Processor Chip (enabled)
  Processor revision: 2.1. Scache: Size 4 MB Speed 350 Mhz  Tap 0xc
CPU 3 at Module 001c01/Slot 0/Slice D: 700 Mhz MIPS R16000 Processor Chip (enabled)
  Processor revision: 2.1. Scache: Size 4 MB Speed 350 Mhz  Tap 0xc
CPU 4 at Module 001c02/Slot 0/Slice A: 700 Mhz MIPS R16000 Processor Chip (enabled)
  Processor revision: 2.1. Scache: Size 4 MB Speed 350 Mhz  Tap 0xc
CPU 5 at Module 001c02/Slot 0/Slice B: 700 Mhz MIPS R16000 Processor Chip (enabled)
  Processor revision: 2.1. Scache: Size 4 MB Speed 350 Mhz  Tap 0xc
CPU 6 at Module 001c02/Slot 0/Slice C: 700 Mhz MIPS R16000 Processor Chip (enabled)
  Processor revision: 2.1. Scache: Size 4 MB Speed 350 Mhz  Tap 0xc
CPU 7 at Module 001c02/Slot 0/Slice D: 700 Mhz MIPS R16000 Processor Chip (enabled)
  Processor revision: 2.1. Scache: Size 4 MB Speed 350 Mhz  Tap 0xc
Main memory size: 16384 Mbytes
Instruction cache size: 32 Kbytes
Data cache size: 32 Kbytes
Secondary unified instruction/data cache size: 4 Mbytes
Memory at Module 001c01/Slot 0: 8192 MB (enabled)
  Bank 0 contains 1024 MB (Premium) DIMMS (enabled)
  Bank 1 contains 1024 MB (Premium) DIMMS (enabled)
  Bank 2 contains 1024 MB (Premium) DIMMS (enabled)
  Bank 3 contains 1024 MB (Premium) DIMMS (enabled)
  Bank 4 contains 1024 MB (Premium) DIMMS (enabled)
  Bank 5 contains 1024 MB (Premium) DIMMS (enabled)
  Bank 6 contains 1024 MB (Premium) DIMMS (enabled)
  Bank 7 contains 1024 MB (Premium) DIMMS (enabled)
Memory at Module 001c02/Slot 0: 8192 MB (enabled)
  Bank 0 contains 1024 MB (Premium) DIMMS (enabled)
  Bank 1 contains 1024 MB (Premium) DIMMS (enabled)
  Bank 2 contains 1024 MB (Premium) DIMMS (enabled)
  Bank 3 contains 1024 MB (Premium) DIMMS (enabled)
  Bank 4 contains 1024 MB (Premium) DIMMS (enabled)
  Bank 5 contains 1024 MB (Premium) DIMMS (enabled)
  Bank 6 contains 1024 MB (Premium) DIMMS (enabled)
  Bank 7 contains 1024 MB (Premium) DIMMS (enabled)
Integral SCSI controller 5: Version SAS/SATA LS1064
  Disk drive: unit 1 on SCSI controller 5 (unit 1) (XVM Local Disk) (primary path)
  Disk drive: unit 2 on SCSI controller 5 (unit 2) (XVM Local Disk) (primary path)
Integral SCSI controller 6: Version Fibre Channel QL2342 Port 1, 100 MHz PCI-X
Integral SCSI controller 2: Version IDE (ATA/ATAPI) IOC4
  CDROM: unit 0 on SCSI controller 2
Integral SCSI controller 0: Version QL12160, low voltage differential
  Disk drive: unit 1 on SCSI controller 0 (unit 1)
Integral SCSI controller 1: Version QL12160, low voltage differential
Integral SCSI controller 3: Version LS1030, low voltage differential
Integral SCSI controller 4: Version LS1030, low voltage differential
Integral SCSI controller 7: Version Fibre Channel QL2342 Port 2, 100 MHz PCI-X
IOC3/IOC4 serial port: tty3
IOC3/IOC4 serial port: tty4
IOC3/IOC4 serial port: tty5
IOC3/IOC4 serial port: tty6
Integral Gigabit Ethernet: tg0, module 001c01, PCI bus 1 slot 4
Gigabit Ethernet: tg1, module 001c01, PCI bus 2 slot 2
  PCI Adapter ID (vendor 0x10a9, device 0x100a) PCI slot 1
  PCI Adapter ID (vendor 0x1077, device 0x1216) PCI slot 3
  PCI Adapter ID (vendor 0x14e4, device 0x1645) PCI slot 4
  PCI Adapter ID (vendor 0x1000, device 0x0050) PCI slot 1
  PCI Adapter ID (vendor 0x1077, device 0x2312) PCI slot 1
  PCI Adapter ID (vendor 0x1077, device 0x2312) PCI slot 1
  PCI Adapter ID (vendor 0x1000, device 0x0030) PCI slot 1
  PCI Adapter ID (vendor 0x1000, device 0x0030) PCI slot 1
  PCI Adapter ID (vendor 0x14e4, device 0x1645) PCI slot 2
IOC4 firmware revision 83
IOC3/IOC4 external interrupts: 1
HUB in Module 001c01/Slot 0: Revision 2 Speed 200.00 Mhz (enabled)
HUB in Module 001c02/Slot 0: Revision 2 Speed 200.00 Mhz (enabled)
IP35prom in Module 001c01/Slot n0: Revision 6.211
IP35prom in Module 001c02/Slot n0: Revision 6.211

L2 controller

Code: Select all

M2100629-001-L2>version
L2 version: 1.48.0

environmental data

Code: Select all

M2100629-001-L2>env
001c01:
Environmental monitoring is enabled and running.

Description    State       Warning Limits     Fault Limits       Current
-------------- ----------  -----------------  -----------------  -------
          1.8V    Enabled  10%   1.62/  1.98  20%   1.44/  2.16    1.791
           12V <not present>
        12V #2    Enabled  10%  10.80/ 13.20  20%   9.60/ 14.40   12.063
          3.3V    Enabled  10%   2.97/  3.63  20%   2.64/  3.96    3.302
        12V IO    Enabled  10%  10.80/ 13.20  20%   9.60/ 14.40   12.125
        5V AUX    Enabled  10%   4.50/  5.50  20%   4.00/  6.00    5.044
      3.3V AUX    Enabled  10%   2.97/  3.63  20%   2.64/  3.96    3.268
    PCI 5V AUX    Enabled  10%   4.50/  5.50  20%   4.00/  6.00    5.044
      PCI 3.3V    Enabled  10%   2.97/  3.63  20%   2.64/  3.96    3.302
      PCI 2.5V    Enabled  10%   2.25/  2.75  20%   2.00/  3.00    2.509
        PCI 5V    Enabled  10%   4.50/  5.50  20%   4.00/  6.00    4.966
  XIO 12V BIAS <not present>
        XIO 5V <not present>
      XIO 2.5V <not present>
  XIO 3.3V AUX <not present>
 IP53 3.3V AUX    Enabled  10%   2.97/  3.63  20%   2.64/  3.96    3.268
   IP53 5V AUX    Enabled  10%   4.50/  5.50  20%   4.00/  6.00    5.044
      IP53 12V    Enabled  10%  10.80/ 13.20  20%   9.60/ 14.40   12.000
     IP53 VCPU    Enabled  10%   1.13/  1.38  20%   1.00/  1.50    1.255
     IP53 SRAM    Enabled  10%   2.25/  2.75  20%   2.00/  3.00    2.470
     IP53 1.5V    Enabled  10%   1.35/  1.65  20%   1.20/  1.80    1.495

Description     State       Warning RPM  Current RPM
--------------- ----------  -----------  -----------
FAN  0  EXHST 1    Enabled         1980         2327
FAN  1  EXHST 2    Enabled         1980         2327
FAN  2       PS    Enabled         3200         4066
FAN  3    PCI 1    Enabled         1980         3013
FAN  4    PCI 2    Enabled         1980         2721

                              Advisory   Critical   Fault      Current
Description       State       Temp       Temp       Temp       Temp
----------------- ----------  ---------  ---------  ---------  ---------
 0 INTERFACE 0       Enabled   31C/ 87F   48C/118F   55C/131F   15C/ 59F
 1 INTERFACE 1       Enabled   31C/ 87F   48C/118F   55C/131F   17C/ 62F
 2 INTERFACE 2       Enabled   31C/ 87F   48C/118F   55C/131F   19C/ 66F
 3 PCI RISER         Enabled   31C/ 87F   48C/118F   55C/131F   20C/ 68F
 4 ODYSSEY        <not present>
 5 NODE              Enabled   31C/ 87F   48C/118F   55C/131F   18C/ 64F
 6 BEDROCK           Enabled   31C/ 87F   48C/118F   55C/131F   13C/ 55F

001c02:
Environmental monitoring is enabled and running.

Description    State       Warning Limits     Fault Limits       Current
-------------- ----------  -----------------  -----------------  -------
          1.8V    Enabled  10%   1.62/  1.98  20%   1.44/  2.16    1.791
           12V <not present>
        12V #2    Enabled  10%  10.80/ 13.20  20%   9.60/ 14.40   12.000
          3.3V    Enabled  10%   2.97/  3.63  20%   2.64/  3.96    3.320
        12V IO    Enabled  10%  10.80/ 13.20  20%   9.60/ 14.40   12.063
        5V AUX    Enabled  10%   4.50/  5.50  20%   4.00/  6.00    5.044
      3.3V AUX    Enabled  10%   2.97/  3.63  20%   2.64/  3.96    3.268
    PCI 5V AUX    Enabled  10%   4.50/  5.50  20%   4.00/  6.00    5.070
      PCI 3.3V    Enabled  10%   2.97/  3.63  20%   2.64/  3.96    3.337
      PCI 2.5V    Enabled  10%   2.25/  2.75  20%   2.00/  3.00    2.509
        PCI 5V    Enabled  10%   4.50/  5.50  20%   4.00/  6.00    4.940
  XIO 12V BIAS <not present>
        XIO 5V <not present>
      XIO 2.5V <not present>
  XIO 3.3V AUX <not present>
 IP53 3.3V AUX    Enabled  10%   2.97/  3.63  20%   2.64/  3.96    3.268
   IP53 5V AUX    Enabled  10%   4.50/  5.50  20%   4.00/  6.00    5.044
      IP53 12V    Enabled  10%  10.80/ 13.20  20%   9.60/ 14.40   12.000
     IP53 VCPU    Enabled  10%   1.13/  1.38  20%   1.00/  1.50    1.241
     IP53 SRAM    Enabled  10%   2.25/  2.75  20%   2.00/  3.00    2.457
     IP53 1.5V    Enabled  10%   1.35/  1.65  20%   1.20/  1.80    1.480

Description     State       Warning RPM  Current RPM
--------------- ----------  -----------  -----------
FAN  0  EXHST 1    Enabled         1980         2393
FAN  1  EXHST 2    Enabled         1980         2376
FAN  2       PS    Enabled         3200         4326
FAN  3    PCI 1    Enabled         1980         2636
FAN  4    PCI 2    Enabled         1980         2884

                              Advisory   Critical   Fault      Current
Description       State       Temp       Temp       Temp       Temp
----------------- ----------  ---------  ---------  ---------  ---------
 0 INTERFACE 0       Enabled   31C/ 87F   48C/118F   55C/131F   14C/ 57F
 1 INTERFACE 1       Enabled   31C/ 87F   48C/118F   55C/131F   15C/ 59F
 2 INTERFACE 2       Enabled   31C/ 87F   48C/118F   55C/131F   18C/ 64F
 3 PCI RISER         Enabled   31C/ 87F   48C/118F   55C/131F   19C/ 66F
 4 ODYSSEY        <not present>
 5 NODE              Enabled   31C/ 87F   48C/118F   55C/131F   18C/ 64F
 6 BEDROCK           Enabled   31C/ 87F   48C/118F   55C/131F   13C/ 55F


serial data

Code: Select all

M2100629-001-L2>serial all
001c01:

Data                            Location      Value
------------------------------  ------------  --------
Local System Serial Number      NVRAM         M2100629
Reference System Serial Number  Attached L2   M2100629
Local Brick Serial Number       EEPROM        MTZ549
Reference Brick Serial Number   NVRAM         MTZ549


EEPROM      Product Name    Serial         Part Number           Rev  T/W
----------  --------------  -------------  --------------------  ---  ------
INTERFACE   2U_INT_53       MTZ549         030_1809_003          B    00
IO9         IO9             MTS559         030_1771_005          A    00
ODYSSEY     no hardware detected
RISER       2U_RISER        MXN220         030_1808_005          A    00
NODE        IP53_4CPU       MXM746         030_1868_001          C    00
SNOWBALL    no hardware detected
PS 1        no hardware detected
PS 2        DPS-500EBE      XPD0323001887  060-0178-003          S1

EEPROM     JEDEC-SPD Info           Part Number        Rev  Speed  SGI
---------- ------------------------ ------------------ ---- ------ --------
DIMM 0     CE000000000000000C097C00 M3 46L2820DT2-CA0   2D   10.0  N/A
DIMM 2     CE000000000000000CEA7B00 M3 46L2820DT2-CA0   2D   10.0  N/A
DIMM 4     CE000000000000000C0A7C00 M3 46L2820DT2-CA0   2D   10.0  N/A
DIMM 6     CE000000000000000C0D7C00 M3 46L2820DT2-CA0   2D   10.0  N/A
DIMM 1     CE000000000000000C0C7C00 M3 46L2820DT2-CA0   2D   10.0  N/A
DIMM 3     CE000000000000000CE97B00 M3 46L2820DT2-CA0   2D   10.0  N/A
DIMM 5     CE000000000000000C0E7C00 M3 46L2820DT2-CA0   2D   10.0  N/A
DIMM 7     CE000000000000000C0B7C00 M3 46L2820DT2-CA0   2D   10.0  N/A

001c02:

Data                            Location      Value
------------------------------  ------------  --------
Local System Serial Number      NVRAM         M2100629
Reference System Serial Number  Attached L2   M2100629
Local Brick Serial Number       EEPROM        MTV599
Reference Brick Serial Number   NVRAM         MTV599


EEPROM      Product Name    Serial         Part Number           Rev  T/W
----------  --------------  -------------  --------------------  ---  ------
INTERFACE   2U_INT_53       MTV599         030_1809_003          A    00
IO9         no hardware detected
ODYSSEY     no hardware detected
RISER       2U_RISER        MXN157         030_1808_005          A    00
NODE        IP53_4CPU       MTA291         030_1868_001          C    00
SNOWBALL    no hardware detected
PS 1        no hardware detected
PS 2        DPS-500EBE      XPD0323002565  060-0178-003          S1

EEPROM     JEDEC-SPD Info           Part Number        Rev  Speed  SGI
---------- ------------------------ ------------------ ---- ------ --------
DIMM 0     CE000000000000000CE17B00 M3 46L2820DT2-CA0   2D   10.0  N/A
DIMM 2     CE000000000000000CED7B00 M3 46L2820DT2-CA0   2D   10.0  N/A
DIMM 4     CE000000000000000CEE7B00 M3 46L2820DT2-CA0   2D   10.0  N/A
DIMM 6     CE000000000000000CEF7B00 M3 46L2820DT2-CA0   2D   10.0  N/A
DIMM 1     CE000000000000000CE77B00 M3 46L2820DT2-CA0   2D   10.0  N/A
DIMM 3     CE000000000000000CEC7B00 M3 46L2820DT2-CA0   2D   10.0  N/A
DIMM 5     CE000000000000000CE37B00 M3 46L2820DT2-CA0   2D   10.0  N/A
DIMM 7     CE000000000000000CE27B00 M3 46L2820DT2-CA0   2D   10.0  N/A


pci settings

Code: Select all

M2100629-001-L2>pci
001c01:

Bus Slot Stat    Power Mode/Speed
--- ---- ------- ----- -----------
  1    1 0x80 01   15W PCI   66MHz
  1    2 0x80 0f  none PCI   66MHz
  2    1 0x00 0d   15W PCIX 100MHz
  2    2 0x00 0d   15W PCIX 100MHz
001c02:

Bus Slot Stat    Power Mode/Speed
--- ---- ------- ----- -----------
  1    1 0x00 0c  7.5W PCIX 100MHz
  1    2 0x00 0f  none PCIX 100MHz
  2    1 0x00 0d   15W PCIX 100MHz
  2    2 0x00 0f  none PCIX 100MHz


There are 4 cards spread out over the 4 buses:

• module1, bus1, slot1: IO9
• module1, bus2, slot1: LSI 22320 (dual U320 scsi)
• module1, bus2, slot2: Gigabit ethernet (modded HP NC7770)
• module2, bus1, slot1: LSI SAS3041X-R
• module2, bus2, slot1: Qlogic SANblade QL2342 (dual 2Gbit fibre channel)

Unlike most people I'm not planning to turn it into a wannabee-Onyx350 or Tezro. This one will live in the natural habitat of Origins: in a rack somewhere, running 24/7 and quietly performing it's duties (compile & compute server).

The second module is an expansion compute module, so it lacks IO9 and scsi drive backplane. It is still possible to install disk sleds, they just don't slot into anything. There is enough space for a SATA cable, though. You know where this is going

I briefly attached a 2TB Samsung to the SAS3041X-R and verified that IRIX can fx and mount it. I'm currently awaiting two extra disk sleds and two Samsung EcoGreen F4EG 2TB disks. Will make a nice backup server

Update 4-nov-2010: added DVD-ROM and XVM stripe of two 2TB SATA disks.
Update 3-dec-2010: increased RAM to 16GB, added QLA2342 dual 2Gb SANblade
Update 6-dec-2010: added L1 data
Update 19-sep-2011: IO9 firmware upgrade, added ethernet card
Update 15-nov-2011: added L2 controller

[ramq]

Sweet!
Or... I know how sweet they are.

[recondas]

Congratulations - I know ramq hated to part with them, but they couldn't have gone to a better home.

Almost the same set up as my daily desktop <except that I couldn't resist the temptation to have a wannabee Onyx >.

[jan-jaap]

Added 4TB of local storage: two 2TB SATA disks attached to an LSI SAS3041X-R, striped using XVM. These are "eco" (5400RPM) models. The SAS3041 is in the lowest PCI slot of the second Origin 350, where you would normally find the IO9. It has the PCI bus to itself so it runs at 100 or 133MHz PCI-X speed. I had to order some special 70cm SATA cables with an angled connector at the drive end: there's insufficient between the drives and the nearest fan for anything else. I expect some more RAM sometime soon, maybe I'll take some pictures then.

Disks installed:

Code: Select all

# diskpatch -v
sc0d1l0:  Disk         SEAGATE ST373453LC      9507  Serial: 3HW2BVHV
sc5d1l0:  Disk         ATA     SAMSUNG HD204UI 0001  Serial: S2HGJ1BZ
sc5d2l0:  Disk         ATA     SAMSUNG HD204UI 0001  Serial: S2HGJ1BZ


Some results:

Code: Select all

# diskperf -W -D -n "SATA stripe 4TB (2*HD204UI)"  /xvm0/junk
#---------------------------------------------------------
# Disk Performance Test Results Generated By Diskperf V1.2
#
# Test name     : SATA stripe 4TB (2*HD204UI)
# Test date     : Fri Nov  5 10:57:17 2010
# Test machine  : IRIX64 speedo 6.5 07202013 IP35
# Test type     : XFS data subvolume
# Test path     : /xvm0/junk
# Request sizes : min=16384 max=16777216
# Parameters    : direct=1 time=10 scale=1.000 delay=0.000
# XFS file size : 1341112320 bytes
#---------------------------------------------------------
# req_size  fwd_wt  fwd_rd  bwd_wt  bwd_rd  rnd_wt  rnd_rd
#  (bytes)  (MB/s)  (MB/s)  (MB/s)  (MB/s)  (MB/s)  (MB/s)
#---------------------------------------------------------
      16384   55.88   70.44   60.45   14.16    8.35    1.81
      32768  108.69  100.48   94.44   16.10   15.45    3.61
      65536  149.80  150.16  135.75   19.38   29.30    6.90
     131072  195.81  198.17  194.69   26.10   29.54   10.76
     262144  198.04  197.83  196.17   33.64   49.47   20.15
     524288  191.79  197.42  189.57   54.66   77.68   36.58
    1048576  199.66  197.79  188.56   67.87  105.20   63.45
    2097152  195.73  197.21  190.51  100.51  134.21   95.33
    4194304  200.74  197.27  191.49  139.87  160.75  128.47
    8388608  199.87  197.80  196.63  162.92  177.47  155.89
   16777216  201.08  197.08  194.55  169.71  198.21  174.91

Compare this to the system disk, a Seagate 15K.3:

Code: Select all

# diskperf -W -D -n "Seagate 15K.3 ST373453LC" /tmp/junk
#---------------------------------------------------------
# Disk Performance Test Results Generated By Diskperf V1.2
#
# Test name     : Seagate 15K.3 ST373453LC
# Test date     : Fri Nov  5 11:14:22 2010
# Test machine  : IRIX64 speedo 6.5 07202013 IP35
# Test type     : XFS data subvolume
# Test path     : /tmp/junk
# Request sizes : min=16384 max=16777216
# Parameters    : direct=1 time=10 scale=1.000 delay=0.000
# XFS file size : 1073741824 bytes
#---------------------------------------------------------
# req_size  fwd_wt  fwd_rd  bwd_wt  bwd_rd  rnd_wt  rnd_rd
#  (bytes)  (MB/s)  (MB/s)  (MB/s)  (MB/s)  (MB/s)  (MB/s)
#---------------------------------------------------------
      16384   23.32   65.05   13.64   22.25    6.37    3.28
      32768   60.58   67.06   21.84   27.76   11.57    6.19
      65536   61.83   67.00   31.23   30.94   19.33   11.09
     131072   60.91   67.04   40.32   30.13   29.41   19.10
     262144   61.99   67.25   49.14   34.72   39.77   29.26
     524288   61.85   67.55   55.04   50.05   46.37   40.16
    1048576   61.62   67.03   55.29   55.64   46.08   49.00
    2097152   61.96   67.37   59.26   59.52   53.08   40.21
    4194304   28.18   37.33   48.09   60.36   43.42   61.29
    8388608   61.24   63.95   60.65   65.78   58.89   64.25
   16777216   61.34   67.52   62.85   66.93   61.51   65.58

As was to be expected, the 5400 RPM disks loose to the 15K disk for small random I/O, but for everything else the SCSI disk takes a severe beating. Both tests use direct I/O, all disks have the (disk) write cache enabled. The system is in use, which probably explains the dip at block size 4194304 for the SCSI disk.

[smj]

This one will live in the natural habitat of Origins: in a rack somewhere, running 24/7 and quietly performing it's duties (compile & compute server).

As somebody expecting delivery of two Origin 300s and a NUMAlink cable next week, I'm curious - were these received with licenses so they could be used as compile-servers? I'm new to linked nodes so I'm wondering about hostid changes and how one deals with licenses that no longer match... RTFM PMs and redirects to other threads welcome.

[recondas]

I'm new to linked nodes so I'm wondering about hostid changes and how one deals with licenses that no longer match... RTFM PMs and redirects to other threads welcome.

If they have previously been linked they'll already have the same system serial number. If they haven't previously been linked, the pair will assume the serial number of which ever becomes the master module <though you might have to use the "serial clear" command in the L1 of the *unlinked* slave so when it is linked it's ready to receive the serial number from the master>. So examining what licenses <if any> came with each module before selecting the master would be a good idea.

If you have an L2 controller <or emulator>, then the attached modules will assume the serial number assigned to the L2. A very nice fringe benefit of having an L2 controller is that can easily change the L2 serial number at will using the L2 command "serial set <desired_serial_number>". The 'serial set' command doesn't work at the compute module level <with the L1 controller>.

The following excerpts from an L2 "serial all" command example shows the serial numbers assigned to 01c001 <the master compute module>, 001c002 <a linked slave module>. Both also list the <same> L2 "reference system serial number". These particular compute modules didn't come from the same source and originally had different 'local system serial numbers'. One had a full set of MIPSPro licenses, the other didn't. The serial number from the licensed system was assigned to the L2, which in turn wrote the licensed serial number it to the <previously> unlicensed slave.

Code: Select all

serial all
001c01:

Data                            Location      Value
------------------------------  ------------  --------
Local System Serial Number      NVRAM         M2008888
Reference System Serial Number  Attached L2   M2008888
Local Brick Serial Number       EEPROM        MYX901
Reference Brick Serial Number   NVRAM         MYX901

001c02:

Data                            Location      Value
------------------------------  ------------  --------
Local System Serial Number      NVRAM         M2008888
Reference System Serial Number  Attached L2   M2008888
Local Brick Serial Number       EEPROM        NPR815
Reference Brick Serial Number   NVRAM         NPR815

An L2 controller can be used to set the system serial number of any of the O3x0 modules *except* the Router Module, which has an enforced serial number security routine coded into NVRAM <that prevents end-user system serial number changes> - though there are now a couple of known workarounds for the NUMALink <Router> Module <and the R-Brick>. This would also be a good time to mention that you can't link more than two O3x0 compute modules without using a router - a NUMAlink Module <or a hacked R-Brick>.

[smj]

jan-jaap: Sorry about the thread hijack -- I'll start one or more when my Origin 300's come in this week.

recondas: Thanks, I've started re-reading Escher's threads about his recently acquired O300's, and all the threads linked from those; grabbed the L3 software & DINA and put up a mirror... I'll see about distilling all of this into something for the Wiki, too, as it keeps coming up.

[jan-jaap]

This system has genuine MIPSpro C/C++/F77/F90/Workshop and XVM licenses. Everything is 100% legit

Otherwise, the SGI FLEXlm licensing scheme hasn't changed since IRIX 6.2 / FLEXlm v4.x. I won't get into the details because it probably violates your awful DMCA law and I don't want to cause any trouble, but it isn't hard to break.

[jan-jaap]

Some pictures of the SATA mod:

Angled SATA connector

Power cable

LSI SAS3041X-R, plus a QLA2342 dual 2Gb FC board.

Needed:
* Two O350 drive sleds or the Intel / SUN equivalent
* Two 70cm SATA cables with a straight connector on one end and an angled connector on the other end
* Two SATA disks. I used 2TB Samsung disks
* A SATA power cable with two vertically attached SATA power plugs and a Molex
* Another misc power cable with at least a Molex plug
* One TYCO ELECTRONICS / AMP - 3-640426-4 - HOUSING, 18AWG, 4WAY

Of course you cannot boot from this, and the drive bay must not have the SCSI drive backplane either. So this works only in a system with at least two modules.

[smj]

Good looking installation - thanks for sharing the photos and parts list!

[nekonoko]

Great idea! Since I took the IO9 out of my second O350 this would be a perfect upgrade for that brick.

[jan-jaap]

Space between the disks and the blower is limited. I looked around for a suitable SATA backplane but found nothing. Actually, I suspect that the Altix 350 has it. If someone is going to gut one, feel free to donate it to me But that's why the cables have to be just right. I had the right SATA power cable in my junk bin, but not the extra long, angled SATA cables. They have to be the 'left' / 'straight' model:

There are some clips on the outside of the O350 chassis, and the space to route the cable around the fan, which is why I chose the left hand cable. The more common cables with vertical attachment won't work on the lower drive (not enough space).

I bought a big box of 2GB memory kits so this system now has 16GB installed. Unfortunately 1 DIMM is bad or dirty so the machine currently runs with 2GB disabled and I don't have the time to pull it from the rack and rectify that. As soon as that's fixed I'll update the 'hinv' one (last ?) time. That's also the reason I put the SANblade in: if the need to attach some SAN storage pops up I don't want to have to pull the system from the rack ...

[jan-jaap]

After a bit of cleaning all 16GB RAM is now enabled

[jan-jaap]

Updated L1 to rev. 1.48.1 (IRIX 6.5.30 + patchSG0007149) using the procedure described by tjsgifan (thanks!)

This changed a few things in the '* env' output: both warning RPM and current RPM of the PSU fan have mysteriously doubled on both modules. Also, the '* serial all' now probes a SNOWBALL (nor found) and serial numbers of the PSUs. Speaking of those, I get this now too:

Code: Select all

001c01-L1>reboot_l1
ALERT: PS 2 EEPROM board info checksum error


SGI SN1 L1 Controller
Firmware Image B: Rev. 1.48.1, Built 01/22/2007 11:34:34


001c01-L1>

Right

The whole procedure is rather involved, if it wasn't for the fact that I was rebuilding an O300 anyway I wouldn't have bothered.

[foetz]

Good looking installation - thanks for sharing the photos and parts list!

indeed. very nice machines and just as nice work. good to see so many mips cuties still in action