Overview of T2 Plus systems

Sun on Wednesday launched the next generation of CMT servers based on the UltraSPARC T2 Plus processor. The T2 Plus is the first CMT processor with in-built coherency links that enables 2-way servers. The new servers are called the T5140 and T5240. The T5140 is a 1U server and the T5240 is a 2U server. A picture of the T5240 is on the right. Each server comes with two T2 Plus processors linked together through the motherboard

This is really exciting for us as it doubles the capacity of these servers while maintaining the same 1U and 2U form factors. This represents the absolute highest computes density of any server in the market.

As the name suggests the UltraSPARC T2 Plus is a derivative of the UltraSPARC T2. The vast majority of the processors are the same, both use Texas Instruments 65nm technology. There are still 8 cores with 8 Floating point and crypto units and 16 integer pipelines on each processor and a x8 PCI-E link integrated. The main differences are the replacement of the T2's 10Gig interface with silicon to perform coherency on the T2 Plus. The coherency does not use a traditional bus but instead uses multiple high speed SERDES links running at 4.8Gbps between chips to achieve optimal scaling

First the stats on these servers

T5140 is a 1U server with 16 FBDIMM slots, there are 1GB, 2GB and 4GB DIMMs available and we offer the following options

2x 4 Core, 1.2Ghz, 8GB memory

2x 6 Core, 1.2Ghz, 16GB memory

2x 8 Core, 1.2Ghz, 32GB memory

2x 8 Core, 1.2Ghz, 64GB memory

A T5140 can have up to 4 hot plug disks, either 73GB or 146GB SAS

At the rear are up to 3 PCI-Express slots. Two of these can be 10Gig ports via Sun's XAUI cards shown on the right. Note that unlike the T2 based servers the the 10Gig on the T1540 is not integrated on the processor but is provided by a Neptune NIC on the motherboard.

As with all our CMT servers there are 4 inbuilt GigE ports which are provided by the same onboard Neptune NIC. This is different from the T5120 and T5220 which used two Intel “Ophir” NICs for the 1Gig connectivity.

The server has 2 Hot plug power supplies at 720 Watts each.

Below is a photo of the T5140. Note the two T2 Plus processors under the larger copper heat sinks. The interconnect between the processors is wired through the motherboard. The other copper heat sink in the bottom right hand corner is the Neptune NIC

T5240 is a 2U server with up to 32 FBDIMM slots

We offer the following options with 8 or 16 DIMMs

2x 6 Core, 1.2Ghz, 8GB memory

2x 8 Core, 1.2Ghz, 32GB memory

2x 8 Core, 1.2Ghz, 64GB memory

2x 8 Core, 1.4GHz, 64GB memory

In addition you can buy a riser (called the Memory Mezzanine Kit) that will accommodate another 16 DIMMs there is a photo of the riser on the right.

This riser snaps on top of the layer of DIMMs on the motherboard and extends the FBDIMM channels so each can have up to 4 DIMMs

By default the T5240 can have up to 8 hot plug disks, again either 73GB or 146GB SAS. In addition when ordering the system a different disk backplane can be selected that can accommodate up to 16 disks.

The system has 6 PCI-Express slots and just like the T5140 two of these slots can be 10Gig ports via Sun's XAUI cards using the onboard Neptune NIC. Also like the T5140 the Neptune also provides the 4 built-in GigEs

By default the T5240 has two hot plug power supplies 1100 watts each. For the 1.4GHz and 16 disk configs however you need to use 220V AC input.

Below is a photo of the T5240 without a riser card, notice the motherboard is exactly the same as the T5140. The server has larger fans, however, to accommodate the extra memory and potentially more disks and PCIE cards. Note the larger power supplies are stacked one on top of each other as opposed to side by side on the T5140

As mentioned the T5140 and T5240 have bigger power supplies than the corresponding T5120 and T5220 as they need to support two processors. Power supplies from T5120 and T5220 should not be used for these servers.

The T5140 and T5240 use the exact same FBDIMM memory, however, as the T5120 / T5220 and support the exact same PCI-E and XAUI cards.

As noted earlier networking on the T5140 and T5240 is interesting as the two 10Gig XAUI and 4xGigE share the same Neptune NIC. If you use a XAUI card one of the GigE ports are disabled. Looking at the diagram below which highlights the two XAUI and GigE ports.

If you insert a XAUI card into XAUI 0 then the GigE port net1 will be disabled

If you insert a XAUI card into XAUI 1 then the GigE port net0 will be disabled

The Solaris Driver for all these ports is nxge, so device nxge0 can be either a 10Gig or a 1Gig port

One neat feature of the T5240 and T5140 is that each of the UltraSPARC T2 Plus processors has its own integrated x8 PCI-E link. Having two processors therefore automatically doubles the PCI-Express bandwidth. The T5x40 servers have twice the I/O bandwidth of their T5x20 equivalents. The PCI-E slots are wired so that the I/O is spread evenly across the x8 ports on both UltraSPARC T2 Plus processors.

For more information check out our whitepaper at http://www.sun.com/servers/coolthreads/t5140/wp.pdf


Post a Comment:
Comments are closed for this entry.



« July 2016