Difference between revisions of "Computer Hardware"

From SharedSkies
Jump to navigation Jump to search
 
(41 intermediate revisions by 2 users not shown)
Line 1: Line 1:
Computer systems that run the telescopes, store data, and provide remote analysis for users are currently built in house from standard components selected for the best performance/price ratio.  Starting in the spring of 2014 we will try to document the selections here.  Typically useful lifetimes for hardware before failure or obsolescence is 3 to 5 years. 




== Server Chassis ==
Computer systems that run the telescopes, store data, and provide remote analysis for users are currently built in house from standard components selected for the best performance/price ratio. The selections in use now were  made in Fall 2017 and have been working well since then (currently December 2021).  The main  servers mtkent1 and mtkent3 which archive data are Supermicro servers.  Typically useful lifetimes for hardware before failure or obsolescence is 3 to 5 years though recently these systems have been more reliable, with only two failures out of  about 12 attributed to environmental heat stress. Nevertheless, computers at the telescopes may be smaller modular fanless units where proximity to electronics such as cameras, filter wheels, and focusers encourage short cable runs.
   
Supermicro  822T-400LPB $424


[http://www.supermicro.com/products/chassis/2U/822/SC822T-400LP.cfm  Supermicro SC822T]


This is a 2U rack server that accommodates an ATX motherboard with space for 6 hot-swap SATA drives and 1 full height DVD. It includes a single 400 watt power supply.
== Servers ==
The [http://www.supermicro.com Supermicro] 1U Intel Xeon servers accomodate 4 hot-swap drives.  Assembled and tested systems are availalble from
from [http://www.serversdirect.com/ Servers Direct] for a price that is competitve with building one from parts, without the risk.




== Workstation Chassis ==
== Workstations ==


Corsair Obsidian Series Black 550D Mid Tower Computer Case $117
Used for data analysis, given the size of datasets and processing needs of a photometry run, workstations require large memory access,  multiple processing cores, and storage of 10 TB or more.  We prefer Xeon processors with ECC memory, trading speed  of the consumer Intel core series for reliability and lower power consumption of the high end server CPUs. The preferred design for new hardware is an Intel W-1390 Rocket Lake processor with an LGA 1200 socket requiring a W580 motherboard chipset, available as of late 2021 for $540.    The Supermicro MBD-X12SCA-5F motherboard which accommodates this processor provides USB 3.0, dual Ethernet, and up to 128 GB of error-correcting ECC memory for $510.  This motherboard is in ATX format, and the Supermicro workstation chassis CSE-732D3-903B  900 W of power and only  21 DB of noise accomodates this board for $400.  Currently 32 GB of DDR4 ECC UDIM costs $120, and the large 14 TB Seagate Exos drives are $330. With these components, a very useful workstation using 11th generation Intel processing with 64 GB of memory would cost $2220 to build from components. 


[http://www.amazon.com/gp/product/B006L6ZSWC/ref=oh_details_o00_s02_i00?ie=UTF8&psc=1 Corsair Mid Tower case on Amazon.com]
Used for machine control, simpler, lower cost, and compact mini- or micro-chassis computers are the preferred choice and are being used to replace computers at the telescopes as they age or fail. For these, small HP or Dell systems which are supported by the University's purchasing agreements can be found for less than $1000HP Elitedesk business computers with a Core I5 processor are available used for  $300 with 16 GB of DDR4 non-ECC memory and USB 3.0, perfect for telecope operation, and inexpensive enough to maintain on-site spares.  Used HP 800 G3 mini formfactor "desktop" computers with Intel I7, 32 GB of DDR4, and 1 TB NVme SSD plus WiFi cost about $600 in December 2021. The issue with these smaller devices for instrument control is that typically older generations have one Ethernet port, but they are usually run headless in our applications so the display technology should not be a factor in selecting them.


A large case provides exceptional ventilation, ease of access, and quiet operation.  USB3 is brought out to the front panel.  The interior has many slots for SATA drives and for two full height DVD drives. If rack mounting is not required, it will work splendidly as a server enclosure especially for systems with GPU cards that require high power.  The SATA drive carriers do not use screws, and while the drives are not hot swappable, it takes only minutes to replace one without tools.
== Power ==
The Corsair power supplies have been reliable and are quiet.  A typical one in recent use is the TX650 available for about $95.
[http://www.amazon.com/Corsair-Enthusiast-Certified-Compatible-platforms/dp/B004LB5AZY/ref=sr_1_1?s=electronics&ie=UTF8&qid=1400883726&sr=1-1&keywords=corsair+tx650 Corsair TX650 on Amazon]
Power supplies for the observatories have to be quiet, and should be green with high efficiency.  Typical lifetimes have been 3 to 5 years, but some supplies from Antec have had premature failure and are not recommended.
== CPU ==
The best CPU is selected at time of purchase based on Passmark ratings from this site:
[http://www.cpubenchmark.net/  http://www.cpubenchmark.net/]
As of September 2014 the preferred selection is an LGA2011 socket Intel Hex Core I7-5820K running at  3.3 GHz for $580.  It is available from Amazon and other suppliers at about $380,  an alternative to comparable Xeon processors that are about twice the price.
[http://www.amazon.com/Intel-i7-4930K-Technology-Processors-BX80633I74930K/dp/B00EMHM622/ref=sr_1_1?s=electronics&ie=UTF8&qid=1400878974&sr=1-1&keywords=I7-5820K I7-5820 on Amazon.com]
These are  supplied without a cooler which is purchased separately.  We use the low cost air-cooled Intel Thermal Solution Air $21
[http://www.amazon.com/Intel-BXRTS2011AC-Thermal-Solution-Air/dp/B006588YUE/ref=sr_1_fkmr0_3?s=electronics&ie=UTF8&qid=1400879345&sr=1-3-fkmr0&keywords=I7-4930K+lga2011+intel++cooler  Intel LGA2011 cooler]
It runs quietly, and is not at risk for use at a telescope where there may be temperature extremes.
== Motherboard ==
We have had good success with motherboards from Supermicro.  Currently there are more than 10 in service, some for two years of continuous use.  We have had three failures in two years.  One was in a system exposed to environmental extremes, and a similar one was in a controlled environment.  Both failed after a power disruption even though they were on surge-protected circuitry. The problem could have been with the motherboard itself, or due to a spike from the power supply.  We have not had a failure with the preferred power supply noted below.
'''LGA2011'''
[http://www.supermicro.com/products/motherboard/Xeon/C600/X9SRA.cfm Supermicro X9SRA] Xeon and I7 supports 512 GB of DDR3 memory in 8 sockets, and offers 2x PCI-E 3.0 x16, 1x PCI-E 3.0 x4 (in x8), 1x PCI-E 2.0 x4 (in x8), and 1x PCI-32. It is available through distributors offered by Amazon for about $280. This board has built-in audio.
== Memory ==
For the LGA2011 socket motherboard, the required memory is 4x or more  8 GB registered ECC DDR3 modules. Crucial currently recommends 8 GB DDR3 PC3-12800 Registered  ECC  DDR3-1600  1.5V for $110 each.
[http://www.crucial.com/usa/en/x9sra/CT3421493 Crucial 8GB registered DDR3-1600 ECC]
There does not seem to be the requirement to use non-ECC memory with I7 processors that was in the previous chipset.


== Hard Disk Drives ==
== Hard Disk Drives ==




All new drives are Seagate Constellation Enterprise class SATA drives. For example, the 2 TB drive  currently $150 on Amazon was the drive of choice in 2013:
All new drives are Seagate Exos  (formerly Enterprise or Constellation) class SATA drives.  
 
 
[http://www.amazon.com/Seagate-Constellation-7200RPM-Internal-ST2000NM0011/dp/B0057BOO4A/ref=sr_1_6?s=electronics&ie=UTF8&qid=1400882945&sr=1-6&keywords=seagate+constellation Seagate 2 TB SATA  ST2000]
 


The 4 TB drive now at [http://www.amazon.com/Seagate-Enterprise-Constellation-Cache-Internal-ST4000NM0033/dp/B00A45JEX0/ref=sr_1_fkmr0_2?ie=UTF8&qid=1407310115&sr=8-2-fkmr0&keywords=seagate+enterprise+ST4000NM003 $262] would be the choice for new installations in 2014:
The 8 TB drive was the cost effective choice in 2020 and is being used for replacements and storage upgrades.  Allowing 4 slots at this capacity provides 48 TB online, exceeding our current needs for  several years. Drives with 14 TB are now available for the price of 8 TB last year, making the 8 TB very cost effective for a workstation.


Note that the commodity Seagate Barracuda line is not as reliable and has had in our uses a unacceptable MTBF of about 2 years.  We have not had only 1 enterprise-class  drive failure since implementing them in 2012 and an specified MTBF of 5 years does seem to be a realistic expectation in practice.


[http://www.seagate.com/internal-hard-drives/enterprise-hard-drives/hdd/enterprise-capacity-3-5-hdd/#specs Seagate Enterprise Capacity v.4 4TB SATA  ST4000]


== GPUs and Graphics ==


Note that the commodity Seagate Barracuda line is not as reliable and has in our uses an MTBF of about 2 yearsWe have not had a Constellation drive failure since implementing them in 2012.
Where needed we have  NVIDIA Pascal and Kepler architecture  GPU cards installed on some processing workstations, but not on the main data storage and web server systems.  This technology is evolving rapidly, and for affordable small scale uses the previous generation Quadro series of graphics cards  is still usefulNew or replacement systems would use the NVIDIA RTX cards, and the RTX A2000 with 6 GB of GDDR6 and 4 display port outputs is available  for $700 retail in December 2021.

Latest revision as of 21:45, 19 December 2021


Computer systems that run the telescopes, store data, and provide remote analysis for users are currently built in house from standard components selected for the best performance/price ratio. The selections in use now were made in Fall 2017 and have been working well since then (currently December 2021). The main servers mtkent1 and mtkent3 which archive data are Supermicro servers. Typically useful lifetimes for hardware before failure or obsolescence is 3 to 5 years though recently these systems have been more reliable, with only two failures out of about 12 attributed to environmental heat stress. Nevertheless, computers at the telescopes may be smaller modular fanless units where proximity to electronics such as cameras, filter wheels, and focusers encourage short cable runs.


Servers

The Supermicro 1U Intel Xeon servers accomodate 4 hot-swap drives. Assembled and tested systems are availalble from from Servers Direct for a price that is competitve with building one from parts, without the risk.


Workstations

Used for data analysis, given the size of datasets and processing needs of a photometry run, workstations require large memory access, multiple processing cores, and storage of 10 TB or more. We prefer Xeon processors with ECC memory, trading speed of the consumer Intel core series for reliability and lower power consumption of the high end server CPUs. The preferred design for new hardware is an Intel W-1390 Rocket Lake processor with an LGA 1200 socket requiring a W580 motherboard chipset, available as of late 2021 for $540. The Supermicro MBD-X12SCA-5F motherboard which accommodates this processor provides USB 3.0, dual Ethernet, and up to 128 GB of error-correcting ECC memory for $510. This motherboard is in ATX format, and the Supermicro workstation chassis CSE-732D3-903B 900 W of power and only 21 DB of noise accomodates this board for $400. Currently 32 GB of DDR4 ECC UDIM costs $120, and the large 14 TB Seagate Exos drives are $330. With these components, a very useful workstation using 11th generation Intel processing with 64 GB of memory would cost $2220 to build from components.

Used for machine control, simpler, lower cost, and compact mini- or micro-chassis computers are the preferred choice and are being used to replace computers at the telescopes as they age or fail. For these, small HP or Dell systems which are supported by the University's purchasing agreements can be found for less than $1000. HP Elitedesk business computers with a Core I5 processor are available used for $300 with 16 GB of DDR4 non-ECC memory and USB 3.0, perfect for telecope operation, and inexpensive enough to maintain on-site spares. Used HP 800 G3 mini formfactor "desktop" computers with Intel I7, 32 GB of DDR4, and 1 TB NVme SSD plus WiFi cost about $600 in December 2021. The issue with these smaller devices for instrument control is that typically older generations have one Ethernet port, but they are usually run headless in our applications so the display technology should not be a factor in selecting them.


Hard Disk Drives

All new drives are Seagate Exos (formerly Enterprise or Constellation) class SATA drives.

The 8 TB drive was the cost effective choice in 2020 and is being used for replacements and storage upgrades. Allowing 4 slots at this capacity provides 48 TB online, exceeding our current needs for several years. Drives with 14 TB are now available for the price of 8 TB last year, making the 8 TB very cost effective for a workstation.

Note that the commodity Seagate Barracuda line is not as reliable and has had in our uses a unacceptable MTBF of about 2 years. We have not had only 1 enterprise-class drive failure since implementing them in 2012 and an specified MTBF of 5 years does seem to be a realistic expectation in practice.


GPUs and Graphics

Where needed we have NVIDIA Pascal and Kepler architecture GPU cards installed on some processing workstations, but not on the main data storage and web server systems. This technology is evolving rapidly, and for affordable small scale uses the previous generation Quadro series of graphics cards is still useful. New or replacement systems would use the NVIDIA RTX cards, and the RTX A2000 with 6 GB of GDDR6 and 4 display port outputs is available for $700 retail in December 2021.