Summary: SSDs needed for Infra server consolidation (Forums/Wiki/Bugs) [Gossamer Threads] Requesters: robbat2, infra Deadline (mandatory): 2017, early October Priority: High Amount requested: Under $3600 USD-equivalent (price quote still outstanding) Funding disbursement: Combination Direct purchase / reimbursement (will try to to PayPal & Foundation debit cards if possible) Shipping Destination: Ship to robbat2 in Vancouver, will hand-deliver to servers / sponsor. Vendors: - Amfeltec (NVMe M.2 PCIe adapters) - Amazon (SSD) Justification: One of the Foundation's long-time Infrastructure sponsors wishes to consolidate some older systems, and is concerned about possible failures, in light of other machines of the same age in their fleet slowly dying. Presently they provide the Foundation with 5x Tyan servers, approximately 10 years old. The hard drives are much newer, but the rest is old. The existing systems presently host: - 3x www nodes, has wiki, forums, bugzilla - 2x db nodes, redundant MySQL for wiki & forums & bugzilla (4-disk MDRAID10 on 600GB SAS 15K 3.5" disks); also failover load-balancer for DB & WWW services. The disk IO on the present database systems already exceeds 50% of available IOPS, 24/7, and maxes out available IO during recovery situations. There is also not enough free space in some circumstances to perform in-place recovery of the database. The replacement systems are 2x Dell R610, and several lightweight VMs (not hosted on the Dells). The Dell's will come with the H700 RAID controller and 4x 10K 2.5" SAS disks, probably 600GB, this is a going to be a big drop in disk performance. The replacement systems will host database AND website on the same server. The load-balancing will move to the VMs. There is potentially an option for a third R610 server in 2018. The sponsor is not able to purchase large SSDs at this time for the Foundation's use. The existing H700 RAID controller does not support TRIM/DISCARD at all, so alternative plans need to made for optimum SSD performance. The plan is to install a M.2 PCIe adapter in the internal card slots of each DB server, and populate it with M.2 format SSDs (2x M.2 cards per adapter), and use MDRAID1 for data integrity. The adapters are available in multiple forms: - PCIe x4 to single M.2 M-slot - PCIe x4/x8 to dual M.2 M-slot - PCIe x8/x16 to quad M.2 M-slot The M.2 cards need to be NVME variants [M-slot] (not SATA variant), and the usable capacity in RAID1 needs to be 500GB. Itemized expense list: - Amfeltec: -- Adapters suitable for 2x M.2 in each of the 3 servers (buying a third adapter as a spare for the moment, and using it for the potential 3rd server later) -- $2000USD based on US distributor pricing for the quad-M.2 card (no immediate pricing on the other cards available) -- Exact quote pending, as they are a Canadian company and may be able to ship inside Canada much cheaper. -- Quote request does explore different adapter options. -- No alternate supplier available for equivalent part (Startech makes a similar concept but SATA adapter that is not usable due to needing fast internal SATA ports). - Amazon -- Samsung 960 PRO Series - 512GB PCIe NVMe - M.2 Internal SSD (MZ-V6P512BW), $424CAD/each. -- Quantity 4, 12% tax = $1900CAD. - NewEgg (alternate to Amazon) -- Same as SSD above, but on special -- $370CAD/each -- Quantity 4, 12% tax = $1657CAD
The M.2 PCIe adapters seem expensive 2k for 2 of them (1k each)?
(In reply to Matthew Thode ( prometheanfire ) from comment #1) > The M.2 PCIe adapters seem expensive 2k for 2 of them (1k each)? The public pricing I based it on is $640USD/ea, quantity 3 for a quad-M.2, while I'm waiting for a quote from the manufacturer. Realized I missed a link to the part & present price: Here's the 2xM.2 option: http://amfeltec.com/products/pci-express-gen-3-carrier-board-for-2-m-2-ssd-modules/ Here's the 4xM.2 option: http://amfeltec.com/products/pci-express-gen-3-carrier-board-for-4-m-2-ssd-modules/ (Other cards in the family: http://amfeltec.com/squid-pci-express-carrier-boards-for-m-2-ssd-modules/?view=list) Here's where I got the pricing of $640USD for the 4xM.2 option: http://www.saelig.com/category/MFR00148.htm The reason there seem to be two of them, is that you have to choose between an x16 connector and an x8 connector. The price is the same, but we'd be going with x8 in the R610 servers.
(In reply to Robin Johnson from comment #2) > (In reply to Matthew Thode ( prometheanfire ) from comment #1) > > The M.2 PCIe adapters seem expensive 2k for 2 of them (1k each)? > The public pricing I based it on is $640USD/ea, quantity 3 for a quad-M.2, > while I'm waiting for a quote from the manufacturer. Updated Amfeltec Pricing. > SKU-086-31 > Description: SQUID PCIe Carrier Board for 1 M.2 SSD module > Unit Price: $ 61.90 USD > Spec: > - (M.2 key M) Gen 3 > - (x4 PCIe upstream interface) > The follow options are available for the same price: > - x1 PCI Express upstream interface > > SKU-086-32 > Description: SQUID PCIe Carrier Board for up to 2 M.2 SSD modules > Unit Price: $ 297.12 USD > Spec: > - (M.2 key M) Gen 3 > - (x8 PCIe upstream interface, full size bracket) > > The follow options are available for the same price: > - Low profile PCI Express bracket > - x4 PCI Express upstream interface I'd go with quantity 3, SKU-086-32, x8 & ask for both LP & full-size brackets, which would be ~$891USD + tax + shipping (maybe a few more $ to get both brackets). The quote does state "Subject to change based on exchange rate", but they did quoted me in USD. Updated subtotals: - Adapters: $900-$1000USD - SSDs: $1660-$1900CAD -> $1300-$1500 USD equiv. Total: $2200-$2500USD.
Approved up to $3,500 USD
Ok, that makes sense, didn't think it was such a high spec'd adapter (or in that quantity). Still seems like more than we need, but going to approve it for up to $3000 USD.
As discussed on IRC, I approve a budget of $3,000 US so Infra has a little wiggle room on item and shipping costs.
up to $3000 USD
Ok, a full complement approving it, so I'll go ahead with the purchasing. 02-15:51:00 <@kensington> robbat2: I approve $3k too, I won't have bugzie access until later
Final amount USD 2,413.96 (vs trustee approval for USD 2500). confirmed in ledger.
