[project]6th GeN. 30TB TriplX

[x88x]

I'd like to see the next gen have a petabyte of hdd space but it's unrealistic lol

Maybe Gen 8

[Trace]

This build was absolutely amazing...I can't wait for 7th gen

[x88x]

Ok, because I'm...well, I'm not really sure what I am, but anyways, I did a rough estimate of what it would cost to build a 1PiB cluster using off-the-shelf components:

Basically, you would have three storage nodes, each with a crapton of HDDs, and a quad-port gigabit PCIe NIC. Then you would have a controller node, with three quad-port gigabit PCIe NICs. The quad-port NICs would give you a nice, dedicated 4Gbps channel between the controller node and each storage node.

I worked out that to get 1 TiB (not 1TB...at that level the difference is a massive 73TiB!), you would need 581x 2TB drives. To accomodate any RAID balancing you might want to do, lets even that out to 584. With this setup, you could handle a maximum of 596 drives, though unfortunately, 20 of them would be on onboard controllers (8 in this scenario).

Granted, this wouldn't be the cheapest way to get 1TiB, but that's hardly the point, now is it...

Storage node (x4):
EVGA 170-BL-E762-A1 (MBB)
Xeon W3580
24GB Mushkin DDR3-1600
1x 64GB Intel X25-E
6x Acera 24-port PCIe RAID controllers
146x 2TB Samsung F3EG
1x Intel quad-gigabit NIC
PC P&C TurboCool 1200

Controller node (x1):
EVGA 141-BL-E757-TR (MBB)
Xeon W3580
24GB Mushkin DDR3-1600
1x 64GB Intel X25-E
4x Intel quad-gigabit NIC
PC P&C TurboCool 1200


584x 2TiB Samsung Spinpoint F3EG ($180@): $105,120
24x 24-port Areca PCIe SATA controller ($1,130@): $27,120
4x EVGA 170-BL-E762-A1 ($500@) : $2,000
1x EVGA 141-BL-E757-TR ($240@) : $240
5x Xeon W3580: ($1,090@): $5,450
10x Mushkin 12GB(3x 4GB) DDR3-1600 ($750@): $7,500
8x Intel Quad-port Gigabit PCIe ($407@): $3,256
5x PC P&C TurboCool 1200 ($600@): $3,000
5x 64GB Intel X25-E ($413@): $2,065
Total: $155,751

Oh, plus materials to build the custom case(s).

Soo...anyone got an extra house that they'd be willing to sell so I can build this thing?

[billygoat333]

bla bla bla I have lots and lots and lots of time on my hands

just kidding. that is an expensive cluster setup. d to a m n. haha. I'm bored too.

[knowledgegranted]

http://blog.backblaze.com/2009/09/01...cloud-storage/

[x88x]

http://blog.backblaze.com/2009/09/01...cloud-storage/

Yeah, only problem there is that to get 1PiB, you would need 16 of their units, for a total of ~$126,000, plus a rack to put them in. I was trying to do it in as few systems as possible, with as much reliability and speed as possible (the SATA repeater bridges that BackBlaze uses apparently aren't so good on either front, but in the massive quantity that they deal with them in, it balances out.

[Airbozo]

Yeah, only problem there is that to get 1PiB, you would need 16 of their units, for a total of ~$126,000, plus a rack to put them in. I was trying to do it in as few systems as possible, with as much reliability and speed as possible (the SATA repeater bridges that BackBlaze uses apparently aren't so good on either front, but in the massive quantity that they deal with them in, it balances out.

Well one way to save $$ is to get specific storage chassis that allow you to link HDD backplanes. Intel has a few and there are others out there (supermicro, AIC). You can put up to 188 drives on one controller and the backplane handles the load.

Not that it would save much, but...

[x88x]

Haha, yeah, I was pretty blown away by how much of the cost was just the HDDs

[Airbozo]

Haha, yeah, I was pretty blown away by how much of the cost was just the HDDs

True. We recently built a server for a customer that had 32x2tb drives. He was shocked at the price until he saw the price broken down. We also cautioned him against using consumer grade drives in a server based appliance. He didn't listen to us and we have replaced 3 of the drives already. We told him the company would not warranty them in this configuration for more than a year.

[grevaeg]

Well guys, ive kinda reached a limit on how much stuff can be stored.... its quite frankly hard to fill up more than 30TB. Trust me, ive tried.. simply not enough family photos around on the www..

But hey... its still somewhat over the top for a home rig? 0.o

What i would really like to do this way around is to get the rig REALLY silent... as in... 16db ish, i wanna be able to push the button, and hear no difference at all...

Should be quite obtainable with enough radiators and low rpm fan's, anyone have some insight on how much heat a radiator can dissipate? are there numbers out there?

Also wanna put the build quality to a higher level then previous, might be using solid alu this time, and not those hollow profiles

Give me some ideas guys, running low ^^

Anyone know if its possible to get waterblocks for the 5890's yet?