RMD Office NAS with RAID

Inane baanter or words of wisdom - you decide...
User avatar
gilesgoat
Sheepie Whore
Sheepie Whore
Posts: 27259
Joined: Wed Sep 03, 2003 7:54 am 0
Location: Monfalcone, Italy
Contact:

RMD Office NAS with RAID

Post by gilesgoat »

Just becuase there's that thread, starting with "possibly not costing millions" what reccomendation for :

- let's say 1T storage max ( but even less is ok )

- must have raid optimised for reliability ( not speed ) in HW

- must have hot-swap removeable HD

- ideally would have a behavior like : "Red light telling me this HD is broken", you take out the HD from the bay, you
put in an NEW HD in, the HW does automatic reconstruction of all needed in a "transparent" way, you don't see a shit
while all that is happening. (*)

- shuts down automatically if power goes down beyond what the UPS can support gracefully stopping disks.

- is designed to stay up 7/7 24/24

- it tells you "some stuff is starting to fail, replace it" before it actually crashes

- ideally, in theory, unless the whole system totally collapses you should never loose any data

- it's robust and won't break in at least 4 years time

( OPTIONALS )

- it has an SW that allows you to have "a quick fast glance at disk use and understand what's taking up space"

- it has filters that can be changed to prevent it getting clogged with dust inside

- it gives you warnings of stuff via some net application/client (i.e. if it makes more noise than an airplane when
working is going to be buried in a secret cellar underground and I need to know when something requires attention ).

(*) is "the paramount thing" and "what we really need"

Suggestions ?
Giles the billy goat
"Baa"
User avatar
Wudzi
Baaaaa!
Baaaaa!
Posts: 1146
Joined: Wed Aug 23, 2006 7:34 pm 0
Location: Southampton
Contact:

Re: RMD Office NAS with RAID

Post by Wudzi »

Roughly what budget and what level of RAID do you want?
User avatar
happy_jack
Baaa!
Baaa!
Posts: 491
Joined: Mon Sep 06, 2004 10:53 am 0
Location: Kent, UK
Contact:

Re: RMD Office NAS with RAID

Post by happy_jack »

I've been using an Infrant (now Netgear) ReadyNAS 1TB for a few years.. worked flawlessly, ticks most of the boxes you want.

Had an HD start to fail too, which it kindly notified me by email. Ordered a new one, replaced it, and job done.

Been up 24x7 that long too.
User avatar
hairy_pete
Baaaaaaa!
Baaaaaaa!
Posts: 7217
Joined: Mon May 27, 2002 8:10 pm 0
Location: A Tiny Village in Bavaria

Re: RMD Office NAS with RAID

Post by hairy_pete »

You need a RAID-5 array, at least four drives per RAID group (three active, one spare), SATA/SAS drive bays that let you hot-swap the drives, and either proper 24/7 SAS drives (expensive) or at least "RAID specification" SATA drives (same cheap SATA hardware, only with tweaked firmware).

In a NAS box, it doesn't really matter whether the CPU or a dedicated storage controller chip is doing the RAID logic ... it's not like the CPU in a NAS box has much else to do, just storage and LAN. The important bit is that the individual SAS/SATA channels are all hot-swap capable.
User avatar
WiteWulf
Sheepie Whore
Sheepie Whore
Posts: 10125
Joined: Mon Aug 23, 2004 11:20 am 0
PSN: WiteWulf
Location: Loughborough(ish)

Re: RMD Office NAS with RAID

Post by WiteWulf »

Giles specified reliability over performance so RAID1 is actually preferable to RAID5.

RAID5 stripes and checksums data across disks so, with a minimum of 3 disks, if one disk fails you simply replace it and you stripe set rebuilds in the background. You do, however, sacrifice one disk's worth of capacity in your array for the checksum data.

RAID1 simply mirrors every bit of data on a second disk so performance is whatever you usually get out of a single disk. WIth this you sacrifice a whole disk's worth of storage for your mirror

RAID5 can offer a slight performance increase due to the striping but you need more expensive hardware to do this than RAID1.

RAID1, imho, is preferable in this situation as reliability is most important and, through simple statistics, we can see that adding another disk to the array (going from 2 disks in RAID1 to a minimum 3 disks in RAID5) lowers the MTBF (mean time between failure) for the whole system.

K.I.S.S., as they say...
:::G:::

PSN: WiteWulf
Switch: SW-3941-2878-7584
Steam: WITEWULF66
User avatar
gilesgoat
Sheepie Whore
Sheepie Whore
Posts: 27259
Joined: Wed Sep 03, 2003 7:54 am 0
Location: Monfalcone, Italy
Contact:

Re: RMD Office NAS with RAID

Post by gilesgoat »

RAID 5 is what I had in mind.

Given the costs of disks nowadays I am more than happy to spend "one more extra disk" to have
more reliability VS capacity.

That NETGEAR thing looks incredibly interesting, if that is the price is "awesome".

When the disk fails do you simply put one in an "does all by its own" ?
Giles the billy goat
"Baa"
User avatar
WiteWulf
Sheepie Whore
Sheepie Whore
Posts: 10125
Joined: Mon Aug 23, 2004 11:20 am 0
PSN: WiteWulf
Location: Loughborough(ish)

Re: RMD Office NAS with RAID

Post by WiteWulf »

Giles, do the maths: RAID1 is "more reliable" than RAID5 and you get very little increase in performance with RAID5 these days.

There's also RAID0+1 to consider. This stripes across two or more disks for the ultimate in performance, then mirrors the stripe set to an identical, second array of disks. This means a minimum of four disks with 50% overhead. This is will give you the best performance and data security but you still get that hit on MTBF due to the increase in number of disks.

wrt replacing disks, yeah, when a disk fails you just pop a new one in and the controller will automagically start to rebuild the array (so long as your system is hot-swappable - if it's not you'll have to power the system down). If you've bought something really fancy you may have a hot spare disk installed that's just waiting for an occasion like this and will rebuild without even asking you. This can be particularly useful in the unlikely even that you have two disks fail before you get to the device to replace one of them.
:::G:::

PSN: WiteWulf
Switch: SW-3941-2878-7584
Steam: WITEWULF66
User avatar
Wudzi
Baaaaa!
Baaaaa!
Posts: 1146
Joined: Wed Aug 23, 2006 7:34 pm 0
Location: Southampton
Contact:

Re: RMD Office NAS with RAID

Post by Wudzi »

RAID 10 is what he wants by the sound of it. I'm not sure that there is much consumer stuff that supports it though.
User avatar
WiteWulf
Sheepie Whore
Sheepie Whore
Posts: 10125
Joined: Mon Aug 23, 2004 11:20 am 0
PSN: WiteWulf
Location: Loughborough(ish)

Re: RMD Office NAS with RAID

Post by WiteWulf »

RAID10, RAID1+0, RAID0+1...all the same thing.
:::G:::

PSN: WiteWulf
Switch: SW-3941-2878-7584
Steam: WITEWULF66
User avatar
Dio
Sheepie Whore
Sheepie Whore
Posts: 18887
Joined: Mon May 31, 2004 1:08 pm 0
Location: Newcastle UK

Re: RMD Office NAS with RAID

Post by Dio »

Worth mentioning also: RAID is not in the slightest way a substitute for backup. It absolutely does not stop you 'loosing data' - it just eliminates the hardware as a possibility. If someone accidentally deletes Z:\, it's all still gone. I've made that mistake before.

If the only things you're using on the RAID means that's not an issue (Perforce perhaps or some other SCM that never 'deletes anything', and so you never need to map the drives explicitly) that's OK, but if you're just using this as a mappable fileserver you absolutely, utterly must still backup anything important to some media that's at least a few clicks - preferably of power switches, not mice - away from brain-off deletion.

Personally, I don't use RAID because it would encourage me to be (even more) sloppy about backups. Which is the kind of perverse logic that works for me.
User avatar
WiteWulf
Sheepie Whore
Sheepie Whore
Posts: 10125
Joined: Mon Aug 23, 2004 11:20 am 0
PSN: WiteWulf
Location: Loughborough(ish)

Re: RMD Office NAS with RAID

Post by WiteWulf »

Well said that man. Nothing tops making proper backups for data security (preferably with copies held off-site).
:::G:::

PSN: WiteWulf
Switch: SW-3941-2878-7584
Steam: WITEWULF66
User avatar
gravy
Sheepie Whore
Sheepie Whore
Posts: 19572
Joined: Wed May 01, 2002 1:28 pm 0
Location: The Other Place

Re: RMD Office NAS with RAID

Post by gravy »

Dio wrote:If the only things you're using on the RAID means that's not an issue (Perforce perhaps or some other SCM that never 'deletes anything', and so you never need to map the drives explicitly) that's OK
Even that's dodgy, database corruption isn't that unusual so you need to backup up your perforce data as well.
User avatar
gilesgoat
Sheepie Whore
Sheepie Whore
Posts: 27259
Joined: Wed Sep 03, 2003 7:54 am 0
Location: Monfalcone, Italy
Contact:

Re: RMD Office NAS with RAID

Post by gilesgoat »

True .. RAID is not backup .. BUT ..

What is backup nowadays ?

You have amount of data the only way it could be possibly moved somewhere else
is only another HD (set) because there's nothing else that big to contain it.

At this point 'backup' for me becomes an external USB HD that you switch on/off
the only moment you need to move data in/out and the remaining of time is
in some safe closed.

CDs, out of question, DVDs too .. maybe 'more secure because not mechanical'
we end up in USB keys but capacity is extremely limited.

Of course you do backup in some way BUT the difference is between :

- at some point my 'main disk' goes in HD failure at that point only the backup
saves me
- I have raid, before all the N disk fails there's at least some I can still recover
data and maybe launch a backup before it all explodes

Incremental backups yes but you can' go on them 'forever' plus you still
tend to end up in 'deleting 0, accumulating data', is rare you really delete
anything from the stuff you put in 'backup'.

Anyway RAID should ( temporary ) save you from 'omg all is broken' into
'it's going to break but I can sill save it'.

I can't see a backup ( made via HDs ) that much more reliable than anyhing else.
Giles the billy goat
"Baa"
User avatar
piku
Sheepie Whore
Sheepie Whore
Posts: 20960
Joined: Wed Apr 24, 2002 10:44 am 0
Website: Http://Www.ncot.uk
Location: Wakefield
Contact:

Re: RMD Office NAS with RAID

Post by piku »

Dio wrote: Personally, I don't use RAID because it would encourage me to be (even more) sloppy about backups. Which is the kind of perverse logic that works for me.
I also don't use RAID because in my brain, the more disks I have running 24/7 the more chances there are of one breaking down. I have a single terabyte drive, with all the important stuff backed up every night to an offsite storage place - they put it on a giant RAID array for me, it's their problem if the disks die. It's my problem if I back up five gigs of nonsense corrupt database gibberish.

More importantly I don't work "live" off my server's disks. My PC is capable of running just fine without a network connection, a backup job copies the data to my server every hour. So should I go mental and delete my Visual Studio 2008 folder I've got two other copies, plus an SVN repo of which I have two copies.

I've lost lots of important data over the years, I've slowly learnt that there's no such thing as a foolproof backup plan, it's all about how much data you are willing to lose.

RAID at home is pointless and a waste of money, you're not a large multinational company with terabytes of data that must remain live at all times. Discuss.
return (0);
User avatar
Dio
Sheepie Whore
Sheepie Whore
Posts: 18887
Joined: Mon May 31, 2004 1:08 pm 0
Location: Newcastle UK

Re: RMD Office NAS with RAID

Post by Dio »

For a long time I had a pretty simple system: the server drive was explicitly zero backup, with the exception of specific work directories, where I have a script I run once a month or so (not frequent enough really, but tolerable) and copy the results of that off to one DVD.

This fell part-way apart when I started recording music, and all the way when the baby pictures bloated the pics folder at about 0.5G per month, so it doesn't all fit on one DVD any more.

For the moment, I've reduced the frequency of backing up older stuff. I reckon in 12-24 months there will be a viable 'single unit' backup system again - either Blu-ray or, at the rate prices are still dropping, flash. £10 for a 16G flash card is probably about where it needs to be to make sense. To make me feel less paranoid - and because of the inconvenience and download time required to get back the 3-500G of data on the server - I'm using an external drive and SyncToy as a line of hardware defense. (In addition, I've largely stopped deleting pictures off camera flash cards and started buying new cards instead).

RAID arguably makes sense for this job, but I like the idea that this drive only gets turned on when I know I want to backup, and until I activate the sync everything that was there is still there. So I still have a little bit more Pressing The Stupid Button protection than RAID would offer.
Post Reply