Welcome to MacForumz.com!
FAQFAQ    SearchSearch      ProfileProfile    Private MessagesPrivate Messages   Log inLog in

Large RAID Mac Solution?

 
   Macintosh computer (Home) -> Storage RSS
Next:  game recommendation  
Author Message
Heynony

External


Since: Mar 26, 2004
Posts: 14



(Msg. 1) Posted: Tue Sep 25, 2007 12:09 pm
Post subject: Large RAID Mac Solution?
Archived from groups: comp>sys>mac>hardware>storage (more info?)

I need five terrabytes of storage for my home video, which is now
fragmented over several devices: computers, Tivos, DVDs, etc. with a
combination of haphazard backup and SoftRAID (RAID-1, mirrored).

We have a mix of Macs & pcs in the family, mostly Macs.

I could slap together a dedicated pc/Wintel server with a motherboard
using the relatively new Intel ICH9R Southbridge 6-port RAID
controller, something like the Intel DP35DPM at just over $100. Cheap
CPU, case, video, kb & mouse, etc. since all it's doing is serving.
Would get a real good power supply. Maybe $500 or so total.

To that I can add 6 1 TB SATA drives for about $1,600 (and getting
cheaper as I procrastinate). Set up a RAID-5 and my sanity is
preserved.

On the Mac side, the only decent option I see is to take a
light-traffic Mac and hook up a Drobo Robot, but there's no track
record on this and it's USB only. Pretty much the same total dollars
but much poorer performance.

I really could use some guidance, my stuff is out of control and some
of the older, smaller (300 GB) hard drives are starting to fail.

 >> Stay informed about: Large RAID Mac Solution? 
Back to top
Login to vote
nospam

External


Since: Jul 14, 2003
Posts: 857



(Msg. 2) Posted: Tue Sep 25, 2007 1:33 pm
Post subject: Re: Large RAID Mac Solution? [Login to view extended thread Info.]
Archived from groups: per prev. post (more info?)

In article , Heynony
wrote:

> On the Mac side, the only decent option I see is to take a
> light-traffic Mac and hook up a Drobo Robot, but there's no track
> record on this and it's USB only. Pretty much the same total dollars
> but much poorer performance.

take a look at the readynas. it is similar to the drobo, but it has
gigabit and significantly more features. however, you'd need more than
one for 5 terabytes.

<http://www.infrant.com/products/products_details.php?name=ReadyNAS%20NV
Plus>

 >> Stay informed about: Large RAID Mac Solution? 
Back to top
Login to vote
David Lesher

External


Since: Aug 04, 2003
Posts: 95



(Msg. 3) Posted: Tue Sep 25, 2007 1:36 pm
Post subject: Re: Large RAID Mac Solution? [Login to view extended thread Info.]
Archived from groups: per prev. post (more info?)

Heynony writes:


>On the Mac side, the only decent option I see is to take a
>light-traffic Mac and hook up a Drobo Robot, but there's no track
>record on this and it's USB only. Pretty much the same total dollars
>but much poorer performance.

Why not something unMac running SMB or AFP? I have not followed who makes
RAID6 hardware supported by Linux but that is where I'd look.

--
A host is a host from coast to coast.................wb8foz DeleteThis @nrk.com
& no one will talk to a host that's close........[v].(301) 56-LINUX
Unless the host (that isn't close).........................pob 1433
is busy, hung or dead....................................20915-1433
 >> Stay informed about: Large RAID Mac Solution? 
Back to top
Login to vote
dg

External


Since: Jun 06, 2007
Posts: 15



(Msg. 4) Posted: Mon Oct 01, 2007 10:42 pm
Post subject: Re: Large RAID Mac Solution? [Login to view extended thread Info.]
Archived from groups: per prev. post (more info?)

On Sep 25, 9:09 am, Heynony wrote:
> I need five terrabytes of storage for my home video, which is now
> fragmented over several devices: computers, Tivos, DVDs, etc. with a
> combination of haphazard backup and SoftRAID (RAID-1, mirrored).
>
> We have a mix of Macs & pcs in the family, mostly Macs.
>
> I could slap together a dedicated pc/Wintel server with a motherboard
> using the relatively new Intel ICH9R Southbridge 6-port RAID
> controller, something like the Intel DP35DPM at just over $100. Cheap
> CPU, case, video, kb & mouse, etc. since all it's doing is serving.
> Would get a real good power supply. Maybe $500 or so total.
>
> To that I can add 6 1 TB SATA drives for about $1,600 (and getting
> cheaper as I procrastinate). Set up a RAID-5 and my sanity is
> preserved.
>
> On the Mac side, the only decent option I see is to take a
> light-traffic Mac and hook up a Drobo Robot, but there's no track
> record on this and it's USB only. Pretty much the same total dollars
> but much poorer performance.
>
> I really could use some guidance, my stuff is out of control and some
> of the older, smaller (300 GB) hard drives are starting to fail.

Note that NTFS volumes under 32-bit XP cannot be over 2 TB on boot
partition. Actually, try Windows Home Media Server...this is, after
all, what it is specifically for.... Otherwise, I'd go with Linux
(Debian preferred for simple and stable, but there's a rich diversity
of flavors) or OpenBSD. Intel tends to provide above-average hardware/
driver support for Linux, from what I've seen. Note too that the ICH8
SouthBridge has tested with much much higher throughput than the newer
ICH9, up to about 20 MB/s per drive difference. (Read more on
http://www.anandtech.com) On a RAID 5 or RAID 6 array, that much of a
speed drop adds up fast!

Also, if you're new to RAID you need to know that there are HUGE
differences in the demands made on power and drives when placed in a
RAID situation. Drives fail faster; "Enterprise" drives are made for
server situations; likewise, you want a power supply made to sustain
the demand... RAID arrays start high, stay high. If your power supply
has a high "peak load" capacity but a significantly lower "sustained
load" capacity, it will overheat and burn out. I've seen them melt
their own (power supply) case to cherry-hot and start sagging... I've
seen them catch fire... most often, I've seen them simply blow in a
flash of blue radiance and some sparks. Often, they have taken at
least some of the RAM and the CPU with them, but I've also seen one
fry every drive in the box. Anandtech has articles on this.

Lots of files on individual drives means eventually you lose something
-- I can't imagine having 5 TB of TV to watch, but video is well
suited to RAID application. Have you checked http://www.otherworldcomputing.com
for a Mac-compatible RAID 5 / 6 PCI-express controller? It is, after
all, why those MacPro's have so many of those slots... and the
removable drive racks, etc., and (IF Apple has done its job of
implementing it...) having two dual or quad-core processors, they
might as well have something to do. There's a very nice compatible
card I've my eye on, set-up for four internal drives and four external
drives, with option of expansion on each of the external connectors
(sort of the eSATA version of a hub). Max of eight drives direct-
connect, theoretical number is just huge. It's hardware RAID, so
system performance impact should be minimized in a decent
implementation. Just remember that compared with Linux, Windows, or
true BSD-Unix, OS X just doesn't keep up with high-demand networking
(multiple machines making simultaneous requests, as for example, when
you and the wife and the kids are each watching a different show
served off one file server). (Again, I'll refer you to http://www.anandtech.com
but this time to their very prestigious tests of OS X versus Linux on
Apple hardware.) I may be showing some ignorance on this particular,
but doesn't the MacPro have Intel's implementation of RAID built into
those MacPro motherboards, along with all those SATA2/300 ports? I
have heard you have to run OS X Server to access it fully, but
honestly I haven't confirmed that.
 >> Stay informed about: Large RAID Mac Solution? 
Back to top
Login to vote
Heynony

External


Since: Mar 26, 2004
Posts: 14



(Msg. 5) Posted: Wed Oct 03, 2007 9:20 am
Post subject: Re: Large RAID Mac Solution? [Login to view extended thread Info.]
Archived from groups: per prev. post (more info?)

dg wrote:

> If your power supply
> has a high "peak load" capacity but a significantly lower "sustained
> load" capacity, it will overheat and burn out

As I mentioned, the power supply is the one piece I'd plan to be
superior, and obviously properly rated, with margin. Air conditioned
room; dedicated fan over the whole works, in addition to what's built
into the box and it's components. Right now I have most of my
jerry-rigged maze of dozens of drives exposed, tops removed from the
external cases, with this fan playing over the whole mess, and mostly
everything is cool to the touch, warm at the worst.

The ICH9R looks like it will keep things running fast enough. Lots of
buffering in my playback client software. Really not a whole lot of
demand on the server. A constant library, just sits there 85% of the
time doing nothing but generate heat; titles added a few times a week.
We don't really watch a lot of TV, just want the diversity there, when
we want it.

Kids, when they watch at all, watch late afternoon/early evening. Wife
& I usually watching same thing, late evening.

For my basic notion of a $100 motherboard running RAID 5 with 6 $250 1
TB drives (with a spare drive always ready to insert on failure), I
find zero support among my technical friends; your reservations are
certainly main stream.

But there was zero support eight years ago when I started building the
video library with small drives strung together in an endless firewire
chain off a low-end eMac, and it's worked perfectly until recently when
some of the older drives have started to get balky and some flaws in my
backup procedures (and maintaining the source files) were exposed.

Even with a top grade power supply, seems like this would be a cheap
experiment. Risk is primarily that an error might occur just at the
moment when a faulty drive has just been replaced and is being
restored. That would be lights out, but odds seems remote, and most of
the library is always restorable from original DVDs and other
distributed off-line sources. A pain, but recoverable.

If I'm wrong about this thing working well, seems to me I'll just find
myself replacing a _lot_ of cheap SATA drives, one at a time as they
fail, and I'll soon come to understand that everybody else was right
and my notion was faulty. But still no substantial risk of data loss
even so.

All the approved solutions I check out look like many thousands for a 5
TB server.
 >> Stay informed about: Large RAID Mac Solution? 
Back to top
Login to vote
dg

External


Since: Jun 06, 2007
Posts: 15



(Msg. 6) Posted: Thu Oct 04, 2007 7:48 pm
Post subject: Re: Large RAID Mac Solution? [Login to view extended thread Info.]
Archived from groups: per prev. post (more info?)

On Oct 3, 6:20 am, Heynony wrote:
> dg wrote:
> > If your power supply
> > has a high "peak load" capacity but a significantly lower "sustained
> > load" capacity, it will overheat and burn out
>
> As I mentioned, the power supply is the one piece I'd plan to be
> superior, and obviously properly rated, with margin. Air conditioned
> room; dedicated fan over the whole works, in addition to what's built
> into the box and it's components. Right now I have most of my
> jerry-rigged maze of dozens of drives exposed, tops removed from the
> external cases, with this fan playing over the whole mess, and mostly
> everything is cool to the touch, warm at the worst.

Been there (especially with old SCSI drives I bought cheap).

> The ICH9R looks like it will keep things running fast enough. Lots of
> buffering in my playback client software. Really not a whole lot of
> demand on the server. A constant library, just sits there 85% of the
> time doing nothing but generate heat; titles added a few times a week.
> We don't really watch a lot of TV, just want the diversity there, when
> we want it.
> Kids, when they watch at all, watch late afternoon/early evening. Wife
> & I usually watching same thing, late evening.

O.K., sounds easy. Maybe look through your options, and see if the
server can be set for wake-on-LAN and spend its off-time sleeping.
Lots of arguments over it, but most wear on the drives occurs during
spin-up and spin-down (and OS & program crashes), but on the other
hand the amount of electricity RAID arrays consume has made most of
the home-media-server crowd I've helped with assembly eventually swear
off them; but most of those were pre-SATA.

> For my basic notion of a $100 motherboard running RAID 5 with 6 $250 1
> TB drives (with a spare drive always ready to insert on failure), I
> find zero support among my technical friends; your reservations are
> certainly main stream.

I've done this sort of thing (home-brew file servers, home-brew RAID)
before, and have some experience with commercial (IBM, Compaq, and
less common names) for-real servers, with large-volume NAS & SAS RAID
arrays. One thing I've learned, differentiating the real servers from
most home-built file servers, is that true server motherboards will
constantly monitor themselves, their on-board and add-in devices,
processors, and RAM for failure, and allow hot-swap of any device
short of the motherboard itself. That monitoring and redundancy are
what the money pays for; for a home-built file server most of these
options are out-of-price, but I'd suggest looking for a motherboard
which, besides doing what you want otherwise, also allows registered
error-correcting memory use. This is especially important in long-
term use, since incremental errors can lead to wide-spread problems.
Enabling the full SCSI / SATA-II SMART on your new drives is also
important (as is the monitoring software that lets you know of
impending drive failures well in advance, besides when the system is
booting!). You may want to load your manufacturer's hard-drive
firmware options controller before installing your Operating System
software, to choose up what options you want there. This can be an
important step in preparing drives for RAID arrays!

> But there was zero support eight years ago when I started building the
> video library with small drives strung together in an endless firewire
> chain off a low-end eMac, and it's worked perfectly until recently when
> some of the older drives have started to get balky and some flaws in my
> backup procedures (and maintaining the source files) were exposed.

Been there, too.

> Even with a top grade power supply, seems like this would be a cheap
> experiment. Risk is primarily that an error might occur just at the
> moment when a faulty drive has just been replaced and is being
> restored. That would be lights out, but odds seems remote, and most of
> the library is always restorable from original DVDs and other
> distributed off-line sources. A pain, but recoverable.

Yup. BTW, the difference between RAID 5 and RAID 6 is that with RAID
5, your spanned volume can recover from the loss of one drive--and
even remain in use meanwhile. RAID 6 allows for the loss of two
drives, thereby overcoming the possibility you mention. Paying
attention to your choice of file system is very much worth your while,
depend on it. I hear good things for IBM's JFS and, especially, for
SGI's file system (I momentarily forget the name of it, but it's
especially designed to maximize use of storage and to handle
comparatively very large files better than anyone else's.), there are
actually several non-default but available optional file systems when
you use Linux. I've had good results with both those. You may want
to search through some white papers, bug reports, and GNU-Linux-
oriented magazines' online back-issues to spot the differences.

> If I'm wrong about this thing working well, seems to me I'll just find
> myself replacing a _lot_ of cheap SATA drives, one at a time as they
> fail, and I'll soon come to understand that everybody else was right
> and my notion was faulty. But still no substantial risk of data loss
> even so.

Seems like a proper application of technological devices for intended
purposes, to me. I'd be quite cautious about the choice of hard drive
model; take care in selecting a file system suited to my file sizes,
as well as making sure suitable management application software (such
as drive status monitoring) is present and enabled when I'm done; and
I'd preferentially use error-correction coding RAM.

> All the approved solutions I check out look like many thousands for a 5
> TB server.

Nah, you can buy a Dell small business server for US $500.00 or less
(they start at about $350, last I checked, but the extra RAM and drive
slots were worth the extra money), then throw in your drives and
operating system; I've had to form a generally grudging liking for
their server motherboards for their dependability. They'll even pre-
install and support SuSE and Red Hat Linux, though these are the
"Enterprise" versions, not free. Also not free, are Dell-compatible
RAM upgrades. Check Crucial, etc. before trying to pay Dell's
prices! Still, your DIY file server with a free Linux distro will
cost less in parts and software, you're just trading "sweat equity"
for $. If possible, read reviews and download the manual for every
last component you plan to use, and read them so that you can plan
around hiccups. Make scale (or at least line-) drawings of where each
component will be. Much cheaper than finding out that RAM you bought
doesn't work with the board, or those hard drives you bought have
earned a reputation for failing if used in a RAID configuration, or
that your cables/drives/fans bump/displace each other when you go to
put the screws in.

All of this has been done before by others, and the fact you're
bothering to ask questions first shows you have a good chance of
getting it right.
 >> Stay informed about: Large RAID Mac Solution? 
Back to top
Login to vote
Display posts from previous:   
   Macintosh computer (Home) -> Storage All times are: Pacific Time (US & Canada)
Page 1 of 1

 
You can post new topics in this forum
You can reply to topics in this forum
You can edit your posts in this forum
You can delete your posts in this forum
You can vote in polls in this forum



[ Contact us | Terms of Service/Privacy Policy ]