Decorum for the Forum:
  • Be nice. If you want to be mean, try Reddit.
  • No Piracy. If you want to be a thief, there are dark places on the internet dedicated to that.
  • No Cracking. Discussions on AnyDVD, DeUHD, DVDFab, UHDKeys and similar tools are not permitted here.
  • No Spamming. If you want to make a buck, work smarter... somewhere else.
  • No Adult Content. Half the internet is dedicated to adult content. This half isn't.

Privacy Policy: Click Here to Review (updated September 30, 2020)

What is Unraid and how to build an Unraid media server

Show off your HTPC builds, NAS Servers, and any other hardware. Great place to ask for hardware help too.
Jamie
Posts: 942
Joined: Wed Dec 27, 2017 11:26 pm

Re: Need advice on building an unraid media server

Post by Jamie » Fri Feb 22, 2019 10:57 pm

Yes, Paul, I did forget about buying a UPS for the Laundry room when I get the unraid server in there.

I have 4 APC Back-ups Pro 1500s. I have one for my bedroom computers. 1 for all my Drobos. 1 for my Bedroom entertainment system and 1 for the living room entertainment system. We have dirty power here so we have to protect our equipment. That is why I get so nervous due to the fact that it can take days (yes days) for a drobo to refresh the drives after one has been replaced. I can handle an outage for 30 minutes, but we can have the power go out for hours at a time.

I had a Cyberpower UPS and liked it. They are much less expensive than the APC. I think the reason I stick with APC now is that they have a powerchute application which tracks, up and down time, as well as electricity consumption. I think they have a longer warranty and they cover a higher cost for electronic device lost. I have never had a device fail due to an electrical surge, or outage when the device was on a UPS.

I have had lightning strike my cable company coaxial cable line and blowout the HDMI ports on a TV and a Yamaha receiver. This has not happened since I went back to Directv by the way.

Back to UPS's. I too am a believer that they are an important device to have for your computer equipment. Thank you for reminding me that I need one for the unraid server.

Also, I heard that Cyberpower was bought out by APC and that Cyberpower is a value brand of theirs. Do you know whether that is true?

Jamie

User avatar
Pauven
Posts: 2777
Joined: Tue Dec 26, 2017 10:28 pm
Location: Atlanta, GA, USA
Contact:

Re: Need advice on building an unraid media server

Post by Pauven » Sat Feb 23, 2019 12:13 am

Jamie wrote: Fri Feb 22, 2019 10:57 pm Also, I heard that Cyberpower was bought out by APC and that Cyberpower is a value brand of theirs. Do you know whether that is true?

I really don't know. I tried googling it but didn't get any hits. But I did find this (Edit: interesting, all I did was post a URL, and somehow the forum showed a snippet of the reddit post. Fancy):

https://www.reddit.com/r/hardware/comme ... it-android
President, Chameleon Consulting LLC
Author, Chameleon MediaCenter

Jamie
Posts: 942
Joined: Wed Dec 27, 2017 11:26 pm

Re: Need advice on building an unraid media server

Post by Jamie » Sat Feb 23, 2019 11:36 am

That's good to know. I guess they're two competing companies.

Jamie

User avatar
Pauven
Posts: 2777
Joined: Tue Dec 26, 2017 10:28 pm
Location: Atlanta, GA, USA
Contact:

Re: Need advice on building an unraid media server

Post by Pauven » Fri Mar 01, 2019 11:24 am

Unraid Flash Drive

The next topic to cover is the flash drive for the Unraid OS.

You install Unraid to a thumb drive, and you boot the server from the thumb drive. Your Unraid license will be tied to a unique ID that is present on every thumb drive.

If your thumb drive ever goes bad, LimeTech will work with you to move your license over to a new thumb drive, but that's a hassle best avoided. For this reason, I recommend using a high-quality thumb drive.

It doesn't need to be very big. My thumb drive is 4GB, and after a decade of use, it still has 3.5 GB free. Recently, some options have been added to Unraid to allow the log files to be written to the flash drive (previously they were stored in RAM only), and if you make heavy use of this then you might use up more space on your flash drive. Some users have also mistakenly configured Dockers to use their Flash storage, using up all the space (easy mistake to make). For this reason, I would recommend 4GB as a minimum, and maybe 8GB or 16GB. Flash drives are so affordable these days, I don't think that would present an unreasonable cost. You could go even bigger if you want, but chances are the space will go unused.

Do NOT get a flash memory adaptor type thumb drive! I have a few small thumb drives that really just have a MicroSD card inside - these do NOT have the unique ID that is needed. Make sure you get a real thumb drive.

Speed isn't too important. A faster flash drive might shave a few seconds off of the system boot, but longevity is more important than speed.

Years ago, I used to pull out my flash drive and plug it into my desktop to do version upgrades or tweak configuration parameters. I haven't had to do that in years, as you can do everything remotely 99.9% of the time. There may still be a rare occasion that you need physical access to your flash drive, so do give a bit of thought as to what physical size flash drive you use.

One that is super tiny might be difficult to access on that rare occasion. On the other hand, a super large thumb drive might pose a breakage hazard as it will stay plugged into your system 24/7 for years (i.e. something could fall and hit the drive and break it off).

Alternatively, you could get a USB adapter for your motherboard USB headers and keep the drive inside the case if you like, but depending on how easily you can access the inside of the case, that might be less convenient.

Paul
President, Chameleon Consulting LLC
Author, Chameleon MediaCenter

User avatar
Pauven
Posts: 2777
Joined: Tue Dec 26, 2017 10:28 pm
Location: Atlanta, GA, USA
Contact:

Re: Need advice on building an unraid media server

Post by Pauven » Fri Mar 01, 2019 1:24 pm

Your first HDDs and Migrating Data to Unraid
Once you get your system built, I'm sure you will be eager to start copying your data over to it. But before you jump in, here's some things to think about that should make the transition easier.


User Shares
Before you copy data over to Unraid, you will want to define one or more User Shares. A share is basically a virtual directory that can span one, multiple or even all drives. I have a lot of shares, and here's an example of some of my shares:
  • Backups
  • Blu-Rays
  • DVDs
  • TV_Series
  • Music
Obviously, you can set up your shares any way you want. You might want to do a single 'Movies' share instead of breaking out Blu-rays and DVD's as I have. The important thing is that you should copy data into shares (and not directly to drives) and let Unraid manage where the data goes. You can always move data around later, but it's easier to get this right the first time. I use dedicates shares for DVDs and Blu-rays as I set different minimum free space limits for each individually, which helps me automatically use more of my available disc space without issues.

There are also quite a few parameters you can define for shares. Things like assigning or excluding drives from a share, minimum free-space, and the fill-up method.

For my Blu-Rays share, I include All disks, but exclude Disk 20, which I have reserved for my PC backups. I have the minimum free-space set to 180GB, which ensures that any Blu-ray discs copied to it will have enough room before the copy begins (180 GB is approximately 4 full-size BR ISO files) . The allocation method I use is "Fill-Up", which sequentially fills up each disk, one by one, until it hits the 180GB minimum free-space limit I set, then it moves to the next disk. I have the split level set to "Automatically split only the top level directory as required", which is the default and works well, though you may want to read up on this to determine if you like this behavior. I also have the "Use cache disk" set to yes, so that means any new data I copy to this share will copy first to the fast SSD cache disk, then overnight move into onto the protected HDD array.

image.png
image.png (498.5 KiB) Viewed 17093 times

For comparison, I have my DVDs share set with nearly identical parameters, though I have the minimum free space set to 100GB. Yes, this is much larger than a single DVD ISO, though from experience I have found that there are scenarios for which having the min free-space set higher works better. For example, if I copy an entire TV show season's worth of DVD's all at one, that might be 5 or 6 DVD's, or 40+ GB of data. Because they are for a single show, they would all reside in the same directory, so by setting the minimum free space to 100GB I ensure that the entire season gets copied together to the same physical drive (a preference of mine), while also preventing accidentally running out of space on a drive when copying a lot of data to a single directory.

Something else to know about shares and the split level, once a directory gets written to a drive, any further contributions to that directory get written to the same drive. For example, let's say you have \Blu-Rays\Elementary\Season 1 that gets created on drive 5. Perhaps when you create it you only add the very first Blu-ray disc, then come back a few weeks later and finish copying those ISOs. Unraid will naturally want to add all the additional discs to the same directory (Season 1) on the same drive (drive 5), and if you didn't keep the minimum free-space high enough, then your free space buffer may not be enough for these additional ISO rips.

Years ago I kept my minimum free space values aggressively low, and would occasionally have errors when drive space ran out. That's why I keep my values quite a bit higher now, and I haven't had problems in years. On occasion I will manually copy files directly to a disc to fill up more free space, bypassing the configured User Share limits, but it is best to keep your shares with higher free space minimums as those are automatic behind the scenes copies you don't want to fail. When a Share's minimum free space limit is hit, any NEW directories automatically get written to the next drive with sufficient free-space, but any further contributions to the existing directory get written to the same drive.

The other thing to know about the minimum free space parameter is that this is the minimum free-space pre-copying, not post-copying. Since my minimum free space for Blu-rays is set to 180GB, let's say I have a drive with 200GB free so it meets this criteria. I then copy a 45GB BR ISO to the share, and it goes to that drive, decreasing the available free space to 155GB. Because it is now below 180GB, it is excluded from any further Blu-ray contributions (at least for new titles/directories), but because it is above 100GB it is still good for the limit I set for DVD ISOs. So writing to a share can and will take space below the minimum free-space limit you set, as this parameter controls how much space must be available before a copy is performed to that drive, not after the copy.


When to enable Parity
Obviously one of the main reasons to use NAS devices like Drobos and Unraid is for data protection from drive failures, so you're probably expecting to enable Parity protection before copying any data into the array.

There's actually a good reason to wait on Parity. When you copy data to a HDD, you can copy at the full speed of that drive. But once you apply Parity, you will copy at less than 1/2 the full speed of the slowest drive. This is because both the data drive and the parity drive have to first be read, then new parity calculated while the new data is written, and parity data written to the Parity drive too.

As long as your data still exists on your Drobos, I would recommend not enabling Parity during the initial copies while you're first populating the array. But before you start to decommission your Drobos, and pull their drives for re-use in your Unraid server, you will want to enable Parity.


What size Parity Drives
The requirement for Unraid is that your parity drives have to be equal to the largest data drives in the system. If your largest data drive is a 4TB HDD, then your parity drives should also be at least 4TB (if they were smaller, then Unraid will artificially restrict your data drives to the size of your parity drives).

You may be thinking that in the future you want to use larger data drives, so go ahead and install larger parity drives now. And you can do this, as I have. For years I used 3TB drives only for data and parity, then I had a couple spare 4TB drives from a decommissioned PC I wanted to add. Before I could use them, I needed to upsize my parity drive, and I decided that 8TB would be my new drive size choice. So I now have two 8TB parity drives, and a couple 4TB data drives, and about 16 3TB data drives.

Perfect, right? Well, mostly, but there is one caveat that you need to know and understand about Unraid - the Parity Check and drive Rebuilds.

It is a best practice to do a monthly Parity Check (you can do it more/less often if you desire), and the Parity Check spins up all drives, and reads every last bit on every last drive and makes sure your parity data is valid (and can correct it if it is wrong). The same will happen with a drive rebuild (i.e. upgrading a drive to a larger size, or replacing a failed drive).

When I had only 3TB drives, my monthly Parity Check took about 7.5 hours. Then, when I added the two 8TB parity disks to my 3TB data drives, my monthly parity check increased to about 15 hours (because it had to read every last bit of 8TB now, not just 3TB).

Then when I added my two 4TB data drives, my Parity Check increased to 18.5 hours. I'll give you a second to think about that... do you know why?

It's because HDD's read faster at the beginning of the platter (outside edge), and slower at the end (inside edge). Your parity check might start off at 120 MB/s, then slow down to 60 MB/s by the end of the disc. But that slowdown is now happening muliple times, at the end of the 3TB drives, at the end of the 4TB drives, and again at the end of the 8TB drives. And here's the real gotcha - the parity check will always proceed at the speed of the currently slowest drive. So at the end of 3TB, all of your drives might be reading at 60 MB/s, then as soon as the 3TB drives are done the speed might jump up to 100 MB/s, slowing down again to 70 MB/s at the end of the 4TB drives, then jumping up to 150MB/s once those are done, and gradually slowing down to 90 MB/s at the end of the 8TB drives.

If I only had 8TB drives, then they would all slow down at the same rate, and my parity check would proceed at the speed of my 8TB drives - my entire parity check might only take 12 hours instead of over 18.

So while the ability to mix and match drives of any size is a huge benefit to the Unraid solution, if you mix a lot of different drive sizes then your monthly parity check could take longer. For some users, their parity check takes 1-2 days. And during the course of the parity check, all your drives are spinning (well, at least at the beginning), generating noise and heat and vibration - this is wear and tear on your drives.

Your goal should be to minimize how long your parity checks/drive rebuilds take, and the best way to do this is to use drives of all the same size. So you might be using a mix of 3 and 4TB drives today, but as you plan your next size upgrade, I recommend you do as I have, and pick a single size and plan to use that for all drives. I picked 8TB, and will gradually upgrade all my drives to 8TB over the coming 1-2 years. I will end up with a 160TB server, which I think is as far as I want to push this thing, so this will be my final size upgrade.

The nice thing is that by gradually upgrading to 8TB drives, I'm minimizing my expense as these drives become cheaper over time. But during this transition period, I have to accept the longer parity check and drive rebuild times that come with having a mix of 3, 4 and 8TB drives. This would be even worse if I had more drive sizes in my mix.

So long story short, use parity drives that are equal in size to your largest data drives, until such time as you are actively upgrading to a larger size. This will keep your parity checks shorter, minimizing unwanted noise/vibration/heat on your system. And also try to standardize on a single drive size for best performance overall.


What rotational speed for your HDD's
Also, a brief note of drive RPM speeds: In general, Unraid performs at the speed of your slowest drives. So having a few 7200RPM drives mixed in with 5400 RPM drives will not normally give you a speed boost. True, if you are just reading data from a single 7200 RPM drive, that will be a bit faster, but during the parity check or drive rebuilds, it's the slowest drive that sets the pace, not the fastest. And the same on writing data to the array: you could have 7200 RPM parity drives, but if you are writing data to a 5400 RPM drive, then the 7200 RPM drives will operate no faster than the slower 5400 RPM data drives. The might be spinning faster, generating more heat and vibration, but they won't be working faster. So for this reason you should try to have all the same speed drives in your system. Either all 5400 RPM, or all 7200 RPM, as a mixture of speeds will drive up expenses, but not drive up performance.


Minimizing HDD Expense while Migrating from your existing Drobos
It makes sense to me that you will want to pull your drives from your Drobos and re-use them in your Unraid server. But you can't do that until you copy the data off of them first. When you put a drive in your Unraid system, Unraid will prep it by writing all zeros to it and formatting it for use in Unraid - this will destroy any data on that disk.

So you will need some starter discs in your Unraid system so you have a place to copy your Drobo data.

I don't know exactly what size Drobos you have, so I'll just lay out a hypothetical example that you can adjust to your needs.

It makes sense to start with your smallest, 5-bay Drobos first. Let's say you have a 3TB drives installed in it, so you have 12TB of total available storage on that Drobo.

For your Unraid server, you could start off with 4 new 4TB drives. Three of those 4TB drives would be for data, giving you an equivalent of 12TB of space in Unraid. You would copy your data over at full speed, then assign the 4th drive as the 4TB parity drive.

Now that your data is copied and protected, you can then decommission your 1st Drobo and move those 5 3TB drives into your Unraid array. That will add 15TB of space (more than the 12 TB of space the Drobo gave you), so now you can copy a 5-drive Drobo that has 4TB drives in it. This copy from the 2nd Drobo will go slower, since you now have parity enabled on Unraid.

Once the 2nd Drobo is copied, you repeat this process: decommission the Drobo, move the five 4TB drives into Unraid, and you will gain 20TB of space, and you'll be ready to copy your next Drobo. After your 2nd Drobo's discs are added, you will have about 14 drives in your Unraid system, so it's probably a good idea to go ahead an enable the 2nd Parity drive at this time. You can do it earlier - it won't affect performance any more than adding that first parity drive, but since parity drives are not available for data, it might increase your migration costs if you have to buy an extra HDD to enable the 2nd parity earlier.

I think you currently have 31 drives across all your Drobos, so there is no way you'll be able to re-use all those drives in your Unraid server. Since your Unraid server only has 24 bays, and you'll be using 2 drives for Parity and possibly keeping 2 drive bays empty for maintenance tasks, that gives you only 20 drives for data. Assuming an even split of 3TB and 4TB drives, that would give you 70 TB of storage. That may not be enough to copy all your Drobos, so you may need to start off with bigger than 4TB drives for your initial drives. You might need to do 6TB or even 8TB drives as your initial drives in order to have enough total space to complete the Drobo data migration.

Keep in mind that you can upgrade a drive to a larger size at any time. So you can temporarily pop in 3TB drives as you migrate your smaller Drobos, then when a 4TB drive get's free up from decommissioning a larger Drobo, you can replace a 3TB Unraid drive with the 4TB drive, and after the rebuild you will gain that extra 1TB of space.

If you buy 4 4TB drives, and re-use 18 4TB drives from your current Drobos (assuming you have that many), then you will have all 4TB drives (nice) and 80 TB of storage. You wrote in your original post that you currently have 75TB of storage space across all your Drobos, so this would allow for a slight expansion in storage space, and you could migrate off of all your Drobos. When you get to your last 8-drive Drobo (using all 4TB drives, I assume), you will have already filled out your Unraid server with 22 drives, hopefully all 4TB at that point, so you should in theory have sufficient space to copy that last Drobo even without using those drives. It's possible that if you don't have enough 4TB drives in your collection, you might still have some 3TB drives in your Unraid server at this point, so you might be a little short on space (really depends on just how full your Drobos are), so you may have to upgrade a few 3TB drives to 4TB out of pocket instead of re-using Drobo drives to get to the finish line.

Hopefully you can minimize that expense by following the example I laid out above. If you don't think you can get there with purchasing four 4TB drives as your starter drives, you may want to go up a size on those initial drives (perhaps all 6TB drives, or 8TB like I'm doing). But since you went large on the # of drives in your server, I don't really recommend going bigger than 8TB for any drives at this time. Bigger drives are a lot more expensive, and with that many bays you get a better bang for your $ by using more smaller drives.


Hopefully all of the above made sense. I know some of these Unraid concepts are new for a Drobo user, and I might have over-generalized a few areas. Just let me know if you need any clarity on any topics. I can also help you determine what size and how many starter drives you need to get through your full data migration, I would just need more specifics on your existing Drobos (I would need # of drives and drive size for each Drobo, plus how much space used in TB on each Drobo).

Paul
President, Chameleon Consulting LLC
Author, Chameleon MediaCenter

Jamie
Posts: 942
Joined: Wed Dec 27, 2017 11:26 pm

Re: What is unraid and how to build an unraid media server

Post by Jamie » Fri Mar 01, 2019 4:46 pm

Thanks Paul.

I think I will go with 2 - 8 TB parity drives at the moment.

I also think that I will stick with 4 or 6 tb drives as I fill up the unraid server. I will do this slowly but I will try to remove the oldest drobos from my media needs until I have removed them all. Budgeting my money along the way. The first two drobos will be the 5 bay ones. I will save the other 5 drive bay drobo for last since it is the newest except it is still a "crap shoot" as to which will die first.

One drobo has
1 drive at 4 tb and
4 drives at 3 tb.

The other has
2 drives at 4 tb and
3 drives at 3 tb.

These 2 drobos have a total used space of 24 tb around 11 - 12 tb used for each.

One 8 drive bay drobo has all 3 tb drives. A total used space of 15 tb
The other 8 drive bay drobo has all 4 tb drives. A total of 20 tb of used space

The last 5 - bay drobo has
1 drive at 4 tb and
4 drives at 6 tb.

A total of 13 tb used and growing. 7 tb free but as I said you can only use 80% of the total drive space so that leaves 5 tb left to go.

What type drives do you use? I have been using wd reds on my last 2 drobos. I was told that they last longer and are built for NAS arrays. The other drobos have a mixture of wd green drives and seagate blacks. The seagates seem to burn out faster so I prefer WD.

Do you have a preference??

User avatar
Pauven
Posts: 2777
Joined: Tue Dec 26, 2017 10:28 pm
Location: Atlanta, GA, USA
Contact:

Re: What is unraid and how to build an unraid media server

Post by Pauven » Fri Mar 01, 2019 5:58 pm

Jamie wrote: Fri Mar 01, 2019 4:46 pm What type drives do you use? I have been using wd reds on my last 2 drobos. I was told that they last longer and are built for NAS arrays. The other drobos have a mixture of wd green drives and seagate blacks. The seagates seem to burn out faster so I prefer WD.

My very first Unraid server had Samsung 1 and 2TB drives, and over many years I never had a single failure. They were awesome. Then Samsung exited the HDD business, though I do love their SSD and NVMe options.

All of my 3TB drives have been WD Reds, 5400 RPM. They've been mostly great. I think I've had 2 failures in the past 5 years.

My two 4TB drives were just some Seagates that came out of a PC. They were handy and have worked fine so far, but nothing I would recommend buying on purpose.

Since then I've started following the BackBlaze reports. They use a lot of consumer drives in NAS servers, and they report on failure rates. I feel much more informed now.

My two 8TB parity drives are HGST HUH728080ALE600. These are 7200 RPM Helium drives. A bit pricier, but I decided I wanted a high-performance server once I had converted all to 8TB drives. Plus these HGST helium drives have a great track record. I have 2 more of these drives in a PC I am decommissioning, so they will be going into my Unraid server as data drives, replacing my oldest 3TB drives. You can get these for about $280, maybe less if you find a deal.

I've also got one WD RED 8TB drive. It's only 5400 RPM and not helium, so it doesn't really fit in with my long term plan, but it came up for sale on the Unraid forum - a user had received it as a warranty replacement and didn't need it, and sold it to me new-in-bag for only $200, an awesome price for an 8TB drive. I've prepped this drive for use, but haven't put it in my array yet.

When I was buying my 3TB WD Reds, I was usually picking them up for $120-$140. That actually makes the HGST 8TB drive cheaper on a per TB metric.

Also, one thing I do when evaluating how $$$ a drive is, is that I add in the cost of the drive bay itself. I think your cost per drive bay is somewhere around $50 if I remember correctly. Right now you can get a WD Red 3TB drive for a cheap $98. But add in the $50 drive bay cost, and your total cost per TB is $148/3TB or about $49. That 8TB HGST Helium drive is expensive at $280, but do the math and the cost per TB is $330/8TB or only $41.25, about $8 cheaper per TB. Interesting, isn't it?

I think most people forget to factor in their overhead costs when picking one drive over another. But doing the calculation above, I find that bigger drives are typically cheaper, especially if it prevents you from building another server. At a certain point the biggest drives have a price premium, so there usually is a point of diminishing returns. Your Drobo's were so expensive, you should have always been running the biggest drives in them to be cost effective. For example, running 8TB drives instead of 4TB drives, you could have bought only 1 Drobo instead of 2, saving a ton of money.


Jamie wrote: Fri Mar 01, 2019 4:46 pm I think I will go with 2 - 8 TB parity drives at the moment.

I also think that I will stick with 4 or 6 tb drives as I fill up the unraid server.

If you are buying new drives, and you are considering 8TB parity drives, I would highly recommend you do the same for all new drives you buy. For the parity/rebuild speed issue I mentioned above, and also due to the cost per TB, it will be cheaper in the long run. Instead of buying four 6TB data drives, just buy three 8TB data drives. Same usable capacity, cheaper cost per TB once you include the server cost, and it keeps more of your valuable drive bays open for re-using old Drobo drives until you buy more 8TB drives.

Paul
President, Chameleon Consulting LLC
Author, Chameleon MediaCenter

Jamie
Posts: 942
Joined: Wed Dec 27, 2017 11:26 pm

Re: What is unraid and how to build an unraid media server

Post by Jamie » Fri Mar 01, 2019 6:32 pm

Thanks Paul.

The drobos used some of the disk space on each drive as overhead and also only 80% of the drives could be used. Do I have to be concerned with overhead on unraid, or can I figure that most of the drive space will be used except for that last 100 - 180 GB as you mention in an earlier post?

Jamie

User avatar
Pauven
Posts: 2777
Joined: Tue Dec 26, 2017 10:28 pm
Location: Atlanta, GA, USA
Contact:

Re: What is unraid and how to build an unraid media server

Post by Pauven » Fri Mar 01, 2019 7:02 pm

Jamie wrote: Fri Mar 01, 2019 6:32 pm The drobos used some of the disk space on each drive as overhead and also only 80% of the drives could be used. Do I have to be concerned with overhead on unraid, or can I figure that most of the drive space will be used except for that last 100 GB as you mention in an earlier post?

You really shouldn't have to be concerned about overhead with Unraid. You can even use most of that last 100 GB, I just wouldn't use it through a Share to copy really big ISO's. Essentially, you should be able to easily utilize 99.9% of every data drive. Your two parity drives are the only sacrificed capacity.

For example, my "disc 5" currently has 88GB free, so neither my Blu-Rays Share or DVDs Share will automatically write to it (which makes me happy). It would be a pain if I wasn't paying attention and I allowed too much data to be written to a single drive via the Share, filling up a drive. This setting prevents that from happening in normal day to day copies when I'm not paying attention.

But I can browse out to /mnt/disk5/DVDs directly, and copy over another 10 ISO's directly to the disc and still have 10GB or more free. By copying them into that path, they become part of the DVDs Share, so I essentially temporarily override my 100GB share free-space limit by copying directly to the target disc. So I get to use all of my space, I just have to intentionally fill up that last little bit, and this forces me to pay attention and not make a mistake.

I could also get the same result by temporarily lowering the Min Free Space parameter on the Share, but then Unraid might decide to put my ISOs on Disc3 instead, which would upset me if I was trying to put them on Disc5. That's why I like to use direct disc access for the last little bit, it puts me fully in control.

This is just my preferred way of doing things. It allows me to set it and forget it for 99% of the time, then every so often I might manually copy a few more ISOs into the nooks and crannies to use more of my space.

Another point to revisit is that I have a LOT of Shares, not just for Blu-rays and DVDs. For example, I have a Share named Software, and it has a very low 1 GB set for minimum free space. Anytime I write to it, Unraid will use the space left over that I didn't use for ISOs.

Your only concern really should be to make sure you never hit 100% on a drive, as then you will have problems. But as long as you leave at least 1 or 2 GB free per drive (99.9% utilization), then that should be sufficient room for My Movies to maintain the meta-data files and artwork.

Unraid also has 3 allocation methods: High-water, Fill-up, and Most-free. I like Fill-up for my ISOs. Here's the Unraid help on those 3 methods:

This setting determines how Unraid OS will choose which disk to use when creating a new file or directory:

High-water Choose the lowest numbered disk with free space still above the current high water mark. The high water mark is initialized with the size of the largest data disk divided by 2. If no disk has free space above the current high water mark, divide the high water mark by 2 and choose again.

The goal of High-water is to write as much data as possible to each disk (in order to minimize how often disks need to be spun up), while at the same time, try to keep the same amount of free space on each disk (in order to distribute data evenly across the array).

Fill-up Choose the lowest numbered disk that still has free space above the current Minimum free space setting.

Most-free Choose the disk that currently has the most free space.

So if you used Most-free, then your data would be spread out across all the drives equally, and they all would fill up gradually. But this might separate directory files from each other more. I like Fill-up, because it is more likely to keep files together on the same drive for the same directory. There's no requirement for that, this is just my preference.

Paul
President, Chameleon Consulting LLC
Author, Chameleon MediaCenter

Jamie
Posts: 942
Joined: Wed Dec 27, 2017 11:26 pm

Re: What is unraid and how to build an unraid media server

Post by Jamie » Fri Mar 01, 2019 9:28 pm

Pauven wrote: Fri Mar 01, 2019 7:02 pm


You really shouldn't have to be concerned about overhead with Unraid. You can even use most of that last 100 GB, I just wouldn't use it through a Share to copy really big ISO's. Essentially, you should be able to easily utilize 99.9% of every data drive. Your two parity drives are the only sacrificed capacity.

This is good for me. As you probably realize from my Drobo experience, there is a lot of wasted space using a Drobo. I wish that I had started to use unraid a number of years ago. It would have saved me a lot of money and irritation.

Jamie

Post Reply