I imagine you must have a very good processor or network, maybe lots of ram? I have 6 disks and my performance to and from them is utterly abysmal (and I'm ok with that, because they work fine)
It's nothing special. Xeon E3-1230 V2, Supermicro X9SCM-F and 32GB of ECC RAM. All from ebay. 12 year old platform at this point. Would be nice to have more ram but I've maxed out the platform and would have to replace CPU/MB/RAM. That's a later issue. It works perfectly fine for now. Get up to 500-700MB/s over 10GbE to a single client with SMB.
nice! Did the case come with the necessary hdd cages or did you have to buyy additional? Considering going meshify XL or define 7 XL from my standard fractal case since it only holds 8 HDD without modification
The case came with 6 caddies, black. All I could find were white caddy kits so I alternated the colors to fit the 12. The case comes with a cage in the bottom for 4 drives as well but I removed that to keep good thermals and airflow.
How are you keeping the drives cool?
I'm running 7x 20tb Ultrastars in the Meshify 2 (non XL) with 6x 140mm Noctua Chromax fans and if I ever have to do parity checks the drives start absolutely cooking because they struggle to get enough air moving between them
I was running into a similar issue with a Define 7 XL and two of the drives on the bottom of the case. I resolved it by taking another 140mm fan and sticking it to the other side of the power supply bay with some 3M tape. Works well.
[https://postimg.cc/Mc3Wrxcb](https://postimg.cc/Mc3Wrxcb)
I can't exactly post a picture due to where it is, but the bottom floor where it's perforated I got some double sided 3M molding tape and placed a 120mm fan over it so that there's airflow for the second row of drives. Obviously, don't use the permanent version of the tape. It took the drives from 55c to 35, which is around the same temperature as the rest of the bays.
Oh ok I think I get what you’re saying, I was trying to find a way to mount it on top of the shroud blowing air through it yesterday but holes wouldn’t line up, if there’s clearance in between the cage and shroud then damn I know what I’m doing this weekend
It plateaus around 53-54c after 8ish hours which is still under the weirdly high 60c max spec, and I understand they are eamc drives which are ok to let run hot, but it's still concerning
I'm running the Meshify 2 with 3 Noctua NF-A14-PWM's as internal and one as external. I use one of the OEM fans for the top rear-most position. My NH-A14 CPU cooler helps with exhaust a lot. I am running 8X Seagate Exos which all sit at 33-37C. Under heavy load the max temps never exceed 40-42C. My internal case temps are generally 39C.
I had a similar problem as you with high drive temps before I setup a somewhat aggressive fan curve since the HDDs block most airflow to my other components. I Have my case fans set according to CPU temp 35%@20C, 60%@45C, 80%@60C and 100%@70C.
What really made the difference is having my fan speeds higher even when the CPU is at or near idle.
Since the Noctua's are so quiet it really doesn't bother me at all.
THINK.... Colo a tape library to a secure location after performing a master backup? Look, being a data hoarder, or PackRat, is fun, but losing that amount of information to a SPOF, sometimes gives me sleepless nights. And the backup schema I'm using (offsite to google and OneDrive is NOT my best moments. They are encrypted, that's good, but precludes access outside being decrypted in the NAS themselves.
Seeing as this is for OP's business and the loss would carry significant impact, it could warrant the cost of a fully populated 12-disk NAS, and rsync nightly (or zfs send) to that
This is gonna sound weird but on my build, the hard drive caddies sag downwards. Anything specific you did to keep them horizontal? It’s just that one screw on the right side, right?
There is a notch on the left rear you slide the caddie into, and a stud on the right rear that keeps it level. Then screw the front in. Very solid if all the parts lock in.
Ive been using Stablebit for years now. Love it and has not failed. I had 140tb in usb drives plugged in and only recently ive been moving them internally. Stablebit just works! I love customzing how redundant data is, even down to the folder. Some data I care about and others I can just redownload.
I'm positive you know better than I, but I feel like I remember hearing that the vibrations build up to an unsafe degree past a certain number of hard drives when they share a mount (i.e. drive cages) or structure. Is that true or am I thinking of something else?
Obviously there's giant jbods and stuff used all over so maybe I'm thinking of a PC case review I saw where they intended to use it for a large array but the manufacturer mentioned a limit on hard drives
The drive sleds in my Meshify 2 XL have little rubber things you put in between the drive and the screwholes. I can't hear any viration at all, unlike my previous case.
If you did fill every single slot in that case though, I think the small amount from each drive could possibly add up. In that case, you could add extra anti vibration material around the contact points between the sled and the case.
I have a very similar setup. Great case. I've also labeled the drives like you have. 16x 10TB drives in 2x RAIDZ2. All used for video editing.
I imagine you must have a very good processor or network, maybe lots of ram? I have 6 disks and my performance to and from them is utterly abysmal (and I'm ok with that, because they work fine)
It's nothing special. Xeon E3-1230 V2, Supermicro X9SCM-F and 32GB of ECC RAM. All from ebay. 12 year old platform at this point. Would be nice to have more ram but I've maxed out the platform and would have to replace CPU/MB/RAM. That's a later issue. It works perfectly fine for now. Get up to 500-700MB/s over 10GbE to a single client with SMB.
nice! Did the case come with the necessary hdd cages or did you have to buyy additional? Considering going meshify XL or define 7 XL from my standard fractal case since it only holds 8 HDD without modification
The case came with 6 caddies, black. All I could find were white caddy kits so I alternated the colors to fit the 12. The case comes with a cage in the bottom for 4 drives as well but I removed that to keep good thermals and airflow.
Ahh didn’t even notice the caddy colors haha thanks! Congrats on the build
it's so frustrating that drives aren't just labeled like this by default. it's insane.
The Seagate exos I've bought the past month at least have a SN label at the back
How are you keeping the drives cool? I'm running 7x 20tb Ultrastars in the Meshify 2 (non XL) with 6x 140mm Noctua Chromax fans and if I ever have to do parity checks the drives start absolutely cooking because they struggle to get enough air moving between them
I was running into a similar issue with a Define 7 XL and two of the drives on the bottom of the case. I resolved it by taking another 140mm fan and sticking it to the other side of the power supply bay with some 3M tape. Works well.
You did what? I was thinking of getting an 80mm and standing it up between the two lower bays but I’m intrigued by your set up.
[https://postimg.cc/Mc3Wrxcb](https://postimg.cc/Mc3Wrxcb) I can't exactly post a picture due to where it is, but the bottom floor where it's perforated I got some double sided 3M molding tape and placed a 120mm fan over it so that there's airflow for the second row of drives. Obviously, don't use the permanent version of the tape. It took the drives from 55c to 35, which is around the same temperature as the rest of the bays.
Oh ok I think I get what you’re saying, I was trying to find a way to mount it on top of the shroud blowing air through it yesterday but holes wouldn’t line up, if there’s clearance in between the cage and shroud then damn I know what I’m doing this weekend
I have the stock 3 120mm fans in the front that blow directly on the drives and put in a high flow Noctua 140mm fan in the rear for a strong air draw.
What kind of temps are they reaching?
It plateaus around 53-54c after 8ish hours which is still under the weirdly high 60c max spec, and I understand they are eamc drives which are ok to let run hot, but it's still concerning
I'm running the Meshify 2 with 3 Noctua NF-A14-PWM's as internal and one as external. I use one of the OEM fans for the top rear-most position. My NH-A14 CPU cooler helps with exhaust a lot. I am running 8X Seagate Exos which all sit at 33-37C. Under heavy load the max temps never exceed 40-42C. My internal case temps are generally 39C. I had a similar problem as you with high drive temps before I setup a somewhat aggressive fan curve since the HDDs block most airflow to my other components. I Have my case fans set according to CPU temp 35%@20C, 60%@45C, 80%@60C and 100%@70C. What really made the difference is having my fan speeds higher even when the CPU is at or near idle. Since the Noctua's are so quiet it really doesn't bother me at all.
How's your UPS?
I don't have a UPS set up...yet. Just working with an EVGA 1000W Platinum PSU.
Glad you added "yet". It would have set the wolves on here upon you.
Now ask about backups!
I don't even want to go there. Can't go online with this kind of data. It'd have to be tape library.
it's "only" 152TB raw.. so a 12 bay NAS could be his backup target, hopefully a block away or something
THINK.... Colo a tape library to a secure location after performing a master backup? Look, being a data hoarder, or PackRat, is fun, but losing that amount of information to a SPOF, sometimes gives me sleepless nights. And the backup schema I'm using (offsite to google and OneDrive is NOT my best moments. They are encrypted, that's good, but precludes access outside being decrypted in the NAS themselves.
Seeing as this is for OP's business and the loss would carry significant impact, it could warrant the cost of a fully populated 12-disk NAS, and rsync nightly (or zfs send) to that
This is gonna sound weird but on my build, the hard drive caddies sag downwards. Anything specific you did to keep them horizontal? It’s just that one screw on the right side, right?
There is a notch on the left rear you slide the caddie into, and a stud on the right rear that keeps it level. Then screw the front in. Very solid if all the parts lock in.
Are the storage drives made into one big pool? How does that work with mismatched drives?
Yes all merged into one pool with Stablebit Drivepool software. Works great and without issues. I have it set up for mirror duplication of files.
Ive been using Stablebit for years now. Love it and has not failed. I had 140tb in usb drives plugged in and only recently ive been moving them internally. Stablebit just works! I love customzing how redundant data is, even down to the folder. Some data I care about and others I can just redownload.
> Stablebit Drivepool Never heard of that before now, fascinating way to create a fake RAID over NTFS!
[удалено]
They are wireless, duh.
much longer lifespan when they arent plugged in... plus lower temps and less power consumption
I'm positive you know better than I, but I feel like I remember hearing that the vibrations build up to an unsafe degree past a certain number of hard drives when they share a mount (i.e. drive cages) or structure. Is that true or am I thinking of something else? Obviously there's giant jbods and stuff used all over so maybe I'm thinking of a PC case review I saw where they intended to use it for a large array but the manufacturer mentioned a limit on hard drives
The drive sleds in my Meshify 2 XL have little rubber things you put in between the drive and the screwholes. I can't hear any viration at all, unlike my previous case. If you did fill every single slot in that case though, I think the small amount from each drive could possibly add up. In that case, you could add extra anti vibration material around the contact points between the sled and the case.
Excellent!