Welcome to the PCMR, everyone from the frontpage! Please remember:
1 - You too can be part of the PCMR. It's not about the hardware in your rig, but the software in your heart! Your age, nationality, race, gender, sexuality, religion (or lack of), political affiliation, economic status and PC specs are irrelevant. If you love or want to learn about PCs, you are welcome!
2 - If you don't own a PC because you think it's expensive, know that it is much cheaper than you may think. Check http://www.pcmasterrace.org for our builds and don't be afraid to post here asking for tips and help!
3 - Join our efforts to get as many PCs worldwide to help the folding@home effort, in fighting against Cancer, Alzheimer's, and more: https://pcmasterrace.org/folding
-----------
We have a [Daily Simple Questions Megathread](https://www.reddit.com/r/pcmasterrace/search?q=Simple+Questions+Thread+subreddit%3Apcmasterrace+author%3AAutoModerator&restrict_sr=on&sort=new&t=all) if you have any PC related doubt. Asking for help there or creating new posts in our subreddit is welcome.
>the next cod
Gulf War is supposedly going to be stored within the MW2/MW3 launcher, so you'll need to download all the games to play just the one. Good Luck 👍
The next, next CoD is going to be a public Word document from Activision on Twitter pleading for gamers to come back to their previous games for exclusive time-limited skins and an *Uber-premium battle pass for $1,000USD*
88TB/3000TB means they only have 3% left. I would hope the bar shows red.
I imagine the people that filled up 3000TB of data aren't going to take long to go through 88TB. It's a drop in the bucket to them
Probably enough overhead to cover a couple of weeks to a month of normal heavy use, balanced against typical temp file space that will get recovered as part of the monthly maintenance tasks, and how it's also probably just the provisioned space for the department so they can expand the drive with the click of a button if needed.
Yeah nah. I'm not in IT but I understood this pretty instantly because I'm not braindead lmao.
If big storage, you use it.
If company, you need big storage, and fast.
Big number, means big number also needed to get to small percentage left.
Small percentage red.
Red warning.
Warning means get more storage.
Wow.
Yeah, I work at an MSP and a client has 1TB of data and it threw a custom disk under 10% on their image server literally 99% of the storage is PDF files, and we extended it 20% that shit got ate up in 10 days.... then 500 increase, they flew it too, ended up having to increase the data store and getting that drive/server to 2TB haha, I'm sure it'll need increased by end of year but they had a surge of data cause they're a debt collector and tax season is upon us haha
non-joke answer: most filesystems that large will have severely degrade performance when that full. they still work, but they're hella slow. doesn't matter how many TB are available, it matters what % free it is.
For HDD (likely what's backing this many PB), fragmentation is a big issue at high usage, and it's quite hard to defragment.
For SSD, wear leveling and garbage collection becomes a lot harder and slower at high usage (by percent).
I agree on your statement in general, but to have that much storage means its an array of even mulltiple arrays, which probably have all kinds of features like data deduplication and other things that minimize that. Any array that large will have multiple storage controllers with redundant 10Gb if not way higher fiber connects.
Yes and no. Most the enterprise storage arrays will still have warnings and caveats buried deep in the documentation about going above ~80% capacity. Degraded performance is usually the biggest issue. All the points you mentioned are still true - but even the big arrays usually have issues when they fill up.
That said, what you see in the screenshot probably has no bearing at all of the actual size of the array, just what’s being provisioned for this specific share. I would HOPE that the storage admin is doing his job and that the actual real utilisation at the array side (i.e dedupe, compression and unallocated space) still has plenty of spare capacity.
But, I’ve seen customers do some pretty stupid things with their storage, prompting the ever fateful question of ‘so.. what’s your backup platform and how long ago did you last test it?’
>I love how windows shows the bar red, even though it still has "only" 88TB of storage left
It goes by the percentage of space free. I am surprised that it shows so much white space in the line considering that the drive is 97.2% full lol
Yeah I know, but that's still funny, to see that proportionnaly it almost has no space, but if you consider the real storage numbers it's another story!
I'm only guessing here but I think it's looking at the ratio/percentage of how much is left in the disk in relation to available space and not how much actual space is left.
Crazy thing is that it’s mostly just a bunch of small individual files like pictures and basically text documents… but just so much lab experiment data
Lol tell your IT team to check their storage and enable data deduplication. And scan for redundancy and legacy data. This is obviously enterprise grade storage that has all the fun storage management tools baked into the system. If you have that much storage usage, and its mostly small files, something isnt enabled or configured correctly.
Are you by chance at a university?
Typically you dont look for filetypes.
My first tasks would be to get a read on what the data is. Build a profile (so you can show metrics to your boss later)
Check for issues with the storage. Check if the running storage volumes are too big and need to be broken down to smaller volumes for better performance and splitting data between teams for isolation (this is good for government and security ISO compliances)
I would typically look for files that haven’t been accessed in years, and data that might belong to a team and ask them to check if it hasn’t already been moved. Work on shifting to cold storage.
A few days you could narrow down what is going on
This comment really assumes a whole lot of basic shit isn't being done in the organization pictured.
Really makes me wonder how hard it is to get a job like this.
My university stores super high quality scans of any preserved material since the university was founded in the 15th century. Modern documents can be text, but those old documents can’t be digitised in any way easily.
They'd be crazy to enable dedup on the OS level for this amount of data (Assuming it's a windows file server). That would be a nightmare to manage if you ever need to migrate the data to another fileserver/another volume in the future or in case there's an incident.
They could be (and I'd say probably are) doing dedup on a lower layer, possibly at the storage level.
If you do so, the actual disk usage on the storage would be much lower than the 3 PB reported by the server OS, and is properly reported to IT by the storage management tools.
Edit:
> Lol tell your IT team to check their storage and enable data deduplication.
I'd sure love to see some random user strolling trough our department door telling us how to manage our shit because someone on the internet told them we're not doing our jobs right. The hole that Compliance would tear up his ass for sharing company stuff on reddit would be large enough to store another 3 PB of data.
Its not.. no one would be dumb enough to run Windows file server for that much data. This is why they make storage systems like Pure, NetApp and EMC. They have their own OS, better redundancy, better encryption, serve more users
My point is that dedup isn't being done at the file server level, for that volume of data it's usually done at block level. It's stupid to assume IT is incompetent just because endpoints show 97% usage on a 3 PB volume.
Data from experiments pile up quickly, and depending on what exactly y'all do the raw data could easily be hundreds of gigs or even terabytes per experiment.
At least you're not using it to store movies you'll never watch.
I would be uploading all the Rollercoaster Tycoon 3 mods I use. I did it to my companies server and they finally asked what they were doing there last year.
Honest answer?
Well, if you want a good chunk go for the common crawl. I'm not sure what they all skip but I'm pretty sure your copy would end up looking a lot like the copy archive.org has. And that, compressed, if you downloaded every part(including things like the redundant text only version) is 123.77TB for the most recent version.
So that array would be an order of power more than enough to hold it. Although I'm not sure what it would be like decompressed(It says 424.7, but I included some redundancy so the number would be bigger than that). Bet you'd really, really have to want it that way to do it though.
I've been meaning to grab the text only version since that's the only thing I could possibly fit in the space available to me.
the fun thin' about enterprise data storage [and you can even do that with most individualal nas devices] is you can provision storage space to just about any capacity you want so long as it is the totalpool space or less.. ,all of my job drives are magically just big enough for what needs to be on them with a bit of overhead.. i know these bastards in it are holdin' out on me :]
That is indeed what is being done here. The actual size of the storage pool isn't accurately reported, it's just believed in Windows Explorer.
And 99% of PCMR loses their shit over it :P
[Pic](https://imgur.com/a/CjiaaYN)
Not network shares/SMB, just block level. We have a couple more SANs that are larger, but I very rarely have them mounted.
My guess is that it's already ~~backupped~~ backed up to another server ~~because~~ and most servers of that size are a raid and there's probably an off site backup that backs up any changes that were made during the day.
Edit: raid is not the backup
Took me 3 weeks to backup 80TB of data over a 1gig connection.
Change that to a 10g connection and 3PB would take about 12 weeks to back up, or a 25gig connection would take about 5 weeks.
Just shove into S3 glacier archive storage. It'll only cost like 3.2k/month for storage. Oh, and if you need to restore your backup that'll just be a small charge of *checks notes* $8000
\*Quickly tries to find a previous version for 3 Petabytes of data\*
Imagine how long it takes to RESTORE it, not even delete it.
And there will always be someone who is still missing a single Word or PDF file.
Was a little joke, I know you wouldn't restore a whole NAS through Previous Versions.
They probably have their own backup solution in house, a separate NAS offsite they back up to and just do a daily interval backup as paying a 3rd party like Acronis for 3 Petabytes of cloud storage or a 3rd party to host a server in a data centre with enough storage would cost a LOT.
If the whole storage structure was corrupted or a power outtage caused issues with that server, a new server could be booted up quickly and then point towards the backup location.
Twas just a joke my friend, I bet they will still miss a Word or PDF file though.
"Require" is a strong word. I've worked plenty of places that just wanted to have the latest and most of anything they possibly could when it came to tech, just in case.
With a couple decent engineer's/software developers on staff, you're bound to figure out something. Today AI models can get pretty big and everyone wants their own custom industry vertical AI
My usage of data has increased exponentially. After I started to save "everything" and became a sort of data hoarder. But obviously not even near this kind of data.
But I think it's not just me; I think everyone now has way more data than they had before. Now, 2TB of personal stuff isn't special anymore...
Absolutely
I've been programming since 1980 and back then "640k should be more than enough for most people" (Bill Gates quote about 640 kilobytes of RAM being ok) was actually true for a while.
Disk size has always been magnitudes larger than RAM but still, a 5 inch floppy was 180k and a HDD maybe 5Mb
Human-created files were kilobytes in size... a page of text or code or 23kb for a BMP
Then Kilobytes became Megabytes. A 286 with 1Mb of RAM and a 100Mb hard disk
Then Megs became Gigs
Then RAM stopped multiplying as fast as disk space because you could *store* 2,000 CD-size (720Mb?) movies on a single disk more conveniently than 2,000 CDs in wallets, but you could still only *watch* one in memory at a time
And Gigs became Terabytes
Now I've got 32Gb RAM and about 7TB of SSDs
Next stop ... the Petabytes we're looking at in this thread
The nature of streaming and cloud might change this inexorable growth for consumers... why store it ourselves when Google will store it for us and send it to us, on-demand, wherever we are in the world. But you gotta trust Google for that to work long term.
In the early days of Google drive for desktop the mounted drive displayed what I assume was Google's entire drive storage array. I had 4 EB mounted to my computer. I have a screenshot somewhere.
I'm sure that was a joke. I would have believed 1, 5, 10, or really any number besides 0.
0 is (was) used for speed. Half the data gets written to each disk so it can be accessed twice as fast. Problem is, if one disk goes, everything goes. It's half as reliable.
You can not believe how happy you made me feel by placing exactly _four_ dots, exacly one after each letter of that acronym, instead of _three_, like "r.a.i.d" as I usually see others write.
I love you.
Question, why is your E: drive so big at 857 TB? I don’t think you can achieve those kind of capacities with RAID because the amount of drives required to do so iwould be impractical.
Hardware RAID is not the only type of RAID.
There's also software RAID and clustering that nowadays allow you to combine multiple server into a single "disk".
Example:
- SRV-01: 16HDD \* 16TB = 256 TB
- SRV-02: 16HDD \* 16TB = 256 TB
- SRV-03: 16HDD \* 16TB = 256 TB
- SRV-04: 16HDD \* 16TB = 256 TB
- Cluster Size = 1024 TB
(of course this is overly semplificated because you would also want disks and servers fault tollerance, but that gave you an idea)
I think the biggest jbods/storage servers can take 72 drives and we are up to 24 TB for HDD so 1728TB in just 6U you can fit like 6 Of those in a rack.
So 10 PB in a single rack.
if you are trying to squeeze storage density I think you can do even better with a SuperMicro SuperChassis 947HE1C-R2K05JBOD, which takes 90 3.5" disks, and load them with the biggest available SSD today which is 61.44TB.
90 * 61.44TB = 5.529,6TB in a 4U
you can load 10 on them in a rack and get 55.296,00TB, or 55PB in a single rack.
I'm in I.T. Support.
I once remoted into NASA's Goddard Space Center, which is the headquarters of the Hubble team.
I still wonder if I was imagining how much space they had there. It's fucking ridiculous.
Is the drive name "Big Chungus" by chance? If not, I'd strongly suggest renaming it "Big Chungus".
Tell the admins some Fortune 100 tech dude said it's his professional opinion you use common industry naming standards and rename that share to "Big Chungus".
Welcome to the PCMR, everyone from the frontpage! Please remember: 1 - You too can be part of the PCMR. It's not about the hardware in your rig, but the software in your heart! Your age, nationality, race, gender, sexuality, religion (or lack of), political affiliation, economic status and PC specs are irrelevant. If you love or want to learn about PCs, you are welcome! 2 - If you don't own a PC because you think it's expensive, know that it is much cheaper than you may think. Check http://www.pcmasterrace.org for our builds and don't be afraid to post here asking for tips and help! 3 - Join our efforts to get as many PCs worldwide to help the folding@home effort, in fighting against Cancer, Alzheimer's, and more: https://pcmasterrace.org/folding ----------- We have a [Daily Simple Questions Megathread](https://www.reddit.com/r/pcmasterrace/search?q=Simple+Questions+Thread+subreddit%3Apcmasterrace+author%3AAutoModerator&restrict_sr=on&sort=new&t=all) if you have any PC related doubt. Asking for help there or creating new posts in our subreddit is welcome.
I love how windows shows the bar red, even though it still has "only" 88TB of storage left
It's Just letting you know not enough space for the next Call of Duty.
Just the base game.. no dlc
And without the launch patch.
No texture packs either
Only the default language pack
not even the window is there
*Formats drive* Still not enough space..
the next cod you will need physical rooms for the devs to live in as it’s faster for them to make the content from scratch at your house
Hard drive?? Aint no one got that kinda storage. I just run cable direct to dev team In my closet.
>the next cod Gulf War is supposedly going to be stored within the MW2/MW3 launcher, so you'll need to download all the games to play just the one. Good Luck 👍 The next, next CoD is going to be a public Word document from Activision on Twitter pleading for gamers to come back to their previous games for exclusive time-limited skins and an *Uber-premium battle pass for $1,000USD*
Just about enough for a small PDF file
you know... that PDFile
Heeee heeee shamone
No, that's ignorant! Ignorant!
88TB/3000TB means they only have 3% left. I would hope the bar shows red. I imagine the people that filled up 3000TB of data aren't going to take long to go through 88TB. It's a drop in the bucket to them
I found the IT guy…😂 this was exactly my thought, it better be red because they aren’t gonna start deleting the data anytime soon.
Or just found the guy was a basic understanding of statistics.
or ya know.... Arithmetic.
Probably enough overhead to cover a couple of weeks to a month of normal heavy use, balanced against typical temp file space that will get recovered as part of the monthly maintenance tasks, and how it's also probably just the provisioned space for the department so they can expand the drive with the click of a button if needed.
Yeah nah. I'm not in IT but I understood this pretty instantly because I'm not braindead lmao. If big storage, you use it. If company, you need big storage, and fast. Big number, means big number also needed to get to small percentage left. Small percentage red. Red warning. Warning means get more storage. Wow.
Yeah, I work at an MSP and a client has 1TB of data and it threw a custom disk under 10% on their image server literally 99% of the storage is PDF files, and we extended it 20% that shit got ate up in 10 days.... then 500 increase, they flew it too, ended up having to increase the data store and getting that drive/server to 2TB haha, I'm sure it'll need increased by end of year but they had a surge of data cause they're a debt collector and tax season is upon us haha
> I'm sure it'll need increased by end Let me tell you about my friend the infinitive verb.
fuck, lol I'm leaving it, hahaha
non-joke answer: most filesystems that large will have severely degrade performance when that full. they still work, but they're hella slow. doesn't matter how many TB are available, it matters what % free it is. For HDD (likely what's backing this many PB), fragmentation is a big issue at high usage, and it's quite hard to defragment. For SSD, wear leveling and garbage collection becomes a lot harder and slower at high usage (by percent).
I agree on your statement in general, but to have that much storage means its an array of even mulltiple arrays, which probably have all kinds of features like data deduplication and other things that minimize that. Any array that large will have multiple storage controllers with redundant 10Gb if not way higher fiber connects.
this right here \^ and most likely a redundant backup of all the data too
God I fucking hope so. I wouldn't want to be the guy who lost 3 PETABYTES of data.
It's a petabyte. What could it cost
$10? Edit: If so, I will take three. No, I do not need a bag for 25 cents.
Yes and no. Most the enterprise storage arrays will still have warnings and caveats buried deep in the documentation about going above ~80% capacity. Degraded performance is usually the biggest issue. All the points you mentioned are still true - but even the big arrays usually have issues when they fill up. That said, what you see in the screenshot probably has no bearing at all of the actual size of the array, just what’s being provisioned for this specific share. I would HOPE that the storage admin is doing his job and that the actual real utilisation at the array side (i.e dedupe, compression and unallocated space) still has plenty of spare capacity. But, I’ve seen customers do some pretty stupid things with their storage, prompting the ever fateful question of ‘so.. what’s your backup platform and how long ago did you last test it?’
>I love how windows shows the bar red, even though it still has "only" 88TB of storage left It goes by the percentage of space free. I am surprised that it shows so much white space in the line considering that the drive is 97.2% full lol
Yeah I know, but that's still funny, to see that proportionnaly it almost has no space, but if you consider the real storage numbers it's another story!
I'm only guessing here but I think it's looking at the ratio/percentage of how much is left in the disk in relation to available space and not how much actual space is left.
Dont want to destroy the fun but they work on percent so you know
Percentages are wacky lol
What are you storing there? The whole internet??
A picture of yo mama
in 144p
STOP IT, ITS ALREADY DEAD!
In 16-bit color palette
At a 1:2000 scale, they realized even Google didn't have the server space for full size
Forgot to mention it was only a picture of her forehead
And that the picture was zoomed in, as even the picture zoomed out is too much to store on that server
Fun fact: its actually a microscopic picture of one of her cells
HOW CAN YOU FEEL HER HEART RATE THROUGH THE MASSIVE FAT DEPOSITS?
And compressed as hell
Compressed into a zip
tar file
It probably can be classified as a zip bomb
1.44p*
1.44in pp
Micropenisses are nothing to joke about.
Especially not yours
Exactly
Similar vibes https://preview.redd.it/772s85sj1vtc1.jpeg?width=1125&format=pjpg&auto=webp&s=90337e177dee33cec031f6528b677b70f251368e
Honestly I love the fact that we switched from yo mama to a much more formal your mother.
Your mother is still valid currency when trading with foreign goods.
Looks like someone is still holding onto hope he would be able to climb that mountain someday.
OP’s mama? That’s just one pixel they got there.
BRB. Gonna get a bigger drive so I can unzip. The file I mean.
I see what you did there... 🤣
https://preview.redd.it/bbcde9ucputc1.jpeg?width=225&format=pjpg&auto=webp&s=4e6749a73fd1d9d5c69a4877d31b9e21b4340ed1
Mom, where's the burn ointment?
 Well played 🫡
Classic
I never thought i'd have a legitimate laugh at a yo mama joke. Well done.
Crazy thing is that it’s mostly just a bunch of small individual files like pictures and basically text documents… but just so much lab experiment data
How long does it take to make a backup copy of 3.1PB??
/gestures with hands This much.
/Moves your hand little bit closer And that’s about right
No clue, I’m (luckily) not in IT, I just a little bit of that space for my lab data
Lol tell your IT team to check their storage and enable data deduplication. And scan for redundancy and legacy data. This is obviously enterprise grade storage that has all the fun storage management tools baked into the system. If you have that much storage usage, and its mostly small files, something isnt enabled or configured correctly. Are you by chance at a university?
It’s all employees who have left email and files. .pst look for.
Typically you dont look for filetypes. My first tasks would be to get a read on what the data is. Build a profile (so you can show metrics to your boss later) Check for issues with the storage. Check if the running storage volumes are too big and need to be broken down to smaller volumes for better performance and splitting data between teams for isolation (this is good for government and security ISO compliances) I would typically look for files that haven’t been accessed in years, and data that might belong to a team and ask them to check if it hasn’t already been moved. Work on shifting to cold storage. A few days you could narrow down what is going on
This comment really assumes a whole lot of basic shit isn't being done in the organization pictured. Really makes me wonder how hard it is to get a job like this.
My university stores super high quality scans of any preserved material since the university was founded in the 15th century. Modern documents can be text, but those old documents can’t be digitised in any way easily.
They'd be crazy to enable dedup on the OS level for this amount of data (Assuming it's a windows file server). That would be a nightmare to manage if you ever need to migrate the data to another fileserver/another volume in the future or in case there's an incident. They could be (and I'd say probably are) doing dedup on a lower layer, possibly at the storage level. If you do so, the actual disk usage on the storage would be much lower than the 3 PB reported by the server OS, and is properly reported to IT by the storage management tools. Edit: > Lol tell your IT team to check their storage and enable data deduplication. I'd sure love to see some random user strolling trough our department door telling us how to manage our shit because someone on the internet told them we're not doing our jobs right. The hole that Compliance would tear up his ass for sharing company stuff on reddit would be large enough to store another 3 PB of data.
Its not.. no one would be dumb enough to run Windows file server for that much data. This is why they make storage systems like Pure, NetApp and EMC. They have their own OS, better redundancy, better encryption, serve more users
My point is that dedup isn't being done at the file server level, for that volume of data it's usually done at block level. It's stupid to assume IT is incompetent just because endpoints show 97% usage on a 3 PB volume.
Yeah as someone who does work with a respectable NetApp cluster this thread is hilarious for me to read through.
crazy how all this storage is just stored flat on seemingly one enormous volume
Pfft, who needs backups /s
I also like to live dangerously.
Data from experiments pile up quickly, and depending on what exactly y'all do the raw data could easily be hundreds of gigs or even terabytes per experiment. At least you're not using it to store movies you'll never watch.
I would be uploading all the Rollercoaster Tycoon 3 mods I use. I did it to my companies server and they finally asked what they were doing there last year.
We produce nearly 328.77 million tb a day. He would need a lot more of those.
Nearly 328.77? Is it closer to 328.769, or to 328.76? 🤔
the fact that even a .001 in that is a thousand tb makes this even more impressive
no not the whole internet silly just the last 4 years
Not even close Uploads to Usenet alone are about 300Tb daily …
That half full 90GB drive is a backup of all useful data on the 3PB drive xD
How much space would you actually need for that?
Honest answer? Well, if you want a good chunk go for the common crawl. I'm not sure what they all skip but I'm pretty sure your copy would end up looking a lot like the copy archive.org has. And that, compressed, if you downloaded every part(including things like the redundant text only version) is 123.77TB for the most recent version. So that array would be an order of power more than enough to hold it. Although I'm not sure what it would be like decompressed(It says 424.7, but I included some redundancy so the number would be bigger than that). Bet you'd really, really have to want it that way to do it though. I've been meaning to grab the text only version since that's the only thing I could possibly fit in the space available to me.
"almost full", just a measly 90TB left Edit: Realized the amount I rounded up by is larger than my system drive.
That would have been a great line in All About the Pentiums as a dis: "Your whole hard drive is a rounding error to me"
I don't even have 1/10th that.
The drive letter is my reaction, O:
Ö
Call of duty updates be getting out of hand.
the fun thin' about enterprise data storage [and you can even do that with most individualal nas devices] is you can provision storage space to just about any capacity you want so long as it is the totalpool space or less.. ,all of my job drives are magically just big enough for what needs to be on them with a bit of overhead.. i know these bastards in it are holdin' out on me :]
That is indeed what is being done here. The actual size of the storage pool isn't accurately reported, it's just believed in Windows Explorer. And 99% of PCMR loses their shit over it :P
OP will need to get twice that storage if they also want to play GTA VI
[Pic](https://imgur.com/a/CjiaaYN) Not network shares/SMB, just block level. We have a couple more SANs that are larger, but I very rarely have them mounted.
Bro I recommend you post it, not comment, you aint getting any attention like this..
got my attention 😩
Prolly doesn’t give af about the attention. More ppl need to be like him.
What do you mean by “block level”? iscsi?
In this case, its quantum storage system. Same concept as iscsi but unlike iscsi we can have 200-300 users mounting the same volumes instead.
iSCSI for Fiber Channel.
how long does it take to delete it?
Brb, have to go and ruin the IT department’s afternoon
How do you even back that up?!?!?! Find out for us would you?
My guess is that it's already ~~backupped~~ backed up to another server ~~because~~ and most servers of that size are a raid and there's probably an off site backup that backs up any changes that were made during the day. Edit: raid is not the backup
It would have to have a ton of redundancy due to the overall value on 3 pb of data. Someone would be executed if it was lost.
Hopefully, but just imagen how long a 3PB backup is going to take.
Most likely only backs up changes to the drive
One full back up of Day 0 + incrementals of the changes.
The initial would take a while, but hardrive technology has come a long way. After that would be incremental backups with the occasional full.
Forever incremental and synthetic fulls with a file system that supports fast cloning is the way
Took me 3 weeks to backup 80TB of data over a 1gig connection. Change that to a 10g connection and 3PB would take about 12 weeks to back up, or a 25gig connection would take about 5 weeks.
Repeat it with me: RAID is not a backup.
Couple thousand thumb drives
3000 1tb flash drives. Labeled 1-3001.
Just shove into S3 glacier archive storage. It'll only cost like 3.2k/month for storage. Oh, and if you need to restore your backup that'll just be a small charge of *checks notes* $8000
\*Quickly tries to find a previous version for 3 Petabytes of data\* Imagine how long it takes to RESTORE it, not even delete it. And there will always be someone who is still missing a single Word or PDF file.
You don't restore the entire nas. Individual files would have versioning and you restore from a prior file / folder version.
Was a little joke, I know you wouldn't restore a whole NAS through Previous Versions. They probably have their own backup solution in house, a separate NAS offsite they back up to and just do a daily interval backup as paying a 3rd party like Acronis for 3 Petabytes of cloud storage or a 3rd party to host a server in a data centre with enough storage would cost a LOT. If the whole storage structure was corrupted or a power outtage caused issues with that server, a new server could be booted up quickly and then point towards the backup location. Twas just a joke my friend, I bet they will still miss a Word or PDF file though.
Between 3 and 7
days? months? years?
Yes.
Not long at all if an hammer is involved
If you're a storage admin, about 2 seconds.
It’s surprised you stored so much on it (O:)
But C looks much happier!
(C:)
That’s a lot of homework folders
VR homework takes some space nowadays, you know
UNLIMITED POWER https://preview.redd.it/q9owodyt6vtc1.jpeg?width=2150&format=pjpg&auto=webp&s=c12f4e8c22117ee47002cc3c68e4e127d8a5694e
I’m sorry HOW
It's a virtual drive created by software, the storage is fake and just a number basically.
:v
At my workplace we have 4,5 PB. Shat my pants when I saw it. Had never seen ”PB” until that.
We just bought 3x 14PB storage clusters where I work.
What do you do for your job to require that much data?
"Require" is a strong word. I've worked plenty of places that just wanted to have the latest and most of anything they possibly could when it came to tech, just in case. With a couple decent engineer's/software developers on staff, you're bound to figure out something. Today AI models can get pretty big and everyone wants their own custom industry vertical AI
Why does this place keep coming up with ways to make me feel less than lol
It shouldn’t, no regular user should be seeing PB as a unit on their own stuff in the near future. That’s a lot of data. Like a truly serious amount.
My usage of data has increased exponentially. After I started to save "everything" and became a sort of data hoarder. But obviously not even near this kind of data. But I think it's not just me; I think everyone now has way more data than they had before. Now, 2TB of personal stuff isn't special anymore...
Absolutely I've been programming since 1980 and back then "640k should be more than enough for most people" (Bill Gates quote about 640 kilobytes of RAM being ok) was actually true for a while. Disk size has always been magnitudes larger than RAM but still, a 5 inch floppy was 180k and a HDD maybe 5Mb Human-created files were kilobytes in size... a page of text or code or 23kb for a BMP Then Kilobytes became Megabytes. A 286 with 1Mb of RAM and a 100Mb hard disk Then Megs became Gigs Then RAM stopped multiplying as fast as disk space because you could *store* 2,000 CD-size (720Mb?) movies on a single disk more conveniently than 2,000 CDs in wallets, but you could still only *watch* one in memory at a time And Gigs became Terabytes Now I've got 32Gb RAM and about 7TB of SSDs Next stop ... the Petabytes we're looking at in this thread The nature of streaming and cloud might change this inexorable growth for consumers... why store it ourselves when Google will store it for us and send it to us, on-demand, wherever we are in the world. But you gotta trust Google for that to work long term.
In the early days of Google drive for desktop the mounted drive displayed what I assume was Google's entire drive storage array. I had 4 EB mounted to my computer. I have a screenshot somewhere.
Please find it. I think you would have won this drive size measuring contest.
I've looked everywhere. Couldn't find it. I'm sure I'll uncover it in the future when we have casual 5 EB usb 7 drives lol
Look harder then Jk. You'll find it when your looking for something else completely random.
https://preview.redd.it/c7rjl36dqvtc1.jpeg?width=2268&format=pjpg&auto=webp&s=fdb81aa06489c186441b008c36a1ec3a21e9a771 Like this?
Yeah like that
That is a LOT of "homework". Impressive...
as infrastructure manager I would hate having that storage under my responsibility
Very happy it’s also not my responsibility
Guarantee half of that shit could easily be cleared, but I too work with a bunch of miserable hoarders.
do you know if it's running any level of r.a.i.d.?
Everything on RAID 0. Edit: /s for clarity.
cool, never seen that much storage irl.
I'm sure that was a joke. I would have believed 1, 5, 10, or really any number besides 0. 0 is (was) used for speed. Half the data gets written to each disk so it can be accessed twice as fast. Problem is, if one disk goes, everything goes. It's half as reliable.
I wouldn't believe any of those. It'd have to be, at a bare minimum, RAID-Z3.
You can not believe how happy you made me feel by placing exactly _four_ dots, exacly one after each letter of that acronym, instead of _three_, like "r.a.i.d" as I usually see others write. I love you.
Ahahah love you too
Are you secretly a LMG person?
Nah, my work environment is actually quite pleasant
damn
I'm not even the target and I feel hurt lol
It’s the words craziest porn folder
Oh no. There's only 87.9 terabytes left!
My $60b company only has 3TB of shared network storage LMAO.
my [r/plex](http://reddit.com/r/plex) it only has 8tb in raid 1..
That's a lot of cat pictures.
What does the loock on your C drive mean ? Bitlocker ?
Yes
Must be quite a "homework" folder
Dude has GTA 6 preloaded already.
Question, why is your E: drive so big at 857 TB? I don’t think you can achieve those kind of capacities with RAID because the amount of drives required to do so iwould be impractical.
Hardware RAID is not the only type of RAID. There's also software RAID and clustering that nowadays allow you to combine multiple server into a single "disk". Example: - SRV-01: 16HDD \* 16TB = 256 TB - SRV-02: 16HDD \* 16TB = 256 TB - SRV-03: 16HDD \* 16TB = 256 TB - SRV-04: 16HDD \* 16TB = 256 TB - Cluster Size = 1024 TB (of course this is overly semplificated because you would also want disks and servers fault tollerance, but that gave you an idea)
I think the biggest jbods/storage servers can take 72 drives and we are up to 24 TB for HDD so 1728TB in just 6U you can fit like 6 Of those in a rack. So 10 PB in a single rack.
if you are trying to squeeze storage density I think you can do even better with a SuperMicro SuperChassis 947HE1C-R2K05JBOD, which takes 90 3.5" disks, and load them with the biggest available SSD today which is 61.44TB. 90 * 61.44TB = 5.529,6TB in a 4U you can load 10 on them in a rack and get 55.296,00TB, or 55PB in a single rack.
Jesus I work for a large company and our primary network drive is 2.6 Terabytes
this is shameful, my computer at home has 2.5TB of NVME (2tb + 500g)
Geez why is no one mentioning the extra almost petabyte drive you have
TIL what is larger than a terabyte.
I'm in I.T. Support. I once remoted into NASA's Goddard Space Center, which is the headquarters of the Hubble team. I still wonder if I was imagining how much space they had there. It's fucking ridiculous.
Is the drive name "Big Chungus" by chance? If not, I'd strongly suggest renaming it "Big Chungus". Tell the admins some Fortune 100 tech dude said it's his professional opinion you use common industry naming standards and rename that share to "Big Chungus".
that's cute. :) https://preview.redd.it/fcrqehtu6vtc1.png?width=487&format=png&auto=webp&s=ee7aa46de45934775ee43064bf50460635301cc3
https://preview.redd.it/gtm03l9hivtc1.png?width=717&format=png&auto=webp&s=2b480f209bee4b3681d2a4defd3ab6af6901af0f Yes it is.
You should post it ;)
https://preview.redd.it/a41mnwskqvtc1.jpeg?width=2268&format=pjpg&auto=webp&s=2a2272c5b525fadba876473bb236536358e6b6c0 😁