this post was submitted on 13 Dec 2023
927 points (97.8% liked)

Technology

55738 readers
3087 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
top 50 comments
sorted by: hot top controversial new old
[–] prime_number_314159 266 points 6 months ago (7 children)

Ok, so I think the timeline is, he signed up for an unlimited storage plan. Over several years, he uploaded 233TB of video to Google's storage. They discontinued the unlimited storage plan he was using, and that plan ended May 11th. They gave him a "60 day grace period" ending on July 10th, after which his accouny was converted to a read only mode.

He figured the data was safe, and continued using the storage he now isn't really paying for from July 10th until December 12th. On December 12th, Google tells him they're going to delete his account in a week, which isn't enough time to retrieve his data... because he didn't do anything during the period before his plan ended, didn't do anything during the grace period, and hasn't done anything since the grace period ended.

I get that they should have given him more than a week of warning before moving to delete, but I'm not exactly sure what he was expecting. Storing files is an ongoing expense, and he's not paying that cost anymore.

[–] cogman 153 points 6 months ago (11 children)

but I'm not exactly sure what he was expecting. Storing files is an ongoing expense

He was expecting a company that promised unlimited data to not reneg on their advertised product. Or to simply delete data they promised to store because it's inconvenient for them.

Yeah, it costs money to store things, something Google's sales, marketing, and legal teams should have thought about before offering an "unlimited" product.

[–] Subverb 30 points 6 months ago (3 children)

Reminds me of the guy who paid a million dollars for unlimited American Airlines flights for life. He racked up millions of miles and dollars in flights so they eventually found a way to cancel his service.

load more comments (3 replies)
load more comments (10 replies)
[–] [email protected] 52 points 6 months ago (1 children)

Yeah it's definitely shitty if they really only give 7 days notice that your account is going from read-only to suspended and deleted, but after basically not paying your cloud storage bill for like 6 months this is a pretty predictable outcome

[–] [email protected] 22 points 6 months ago (3 children)

He did pay for the service though. They just decided to stop charging him for it.

load more comments (3 replies)
[–] pete_the_cat 22 points 6 months ago (1 children)

Exactly. People love to "cry foul" when Google does stuff like this but it's completely unrealistic to think you can store 278 TB on Google's server in perpetuity just because you're giving them like $20-30/month (probably less, I had signed up for the Google for Business to get the unlimited storage as well, IIRC it was like $5-$10/month). It was known a while ago that people were abusing the hell out of this loophole to make huge cloud media servers.

He's an idiot for saving "his life's work" in one place that he doesn't control. If he really cares about it that much he should have had cold-storage backups of it all. Once you get beyond like 10-20 TB it's time to look into a home server or one put one in a CoLo. Granted, storing hundreds of TBs isn't cheap (I had 187 TB in my server across like 20 drives), but it gives you peace of mind to know that you control access to it.

I have all my "important" stuff in Google drive even though I run my own media server with like 100 TBs but that's because I tend to break stuff unintentionally or don't want to have to worry about deleting it accidentally. All my important stuff amounts to 33 GB. That's a drop in the ocean for Google. Most of that is also stored either on my server, the server I built for my parents, or pictures stored on Facebook.

load more comments (1 replies)
load more comments (2 replies)
[–] [email protected] 150 points 6 months ago (6 children)

Google is an untrustworthy business partner. Why should anyone invest in their projects.

load more comments (6 replies)
[–] pachrist 125 points 6 months ago (9 children)

Just some advice to anyone who finds themselves in this specific situation, since I found myself in almost the exact same situation:

If you really, really want to keep the data, and you can afford to spend the money (big if), move it to AWS. I had to move almost 4.5PB of data around Christmas of last year out of Google Drive. I spun up 60 EC2 instances, set up rclone on each one, and created a Google account for each instance. Google caps downloads per account to 10TB per day, but the EC2 instances I used were rate limited to 60MBps, so I didn't bump the cap. I gave each EC2 instance a segment of the data, separating on file size. After transferring to AWS, verifying the data synced properly, and building a database to find files, I dropped it all to Glacier Deep Archive. I averaged just over 3.62GB/s for 14 days straight to move everything. Using a similar method, this poor guy's data could be moved in a few hours, but it costs, a couple thousand dollars at least.

Bad practice is bad practice, but you can get away with it for a while, just not forever. If you're in this situation, because you made it, or because you're cleaning up someone else's mess, you're going to have to spend money to fix it. If you're not in this situation, be kind, but thank god you don't have to deal with it.

[–] [email protected] 36 points 6 months ago* (last edited 6 months ago) (1 children)

4.5PB holy shit. You need to stop using UTF2e32 for your text files.

I'd be paranoid about file integrity. Even a 0.000000000022% (sic) chance of a single bitflip somewhere along the chain, like a gentle muon tickling the server's drive bus during the read, could affect you. Did you have a way of checking integrity? Or were tiny errors tolerable (eg video files)?

[–] quinkin 22 points 6 months ago

They were using rclone so all of the transfers would be hash checked. Whether the file integrity on either side of the transfer could be relied upon is in some ways a matter of faith, but there a lot of people relying on it.

[–] [email protected] 26 points 6 months ago

Wow. That's a lot of "homework".

[–] BlackPenguins 25 points 6 months ago

I'm just curious how someone even gets to 4 Petabytes of data. It's taking me years to fill up just 8 TB. And that's with TV and movies.

[–] [email protected] 24 points 6 months ago* (last edited 6 months ago) (2 children)

Don''t even need an ec2 instance if all you do is moving the data to Amazon s3. rclone can do direct cloud-to-cloud transfer, the data won't hit the computer where the rclone running, so it should be very fast. You're going to have an eye watering s3 bill though. Once the data in an s3 bucket, you can copy them to glacier later.

load more comments (2 replies)
[–] [email protected] 22 points 6 months ago

AWS is very expensive. There are other compatible storage options, like Backblaze B2 and Wasabi, that are better for this use case

load more comments (3 replies)
[–] shalafi 102 points 6 months ago (8 children)

tl;dr: Google fucked him proper. But he was naive thinking he could store that much data with a tech giant, his "life's work", risk free.

I store my shit on Google Drive. But it's only 2TB of offsite backups, not my primary.

Time and again I've learned the past 25-years, no one gives a shit about their data until they lose it all. People gotta get kicked in the fork so hard they go deaf before they'll pay attention.

[–] funnystuff97 61 points 6 months ago (1 children)

Naive, perhaps, but if a company advertises a service, they better fucking deliver on that service. Sure, I wouldn't store all of my important documents solely on a cloud service either, but let's not victim blame the guy here who paid for a service and was not given that service. Google's Enterprise plan promised unlimited data; whether that's 10 GB or 200 TB, that's not for us nor Google to judge. Unlimited means unlimited. And in an article linked in the OP, even customer service seemed to assure them that it was indeed unlimited, with no cap. And then pulled the rug.

And on top of that, according to the article, Google emailed them saying their account would be in "read-only" mode, as in, they could download the files but not upload any. Which is fine enough-- until Google contacted them saying they were using too much space and their files would all be deleted. Space that, again, was originally unlimited.

Judge the guy all you want, but don't blame him. Fuck Google, full stop.

[–] pachrist 21 points 6 months ago (1 children)

The problem here is that Google's "unlimited" plan was real, but it was for the G-Suite Enterprise product, which they discontinued. Two years ago, they started moving everything and everyone to a new product offering, Google Workspace. The Enterprise plans there have unlimited* data, and that asterisk is important, because it specifies that unlimited is no longer unlimited, which is dumb. It's a pool of data shared between users, and each user account contributes 5TB towards the pool, capping at 300 users. From there, if I remember correctly, additional 10TB chunks cost $300/month.

I feel bad for this guy, but the writing has been on the wall for years now. Google has changed their account structure and platform costs to discourage this type of use.

load more comments (1 replies)
[–] [email protected] 26 points 6 months ago (1 children)

But he was naive thinking he could store that much data with a tech giant, his "life's work", risk free.

Google made a promise they didn't keep and articles like this are the consequence of that.

It's not ideal, but it still feels better than "let them lie and then blame their victims for believing it".

load more comments (1 replies)
load more comments (6 replies)
[–] linearchaos 99 points 6 months ago (7 children)

Wait, journalist, 233 terabyte? Just what in the fuck did his life's work consist of?

[–] [email protected] 77 points 6 months ago (2 children)
[–] elbarto777 24 points 6 months ago

Liftoff app cache folder.

load more comments (1 replies)
[–] nutsack 74 points 6 months ago* (last edited 6 months ago) (6 children)
load more comments (6 replies)
[–] BlackPenguins 61 points 6 months ago (2 children)
load more comments (2 replies)
[–] [email protected] 51 points 6 months ago

My node_modules folder

[–] [email protected] 34 points 6 months ago (1 children)

Log files from a local SQL server.

load more comments (1 replies)
load more comments (2 replies)
[–] electric 79 points 6 months ago (3 children)

Lot of didn't-read-the-article-itis in here. FBI seized his physical storage, cloud was the only option for the journalist and it did not make financial sense to pay for multiple cloud backups. Google is entirely the bad guy here.

[–] [email protected] 41 points 6 months ago (1 children)

Well, he did ignore that he wasn't paying for storage for half a year and did nothing to prevent data loss. Even ignored the grace period. That is at least negligent.

[–] [email protected] 25 points 6 months ago (2 children)

He assumed that Google assured him that his current data would be safe. But saying that your account will move into read only mode doesn't equate to keeping those much TBs of data on server forever.

Though I have a question. Was this unlimited service that Google offered was a one time payment thing(seems unlikely, since only couple of cloud providers like pCloud do so and that too on a much lesser scale) or a recurring subscription thing? If it was the later, then it is naive to believe that a for profit corporation would keep that much data without raking in money.

load more comments (2 replies)
load more comments (2 replies)
[–] Syrc 55 points 6 months ago (10 children)

a key Achilles’ heel was its basically non-existent customer service and unwillingness to ever engage constructively with users the company fucks over. At the time, I dubbed it Google’s “big, faceless, white monolith” problem, because that’s how it appears to many customers.

Hey, sounds like pretty much every corporation in 2023!

I hate so fucking much how little customer service companies are allowed to have.

load more comments (10 replies)
[–] [email protected] 43 points 6 months ago

Guess he could make reporting on tech giants pulling this shit his new lifework.

[–] [email protected] 38 points 6 months ago

Jesus. Even downloading at 1 Gbps, it would take a few weeks to download all that data. I don't think Google's Transfer Appliance works for retrieving data.

[–] unreasonabro 37 points 6 months ago (2 children)

from "don't be evil" to stunts like this in basically no time flat. #capitalism!

load more comments (2 replies)
[–] [email protected] 36 points 6 months ago* (last edited 6 months ago) (1 children)

Goddamn hope this story gets somebody at google's attention. Off topic, even though it was mentioned in the article, what ended up happening to the dad's account, was it reinstated? I can't find an update

[–] [email protected] 31 points 6 months ago* (last edited 5 months ago) (6 children)
load more comments (6 replies)
[–] [email protected] 28 points 6 months ago* (last edited 6 months ago) (1 children)

Considering that even with one of the cheapest storage services, B2, 250ishTB is about $1500/month(that's more than $5500/m in S3!) whereas Gsuite seems to be about less than $200, I would've never guessed that I could use it as is for a long time.

Extremely shitty of google to do this though. What a shame.

load more comments (1 replies)
[–] cheese_greater 21 points 6 months ago* (last edited 6 months ago) (3 children)

I'm speechless

Googs IS the LastPass of everything!

load more comments (3 replies)
load more comments
view more: next ›