this post was submitted on 14 May 2024
408 points (97.4% liked)

Technology

56128 readers
2662 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
top 50 comments
sorted by: hot top controversial new old
[–] Ensign_Crab 194 points 2 months ago (4 children)

Did they mistake it for one of their own services people were using?

[–] [email protected] 42 points 2 months ago (3 children)

We need to have something like reddit gold. but the money goes to a charity of your choice, and whoever you golded gets a badge next to their comment. I'd do that to this if I could.

[–] [email protected] 25 points 2 months ago (1 children)

But how would a capitalist benefit from that?

[–] [email protected] 5 points 2 months ago

Sigh. That is the world we live in.

[–] [email protected] 23 points 2 months ago

Just give a Lemmy Lemon 🍋 and donate to the charity of your choice.

[–] [email protected] 2 points 2 months ago* (last edited 2 months ago) (1 children)

Or we could just add the Yeah button from the Miiverse

[–] [email protected] 37 points 2 months ago (2 children)

Does this mean we can put that account on https://killedbygoogle.com/ ?

[–] Asudox 4 points 2 months ago
load more comments (1 replies)
[–] Dimand 7 points 2 months ago

Fucking gold!

[–] catalog3115 4 points 2 months ago
[–] [email protected] 56 points 2 months ago (1 children)

The cloud is just someone else's computer.

[–] [email protected] 11 points 2 months ago* (last edited 2 months ago)

And it's a sad, sad day when the situation in xkcd 908 looks like an improvement over even one of the commercial offerings.

[–] [email protected] 42 points 2 months ago (1 children)

They're outsourcing many of their workforce abroad. Like Microsoft, I expect more of these "isolated" accidents to happen.

[–] efstajas 2 points 2 months ago (2 children)

Wait, what does this have to do with outsourcing abroad?

[–] TheGrandNagus 25 points 2 months ago

Company tries to cut costs by outsourcing to another company with lowly paid employees in another country, often India or Pakistan, where the outsourced labour (that all too frequently hasn't been properly trained in the company's procedures) often doesn't share the same first language leading to misunderstandings, made worse by the difference in office hours meaning the teams often can't communicate with eachother in real time (the timezone factor is a big one IMO).

It's an issue affecting a lot of tech companies right now, including where I work (HPE). But I guess it must work out as being cheaper despite the issues, otherwise it wouldn't be happening.

[–] Dendrologist 8 points 2 months ago (1 children)

Let the people who installed/created it maintain it or let a bunch of new folk do it, which is likely to work best?

The abroad part isn't the issue. We're a global village with the Internet now, after all. It's the outsourcing part that's the issue.

load more comments (1 replies)
[–] shalafi 35 points 2 months ago

Better article:

https://www.theregister.com/2024/05/09/unisuper_google_cloud_outage_caused/

They restored from another cloud service. Were I in charge, I'd still be leery of not having that data on my own drives. I have my Windows libraries mapped to my ghetto RAID 0, and those folders are in turn backed to Google. If all else fails, I have a local backup. And this story reminds me, I haven't installed VEEAM on this new PC...

[–] kat_angstrom 29 points 2 months ago (1 children)

Yeah, this has definitely happened before, we just don't hear about it in the news. I am personally aware of a Canadian non-profit whose Google accounts were nuked with no notice or explanation last year, leading to massive disruptions for 150 staff and even more clients. They never found out why, and had to restore from backups onto a brand new Google business account

[–] [email protected] 37 points 2 months ago

had to restore from backups onto a brand new Google business account

Thus proving that they learned nothing from the experience.

[–] [email protected] 27 points 2 months ago (1 children)

Waiting for the news “Google deleted users account, now they lost access to their passkeys and with that to all other services” It can only be a matter of days until it happens.

[–] [email protected] 4 points 2 months ago (1 children)

Happened all the time over on r/androiddev. Small company brings on the wrong person/uses the wrong SDK/wrongfully fails an review and their account is then banned via "association", which then propagates down to countless other employees. Only way out is to hope and pray that a human sees the appeal or try and blow up online

Happened so often in fact that the subreddit even created several guides on how to avoid it. My favourite part is that even unpublished apps must be updated in perpetuity to abide by Google's ever changing requirements

Or this other occasion where viewers of one of the most popular YouTubers in the world were banned for typing in chat

load more comments (1 replies)
[–] TheGiantKorean 25 points 2 months ago (1 children)
load more comments (1 replies)
[–] [email protected] 25 points 2 months ago

Backup was on Azure. I get the sentiment on the cloud, but there is no excuse for this incompetence at Google.

[–] billwashere 23 points 2 months ago

“This should not have happened.”

Duh, ya think?

Google Sales Engineer: oh I see you didn’t purchase the “Do not randomly nuke my cloud” option.. well there’s the problem.

[–] markon 21 points 2 months ago

But you can't trust regular people to have open source ASI, but don't worry, we won't fuck it up.

[–] samus12345 15 points 2 months ago
[–] NegativeLookBehind 15 points 2 months ago (1 children)
[–] clif 6 points 2 months ago
[–] [email protected] 13 points 2 months ago (1 children)

This is a "one of a kind" error.

OK, that it can happen at all is a problem. And sorry, but the idiots who put their data in with Google should be fired.

I get offloading risk, little good will that do when your company goes tits up.

[–] slimarev92 7 points 2 months ago (1 children)

Where would you put their data then? Self hosting is not exactly safe either.

At the end of the day, every approach has its tradeoffs. Using a reputable cloud provider is a very valid choice.

[–] [email protected] 8 points 2 months ago

Thank you! Every time a story like this comes up, people seem to wanna pretend managing your own hardware is all sunshine and rainbows. Especially if you want global scale or as little down-time as possible, cloud provider's your best bet, albeit one where you have less control than you would with your own servers.

Opinion: You should be building on top of open source platforms and tools (Docker, Kubernetes if you need it...granted I'm not an expert in this area) to mitigate some of the vendor-lockin, and take a multi-cloud approach. If you're mainly hosting on GCP for example, host smaller deployments on AWS, Azure, Cloudflare, or something else as a contingency...eventuality you can also add or just move to your own servers relatively painlessly. Also AGGRESSIVELY backup up your database in multiple places.

[–] [email protected] 13 points 2 months ago (2 children)

This is the best summary I could come up with:


The company accidentally erased the private Google Cloud account of a $125 billion Australian pension fund, UniSuper.

“This is an isolated, ‘one-of-a-kind occurrence’ that has never before occurred with any of Google Cloud’s clients globally,” Google Cloud CEO Thomas Kurian and UniSuper CEO Peter Chun said in a joint statement obtained by The Guardian May 8.

Google Cloud has identified the events that led to this disruption and taken measures to ensure this does not happen again.”

And nearly half a million companies across the globe use Google Cloud as a “platform-as-a-service,” or client-facing tool, including Volkswagen and Royal Bank of Canada.

The National Security Agency inked a $10 billion deal with Amazon to move its intelligence surveillance data onto the company’s cloud.

And the Pentagon has a $9 billion contract with Microsoft, Google, Oracle, and Amazon for cloud computing services.


The original article contains 272 words, the summary contains 141 words. Saved 48%. I'm a bot and I'm open source!

[–] [email protected] 28 points 2 months ago

It has happened before. They just swept it under the rug and blamed the client.

A user was setting up a new laptop and synced an empty folder with google drive, intending to download accounts data to their machine. It bugged and treated the empty folder as the master and began erasing the drive contents.

After two weeks of pestering google, they relented and pulled from their backups they swore they didn't have and didn't exist.

[–] db2 6 points 2 months ago (2 children)

19 billion dollars and they can't do it themselves? They need Amazon and Microsoft?

[–] PseudorandomNoise 20 points 2 months ago (1 children)

Much cheaper to have an external company do these things sometimes

[–] [email protected] 5 points 2 months ago

It also lets you pass the buck in case of issues from a manager’s perspective.

[–] sznowicki 4 points 2 months ago

Good way to pay your informants.

[–] [email protected] 13 points 2 months ago

Whoopsie my bad guys

[–] Juice64 12 points 2 months ago (1 children)

Suddenly, using what little 401k I had for a down payment on a house doesn’t seem so bad lol

load more comments (1 replies)
[–] [email protected] 8 points 2 months ago

Is there anyone here who's worked as an engineer for Google, by chance? I'd honestly like to know about their work culture and how they would deal with stuff like this internally. Like, are the line managers understanding, or are they just screaming at their employees if shit hits the fan?

[–] [email protected] 8 points 2 months ago (1 children)

Is this the same one as a few days ago, or a second?

[–] [email protected] 6 points 2 months ago

Same one about the retirement fund operator from Australia.

[–] Wappen 8 points 2 months ago (1 children)

Google Cloud counts about 60% of the world’s 1,000 biggest companies and 90% of generative AI unicorns as its customers

What exactly are generative AI unicorns?

[–] [email protected] 6 points 2 months ago (1 children)

I believe in this context unicorn refers to start-ups that are valued at at least a billion dollars (or some number, I forget). So basically AI start-ups.

[–] Wappen 2 points 2 months ago

Makes sense, thank you

[–] BeMoreCareful 6 points 2 months ago

Critical support

[–] [email protected] 4 points 2 months ago (2 children)

These software guys literally get paid on salary and even get time to spare, the need to fear monger and threaten to destroy people's livelihoods when you run a huge portion of internet services just shows that they're not exactly the type to "do no evil"

load more comments (2 replies)
load more comments
view more: next ›