cross-posted from: https://lemmy.world/post/14465880
It's the endgame.
this post was submitted on 19 Apr 2024
1331 points (98.7% liked)
Comic Strips
11197 readers
2575 users here now
Comic Strips is a community for those who love comic stories.
The rules are simple:
- The post can be a single image, an image gallery, or a link to a specific comic hosted on another site (the author's website, for instance).
- The comic must be a complete story.
- If it is an external link, it must be to a specific story, not to the root of the site.
- You may post comics from others or your own.
- If you are posting a comic of your own, a maximum of one per week is allowed (I know, your comics are great, but this rule helps avoid spam).
- The comic can be in any language, but if it's not in English, OP must include an English translation in the post's 'body' field (note: you don't need to select a specific language when posting a comic).
- Politeness.
- Adult content is not allowed. This community aims to be fun for people of all ages.
Web of links
- [email protected]: "I use Arch btw"
- [email protected]: memes (you don't say!)
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Can you please elaborate on the technical details of the failures? What was the hidden dependency?
The ISP had redundant electrical grid connections for reliability, but the two connections were not isolated at the electrical utility level. A failure in one substation cascaded to the other substation. The operation of one electrical feed depended on the operation of the other, so they were effectively only a single feed.
But I don't understand why them being connected makes one dependent on the other, unless half of the supply alone can't support the workload. What is the "electrical utility level"
Both substations feed in parallel. Demand exceeded the capacity of station 2 to supply demand and it tripped the cutout. Only rural connections are radial. Electrical utility starts at the point of demarcation to the generators that make the power.
The "utility level" is Madison Gas & Electric's infrastructure. Our ISP had two independent electrical service connections based on the idea that if one went down, they'd still get power sufficient to run their data center from the other. That would be the case if each connection reached all the way to the generating station completely independently. However, the two substations to which the ISP was connected were linked in such a way that a catastrophic failure of one caused failure of the other, so it got no electrical power.