this post was submitted on 23 Jun 2023
18 points (100.0% liked)

Lemmy

2172 readers
1 users here now

Everything about Lemmy; bugs, gripes, praises, and advocacy.

For discussion about the lemmy.ml instance, go to [email protected].

founded 4 years ago
MODERATORS
 

504 Gateway Time-out nginx timeout error on home page

top 13 comments
sorted by: hot top controversial new old
[–] AlmightySnoo 4 points 1 year ago (1 children)

they definitely rushed the 0.18.0, first they release without waiting for the captcha to be finished and now we realize it can't even be used in production yet

[–] BitOneZero 1 points 1 year ago* (last edited 1 year ago)

0.17.4 has a lot of the same problems, so going forward is the only hope. The amount of messages and peer servers alone are causing fundamental performance problems with the code, regardless of 0.17 or 0.18.

People taking down their servers to upgrade to 0.18 could have triggered a swarm of resource problems on the central federation instance that they had never experienced when there were only a dozen(?) other Lemmy instances 2 months ago.

[–] BitOneZero 4 points 1 year ago

still down as of the time of this comment you are reading.

[–] [email protected] 4 points 1 year ago (1 children)

So will this comment sync to the lemmy.ml instance once it back up ?

[–] BitOneZero 3 points 1 year ago* (last edited 1 year ago)

There is a pattern of retries built into the code, but syncing has no ability to repair failures (that get past the retry logic), and there have been hand-documented cases where even with retries, there is significant data loss: https://github.com/LemmyNet/lemmy/issues/3101

[–] AlmightySnoo 3 points 1 year ago* (last edited 1 year ago) (1 children)
[–] BitOneZero 1 points 1 year ago* (last edited 1 year ago)
[–] [email protected] 2 points 1 year ago

So that's why the page won't load :(

[–] BitOneZero 2 points 1 year ago* (last edited 1 year ago)

Still down as of time of this comment, 45 minutes since I first observed it.

[–] [email protected] 2 points 1 year ago (1 children)

An I wrong or lemmy.world is down too?

[–] BitOneZero 1 points 1 year ago

I'm posting from it to you, and it's been showing internal crashes off and on, but still mostly up. I expect cascading failures from servers trying to federate and swarming each other.

[–] BitOneZero 1 points 1 year ago

I am starting to see some partial page loads, broken pages - bug with actual data content of posting/comments on them. I expect other federation servers are swarming to the site to try and replicate - and it's causing a mess given how many communities lemmy.ml is center of.

[–] BitOneZero 1 points 1 year ago

Don't be surprised if this causes cascading failures, impacts other instances, as they try to exchange postings/comments/votes with lemmy.ml and get backed up.