this post was submitted on 01 Jul 2023
3987 points (97.9% liked)

Lemmy.World Announcements

29389 readers
28 users here now

This Community is intended for posts about the Lemmy.world server by the admins.

Follow us for server news ๐Ÿ˜

Outages ๐Ÿ”ฅ

https://status.lemmy.world

For support with issues at Lemmy.world, go to the Lemmy.world Support community.

Support e-mail

Any support requests are best sent to [email protected] e-mail.

Report contact

Donations ๐Ÿ’—

If you would like to make a donation to support the cost of running this platform, please do so at the following donation URLs.

If you can, please use / switch to Ko-Fi, it has the lowest fees for us

Ko-Fi (Donate)

Bunq (Donate)

Open Collective backers and sponsors

Patreon

Join the team

founded 2 years ago
MODERATORS
3987
submitted 2 years ago* (last edited 2 years ago) by ruud to c/lemmyworld
 

Looks like it works.

Edit still see some performance issues. Needs more troubleshooting

Update: Registrations re-opened We encountered a bug where people could not log in, see https://github.com/LemmyNet/lemmy/issues/3422#issuecomment-1616112264 . As a workaround we opened registrations.

Thanks

First of all, I would like to thank the Lemmy.world team and the 2 admins of other servers @[email protected] and @[email protected] for their help! We did some thorough troubleshooting to get this working!

The upgrade

The upgrade itself isn't too hard. Create a backup, and then change the image names in the docker-compose.yml and restart.

But, like the first 2 tries, after a few minutes the site started getting slow until it stopped responding. Then the troubleshooting started.

The solutions

What I had noticed previously, is that the lemmy container could reach around 1500% CPU usage, above that the site got slow. Which is weird, because the server has 64 threads, so 6400% should be the max. So we tried what @[email protected] had suggested before: we created extra lemmy containers to spread the load. (And extra lemmy-ui containers). And used nginx to load balance between them.

Et voilร . That seems to work.

Also, as suggested by him, we start the lemmy containers with the scheduler disabled, and have 1 extra lemmy running with the scheduler enabled, unused for other stuff.

There will be room for improvement, and probably new bugs, but we're very happy lemmy.world is now at 0.18.1-rc. This fixes a lot of bugs.

(page 6) 50 comments
sorted by: hot top controversial new old
[โ€“] AlmightySnoo 3 points 2 years ago (1 children)

obviously not critical, but it looks like there's a small sidebar bug (or feature?) that puts the pic near the instance name if it is the first thing in its description?

[โ€“] [email protected] 3 points 2 years ago

I think that's a feature. But not 100% sure ๐Ÿ˜…
But honestly, I like the look. If it is a bug, it should become a feature ๐Ÿคฃ

[โ€“] illbit 3 points 2 years ago

Thanks for all the time and work you put towards making this community better! It's really appreciated!

[โ€“] [email protected] 3 points 2 years ago
[โ€“] smokedclover 3 points 2 years ago

Yay, i could finally login. Thank you for the great work and thank you for keeping us updated!

[โ€“] illbit 3 points 2 years ago

Thanks for all the time and work you put towards making this community better! It's really appreciated!

[โ€“] JoMiran 3 points 2 years ago (1 children)

Would you mind sharing your docker-compose.yml file (sanitized, of course)? I am trying to spin up an instance on Google Cloud.

load more comments (1 replies)
[โ€“] [email protected] 3 points 2 years ago
[โ€“] ami 3 points 2 years ago

Amazing work! It seems much more performant now, everything seems to be loading faster.

[โ€“] BitOneZero 3 points 2 years ago (1 children)

we created extra lemmy containers to spread the load. (And extra lemmy-ui containers).

Is Rust HTTP server running into thread limits? database connection pooling? All kinds of internal questions bout that solution.

load more comments (1 replies)
[โ€“] WigglingWalrus 3 points 2 years ago

Logging in works now! Also got 2FA enabled without issues.

[โ€“] srasmus 3 points 2 years ago

Excellent work!

[โ€“] PKlempe 3 points 2 years ago* (last edited 2 years ago)

It seems that I can't log out in my browser. The page simply reloads after clicking the button.

[โ€“] TragicNotCute 2 points 2 years ago

Amazing work team ๐Ÿ’ช๐Ÿป

[โ€“] [email protected] 2 points 2 years ago* (last edited 2 years ago)

Thanks for the hard work!, I had an issue the first minutes where every time I logged in I got logged in with a different stranger account, now it doesn't happen but I can't login haha.

[โ€“] AlmightySnoo 2 points 2 years ago

looks like commenting got faster too?

[โ€“] BobbyBandwidth 2 points 2 years ago

Thanks dude

[โ€“] hymenopterror 2 points 2 years ago

YEAH BABEYYY

[โ€“] thaedrus 2 points 2 years ago

Looks like everything is working well so far. Browsing from Wefwef and Liftoff.

Thank you!

[โ€“] pickledredonions 2 points 2 years ago

Thank you so much!

[โ€“] Yoz 2 points 2 years ago

Thank you for your hard work.

[โ€“] Botree 2 points 2 years ago

Thanks for your hard work and goodnight to Rudd juniors!

[โ€“] Dude1324 2 points 2 years ago

โค๏ธ

[โ€“] _kern_ 2 points 2 years ago

Love the teamwork

[โ€“] MysticSmear 2 points 2 years ago

Thanks ruud

[โ€“] bappity 2 points 2 years ago

thank you for upgrading! I much prefer the new URL structure of this version

load more comments
view more: โ€น prev next โ€บ