this post was submitted on 21 Jun 2023
1351 points (99.9% liked)

/kbin meta

639 readers
1 users here now

Magazine dedicated to discussions about the kbin itself. Provide feedback, ask questions, suggest improvements, and engage in conversations related to the platform organization, policies, features, and community dynamics. ---- * Roadmap 2023 * m/kbinDevlog * m/kbinDesign

founded 2 years ago
 

Currently, on the main instance, people have created 40191 accounts (+214 marked as deleted). I don't know how many are active because I don't monitor it, but once again, I greet all of you here :) In recent days, the traffic on the website has been overwhelming. It's definitely too much for the basic docker-compose setup, primarily designed for development use. I was aware of the possible consequences of the situation happening on Reddit, but I assumed that most people would migrate to one of the Lemmy instances, which already has an established position. I hoped that a few stray enthusiasts would find their way to kbin ;)

The first step was to upscale the VPS to a higher version (66.91EUR). It quickly turned out that it wasn't enough. I had to enable CF protection just to keep the website responsive, but the response times were still very slow. At this stage, the instance was practically unusable. The next step was a full migration to a dedicated server (100EUR, the current hardware). It can be done relatively quickly, so it resulted in a 5-minute technical break. Despite the much higher parameters, it didn't get any better. It became clear that the problem didn't lie there. I'm really frustrated when it comes to server administration. That was the moment when I started looking for help. Or rather, it found me.

A couple days ago I wrote about how kbin qualified for the Fast Forward program. To be honest, I did it out of pure curiosity and completely forgot because a lot was happening during that time. During the biggest fire incident, Hannah ( @haubles ) reached out with a proposal to help. I outlined the situation (in short: the server is dying, I don't even know what I need, help! ;). She quickly connected us with Vlad ( @vvuksan ) and Renaud ( @renchap ). I was probably too tired because I don't know if the whole operation lasted 60 minutes or 6 hours, but after a series of precise questions and getting an understanding of the situation, the guys themselves adjusted the entire job. I love working with experts, and it's not often that you come across individuals so well-versed in the fediverse. Thanks to Hannah's kindness, we will be staying there a bit longer. Currently, fastly.com handles the caching layer and processes images. Hence those cool moving thumbnails ;)

Things were going well at that point. I could disable Cloudflare protection. Probably thanks to that, many of you are here today, and we got to know each other a bit better :) However, even then, when I tried to enable federation, the server would stop working.

Around the same time, Piotr ( @piotrsikora ), whom I already knew from the Polish fediverse, contacted me. He is the administrator of the Polish Mastodon instance pol.social, operates within the ftdl.pl foundation, and specializes in administering applications with a very similar tech stack. I made the decision to grant him server access. It only took him a few moments, and he came back to me with a few tips that allowed us to enable federation. In the following days, there was more of it, and we managed to reach the current level. I think it's not too bad.

Nevertheless, managing the instance has taken up about 60% or more of my time so far, which prevents me from fully focusing on current tasks. That's why I would like to collaborate with Piotr and hand over full care of the server to him. Piotr will also take care of the security side. Now I have to take this much more seriously. We still need to work out the terms of cooperation, but I want you to know the direction I intend to pursue.

We also need to migrate to a new environment because one server will sooner or later become insufficient. This time, I want to be prepared for it. This may be associated with transient issues with the website in the coming days.

The next two updates will still be about project funding (I still can't believe what happened) and moderation. The following ones will be more technical, with descriptions of changes and what contributors are doing on Codeberg. I would like to be here more often, but not as an admin, just as myself.

Thank you all for this.

P.S. In private messages, I also received numerous offers of help that I didn't even have a chance to read and respond to. You are the best!

(page 2) 50 comments
sorted by: hot top controversial new old
[–] [email protected] 8 points 1 year ago

@ernest Fantastic news and big thanks to all that are helping! @ernest I feel you will keep seeing several thousand users join in daily as the reddit shitshow continues to play out. There are now 10 apps being developed that will further support the transition especially as the July 1st shutdown takes place. That’s probably when a much bigger wave of new users will come in. Is your infrastructure scalable to allow for this onslaught? Thank you and everyone else again for your hard work!

[–] [email protected] 7 points 1 year ago

@ernest this was an extraordinary situation with several crisis points on a platform in early development (as far as mass usage is concerned) and you were able to keep a cool head, keep things going and also keep people informed of the situations as they were developing. I am happy to read that you have help now (and it looks like really great expert help) and that you can take a break/retirement from admin and enjoy it with the rest of us. Bravo!

[–] [email protected] 7 points 1 year ago

@ernest

Can you break down your costs in a spreadsheet?

Many scaling issues can be solved by throwing money at it - and I think seeing the cost in black and white might help!

[–] [email protected] 7 points 1 year ago

Thanks for the update 👍 💚 ... I like the approach you've taken.

[–] [email protected] 6 points 1 year ago

That must've been quite the ride.

Eagerly awaiting the updates on moderation and project funding. I think it'll be good to be transparent about costs and monetisation. We all know what happened with Reddit in the end.

[–] [email protected] 6 points 1 year ago

Thank you @ernest! Please consider setting up a Patreon, or similar, account so I can donate monthly. I've bought you a few coffees but I'd like it to be automatic.

[–] [email protected] 5 points 1 year ago

I had a feeling that the silence over the last few days was a sign that a huge amount of work was happening behind the scenes. I also think you’re doing an excellent job of communicating with us. Thank you for all your effort that’s allowed this community to grow.

[–] [email protected] 4 points 1 year ago

Welcome aboard, Piotr!

[–] [email protected] 4 points 1 year ago

@ernest your achievements with this piece of software is going to go down in internet history, i hope you know that. you have already written your name into the history books. you deserve congratulations and very sincere thanks.

[–] [email protected] 4 points 1 year ago

You handled this situation beautifully. Very often people don't know when to share responsibility and ask for help and their project dies in critical situations like that.
Well done, have fun with your now very alive and thriving project!

[–] [email protected] 4 points 1 year ago

Thanks for the update, Ernest. Maybe a tracker can be posted on the sidebar to make sure we're supplying you with enough 'coffee' to keep the lights on? A lot of us are loving this platform enough to want to invest in your work and I hope everyone will crowdsource funds to keep you afloat.

[–] [email protected] 3 points 1 year ago

Huge shoutout to you and all of those who have gotten kbin to this point. Super crazy to have seen it go from struggling to a place I can happily and easily browse

[–] [email protected] 3 points 1 year ago

I just want to say that I.. we appreciate all of you and all of the work that you are doing! We are happy to be here!

[–] [email protected] 3 points 1 year ago

Thanks for the hard work ernest!! I'm glad you were able to find some help and take some workload off you.

[–] [email protected] 3 points 1 year ago

Look how far we've come in just a week :)

[–] [email protected] 3 points 1 year ago

I'm glad you are here. Thank you for your work.

[–] [email protected] 3 points 1 year ago

Glad you got help with server administration! Hopefully account migration is a feature that can be implemented, I would be happy to move my account to a less crowded instance, once it/they come to fruition.

[–] [email protected] 3 points 1 year ago

@piotrsikora @ernest Is there an easy way to add all the new communities to an instance? I’ve noticed somehow you’ve been able to add what looks like every magazine, even if it’s newly created.

I could help add new magazines to a new instance others can migrate to, but there’s so many, and I don’t know how to keep up with any new ones created on lemmy or kbin.

[–] [email protected] 3 points 1 year ago

Thanks for your transparency and hard work! Loving the site and looking forward to it getting even better!

load more comments
view more: ‹ prev next ›