mrmanager

On June 27:th, the https certificate for lemmy.today was supposed to renew itself. Its set up to automatically renew every 3 months, and its been working perfectly since the site was started over 2 years ago.

But this time it failed to do so, due to a syntax error in the web server config that was not noticed until this incident took place.

Its been fixed now but took more than a day unfortunantly. Sincere apologies for the long delay - it was because I was on vacation in Madeira and in the process of travelling home that day.

Life finds a way to kick us in the balls sometimes.

We are now on latest version. We had some downtime related to this. Normally its quick to update, but this time a database update was needed that took quite some time.

It was about 4 months since we had some downtime so not too bad. Hopefully we go another 4 months (or more) until the next one. :)

Sometimes I think people forget how much Lemmy users have incommon, and we just focus on the differences.

Lets look at some introduction letters from users lately who joined this instance:

I'm a technoligist based out of the United States. I want to explore the fediverse protocols, so I'm trying Lemmy and ActivityPub. Also, I jumped off Reddit when they began restricting API access heavily and have been looking for a link-aggregator alternative ever since.

I am an astronomer, nature lover in heart. I am tired of using apps and websites from companies spying on us and owning basically everything. I will be happy to switch from reddit to lemmy. I am curious though how do you know that a bot cannot write such a text.

Great interest in knowledge and competency building through balanced use of technology. I am currently in the process of moving away from the tech giants and their madness.

Reddit sucks now, want a decentralized, not profit driven alternative

I am a concerned citizen of a country run by Nazis and I am trying to escape most social media sites that harvest our data, I have been pointed in this direction by a privacy enthusiast who said this is the land of the free, Or something like that.

I am a longtime (15 years) reddit user, and I am looking for alternatives that are not driven by corporate interests.

We all really want the same thing. I also want the same thing, which is why I run this instance.

You are all part of a growing community of people who dont want the typical social media experience from ad-funded big tech companies who only care about profits. I think thats really cool.

Thanks for being part of Lemmy guys. :)

Hi everyone,

We just had some unexpected downtime due to a disk quickly getting full over night... :/

We will adjust the monitoring to start alerting us earlier for disk space running out so we can actually do something about it.

I took the chance to install the latest OS patches and updates now though since the server was anyway down.

Hope you didnt notice the downtime too much!

Just wanted to say hello to everyone new joining the instance lately. Seems like reddits ideas of introducing paywalled subreddits got a few more people to think twice about using that site.

I just wanted to encourage new users to install a good mobile client for Lemmy. The web interface is OK but the mobile apps really take Lemmy to another level by being much faster and more user friendly.

I personally like Boost for Lemmy and Sync but there are many others to choose from. More are linked in the sidebar.

After you do that, make sure to subscribe to many communities. You see a list under the Communities tab and you can choose to subscribe with a click.

You can also go here and see all communities in the entire lemmy universe:

https://lemmyverse.net/communities

Me and @Buelldozer@lemmy.today are trying to keep the bots and spammers out and it goes pretty well so far.

Hope you like Lemmy more than Reddit, most of us here do.. :)

Hi all,

We were getting several reports of people linking to csam content in the signal groups community. We tried to contact the moderator but no response in several days.

Its difficult to moderate this kind of content. Moderators of a lemmy community cannot be expected to visit each posted group around the clock to make sure it doesnt have csam content. Signal groups can change their content at any time.

So sorry to say, it had to be removed. If you were using it, I hope you find some other way to find new signal groups.

We decided to double the server memory and add more cpu, since we were close to running out sometimes.

So if you notice higher performance, you know what the reason is now. :)

Short post, but just wanted to mention it.

We just deployed the latest version of Lemmy 0.19.2 where the github code includes a possible fix for the outgoing federation issues we have been having.

But lets see before we celebrate. Help us test if outgoing federation seems to work now by making comments, posts and upvotes and see if they appear on other instances.

Of course if the other instances are on Lemmy 0.19.0 or 0.19.1, they could have issues with outgoing federation still until they update.

Release notes for 0.19.2: https://join-lemmy.org/news/2024-01-10_-_Lemmy_Release_v0.19.2_-_More_Federation_Fixes

Please try to comment and post things now, and see if they federate again.

Hopefully you see your activity instantly federated. I have tried making comments both to instances running Lemmy 0.19.1 and 0.18.5 and they all federate like they should.

Hope you have the same experience! 🥳

As you may have read in other threads, this version of Lemmy (0.19.1) seems to have bugs in outgoing federation on some instances.

As a temporary fix, we have added a scheduled restart of Lemmy every hour. It only takes a few seconds to restart, and the big advantage is that your comments and posts are only delayed up to 1 hour before they federate to other instances. You probably wont notice the restart even.

This will be in effect until a bug fix arrives from Lemmy developers, probably after new years sometime.

Thanks for reading and merry x-mas to everyone. :)

Users of lemmy.today are reporting that outgoing federation of posts and comments stopped to work after the update to 0.19.1 about 19 hours ago.

A restart of lemmy software seems to have made it work again for now, but not sure for how long.

In this version its also common with CPU spikes on a regular basis. I assume its the new federation queue that takes more cpu in exchange for being more reliable. But I see a lot of Postgres UPDATE queries that did not occur in previous version. Also sometimes i see ROLLBACK, which I assume should not be happening.

Anyone else has similar issus with 0.19.1?

Relevant thread: https://lemmy.today/post/4382768

Today we spent some time preparing for the big upgrade, by kicking the Lemmy version up to 0.18.5, merging in the latest changes from lemmy-ansible git repository and cleaning up some disk space on the instance.

So tomorrow at 02.00 am Oregon time we will do the update to Lemmy 0.19.

This is 11.00 am CET for people in Europe.

Hopefully all goes well and we come out the other side with a nice new 0.19 version. Its supposed to take about 30 minutes of downtime if there are no issues to solve.

Wish us luck :)

IMPORTANT: You probably need to log out and log in again to be able to post anything since they reworked authentication in this release.