Hey everyone! Finished up a recap system for lemmy where you can request your stats for the past year (things like posts made, comments made, top posts for the year, etc.)

Hope you enjoy! Theres a role it assigns you and an image you can copy at the bottom

First happy new year everyone! Thanks a lot for all the work provided by admins and everyone involved in this lemmy instance.

Recently I am blocking all communities from zerobytes.monster instance personally. It just appears to be a ripoff some subreddits.

As there is no way to block all communities from some instance as a programming.dev user and as I feel these communities are mostly spam. I wonder if other people share the same feeling and if programming.dev should block them?

I hope I am asking via the correct channel. I don’t think this should be reported as I might also be in the minority and other people prefer to keeps these communities copied from reddit.

Hey everyone! Thanks for being part of p.d in 2023

Ive been working on some things so figured I would give a little sneak peek into some new things that will be arriving in the next couple months

Lemmy Recap

Originally wanted to get this out before the new year but ended up getting sick so itll likely drop sometime this week. Youll be able to see stats like how many posts you made, how many comments you made, your top post, etc.

Icon & Banner Poll

Once im done with the recap ill be running some polls for what people like more between a new logo I designed and the old one and It would possibly have the icon for the instance switch depending on how the vote goes

Pangora shields.io badges & bot list

Adding some new supporting sites for pangora. There will be custom shields.io badges that can be used to display instance, community, or user stats and a bot list to list the bots that currently exist

Supporting sites

New supporting sites for programming.dev such as an improved status page, a donation page, a team page, etc.

Programming challenges

Im bringing back programming challenges but they'll be mostly ran using a supporting site and will be much less frequent (probably 1 challenge a week)

Lemmy Event: Safe Crackers

Should hopefully be running a new event in february called safe crackers that people in any lemmy instance can participate in

Hope you enjoy the instance in the coming year!

If youre interested in chatting we have both a discord and a matrix community at https://discord.com/invite/kwyxvYEYt4 and https://matrix.to/#/#p.d:matrix.org

If youre interested in helping out with coding various things for the instance such as the supporting sites or a new backend + frontend thats been getting built feel free to let me know and I can add you to the areas for that. Languages used are mostly Javascript, Typescript and Java

Back with another community health check-in to see how communities in the instance are doing

• Lively- 5k users/month or above
• Active - 201-4999 users/month
• Moderate - 51-200 users/month
• Quiet - 11-50 users/month
• Dead - 0-10

Communities

• Lively communities: 1 (1%) (~)
• Active communities: 14 (7%) (+1% from last month)
• Moderate communities: 19 (10%) (-5% from last month)
• Quiet communities: 64 (34%) (+9% from last month)
• Dead communities: 90 (48%) (-4% from last month)
• Total communities: 188 (+11 from last month)

• Active communities increased a bit
• Moderate and dead communities decreased
• The amount of quiet communities increased a bunch

Advent of code

Advent of code was at 136 active users/month before this month started and now its at 839 (as this month was when advent of code occured)

Least active communities

(These are ones that will be prioritized for making active) (theres a lot in the dead category so these are random ones from that, not all of them)

• !perl@programming.dev
• !erlang@programming.dev
• !dart@programming.dev
• !swift@programming.dev
• !graphql@programming.dev
• !lua@programming.dev
• !flutter@programming.dev
• !matlab@programming.dev
• !latex@programming.dev
• !lisp@programming.dev

In the future im going to try to automate these stats so I dont have to do this manually

chat rooms and programming content

The instance has now been upgraded up to 0.19.1 from 0.18.5

Due to some authentication changes you will need to log in again and set up 2fa again if you had it previously enabled (since the 2fa process changed to prevent people locking themselves out)

Code Highlighting

If you make code blocks using the three backticks method the code in it will automatically be highlighted based on the detected language (in lemmy-ui aka the site)

Surrounding in 1 backtick lets you do it inline

E.g.

`console.log("hello world")` becomes console.log("hello world")

```
console.log("hello world")
```

Becomes

console.log("hello world")

The blocks will be light if youre on the light theme and dark if youre on the dark theme

Instance Blocking

This is for lemmy-ui, alt frontends may not have support yet or may be done a different way

Go to your profile settings by hitting your name, then settings in the top right

There should be a blocks section you can switch to. Go to the instances part of that and search for the instance you want to block

Blocking an instance will prevent you from seeing posts from that instance

Scaled sort

When you go to choose a sort while browsing posts you should see an option called scaled. This is hot but takes into account the active users to boost communities that need it. (E.g. a community with 20 active users will be shown more than a community with 10000)

Remote following

You can follow a community while browsing it from the site of another instance. To do this just hit subscribe for the community while not logged in on that other instance and it'll bring up a pop-up where you can enter your instance you want to subscribe from

Https://github.com/LemmyNet/lemmy-ui/pull/1875#issuecomment-1727790414

Hey everyone! Were pushing through the update to 0.19 now that 0.19.1 is out that fixes the issues with it (outbound federation breaking + show read posts not working)

Said in the previous meta post it would be after christmas but due to something that got noticed about 0.18 (not going to specify what since we and a bunch of other instances are still on it) were pushing it through now

Major Changes in 0.19

• Code block support in lemmy-ui (the website) (contributed by programming.dev)
• Activity metrics now includes voters (contributed by programming.dev) (this is how our instance was doing it but now all instances do)
• Reports are now resolved automatically when a post is marked as deleted
• 2FA has been reworked to prevent people getting locked out
• Users can now block instances
• Theres a new scaled sort that can be used (hot sort but takes into account community active users so it boosts low activity communities)
• You can now remote follow instances by browsing on another site and hitting subscribe when not logged in (https://github.com/LemmyNet/lemmy-ui/pull/1875#issuecomment-1727790414)

Theres a bunch of other changes but not relevant to end users or are more minor

NOTE

• If you enabled 2fa you will need to enable it again due to the 2fa changes
• You will need to log in again due to authentication changes

Is there a timeline or anything for upgrading the instance to 0.19? The scaled sort and user level instance filters are really nice.

migrating from r/developersindia.

Hey everyone! Been a bit since the instance has been created (and 0.19 is dropping soon) so figured it was time to update the logo and banner to look a bit nicer

The current logo is made using fira code and the banner is a quick one made by snowe

The banner though tends to not look great when text is overlayed on it in certain apps due to it being text on text and it doesn't stand out that well due to it just being black

Submissions

You can submit new logos or banners below that you think would be good for the instance. After around a week theyll be collected together and then ill run a vote for which ones people like the most

Please only submit stuff you have a proper license to use (either you made it or its something such as CC0)

If you submit something you acknowledge that we can then use that for the instance

Current Icon & Banner

Ill be adding in the current icon and banner into the vote as well when im running that if people like them better than the new options

Other misc things

• Voting will be most likely ranked voting. I can try to create a web page that will handle voting so people can vote by logging into their p.d account and then voting with that
• You can submit as much as you want, just if someone is spamming way to many similar things ill limit the amount that is put in the voting section

📌Ill be pinning this post in the instance for a couple days, then will pin the vote when that happens

Until Lemmy (or an alternate) allows for blocking domains on an account level, please block lemmy.blahaj.zone accounts from posting on programming.dev and sending messages to programming.dev accounts.

Starting up a new monthly post where I look at the communities in the instance to see how well all of them are doing

From this we should be able to see what communities are struggling so that they can be focused on for adding activity across the instance

My goal for december will be increasing the amount of communities that appear in the active and moderate sections and will compare to see the activity change then

For community activity levels im breaking this into 5 categories (note these stats are based on the new users/month stats in the instance)

• Lively- 5k users/month or above
• Active - 201-4999 users/month
• Moderate - 51-200 users/month
• Quiet - 11-50 users/month
• Dead - 0-10

Communities in each category

• Lively communities: 2 (1%)
• Active communities: 11 (6%)
• Moderate communities: 27 (15%)
• Quiet communities: 45 (25%)
• Dead communities: 92 (52%)

Most active communities

• !programmer_humor@programming.dev (7.4k users/month)
• !programming@programming.dev (5.12k)
• !godot@programming.dev (1.37k)
• !linux_memes@programming.dev (1.3k)
• !meta@programming.dev (1.09k)
• !software_gore@programming.dev (1.02k)
• !android@programming.dev (974)
• !rust@programming.dev (816)
• !gamedev@programming.dev (786)
• !linux@programming.dev (782)

Least active communities

(These are ones that will be prioritized for making active) (theres a lot in the dead category so these are random ones from that, not all of them)

• !mongodb@programming.dev
• !erlang@programming.dev
• !emacs@programming.dev
• !nim@programming.dev
• !flutter@programming.dev
• !terraform@programming.dev
• !devlogs@programming.dev
• !astro@programming.dev
• !swift@programming.dev
• !intellij@programming.dev

One other community that should be interesting to see the growth is the advent of code community as that is about to start

!advent_of_code@programming.dev

currently at 136 but I assume thats going to grow much larger

Hey everyone, I just pushed a change that changes how active users/month, etc. is calculated

In Pangora I've swapped this to include both post and comment likes to more accurately reflect activity in addition to the default things it counts (By default it only counts people who have posted a post or a comment but thats not everyone who is active in the community) (Its not counting people who have looked at the community but not voted or posted but its closer than before to getting most activity).

To line the instance up to pangora functionality and since I can do this without needing to touch the code I made it follow how pangora calculates it.

users/day on some community gives a tally of all users that have done one of the following in the past 24 hours in that community:

• posted a post
• posted a comment
• voted on a post
• voted on a comment

The community stats have already been updated and the instance-wide ones should update soon next time it recalculates the stats

(note these stats only show in the instance since each instance calculates their own set of stats for all communities. If youre looking at a community in this instance from another instance the old stats will show. However this also means that communities in other instances when viewed in this instance show the new stats)

This is an instance created as staging environment for voyager, as mentioned here

But looks like it is blocked in programming.dev, because of which I can't access it while being logged in to programming.dev instance.

Hi,

I'm trying to post on: !programming@programming.dev

but it seem stuck

Hey everyone, I just finished up a new bot for the instance called Link

This bot aims to give suggestions for other communities in the instance to post to to start populating the more specific topic communities. It currently is triggered just off of keywords it finds in post titles.

This should help people find other communities after they post to !programming@programming.dev and encourage cross-posting in the instance since thats recommended (and standard lemmy behaviour is to show crossposts as one post in the post feed)

I added some of the communities in the instance and will go through and add in the rest of them shortly

Hey everyone! I added some new taglines to the instance to more than double the amount of them we have. You should see the new ones popping up at the top of the home feed

New taglines were taken from the !quotes@programming.dev community and https://http.cat and were currently up to 96 of them

I will no longer be able to assist with development nor debugging actual issues with the software... Quite juvenile behavior from the devs. It stemmed from this issue where the devs continuously argued in public by opening and closing an issue. Anyway, thought I would keep y'all apprised of the situation, since these are the people maintaining the software you are currently using.

I've noticed that !gamedev_discussion@programming.dev is abandoned and is already a child community of !gamedev@programming.dev which basically serves the same purpose and on average receives only a couple of posts per week.

This got me thinking: we have a process in place to create new communities in !community_request@programming.dev, but is there a process in place to remove abandoned communities?

Over the weekend we had a large intermittent outage, followed up by unplanned maintenance that I had put off for way too long.

Lemmy runs with several different services.

• lemmy-ui (the reactesque frontend)
• lemmy (the rust backend)
• postgres (the data store for operations, comments, posts, etc)
• pictrs (the image data store)

The outage concerns itself with the last one. We always knew we'd eventually need to migrate to an object based store, but Lemmy defaults to file based picture storage and that's what we stuck with up until now. This eventually caused the VPS that programming.dev is running on to seize up, and resulted in the outage over the weekend.

Saturday night I spent several hours testing out the object migration on the beta.programming.dev site in order to validate that it worked. During this time I struggled with some very obtuse ansible errors that I hadn't encountered before and so I was not able to start the migration that night. I delayed until the next morning (thank goodness).

I began work Sunday morning at 10:00 America/Denver time. Initially the migration started off quite well, but was moving incredibly slowly. Looking back on it now, the migration would have taken over 144 hours if I left it to do its thing. I let this run for about an hour before messaging the pictrs dev to understand why logs weren't showing up for the migration (even though objects were showing up in the store). Apparently lemmy-ansible is set to use 0.4.0 of pictrs, which not only is quite old, but doesn't have the ability to run migrations concurrently. There was the issue. I asked the dev is it was possible to stop a migration in the middle of the running, upgrade, and continue. They told me what changes I'd need to make, I made them, did the upgrade, and restarted the migration. It immediately failed. This was the start of my issues.

The server was now too full of data to do anything, including running apt update or apt install to install tools to assist me. I was able to attach more block storage, but I'm not enough of a linux guru to figure out how to mount it where the current pictrs filesystem would be able to take advantage of it. I had to result to copying the entire pictrs filesystem to a fresh ~500gb mount, fixing permissions, and then rerunning the migration from there. By the time I got to this point, it was about 12:30PM. The migration from then on took several hours.

After the migration completed, I needed to deploy the new stack with the correct settings. The ansible script needed to run apt though, and, well, that wouldn't work when the server was still full. At this point I was not confident in the migration and I also hadn't realized that you could do the migration while the site was running (big oversight from me). I therefore wanted to maintain the entire pictrs file store until I proved the object store was working. I created another block storage, copied the entire pictrs directory over to it again (another 20 minutes or so) and then deleted the original directory. I was now able to run the ansible script and deploy the new settings for pictrs, confident that I had a backup available in case something went wrong (this is not the main backup method, the server is backed up externally as well, but I didn't want to have to resort to those during the migration).

That completed the migration, some 5 hours after it originally started.

There were several things that exacerbated the issue that made it take several hours longer than I wanted.

1. I let it go so long before doing the migration to object storage that the server was too full to even perform an apt update. This resulted in me not being able to install tools I needed, along with a host of other issues as mentioned
2. pict-rs was at a very suboptimal version. If it had just been two minor versions newer it would have migrated perfectly fine, in a few hours.
3. my limited knowledge around ansible led me on wild goose chases several times

Things I would change if I had to do it again:

1. Dig in a bit deeper on the concurrency flag in the pictrs docs. It was not present in the original guide I followed (from a lemmy post on another instance), and thus I didn't realize that it wouldn't run with concurrency at all.
2. Don't wait so long so that the server is full
3. Migrate while the server is running. That would have been dumb in this case, since the server wouldn't stay up anyway, and could have caused other issues. But there was no reason to take the server down if it had been stable, and other instances have done so with no problems.

Hey everyone, update on https://programming.dev/post/4613085

We did some changes in the database and it seems like outbound federation is working again. If you run into any more problems with it let us know.

Im pinning this post for around a day to let everyone know since we had the last post pinned for a bit

Any posts or comments made while it was broken still wont be federated but new ones should be. The instance essentially marked all other instances as dead which meant it thought it didn't have to send things to them

Hey everyone. Currently the instance is being affected by a bug that prevents outbound federation. This seems to have started when the instance upgraded to 0.18.5

Im pinning this post in the instance while it is affected by the bug so everyone is aware as this affects everyone in the instance

Theres an open issue on the lemmy github repository and we are attempting to track down why this is happening and fix it

https://github.com/LemmyNet/lemmy/issues/4039

What the bug means is essentially

• We still get all posts and comments around the fediverse like normal (so youll see posts made in other communities populate the feeds like normal)
• Posts and comments made by users in programming.dev are not visible outside programming.dev

Hopefully itll be resolved soon. If anyones able to get some info that would be helpful towards resolving the bug throw it here or in the github issue

For example, I can't upvote or comment on a single thing in this thread https://programming.dev/post/4577853?scrollToComments=true which is from !technology@lemmy.world

Same goes for !linux https://programming.dev/post/4449644?scrollToComments=true

I just made this post https://programming.dev/post/4307457

but it isn't showing up here https://sh.itjust.works/c/speedrun

I had a similar issue on a previous post but I didn't think much of a single failure and fixed that one myself by doing the search

https://programming.dev/post/4295735

but now I see it happening again and with a different instance I think there's something wrong