this post was submitted on 06 Jul 2025
270 points (98.9% liked)

Lemmy.ca's Main Community

3564 readers
26 users here now


Welcome to the lemmy.ca/c/main community!

All new users on lemmy.ca are automatically subscribed to this community, so this is the place to read announcements, make suggestions, and chat about the goings-on of lemmy.ca.

For support requests specific to lemmy.ca, you can use !lemmy_ca_support@lemmy.ca.


founded 4 years ago
MODERATORS
 

Hello everyone!

It’s time for another long-overdue update on how Fedecan and our various sites are doing. It’s been just over two years since the great Reddit migration, and in that time we’ve made some solid progress:

Finances

Here’s a look at our bank balance since we began accepting donations:

We’re currently sitting at around $2,900, with a monthly burn of about $200, which gives us roughly a year of runway. We have some additional annual costs (like domain renewals and non-profit registration), but overall we run very lean.

Fedecan still owes:

  • TruckBC: $1,980
  • Shadow (me): $525

These were out-of-pocket hosting and non-profit registration costs from 2023/2024. It’d be great to get those covered, but we want to keep at least a year of operating expenses in reserve.

If you're a regular user and value what we're doing, please consider donating! We have multiple ways to donate, you can find the comparison and donation links on our website: https://fedecan.ca/en/donate

Sh.itjust.works

Nothing major to report here - we’ve all been a bit busy lately, but collaboration is continuing slowly behind the scenes.

Fediverse Growth

We're seeing a healthy volume of posts and communities on lemmy.ca, surging with each Reddit drama:

Infrastructure

Our server is a Dell R7515 with an EPYC 7763, 1 TB ram and 4x 7.68tb nvme data disks, which is hosted in a datacenter in Vancouver, BC.

I spun up victoriametrics + victorialogs a few weeks ago and have been ingesting all of our data, giving us the ability to put together some nice grafana dashboards.

Everything is running great on the infrastructure side of things. Our server is barely working up a sweat and we shouldn't have to worry about scaling for a long time.

Lemmy.ca still comprises almost all of our traffic:

Lemmy.ca

Our over provisioned stack is performing well, handling the occasional lemmy / lemmy-ui dropout:

Similarly the DB is mostly running out of ram:

Our object storage is slowly climbing as expected, but we've got several years of capacity to figure out a long term solution:

I’m also doing some limited analytics on our web logs. As expected, lemmy.world makes up the majority of our federation traffic:

One interesting thing to see from the user-agent data is the breakdown of traffic by the different mobile clients:

The “dart” UA is just a common web library, Thunder reports as this and I suspect other clients do too. If you’re a client developer, please set your user-agent!

Out of the alternative web clients we support, tesseract is the most popular although the overall traffic volume is still low:

We only store 7 days of logs but I’m hoping to get these pulled out into metrics soon, since it would be interesting to track which clients / interfaces people use over time.

Pixelfed.ca

Not much to say on this one, due to using local storage it currently runs on a single VM without redundancy.

Piefed.ca

Piefed runs on a pair of VMs with its own database and object storage backends.

Service Health Response data

Cloudflare

If you want to compare against previous data posts, here’s our same cloudflare graphs for lemmy.ca

As always, feel free to reach out if you have any questions or ideas. Thanks for being a part of the Fediverse!

top 50 comments
sorted by: hot top controversial new old
[–] Shadow@lemmy.ca 18 points 6 days ago (3 children)

As requested, here's some additional info about donation methods / sizes / volume!

@GreyEyedGhost@lemmy.ca @pglpm@lemmy.ca

[–] GreyEyedGhost@lemmy.ca 7 points 6 days ago (1 children)

Thanks, that's quite informative. I take it the Stripe option is new. If those trends continue, it looks like things are currently financially secure, but not necessarily paying things back soon or building much of a reserve for replacement hardware. Hopefully the added awareness gets a few more donors. Given the low costs we're seeing, even $10/year will make a notable difference.

[–] Shadow@lemmy.ca 5 points 6 days ago

No we launched with stripe, but if you look at our site you'll see we don't push it heavily since we pay more fees there.

[–] pglpm@lemmy.ca 2 points 6 days ago (1 children)

PS: are the recurring ones per month or per year?

[–] Shadow@lemmy.ca 3 points 6 days ago

Monthly. There were a couple yearly that I just normalized down to monthly.

[–] pglpm@lemmy.ca 2 points 6 days ago (1 children)

Thank you so much! If I understand correctly it's around 80 donors, counting recurring and one-time together?

[–] Shadow@lemmy.ca 3 points 6 days ago
[–] sam@lemmy.ca 1 points 2 minutes ago

Any thoughts on adding Liberapay as a donation provider? It would allow you to use Stripe as a recurring platform.

[–] GrackleBirb@lemmy.ca 4 points 2 days ago

Thank you so much for your transparency and for encouraging this community. Will be happy to do my part by engaging in meaninful conversation, posting quality content, and will make a donation.

...and to be clear, try to minimize the arguments I find myself in but hey can't promise 99.99 uptime on that one ;)

[–] altasshet@lemmy.ca 3 points 3 days ago

Finally got off my ass to donate. Thanks for all you're doing!

[–] Album@lemmy.ca 11 points 4 days ago (1 children)

How did we get so lucky as to get a competent team willing to put in this much work...thanks so much, really.

[–] cyberpunk007@lemmy.ca 2 points 4 days ago

My thoughts exactly, thank you!

[–] cyberpunk007@lemmy.ca 3 points 4 days ago (1 children)

I have some questions 😄. What's being used for operating systems and are these just connected straight to the internet with 1:1 NATs, or is there most balancing or firewalls involved?

What kind of virtualization technology is being used?

Are all these hosted on the same physical server?

[–] Shadow@lemmy.ca 2 points 4 days ago (1 children)

Single physical host running proxmox. Mix of Ubuntu vms and lxc depending how much I trust the app and if I need direct access to the underlying zfs.

Opnsense + haproxy in front, nothing connected directly.

[–] cyberpunk007@lemmy.ca 2 points 3 days ago

♥️ opnsense and zfs

[–] troyunrau@lemmy.ca 24 points 6 days ago* (last edited 6 days ago) (2 children)

Request for info to be added to fundraising page: which fundraising payment options are processed by American companies. If they're taking fees, I'd like those fees to go to Canadian firms.

Fuck it, sending an e-transfer. ;)

E: sent $100. The equivalent of two one-year reddit subscriptions. I cancelled my subscription to move over here. Good luck with the fundraising :)

[–] Shadow@lemmy.ca 15 points 6 days ago

Good idea, they all do except interac since everything routes through stripe. It's absurd the amount of transaction data they get. Thanks!

[–] k0e3@lemmy.ca 5 points 6 days ago (1 children)

There's a reddit subscription? Whatever for??

[–] troyunrau@lemmy.ca 13 points 6 days ago (1 children)

Before the enshittification took root, reddit was where I interacted the most with people online. You could buy a subscription to get an ad-free experience. It came with a bunch of Reddit gold you could hand out. Basically, help pay for server time, and get an ad-free experience without adblocking.

The amount of time I spent on Reddit I would compare to a Netflix subscription or similar.

In the ramp up to their IPO when they started to fuck with everything, my goodwill evaporated. I stopped moderating and abandoned my subs. Whenever I had new content I wanted to post, I instead post to the fediverse. So, there ya go 😅

[–] k0e3@lemmy.ca 5 points 6 days ago (1 children)

Thanks for taking the time to answer!

And wow, you mod a bunch of communities here. I just joined a few of them that piqued my interest! I've been meaning to learn how to play DnD with my kids.

[–] troyunrau@lemmy.ca 3 points 6 days ago (1 children)

I actually locked the D&D community on lemmy.ca that I created once the ttrpg.network D&D community took off. I recommend that one. I could reactive the lemmy.ca if someone went sideways with that instance.

I also recommend the lemmyverse.net website for finding communities to subscribe to. Copy and paste the community name -- should look something like !dndnext@ttrpg.network -- into the search box and then subscribe.

Also, try to subscribe to communities that aren't on lemmy.world, even if one exists on lemmy.world. Let's avoid putting all of our eggs in one basket ;)

[–] k0e3@lemmy.ca 4 points 6 days ago

Thanks again for the great advice!

[–] BedSharkPal@lemmy.ca 9 points 6 days ago

Appreciate you sharing the data like this. It's cool to peek behind the curtain!

[–] dimeslime@lemmy.ca 2 points 5 days ago (1 children)

I need to show people I work with how little hardware you can use to serve this much traffic. We do around 500/second but our monthly EC2 spend is horrendous for the scale of traffic we get. But rails is what it is...

I think you have it all covered, but are there ways people can contribute with time? I'm mostly k8s focused these days though.

[–] Shadow@lemmy.ca 2 points 4 days ago

Not really, the tech is stable and I honestly put very little time into it. Occasionally I get bored and do something like make dashboards, but ongoing maintenance is just the occasional software update.

I'd like to move it all to k8s at some point, but it's a really low priority. Probably doesn't make sense until we start scaling to multiple machines.

[–] slym@lemmy.ca 8 points 6 days ago

Thank you for keeping this instance alive, Also nice transparency very appreciated

[–] Goodtoknow@lemmy.ca 6 points 6 days ago (1 children)

Is there any regular offsite backup of data?

[–] Shadow@lemmy.ca 6 points 6 days ago

Yes, shipped to a server at my house.

[–] Sunshine@lemmy.ca 37 points 1 week ago

That's really cool that admins can tell which clients folks are using, that would be very helpful for developers to gauge user satisfaction.

[–] MystikIncarnate@lemmy.ca 31 points 1 week ago (2 children)

I'm a sysadmin by day and.... Only one host? And it needs 1TB of RAM? Seems excessive. Probably not though. IDK how optimized Lemmy is.

There's a lot I could say here but I'll limit myself to this: the proof is in the pudding. Lemmy.ca is working well. You all should be very proud of what you've done.

[–] tempest@lemmy.ca 18 points 1 week ago

It doesn't need it. That hardware is just what was available.

https://lemmy.ca/post/37453471

[–] Shadow@lemmy.ca 12 points 1 week ago (1 children)

Two hosts would cost more in colo fees and we don't need the resources. The redundancy would be nice, but this is enterprise grade hardware covered under Dell prosupport. I also have an identical box running my home systems, so I could steal parts temporarily if we had an issue.

Yeah the ram is just what the hosts came with. It's way more than we need and so everything is very over provisioned.

[–] MystikIncarnate@lemmy.ca 4 points 6 days ago

All fair. I'm not trying to say you're doing it wrong at all, quite the opposite.

And yes, redundancy is nice, but it really depends on the importance of the data on the system and the budget.

To be blunt: if Lemmy.ca goes down for any length of time, that would suck for everyone here, but nobody will die, there won't be any loss of profits or whatever... In business talk, the risk of what could be lost due to an outage is less than the cost of the hardware to prevent an outage.

I understand your position and an in warranty Dell server system isn't cheap.

What you're currently going is clearly working. So I don't have any complaints.

[–] mintiefresh@piefed.ca 29 points 1 week ago* (last edited 1 week ago)

I joined lemmy.ca about 2 years ago... right around the time you guys took it over. It's been such an awesome ride and now there's even a piefed.ca instance to start a new journey with.

Thank you for everything you guys do and providing us with a way to build community and share and comment.

[–] avidamoeba@lemmy.ca 16 points 1 week ago

Sent you something in addition to the recurring to help with that repaying. ☺️

[–] Panties@lemmy.ca 16 points 1 week ago

Thank you! I got here at the great Reddit migration, all this time lemmy.ca has been extremely reliable. I've had a great time. Just want to say I appreciate the time, knowledge and effort you put in it.

[–] BurgerBaron@piefed.social 13 points 1 week ago (1 children)

I tried piefed.ca but it was pretty broken. Importing filter blocks will cause internal server errors and fail every time. Some communities including the emulation community I moderate on sh.itjust.works show up blank except stickies. Constant random connection errors similar to lemmynfsw.

[–] Shadow@lemmy.ca 15 points 1 week ago (3 children)

Was this recently? I just pulled in some more fixes a few hours ago. It's still under very active development.

[–] BurgerBaron@piefed.social 5 points 1 week ago* (last edited 1 week ago)

No a couple weeks back now. I made this account last month before I realized .ca existed. None of these issues were present on .social. That's more accurate on the timeline now, edited for bad memory.

I might return to .ca later once it's more mature, kept the account. I'll check to see if anything changed later after work :)

[–] BurgerBaron@piefed.social 5 points 1 week ago* (last edited 1 week ago)

Turns out I'm suddenly not busy now. Saw your reply over there but I'll just follow up here.

Importing works now!

My community is still blank. I checked to make sure I didn't fat thumb selecting a language in my profile settings or a block but I don't see anything weird. :s

Edit: oh right another thing I noticed was if my piefed.ca account replies to a sticky there it's not federated, or I can't see it on my other accounts anyways.

[–] MelonYellow@piefed.ca 4 points 1 week ago* (last edited 1 week ago) (1 children)

Hello Shadow! Just chiming in that import settings is also broken for me. The json file is about 35 kb or so. It just tells me ‘this might take a few minutes’ but nothing imports. I tried a few times yesterday and again just now. It works for my Piefed.social account though.

As always, thanks for all you do. :)

[–] Shadow@lemmy.ca 4 points 1 week ago (1 children)

Willing to email me your file so I can try? Shadow@lemmy.ca

[–] MelonYellow@piefed.ca 2 points 4 days ago

Sorry for the late reply! I’ve been on my main and forgot I made this comment using the Piefed acc lol. I just tried importing again and it worked! Thank you for following up anyways. :)

[–] pglpm@lemmy.ca 11 points 1 week ago (5 children)

Thank you for the great job! 🙏 🚀

Let me ask two explicit questions:

  • Considering costs and total number of users, how much should be a user's monthly donation to keep things even or a little on the safe side?

  • Considering costs and total number of donators, how much should be a donator's monthly donation to keep things even or a little on the safe side? This is a more realistic estimate, as there are users (say, students) who can't pay (and of course users who simply don't want to pay).

Many Fediverse initiatives seem too shy to give this kind of information, but I think there's nothing wrong about it. Please tell us in time if the economy were to be going bad, nobody wants another lemm.ee event :) As Impossible Mission for the Commodore 64 used to say:

Stay awhile, stay forever!

[–] Shadow@lemmy.ca 9 points 1 week ago

I have no problem sharing anonymized info for things like this, it's just difficult to pull.

We accept donations a few different ways, they can be one time or recurring, we don't know who people are , and we often get paid weeks after they happen once it gets reconciled by stripe.

Let me see what I can do.

Re: Lem.ee that's kinda a different problem. They weren't financial issues afaik, but admin burnout. I don't think that's a concern on our side at this time.

[–] howrar@lemmy.ca 8 points 1 week ago* (last edited 1 week ago) (1 children)

We can get a rough estimate for your first question with the information we have. They've shared that it costs them about $200/month, and we can see from the sidebar that we have 3k users per 6 months (estimate for number of active users). That means approximately 7c/month per user.

[–] pglpm@lemmy.ca 7 points 1 week ago

Cheers! Then it'd be quite cheap if every user gave their 10c/month. Let's see what they say about actual donor-users.

load more comments (3 replies)
[–] Blaze@lemmy.dbzer0.com 8 points 1 week ago

Thank you for the update!

load more comments
view more: next ›