1
Test upload image (lemmy.blahaj.zone)

Just testing image upload.

[-] supakaity@lemmy.blahaj.zone 18 points 3 months ago

I think it's because a lot of her fans were like "hang on, she's just misunderstood, she's not really transphobic, just doesn't want those fake transes going into women's spaces", and Rowling kept it pretty vague, open for misinterpretation, not really ever able to be pinned down as actually being provably transphobic in the minds of many.

But something happened recently and it tipped her over the edge, from keeping her donations low key and her transphobia aimed at the theoretical "not really a woman 'trans-identified-male' boogeyman-woman" (who doesn't really exist), to outright making open donations to anti-trans groups and attacking real trans women.

All the sudden her supporters are like... Wait, this is not who we thought you meant… Where are these scary men? The ones invading women's spaces that you were talking about?

[-] supakaity@lemmy.blahaj.zone 10 points 3 months ago

Wow, okay that's weird. It's doing it for me too, must be some debugging option

I've been using alexandrite and haven't noticed.

I'll take a look tonight.

[-] supakaity@lemmy.blahaj.zone 12 points 3 months ago

For a desktop client, it actually works pretty nice on mobile too.

[-] supakaity@lemmy.blahaj.zone 13 points 3 months ago

Yeah, you just need to login again and put in your totp code this time. Kinda annoying that it doesn't provide a field for your totp code on the first page.

114
Alternative frontends (lemmy.blahaj.zone)

Hi all our lovely users,

Just a quick post to let you all know that along-side the upgrade to 0.19.3, we've also added a couple of alternate UIs to the Blåhaj lemmy for you.

Obviously the default lemmy-UI at https://lemmy.blahaj.zone still exists and has been updated to 0.19.3 alongside the lemmy server update.

There's also now an Alexandrite UI at https://alx.lemmy.blahaj.zone which is a more modern, smoother UI, written in svelte, by sheodox.

And then for those who are nostalgic for reddit days of yore, and memories of when PHP websites last ruled the earth, there's MLMYM (courtesy of rystaf) at https://mlmym.lemmy.blahaj.zone.

Please enjoy, and I hope the upgrades work well for you.

24
¡La mariposa, muy bonita! (lemmy.blahaj.zone)

Esto es una prueba

46
Testing image upload (lemmy.blahaj.zone)

Test

[-] supakaity@lemmy.blahaj.zone 30 points 9 months ago

Migration has been completed!

115
submitted 9 months ago* (last edited 9 months ago) by supakaity@lemmy.blahaj.zone to c/main@lemmy.blahaj.zone

We're currently in the process of migrating our pict-rs service (the thing responsible for storing media/images/uploads etc) to the new infrastructure.

This involves an additional step of moving our existing file-based storage to object storage, so this process will take a little time.

New images/uploads may not work properly during this migration, however existing images should continue to load. We expect this migration to take about an hour.

[EDIT]

Migration has completed.

685,271 files / 153.38 GB were migrated. Copying to object storage took about 1.5 hours. Starting service back up on new server and debugging took another 30 minutes.

Timeline:

  • Migration started at 2023-10-01 22:43 UTC.
  • [+1h32m] Objects finished uploading to object storage at 2023-10-02T00:15 UTC.
  • [+2h06m] Migration was completed at 2023-10-02 00:46 UTC.
[-] supakaity@lemmy.blahaj.zone 10 points 10 months ago

For transparency and posterity the maintenance log is here: lemmy-2023-09-03

[-] supakaity@lemmy.blahaj.zone 12 points 10 months ago

Lemmy was running a bit slow on the new database due to too few slots in the pool.

I've increased and seems to be keeping up now.

[-] supakaity@lemmy.blahaj.zone 19 points 10 months ago* (last edited 10 months ago)

The maintenance has completed and everything is now running from our new database.

Thanks for your patience while we performed this migration.

blobcat, code

blobhaj, heart

[-] supakaity@lemmy.blahaj.zone 22 points 10 months ago

You are super welcome, lovely.

It brings Ada and I a whole heap of pleasure running these instances and it's largely knowing that we're making a difference to our users, and providing a safe space for you all to grow and flourish that makes it all worth it for us.

blobhaj, hug, tinybla

73
submitted 10 months ago* (last edited 10 months ago) by supakaity@lemmy.blahaj.zone to c/main@lemmy.blahaj.zone

Blåhaj Lemmy will be down for database migration to the new servers in approximately 1.5 hours from now (06:00 UTC).

Downtime is estimated at under an hour.

I will have more details on the maintenance page during the migration and update the status as the migration progresses.

[-] supakaity@lemmy.blahaj.zone 10 points 10 months ago

Oh let me count the ways...

Ada is super smart and knowledgeable across a broad range of topics from physics, astronomy and technology all the way to the subgenus species and origins of varieties of birds.

She's pretty, loving, caring, empathetic. She has a big strong heart.

But the ruthlessness and absolute conviction which comes out whenever she sees something wrong... that is honestly the most awesome thing about her. The way she goes from zero to 100 in under a second, that's her true superpower, and quite something to see.

I'm somewhat enamored, tbh.

[-] supakaity@lemmy.blahaj.zone 69 points 10 months ago

I have been watching my love tie herself in knots over the last several days, having to deal with the drama that has been brought on, trying her best to bring everyone back together.

There's been bad behaviour from both sides, and I'm really disappointed to see that some of the worst of it came from our users, who didn't keep to the moral high ground, disregarded our instance rules and stoopped to levels of behaviour worse than that leveled against them.

There have been accusations against us (or Ada specifically) that we are a safe harbour for bad behaviour and cause harm to trans people through our inaction.

This is perhaps the cruelest accusation they could have leveled at Ada, as she works tirelessly to maintain a safe space for our community, and while I was hoping, for all the effort that she was investing into this issue, that she could make it work despite my own reservations, this last attack on her impeccable morality has made me very angry.

I'm sorry for those that wanted to remain federated, sorry that it came to this, but I am glad it's over now, purely for the mental health of my precious beloved.

2

The server will be briefly down while we install a new updated version of lemmy and restart it.

The maintenance window is 15 minutes, but should be much shorter.

2
State of the shork! (lemmy.blahaj.zone)

So it's been a few days, where are we now?

I also thought given the technical inclination of a lot of our users that you all might be somewhat interested in the what, how and why of our decisions here, so I've included a bit of the more techy side of things in my update.

Bandwidth

So one of the big issues we had was the heavy bandwidth caused by a massive amount of downloaded content (not in terms of storage space, but multiple people downloading the same content).

In terms of bandwidth, we were seeing the top 10 single images resulting in around 600GB+ of downloads in a 24 hour period.

This has been resolved by setting up a frontline caching server at pictrs.blahaj.zone, which is sitting on a small, unlimited 400Mbps connection, running a tiny Caddy cache that is reverse proxying to the actual lemmy server and locally caching the images in a file store on its 10TB drive. The nginx in front of lemmy is 301 redirecting internet facing static image requests to the new caching server.

This one step alone is saving over $1,500/month.

Alternate hosting

The second step is to get away from RDS and our current fixed instance hosting to a stand-alone and self-healing infrastructure. This has been what I've been doing over the last few days, setting up the new servers and configuring the new cluster.

We could be doing this cheaper with a lower cost hosting provider and a less resiliant configuration, but I'm pretty risk averse and I'm comfortable that this will be a safe configuration.

I woudn't normally recommend this setup to anyone hosting a small or single user instance, as it's a bit overkill for us at this stage, but in this case, I have decided to spin up a full production grade kubernetes cluster with a stacked etcd inside a dedicated HA control plane.

We have rented two bigger dedicated servers (64GB, 8 CPU, 2TB RAID 1, 1 GBPS bandwidth) to run our 2 databases (main/standby), redis, etc on. Then a the control plane is running on 3 smaller instances (2GB, 2 CPU each).

All up this new infrastructure will cost around $9.20/day ($275/m).

Current infrastructure

The current AWS infrastructure is still running at full spec and (minus the excess bandwidth charges) is still costing around $50/day ($1500/m).

Migration

Apart from setting up kubernetes, nothing has been migrated yet. This will be next.

The first step will be to get the databases off the AWS infrastucture first, which will be the biggest bang for buck as the RDS is costing around $34/day ($1,000/m)

The second step will be the next biggest machine which is our Hajkey instance at Blåhaj zone, currently costing around $8/day ($240/m).

Then the pictrs installation, and lemmy itself.

And finally everything else will come off and we'll shut the AWS account down.

3

Discussion of the current situation with the Blåhaj instances, and upcoming maintenance.

1
Lemmy updated to v0.18.2 (lemmy.blahaj.zone)

Our lemmy is now running the 0.18.2 release version, which should fix some lingering issues we've been having.

Let @ada or myself know if there's any issues!

1

Hi everyone, I'll begin migrating the lemmy blåhaj database to the new server this morning in about 20 minutes.

Expected duration is about 1 hour for this migration.

There will be a maintenance page up during the migration and I will be updating the status as we go to keep you updated on the process.

Later today I'll also be upgrading the software to the latest release as well.

2

I have a process which copies emojos from the hajkey blahaj.zone site to our lemmy.

Last night (for me) it copied an invalid emojo into the database and it broke lemmy for hours while Ada and I were sleeping.

I've found the issue and fixed it now, so everything should be purring along once again, but for those who were left without the instance to use, I sincerely apologise.

blobcat, sorry

view more: next ›

supakaity

joined 2 years ago
MODERATOR OF