Announcements

238 readers

1 users here now

Announcements about system updates or other things related to this instance.

founded 1 year ago

MODERATORS

mrmanager

Lemmy.today had its first unexpected downtime today (self.announcements)

submitted 1 year ago by mrmanager to c/announcements

12 comments fedilink hide all child comments

Hi all,

The disk on the instance ran out of space today, due to the way Lemmy software caches images from all other instances. That cache had filled up about 60 GB's of disk, despite us being a small instance with very little local activity.

I had to delete the last 10 days of cached images again, and I plan to delete quite a lot of older cached images as well. The mobile apps seems to not be affected by this (they have a local image cache I believe), but on the web site, this leads to missing thumbnail images.

They are working on a fix for this in the Lemmy software so the disks dont fill up so enormously with cached thumbnails, and as soon as its out, we will install it here.

Hope you guys didnt get too annoyed or sad by the instance being unavailable for a while.

you are viewing a single comment's thread
view the rest of the comments

[–] Buelldozer 1 points 1 year ago* (last edited 1 year ago) (5 children)

Thanks for fixing, I was wondering WTF was going on because this instance hasn't had any unexpected downtime since I joined!

I don't know much about how Lemmy works under the hood, I really need to spend some time looking at it, but isn't it possible to set a cron job to check the available free disk and then do a cache purge of the oldest X days of cached images if needed?

Edit: Since I asked the question I took 90 seconds to look and it appears that it possible to make pictrs do this.

[–] mrmanager 4 points 1 year ago

Yeah it was the first downtime we have had since we started! :)

I think it's an excellent idea to make it purge the oldest X days of cached images. I will look at your link and see what I can do. Thank you!

load more comments (4 replies)