305
Image uploads, federation delays, and performance (lemm.ee)
submitted 5 months ago* (last edited 5 months ago) by sunaurus@lemm.ee to c/meta@lemm.ee
41 comments fedilink hide all child comments

Happy new year!

Hi folks! I hope everybody had a good holiday period and I wish you all the best for 2024. I have some quick updates to share about lemm.ee:

Image uploads

Image uploads are now enabled for all lemm.ee users 4 weeks after account creation. The upload size limit is currently set to 500kb.

The 4 week account age requirement is in place to discourage spam and abuse. It is of course not a fool-proof solution, but let's give it a go and see what the results are.

Please note that lemm.ee is not intended to be a image hosting service! Feel free to upload avatars and banners for your profile and communities, but please be aware that we reserve the right to modify the upload limits going forward, as well as delete old images if storage costs become too high.

For image posts and comments, it would still be preferable for you to use an external image hosting service.

Federation delays

Over the holidays, our outgoing federation workers began experiencing some significant delays. I have been working on this problem for the past few days, and after updating to 0.19.1, applying some additional patches to the code, and changing our infrastructure a bit, I believe the issue has been resolved.

The good news is that now that we are on 0.19, problems such as this do not cause Lemmy to completely drop federated activities, as we now retain a persistent queue of federation activities for all linked instances. This means that after the issue was resolved, our federation workers started going through the backlog of likes, comments, and posts which you had made over the past several days, and sending these out to other instances. Essentially, all of your activities did end up reaching their target servers, just with some additional delay.

One quick side-note here, while we are now federating your activities in real-time again to most big instances, there is still a bit of a backlog left on the lemm.ee -> lemmy.world federation (it is a few days behind). I expect this to also catch up by tomorrow.

Performance

The new persistent federation queue is still quite a new feature in Lemmy, so it's a bit rough around the edges - after resolving the federation issues, our federation workers started going through the queue at extreme speed, which caused intense additional load on our database. This was one of the reasons for some performance degradation many of you noticed over the past few days.

Additionally, since updating to 0.19, there have been regular performance issues for many users. I have managed to solve a few of these by making some changes in our infrastructure, but I am also aware of a few more issues which I will continue to monitor and hopefully improve in the near future. Sorry for the inconvenience, I hope that the changes I have made so far will help make it a bit smoother already!

That's all from me for now, as always, feel free to comment if you have any thoughts, and have a nice day!

all 44 comments
sorted by: hot top controversial new old
[-] aniki@lemm.ee 31 points 5 months ago

You're a star!! Thanks for all the hard work you do to keep us entertained and Lemmy working well!

[-] silas@programming.dev 28 points 5 months ago

Thanks a ton!

For those that don’t know, @sunaurus@lemm.ee is a huge contributor to the Lemmy codebase and discussion on GitHub, probably aware of most problems before we are. Silence here likely means our admin is contributing to all of Lemmy or taking a much deserved break

[-] lud@lemm.ee 15 points 5 months ago

He also has an alt he uses, which is understandable.

He could be anyone of us, he could you, he could even be me!

[-] sunaurus@lemm.ee 6 points 5 months ago

"Huge contributor" is definitely over selling it 😃 I try to contribute a bit here and there, especially with things that are relevant for this instance

[-] TWeaK@lemm.ee 3 points 5 months ago

You're being modest. "Here and there" does nothing to credit the significance of what you do. Penicillin is used "here and there".

I'm sure there are other professionals who could do more, just as I'm sure that you aren't 100% focused on lemm.ee (not that you should have to be), but history so far has shown that you're far ahead of the curve in providing a stable platform - one that other instances should aspire to.

[-] sag@lemm.ee 22 points 5 months ago

Thank You for update

[-] Bongles@lemm.ee 16 points 5 months ago

Thanks, happy new year.

[-] RacerX@lemm.ee 14 points 5 months ago

Anyone have any suggestions on lemmy friendly image hosting services?

[-] scytale@lemm.ee 9 points 5 months ago

catbox.moe is pretty good.

[-] silas@programming.dev 9 points 5 months ago* (last edited 5 months ago)

Very important to know that catbox.moe does not strip image metadata from images when you upload. Still a great host though

[-] ech@lemm.ee 3 points 5 months ago* (last edited 5 months ago)

I second the recommend for catbox. No frills or other frivolous "features". Just hosts images and short videos. Easy peasy.

[-] Rentlar@lemmy.ca 5 points 5 months ago

postimg.cc is my host of choice.

[-] perishthethought@lemm.ee 2 points 5 months ago

I use imgflip.com a lot and it's worked very well.

[-] nocturne213@lemm.ee 2 points 5 months ago

I use Imgur still.

[-] Teal@lemm.ee 2 points 5 months ago

I’ve tried file.coffee a few times and so far it’s good for me. I learned about it from a similar question posted a few months ago.

[-] pineapplelover@lemm.ee 1 points 5 months ago

Imgchest is just like imgur

https://imgchest.com/

[-] TheCaconym@hexbear.net 3 points 5 months ago

Opened your link and immediately came across porn

Please CW it

[-] pineapplelover@lemm.ee 2 points 5 months ago

Damn you're right. I never use it to actually browse through stuff. I just use it to upload and share directly to my images. I can't imagine the nsfw stuff other hosting services have to deal with.

[-] ramble81@lemm.ee 11 points 5 months ago

Thank you very much! In the future, what is the best method to constructively notify of issues we see like this?

[-] Microw@lemm.ee 5 points 5 months ago

Yeah, it would be good to know whether we should Post reports about Problems to !meta@lemm.ee or !support@lemm.ee or elsewhere

[-] sunaurus@lemm.ee 2 points 5 months ago

!support@lemm.ee is the preferred place to report technical issues related to this instance

[-] BarrelAgedBoredom@lemm.ee 8 points 5 months ago

Thank you for your hard work!

[-] Nugget@lemm.ee 7 points 5 months ago

Thanks for the effort, and happy holidays!

[-] Matt_Glan@lemm.ee 7 points 5 months ago

Thank you for everything you do. Have a great new year and 2024

[-] dditty@lemm.ee 7 points 5 months ago

What is the correct way to embed images inline so they display?

[-] silas@programming.dev 6 points 5 months ago

You can use a service like PostImage to upload your photo, then copy the direct link after uploading and paste it into your comment or post like this:

![](https://i.postimg.cc/wBGJPy0J/IMG-6968.jpg)

[-] JakenVeina@lemm.ee 7 points 5 months ago

Thank you for your time and effort. Best instance earns its status yet again. Happy New Year.

[-] Teal@lemm.ee 7 points 5 months ago

Happy New Year! 🥳

Great update. Thanks for your continued dedication and support.

[-] hellequin67@lemm.ee 6 points 5 months ago

Great news, looks like performance is way better. Awesome work, thanks so much.

[-] ech@lemm.ee 6 points 5 months ago

Thanks for the update and the work on fixing these issues!

[-] Thordros@hexbear.net 6 points 5 months ago

I'm very happy to hear that your upgrade was a huge success. Cheers to a new year!

[-] NoneYa@lemm.ee 5 points 5 months ago

That’s awesome news, thank you! I know it must have been a challenge with the holidays, but it’s much appreciated.

[-] abbadon420@lemm.ee 5 points 5 months ago

Awesome! Immediately noticed it, because I got some responses to some "older" posts. You're the best!

[-] scytale@lemm.ee 5 points 5 months ago

Thanks for the update! I was almost ready to create a new account on another instance lol. This is great news and hopefully everything will be up to speed soon.

[-] gregorum@lemm.ee 4 points 5 months ago

[-] MrZee@lemm.ee 4 points 5 months ago

Thank you!

Out of curiosity, are the 19.0 federation issues actually solved with 19.1? Or are the issues just improved with further fixes in the works?

The story I seemed to be seeing was that 19.1 hadn’t actually fixed (but maybe improved?) federation issues and that another high-priority fix was coming.

[-] sunaurus@lemm.ee 3 points 5 months ago

0.19.1 did not fix everything, but the upcoming 0.19.2 should (and we are already running some 0.19.2 code as a patch on lemm.ee)

[-] TWeaK@lemm.ee 2 points 5 months ago

I'm going to ignore this post and continue to upload to 3rd party hosts. I don't want to drain the resources here any more than necessasry!

[-] PlasterAnalyst@kbin.social 1 points 5 months ago

Happy new year and thank you for hosting!

[-] phourniner@lemm.ee 1 points 5 months ago

Thank you for all your hard work!

this post was submitted on 02 Jan 2024
305 points (99.0% liked)

Meta (lemm.ee)

3473 readers
38 users here now

lemm.ee Meta

This is a community for discussion about this particular Lemmy instance.

News and updates about lemm.ee will be posted here, so if that's something that interests you, make sure to subscribe!

Rules:

If you're a Discord user, you can also join our Discord server: https://discord.gg/XM9nZwUn9K

Discord is only a back-up channel, !meta@lemm.ee will always be the main place for lemm.ee communications.

If you need help with anything, please post in !support instead.

founded 1 year ago
MODERATORS
sunaurus@lemm.ee