this post was submitted on 16 Mar 2025
831 points (98.8% liked)

Programmer Humor

21564 readers
2252 users here now

Welcome to Programmer Humor!

This is a place where you can post jokes, memes, humor, etc. related to programming!

For sharing awful code theres also Programming Horror.

Rules

founded 2 years ago
MODERATORS
Feyter@programming.dev
anzo@programming.dev
BurningTurtle@programming.dev
pylapp@programming.dev
831
muskrat's data eng expert's hard drive overheats while processing 60k rows (lemmy.dbzer0.com)
submitted 1 day ago by SchwertImStein@lemmy.dbzer0.com to c/programmer_humor@programming.dev
268 comments fedilink hide all child comments
 
you are viewing a single comment's thread
view the rest of the comments
[–] easily3667@lemmus.org 134 points 20 hours ago (3 children)

60k is laughably, embarrassingly small. It's still sqlite-sized.

[–] morrowind@lemmy.ml 46 points 18 hours ago (3 children)

Sqlite can easily handle millions of rows. Don't sell it short

[–] The_Decryptor@aussie.zone 6 points 15 hours ago (1 children)
[–] morrowind@lemmy.ml 4 points 11 hours ago

Should be enough to hold 60k rows

[–] Korhaka@sopuli.xyz 3 points 16 hours ago

I have an sqlite db that is a few GB in size, game saves using the format. Sadly almost all blob data, would love to play with it if it was a bit more readable

[–] easily3667@lemmus.org 1 points 13 hours ago

I'm not

[–] naught@sh.itjust.works 53 points 19 hours ago (1 children)

i mean its even excel sized depending on how many columns. This is seriously sad and alarming

[–] easily3667@lemmus.org 6 points 12 hours ago* (last edited 12 hours ago) (1 children)

Hey now that's real close to the 65,535 16-bit limit (from 20 years ago)

[–] wise_pancake@lemmy.ca 2 points 12 hours ago

Holy shit if this ids lm issue that’s too funny

[–] Hotzilla@sopuli.xyz 3 points 15 hours ago

60k is single json file