datahoarder

6756 readers

4 users here now

Who are we?

We are digital librarians. Among us are represented the various reasons to keep data -- legal requirements, competitive requirements, uncertainty of permanence of cloud services, distaste for transmitting your data externally (e.g. government or corporate espionage), cultural and familial archivists, internet collapse preppers, and people who do it themselves so they're sure it's done right. Everyone has their reasons for curating the data they have decided to keep (either forever or For A Damn Long Time). Along the way we have sought out like-minded individuals to exchange strategies, war stories, and cautionary tales of failures.

We are one. We are legion. And we're trying really hard not to forget.

-- 5-4-3-2-1-bang from this thread

founded 4 years ago

MODERATORS

archivist@lemmy.ml

Where do you suggest newbies begin? (programming.dev)

submitted 3 weeks ago* (last edited 3 weeks ago) by andioop@programming.dev to c/datahoarder@lemmy.ml

8 comments fedilink hide all child comments

I did try to read the sidebar resources on https://www.reddit.com/r/DataHoarder/. They're pretty overwhelming, and seem aimed at people who come in knowing all the terminology already. Is there somewhere you suggest newbies start to learn all this stuff in the first place other than those sidebar resources, or should I just suck it up and truck through the sidebar?

EDIT: At the very least, my goal is to have a 3-2-1 backup of important family photos/videos and documents, as well as my own personal documents that I deem important. I will be adding files to this system at least every 3 months that I would like incorporated into the backup. I would like to validate that everything copied over and that the files are the same when I do that, and that nothing has gotten corrupted. I want to back things up from both a Mac and a Windows (which will become a Linux soon, but I want to back up my files on the Windows machine before I try to switch to Linux in case I bungle it), if that has any impact. I do have a plan for this already, so I suppose what I really want is learning resources that don't expect me to be a computer expert with 100TB of stuff already hoarded.

top 8 comments

sorted by: hot top controversial new old

[–] pineapple@lemmy.ml 2 points 1 day ago

I feel like a 321 backup is kind of inhibitory specifically 2 different mediums. Hard disks are by far the cheapest and it seams a bit excessive storing your entire database on Ssd's or something like that.

[–] herrcaptain@lemmy.ca 9 points 3 weeks ago* (last edited 3 weeks ago) (1 children)

I'd start by deciding what your goals are, so you know what to work towards in terms of hardware, software, and processes. Once you've got some sort of an idea, explore ways to accomplish it and post your questions in this community. It can be super overwhelming to get started, but the research and problem-solving is half the fun.

[–] andioop@programming.dev 2 points 3 weeks ago

Edited post with goal, I suppose I'm looking for learning resources.

[–] Kissaki@beehaw.org 5 points 3 weeks ago (1 children)

Start by hoarding your own data, on your own, existing devices/hardware.

Consider how to categorize or not your data.

[–] andioop@programming.dev 2 points 3 weeks ago

Aside from proper backups (I have cloud and local) I've actually been doing this for a while albeit in a pretty rudimentary fashion. I'm pretty happy with my existing categorization. I am looking to make it more robust than a copy on an external hard drive + YouTube for big videos/a cloud storage service, especially since I have hit the point where I need to get myself some more storage.

[–] akilou@sh.itjust.works 3 points 3 weeks ago (1 children)

What are you trying to accomplish?

[–] andioop@programming.dev 2 points 3 weeks ago

Edited post with goal, I suppose I'm just looking for information aimed at new people

[–] jlow@beehaw.org 1 points 2 weeks ago

I don't know about any newbie friendly resources, would be interested in that as well. I guess most datahoarders are also selfhosters, so I'd to look into that as well. Start small, get a smalll cheap, used computer, maybe with an external drive. Check out some docker(-compose) tutorials.

As for data corruption this is something I thought about recently as well. I have not seen a good solution, someone said ZFS with redundancy will autocorrect bitrot. Not sure if this is even possible (or practical) on a computer (can you have the redundancy in another pool partition?)