It's A Digital Disease!

86 readers
1 users here now

This is a sub that aims at bringing data hoarders together to share their passion with like minded people.

founded 1 year ago
MODERATORS
26
 
 
This is an automated archive made by the Lemmit Bot.

The original was posted on /r/datahoarder by /u/DeanbonianTheGreat on 2024-11-04 03:20:53+00:00.

27
 
 
This is an automated archive made by the Lemmit Bot.

The original was posted on /r/datahoarder by /u/KoldKore on 2024-11-03 23:37:03+00:00.

28
 
 
This is an automated archive made by the Lemmit Bot.

The original was posted on /r/datahoarder by /u/ThisIsTenou on 2024-11-03 01:06:13+00:00.


Seeing the post about successful YouTube archiving reminded me that I wanna do the same.

I'd like to run it regularly, like daily, to always fetch the latest videos.

I'd like it to download the highest quality audio and video tracks at all times, regardless of container.

I'd like to always download all the metadata I can possibly get (subtitles, descriptions, thumbnail, ratings, comments if possible).

Bonus points for a format that works well with jellyfin and, if required, the youtube-metadata plugin.

Extra bonus points for somehow adding a tag or info to videos that were downloaded in the past but are now no longer available on YouTube during the regular runs.

Being overwhelmed with all the options available by yt-dlp is what kept me from doing this for so long. I'd love to see what ya'll are using for this.

Cheers!

29
 
 
This is an automated archive made by the Lemmit Bot.

The original was posted on /r/datahoarder by /u/L1011TriStar on 2024-11-03 02:31:09+00:00.

30
 
 
This is an automated archive made by the Lemmit Bot.

The original was posted on /r/datahoarder by /u/dmn002 on 2024-11-02 21:39:05+00:00.

31
 
 
This is an automated archive made by the Lemmit Bot.

The original was posted on /r/datahoarder by /u/stilljustacatinacage on 2024-11-02 19:33:47+00:00.


Came in way "under budget" on the storage footprint from what I was anticipating. I was always putting this off because I didn't want to spend 1-2 TB of storage on it, so I thought I'd swing by just to say that if there's anyone else on the fence about backing up their favorite Youtube content, it isn't as burdensome as you - if you're like me - might think it is.

Just grab yt-dlp, punch in the URL, something like:

yt-dlp https://www.youtube.com/[username]/videos

... and away it goes. You'll want to do this from inside its own folder; it downloads all the videos to the active directory. I didn't bother with much customization, the defaults all work out well enough for me.

I did use Bulk Rename Utility after the fact, to prefix the filenames with the upload date, eg:

 [2021-11-02] Video Name

yt-dlp writes the upload date as the "modified date", so it was simple enough using BRU. I looked briefly, and it looks like there is a way to get yt-dlp to write the upload date itself, but it can't be done after-the-fact and I was already 300 videos deep by the time I thought of it. BRU is easy to understand and worked a treat.

Anyway, that's all. I'm obviously preaching to the choir, but even though I consider myself a somewhat experienced hoarder, I thought this little PSA could be useful if there are any others out there like myself.

Okay bye.

32
 
 
This is an automated archive made by the Lemmit Bot.

The original was posted on /r/datahoarder by /u/volthunter on 2024-11-02 10:04:50+00:00.


Looking at the ai bot army descending on the platform, the removal of core subreddits due to protesting, the removal of key users that have submitted key data due to being banned, the current lawsuit on the internet archive.

If I wanted to save all of reddit, but none of the pictures, only the text, how big would that backup have to be and how would I go about it.

Is it achievable, something that would take up 30 tb I could do but if its something to the tune of 300tb, that is a bit more of an ask.

Hope I can get some advice, not just for me but for anyone that would want to do this.

I truly believe we have about 1 year of good internet left before advertisers, bots and some sort of auto moderator destroys the place.

I'm thinking that the only posts worth saving are above 10 upvotes and with more than 1 comment.

33
 
 
This is an automated archive made by the Lemmit Bot.

The original was posted on /r/datahoarder by /u/Trey_An7722 on 2024-11-02 11:57:36+00:00.


I thought they are a mythical creatures. It turns out they are available, even though Sony appears to be the only source. And sources for lesser models have basicaly shrunk to Ricoh and CMC magnetics ( under various brands).

I also didn't know that triple-layer 100GB disk can also be had as "REwriteable now".

128GB models used to be unobtanium. At most one could grab a Verbatim disk at$40-50, but prices seem to have fallen to $10-ish range now: * BDXL QL 128GB on Amazon

Just a few days ago, this guy went on a quest for checking the BDQL market an playing with discs:

His old materials about M-DISC/BluRay difference WRT archiving might be of interest: * Review, Tested: Verbatim Lifetime Archival (Millenniata/M-Disc) 4x BD-R 25Gb

34
 
 
This is an automated archive made by the Lemmit Bot.

The original was posted on /r/datahoarder by /u/42duckmasks on 2024-11-01 20:58:20+00:00.


Samsung for example only has 4TB and 8TB SSD's πŸ˜•

35
 
 
This is an automated archive made by the Lemmit Bot.

The original was posted on /r/datahoarder by /u/trancekat on 2024-11-01 17:44:45+00:00.


Hi, all.

I have two TrueNAS systems. One primary and one back up.

I just built the back up system and have started to rsync folders over to it, but over GigE, it's taking a looong time. Is there any other way I can transfer data more quickly, please?

Servers are in the basement in different rooms connected to a brocade icx 6450-48p switch. Getting between 70 - 100 MB/second rates, but I'm only on the 13th terabyte.

Any other ways to transfer faster audit buying 10gigE interface cards?

Thank you.

36
 
 
This is an automated archive made by the Lemmit Bot.

The original was posted on /r/datahoarder by /u/KrezanutyPun on 2024-11-01 15:44:05+00:00.

37
 
 
This is an automated archive made by the Lemmit Bot.

The original was posted on /r/datahoarder by /u/screthebag on 2024-11-01 19:10:30+00:00.

38
 
 
This is an automated archive made by the Lemmit Bot.

The original was posted on /r/datahoarder by /u/KyletheAngryAncap on 2024-11-01 17:46:26+00:00.

39
 
 
This is an automated archive made by the Lemmit Bot.

The original was posted on /r/datahoarder by /u/Far-Glove-888 on 2024-11-01 14:04:00+00:00.

40
 
 
This is an automated archive made by the Lemmit Bot.

The original was posted on /r/datahoarder by /u/harrypotterismybible on 2024-11-01 13:33:14+00:00.

41
 
 
This is an automated archive made by the Lemmit Bot.

The original was posted on /r/datahoarder by /u/PkHolm on 2024-10-31 23:32:51+00:00.


Look at this marvel of engineering. It turns up-to 10 SD cards to SATA drive as RAID0. :-)

42
 
 
This is an automated archive made by the Lemmit Bot.

The original was posted on /r/datahoarder by /u/Makinito on 2024-10-31 13:21:38+00:00.

43
 
 
This is an automated archive made by the Lemmit Bot.

The original was posted on /r/datahoarder by /u/joetaxpayer on 2024-10-31 11:03:50+00:00.


I've bought drives from Server Parts Deals (direct, from their web site) , and no issues at all.

Just curious. I happened to see their listing on Amazon, and under their company info, "(Formerly Tech on Tech)". Ok, they changed names. But the phone number listed was a 212 area code, NY, and SPD is a Florida company. I searched on the number and it belongs to Water Panther.

A bit more, and an older Reddit post, "Beware Tech on Tech, Amazon reseller. They are affiliated with / are Water Panther!"

Now, 2 years later, it was on this sub I had learned about Server Parts Deals, and wondering how they have such a good reputation, but Water Panther, still around, is the opposite?

(Edit, yes, I should have changed the title after I saw the older Reddit post)

44
 
 
This is an automated archive made by the Lemmit Bot.

The original was posted on /r/datahoarder by /u/Certifiedfawwaz on 2024-10-30 22:55:39+00:00.

45
 
 
This is an automated archive made by the Lemmit Bot.

The original was posted on /r/datahoarder by /u/randopop21 on 2024-10-30 20:49:28+00:00.


Back in the day (original Seagate Barracudas) they got to very high (damaging) temps just operating on the bench. They needed active cooling (fans).

Do modern large-capacity hard drives need that now?

I recently picked up a couple of 18TB used drives for off-site storage. I was going to run them in USB enclosures with the top of the enclosure removed, effectively having them just sit out in the open. This is to prevent them from overheating inside a USB enclosure, which I've seen unmodified WD Easybooks do. I'm hoping that they can operate indefinitely without active cooling.

46
 
 
This is an automated archive made by the Lemmit Bot.

The original was posted on /r/datahoarder by /u/WakyWayne on 2024-10-30 15:34:14+00:00.


I want to know what is the fastest way to wipe drives, I know that most people recommend writing over the unallocated sectors with things like cipher (windows) and dd (Linux) l have heard people say that strong magnets should be effective enough for data that isn't extremely high risk. Is this true?

47
 
 
This is an automated archive made by the Lemmit Bot.

The original was posted on /r/datahoarder by /u/gabefair on 2024-10-30 15:31:57+00:00.


Hello digital librarians,

As you know, the IA was down for nearly a month. We have lost untold amounts of news and historical information in the meantime. If that bothers you, and you would like to help, this post is for you.

I have created a website that pairs you with a SFW news or culture website that has not been historically preserved for some time. With every visit, you are automatically redirected to the site that is currently the highest priority.

  • By clicking the save button you will have helped preserve a piece of human history in an alternative internet archive. I need lots of people's help as I can't automate this due to captchas.

All you have to do to help is visit and click "SAVE".

(You can close out of the window after it's added to the queue)

Ways you can help, and the code for the project is here:

48
 
 
This is an automated archive made by the Lemmit Bot.

The original was posted on /r/datahoarder by /u/runherd on 2024-10-29 16:49:04+00:00.


Hi,

here in Germany the Seagate ironwolf 12tb is about 120-140 euros for weeks already, much less than any other size (and also much less, like half of what we'd red would be) - any idea why?

49
 
 
This is an automated archive made by the Lemmit Bot.

The original was posted on /r/datahoarder by /u/Minduploadr on 2024-10-29 11:59:27+00:00.

50
 
 
This is an automated archive made by the Lemmit Bot.

The original was posted on /r/datahoarder by /u/hlcalstatefandom on 2024-10-28 22:08:00+00:00.


On Yelp, ServerPartDeals has a couple of one-star reviews, by folks who said that SPD declined their warranty because they had labeled their hard drives, to add warranty dates/info as a note to themselves. Does anyone have any experience with this? I would understand it if the serial number was defaced, but otherwise it seems excessive, and also not mentioned on their warranty page when I reviewed it just now.

"Order several hard drives with a 3 year warranty on Amazon, had a drive go bad within 1 month. Sent the drive for replacement and they will not honor the warranty because I wrote the warranty information on the label. I have not got a response further. I will never do business with this company."

u/serverpartdeals, or anyone else, can you clarify or share experiences? Thanks!

view more: β€Ή prev next β€Ί