DataHoarder

AutoModerator · 5日前

Talk about general topics in our Discussion Thread!

Try out new software that you liked/hated?
Tell us about that $40 2TB MicroSD card from Amazon that's totally not a scam
Come show us how much data you lost since you didn't have backups!

Totally not an attempt to build community rapport.

ThrowAway237s · 9時間前

When I revisit a YouTube video through the URL for the first time in over a year, in the moment I press "Enter" after pasting the URL, I have a sensation that is comparable to flipping a coin.

If I am lucky, the up-facing side of the coin indicates "available", otherwise "unavailable". Even if I happen to have saved it, finding it could be a challenge on its own, but still better than it being memory-holed.

There are so many vulnerable links in the metaphorical chain that keeps YouTube videos from falling into the memory hole. Retroactive policy changes, purges such as the many unlisted videos purged in July 2021, the channel owner's emotions, and deletion accidents.

When the coin has already landed on a side and is still rolling on its edge on the ground, that is when the skeleton screen¹ of the watch page appears. It looks different if a video is unavailable.

On the mobile website, it is also distinctive: the black surface where the video player would appear does not appear first. Instead, a loading animation shows at the top center. Then the black surface appears with the error text showing that the video is unavailable.

The coin toss sensation is stronger on YouTube than other platforms, since no platform has lost as much content as YouTube in my experience. When I revisit a SoundCloud track after long, it has been there over 95% of the times. A tweet, over 80% of the times.

Appendix, for clarity:

¹ Skeleton screens serve a similar function as spinners and other loading animations: a visual cue that the user must wait a bit for content to load.

DanielB1990 · 6時間前

Hello everyone,

Today, a few hours ago Ferdi ( getferdi ) went offline, it's website, twitter, instragram and it's github repo on https://github.com/getferdi/ferdi and https://github.com/getferdi/server all went unavailable.

I was wondering i anyone, by any luck / chance has (actively) mirrored these github repos, that way the app can probably saved and revived.

There are 2 repo's being named in r/getferdi but they either do not contain all the commit history are were already a bit behind, so I'm trying my luck here.

Thanks in advance!

Tibbles_G · 2時間前

So, I’m currently running an R510 running Unraid with 36tb of storage on 12 drives. I’m looking to scale up so I can add additional compute for VMs, Docker contains and such.

I have a 12u rack with 8U of availability.

The long term plan I guess is to move Unraid to a lager enclosure with more drive capacities and internal space for a proper GPU and generally more PCI expandability.

The R510 will be repurposed with probably VMware (I’d like to use Proxmox, but I use VMware in the office and need more familiarity outside of courses) to lab out environments and other nerd stuff.

I’m kind of a stickler for appearance so a lot of the cases I’m seeing I just don’t like. I’d like to get a storinator, but even the quote I got for just the AV15 chassis was still $1600 shipped to the US.

Im not opposed to modding or painting either so any suggestions there could be fun as well. If my question isn’t clear let me know.

alex27riva · 3時間前

Hi everyone, today I shucked 2 WD Elements 10TB external drive.
The disk inside is WD100EDAZ.
I connected both disk to my old PC which I will use as a NAS, but the disks are not spinning and are not even detected by EUFI.
Pic of the drive: https://picbun.com/p/cyT24OB6

Is there any way to fix it?

StickwoodJr · 2時間前

I'm looking at this drive for cold storage and I'm wondering how well it will perform.

RW3Bro · 21時間前

Hi, I'm not sure if this is allowed but I'd like to request an archive of the NYC shooter's YT channel. There's some scary stuff on here and plenty of content to show his state of mind. I have to assume it'll be gone soon and I don't have the storage space to archive myself.

Please DM if you do manage to archive, I can pay in crypto if you'd like. But I think this is important content.

YT Channel: https://www.youtube.com/channel/UCtl9pjnppooRbj_YssCKxsA

Source that it's his: https://heavy.com/news/frank-r-james/

chaseNscores · 18時間前

While I was searching around about fax machines, I found out today about document and book scanners. I live near a library and a light bulb went off. This would help me save money buying copies of books for myself and for family. So searching around I found this site of the LibreFlip: https://libreflip.org/ BUt this site seems to be dead for some time.

I want one that could turn the pages and scan automatically without creating more noise for hours on end. My budget is low so I am not shy about building my own.

Where does a noob like me start with hoarding digital copies of books?

DIY_no0b · 18時間前

Hi, I'm on a PC and I have an SSD for OS and applications (250gb). I also have an SSD that was an older drive that I kept for random storage (120gb). I also have HDD that is used for data.

None of this is backed up and I know I should do something about it right now. I was going to purchase a Samsung T5 portable SSD (2TB) and then back all of that up. I figured, I can back it all up now, and once those drives actually fail, then I will buy a newer model SSD with much higher capacity to replace them, instead of replacing them now.

Is this a good idea? After I purchase this external 2TB SSD, would I just download something like Macrium Reflect, which will give me options to copy the OS drive to a folder and my Data drive to another folder? Is that all it is?

And what happens once my original SSD (250gb) fails? Do I use the new external SSD (2TB) to boot my computer, and use the same program (macrium) to copy the OS to a replacement SSD? And at that point, I guess I'm confused. Now I would have to tell the computer to use the replacement SSD as my new default drive and then have the software continue to backup this one to the external?

Sorry I'm a complete noob at this stuff so if you can walk me through it like a child it would be appreciated!

Glen_Garrett_Gayhart · 13時間前

Hello data hoarders. I have been trying to use wget to download images from Deviantart galleries (I'm aware there are other utilities for this purpose, and if I can't make wget work, I'll probably end up using one of those). I've gotten to the point where I can get wget to connect to Deviantart, and now I've run into a new problem:

Lots of images on Deviantart (most of the ones I want, in fact) are housed under a separate domain, "images-wixmp...wixmp.com". I've successfully managed to get wget to connect to this domain during my recursive sweeps by using something like

-H -Ddeviantart.com,images-wixmp...wixmp.com

in the command line. wget connects successfully, but whenever it tries to get an image from this domain, it gives an error, specifically,

Cannot write to 'imagefilename.jpg' (Bad file descriptor).

Now, I have tried using -O to get around this, (something like '-O StandInFileName.jpg') and -O works great if I individually input one of these wixmp.com urls. It downloads the file, no fuss. The problem comes when I recursively download a bunch of files, all of them end up getting put into the same individual StandInFileName.jpg file.

If I were inserting a list of these wixmp.com urls, I could easily write a simple batch file to rename them all something different ( -O StandInFileName%VARIABLE%.jpg with VARIABLE changing each new time). However, the entire reason I want to use wget is so that I don't have to manually find all these urls, I just want wget to crawl around and do that for me. The problem then (and wget warns of this in the error log) is that if I combine the file renaming function of -O with the recursive crawling function of -r, literally everything gets put into a single file, and I can't get around this by changing the -O standin name, because it's all one instance (if that's the right word?) of wget.

Is there a different way to rename files as wget recursively crawls through a website? Is there some other way to get around this "Cannot write to 'imagefilename.jpg' (Bad file descriptor)." that doesn't involve -O? Something else I'm just missing? Thanks a bunch for any help for a noob!

duckalufagus · 20時間前

It sounds like unlimited storage from Drive may be on its way out in the coming months. Looking for a good cloud service that supports 15+TB at a reasonable price that will work with my Plex server and Rclone. If not Rclone integrated, something with encryption would work too. If theres a way to stick with Drive, that would be a huge plus. I have plenty of HDD storage but Drive was a good way to back up and stream some of my library. Any suggestions?

Winter-Animal · 18時間前

How to upload/copy 3 TB worth of stuff shared on gdrive to personal gdrive. I have the 20$ a month unlimited plan but duck slow comcast with upload speeds at 20 mbps. Is there a cloud pc option with higher upload speeds? Or cloud to cloud transfer?

I tried google codepabs but errors out after 140 GB.

Any advice is appreciated

thejohndeer · 19時間前

Ratio of its Health Status taking under consideration amount of hours it has been working for and Total Host Writes? Is there anything I should be worried about?

https://preview.redd.it/pvx9sp35m7t81.png?width=669&format=png&auto=webp&s=c379dcd54eeda9ffeedd14ddfaac84ec6ea3285e

raspberrypiwithpie · 1日前

Essentially, the problem I'm looking to solve is as follows; we generate a lot of various sized block files, ranging from a couple Gigabytes to several Terabytes. We need to squish these files onto tapes, but the LTO tapes we have can't fit everything, so we have to break it up across multiple tapes.

We need to store all of this data on as few tapes as possible, making the most of the space on each tape so nothing is wasted.

Bacula is on the radar, but at this exact moment, we just need something simple we can plug all this information into, and it will spit out a list of files to put onto one tape. Even if it's just the math or theoretical name behind solving the problem, that would be a massive help, because for some reason it's escaping me.

I'm 100% sure this is a solved problem, but after several hours of looking I can't seem to find exactly what I'm looking for, whether talking about tape libraries or not.

nevivurn · 1日前

Hi, I am considering building a storage server. I plan on storing/running

TrueNAS, probably?
Onsite backups and regular online backups (restic in a jail or similar)
A few hundred torrents
Personal media server (Jellyfin)
Maybe some VMs

As for hardware, I'm thinking of something like:

CPU: Ryzen 5 Pro 4650G (~130 USD) - ECC, integrated graphics, maybe for transcoding, and seems quite cheap.
Mobo: ASRock B550M Pro4 (~100 USD) - ECC, mATX, and has 6 SATA ports.
Memory: Whatever compatible 2x16GB unbuffered ECC memory I can find (~160 USD?)
Case: Fractal Design NODE 804 (~130 USD) - or whatever else that fits & has enough space for future expansion
4x8TB drives in RAIDZ1 for ~24TB storage
PSU, os & boot SSD drive.

Now, some questions:

Do my hardware choices look sane? Should I just buy a prebuilt NAS, go with Intel CPUs, drop ECC, etc.?
Should I look into something other than TrueNAS? I am quite familiar with Linux, but the *BSDs are relatively new to me. Still, I tried out TrueNAS and I read over the FreeBSD handbook, and I think I can deal with it.
If I wanted to add more drives later, assuming RAIDZ1, I would have to buy disks in groups of 4 and also get an HBA since I would be out of SATA ports on the motherboard, right?
Any other general advice before I take the plunge?

edit: shit, fucked up the title.

BeatSheik · 21時間前

I'm a silent hoarder and first time poster. I'm looking to achieve media files of all types such as videos, software, music etc.

Some files will be replaced with newer versions and others will be read only files. My question is which does the biggest cheapest drive work? Will I run into issues with data corruption if I delete older files and replace them too often on SMR vs CMR HDDs?

I'm searching for something I can potentially stream from remotely, have decent durability, huge capacity and has a decent public perception as being reliable enough to last till its upgrade time. I've seen debates among CMR and SMR drives but I'm not sure of that matters in my case. Also wanted to know if shucking may be the best option. I've read many posts/articles but still need a little more insight. Hopefully a more seasoned Data Hoarder can help 💾

mylinuxguy · 21時間前

So... I bought 8 fairly new WD 8TB drives from a guy while back. I have a several hot-swap drive bays.
4 of the drives work fine in these drive bays. They all report ( smart control ) ( all 4 drives report this same info )

Model Family: Western Digital Ultrastar He10/12

Device Model: WDC WD80EZAZ-11TDBA0

Firmware Version: 83.H0A83

but I have 4 additional drives... bought at the same time from the same guy that also say:

WD80EZAZ-11TDBA0

on the white labels but these drives won't power up / be detected in the SAME how-swap drive bays that the working / can be detected - WD80EZAZ-11TDBA0 - drives?

Since my hot-swap bays will power up some of these WD80EZAZ-11TDBA0 drives... I don't think that it's the hot-swap bay or the 3.3v power thing. I have put the drives that don't power up in a bay that did power up a working WD80EZAZ-11TDBA0 drive... I don't think it's the drive bays... I think it's the drive.

Any other things I should look at? Google just says it's a 3.3v power thing and no other alternatives.

Feel sad that I have 4, 8TB drives just sitting on my desk....

Thanks - jack

youmeiknow · 22時間前

My dad's old laptop is running slow and decided to reuse with Proxmox and/or as a backup device. Want to install 500GB SSD. When I look on Amazon there are different types of SSDs and brands. Kind of confused. Would you please recommend the one I can use? And if 500GB is overkill? Also, I want to reuse this hard drive instead of throwing, can it be possible?