A thread to discuss methods of archival and the things you have shared, or would like to share with the world. I consider preservation and sharing equivalent to one another, because creating more copies is the most sure-fire method of preventing something from vanishing. On top of that, bit rot, mold, and all that nasty stuff, is increasingly making a reliance on physical copies downright dangerous. On that note, I recently ripped an OS-tan desktop pet application from a CD-ROM. The cover has english text, but it's obviously Japanese and the files are from 2004. I suspect the CD is a re-release sold at an American convention, that may or may not be official. https://archive.org/details/os-tan-desktoppet.-7z
You should update the IA item description with the context you mentioned, and possibly any other info you can gather (if you reverse image search the cover art you get some hits). Metadata is as important as the item itself, as without metadata people can't find things.
Does anyone know where an archive of Futaba threads could be found? Especially one that contains threads from 2004 to 2005? A massive dump, like in a torrent, would be best. Could something like that be on Perfect Dark? I don't really know where to start.
Interesting find anon, thanks for sharing it. Recently I stumbled upon the topic of iM@S 2's early build. For some reason Hidden Palace says they have the file but it leads to a 404 page. I had to search for the original file name that was also listed on Hidden Palace to find it. Google was the only one able to find it, the other search engines couldn't (strange) https://web.archive.org/web/20231126043654/https://moonsekai.xyz/things/The%20Idolm@ster%202%20(Sep%2014,%202010)%20[TGS%202010]%20[JAP].7z If anyone else who has a IA account and isn't banned can upload it properly I would be grateful. I've been thinking about hosting a web archival service similar to Wayback or Ghostarchive. There's a few art blogs I want to preserve for myself. The longer I dwaddle thinking about what to use the more likely content might disappear...
>>41992 I would upload it, but it's still online and Idol Master is a popular, living franchise, so who knows whether IA would allow it to stay up.
>>41992 There's a Twitter thread with pictures of the iM@S arcade prototype that were left in the final version. TCRF or Lost Media Wiki doesn't have them either: https://ghostarchive.org/archive/ASO6o I hate that the new norm for posting hidden game content finds is to just dump it on Twitter. >>41993 That's understandable, uploading content like that is how I got banned after all.
>>41992 Yeah IA is best for "grey area" content where it's unlikely to draw the ire of copyrighters. This is one of the reasons I'm particularly pissed about their ebook lending thing, why would they intentionally try to draw the attention of publishing giants? If someone wanted they could absolutely torch the IA by just pointing out all the copyrighted materials it caontains, the only reason it exists is because until now it's been obscure enough that no one would put in the money to bring the lawsuit. That said yeah I don't know how prickly idolmaster is about copyright, since it exists as a western franchise as well I'm guessing they might be slightly more attentive, so it's not worth risking especially since it's effectively already backed up by virtuing of being in web archives (albeit not discoverable). You could possibly message the Hidden Palace maintainers and inform them that they should update their dead link though. Ghostarchive is interesting, I didn't know it existed; I'll try to back up things to it as well going forward. > There's a few art blogs I want to preserve for myself With Internet Archive this is actually fairly easy: if your blog has a sitemap.xml, you can copy paste all the links into a google sheet and use IA's google sheets ingestor that they offer. If it doesn't there is a bash script someone made that uses the IA api to crawl a website and trigger uploads. Both work really well as a set/forget thing. Only thing is that occasionally some images don't get backed up if the page uses fancy JS to lazy-load them. >Lost Media Wiki If it's a wiki, can you edit the page to include those screenshots? You could also possibly link to the prototype build from there.
I think https://archive.ph/ is worth mentioning. It's a webpage saver like the Wayback Machine, but it doesn't use any crawlers. Redundancy can't hurt.
>>41996 (should be notaed that this one tends to block access if you use a DNS service that don't forward eDNS info. I think cloudflare dns and google dns might be instances, and in such cases you will get hit with an endless fake-captcha). It also doesn't have any batch api, but on the flipside is able to bypass paywalls, and seems to have a better archiving implementation (it captures the entire webpage after rendering, instead of whatever IA does which tends to break on sites with dynamic image loading).
Anyone else trying to keep their stuff under 1T? I mostly do because buying HDD over 1 terabyte is usually more expensive. But an average anime season weights like 10-20 gigas each... I think I will have to upgrade to 2 terabyte per HDD soon.
>>42018 You can buy 1tb SSDs for like $50, and 2tb SSDs for $100. SATA or M.2. So not really. When it comes to HDDs, I'm of the same opinion as Linus Torvalds. http://web.archive.org/web/20230417004704/https://www.wired.com/2012/10/linus-torvalds-hard-disks/ >'Rotating storage is going the way of the dodo. How do I hate thee, let me count the ways. The latencies of rotational storage are horrendous, and I personally refuse to use a machine that has those nasty platters of spinning rust in them' >"My primary requirement -- since CPUs are fast enough -- has been that the system be really really quiet, and that it has a good SSD in it. If our cat deigns to jump into my lap while I'm working, the loudest noise in the room should be the purring of the cat, not the computer," That was over 10 years ago, and since then, SSDs have gotten far cheaper and more reliable. The standard now is a lifespan of like 700TB of writing. Plus I also can't stand the noise an HDD makes.Post edited on 9th Dec 2023, 10:44am
>>42019 SDDs are worse for archival, they tend to fail more catastrophically. They are also not good for cold/offline backups. SSD endurance / write amplification is generally not an issue though, for a "normal" usage pattern it should last for ~30-40 years. I would not use it as a scratch drive however.
>>41992 I just want to support the thread with a visible post. My "archiving" goes as far as me saving videos that I find myself returning to. If I watch it again and again, I have a little folder of memories. I've been a regular YouTube user for over a decade now, and there's been so many videos I've gone through phases of loving, but I can't remember them all because I moved on, and then forgot about them, so yeah, keeping a personal archive is something I do, but that's about it. I save them on Google Drive for now, but I've recently become aware of the fact that Drive, and all Cloud Storage by extension, is actually not a good option for long-term storage. Just because Google will never die, that doesn't mean your files stored on Drive will never die.
>>42021 >I save them on Google Drive for now https://arstechnica.com/gadgets/2023/12/google-calls-drive-data-loss-fixed-locks-forum-threads-saying-otherwise/ The more likely risk with cloud provider is that one day your account will get randomly suspended for mysterious ToS violation. Maybe one of the videos you archived had a slur, and their automated content detection didn't like it. Or maybe the background music in one of your videos was too similar to a famous anthropomorphic mouse song; banned.
View catalog