r/LocalLLaMA · · 5 min read

What's the full local AI "doomsday prepper" kit for cold storage? 16-bit safetensors of LLMs (obv), copies/source codes of Llama.cpp, ComfyUI, vLLM, Kobold, LMStudio, etc, macOS, Linux OSes, Windows 10&11, etc, Rufus (including older ones), various VMs, P-E-W's Heretic/Grimoire,…

Mirrored from r/LocalLLaMA for archival readability. Support the source by reading on the original site.

For those who want to be as paranoid and maximally doomsday prepped as possible, I am curious what the most thorough "doomsday kit" is of things to store offline copies of "just in case", to still be able to use local AI if things go truly crazy to a super extreme level.

So far the main categories of things to save that I am aware of have been:

  • 16-bit safetensors of the most important LLM models (not just your current fav GGUF quants)

  • At least one good local diffusion image-gen, video-gen, and edit model (Z Image Turbo/Flux Klein for image, LTX2.3/Wan2.2 for vid, Qwen Image Edit 2511 for edit)

  • Copies (and source codes where applicable) of the various things used to run the local AI models with, so, llama.cpp, vLLM, SGLang, LMStudio, Ollama, Kobold, SillyTavern, ComfyUI, Draw Things, etc

  • Copies of operating systems, so, copies of various macOS (Sequoia, Tahoe, etc), various generations of Windows, and various Linux OSes (Ubuntu, Pop!, Mint, Arch, Debian, etc. I'm a noob who hasn't been using Linux yet, so, I don't know anything about it other than that Ubuntu is the most noob-friendly one and Pop! has some built in stuff for Nvidia cards without having to download or install anything to make the Nvidia cards work or something. Although I've never set up a dedicated GPU before, so I don't even know what that involves anyway. When I say I'm a noob, I mean a really severe noob, just to be clear.)

  • Copies of recent version(s) of Rufus, and also maybe the 3.22 and 2.18 versions (last ones for Windows 7 and Windows XP in the off chance it somehow ends up mattering for whatever reason, they are tiny, so might as well save them too just in case). Never used it before, but I know it is important for flashing an OS onto a computer, from watching youtube vids where people were building a PC or whatever.

  • Virtual Machines like UTM, VMWare Fusion/Workstation, VirtualBox. Don't know anything about this stuff other than that it let's you run a different OS in your comp than your main OS while your comp is running, and also can be useful for security since things can get contained inside it. And that these are the most famous free and/or open source ones or something.

  • P-E-W's heretic/grimoire stuff, for de-censoring models

  • Not sure if there are some other things I might need if I want to be able to do merges or fine-tuning or training, or if llama.cpp already has everything I need for that in it from the ordinary asset downloads and source codes of it I saved from its main github releases page or whatever.

Anyway, I'm curious if there are any other big gaps or blind-spots of potentially useful/important things to have saved offline just in case, besides all this.

I am a pretty huge noob, barely knew how to use a computer prior to 6 months ago (only maybe slightly more computer literate than your avg grandma/etc. Didn't use linux, didn't know how to use terminal/command line stuff, just knew how to visit websites, use a mouse and keyboard to do the most basic things like go on the internet, check emails, and that's about it) and I've been running local AI on a mac so far, so, I don't know anything about GPUs and drivers or other hardware-related things or how any of that stuff works in terms of setting it up or keeping it working or anything.

I guess also, maybe for local AI models there might be some specialty things I'm forgetting about like STT and TTS models, music/audio models, models for doing live avatar stuff (i.e. whatever that stuff is that VTubers use), small OCR things or something, I dunno. That kind of stuff. I don't really know anything about any of that stuff, since I've never used vision or audio or anything like that so far with local AI. So far have just used regular LLM models (Qwen 27b, Gemma 31b, Mistral 24b, Mistral 123b, etc) via LMStudio, and image/video/edit models (Z Image Turbo, LTX2.3, Qwen Image Edit) via Draw Things, on my mac, and that's it so far. So I'm sure there are a few other important models for other types of things that are good to have at least 1 model per other type of "category" of local AI thing/task of various sorts, too, that I should become aware of.

And then, also maybe some other miscellaneous things that aren't AI models, but like, important things to have for the computer itself, just in case (be sure to mention whatever things, even if they seem obvious, I am a huge noob, so might be forgetting some important random things of various sorts). Maybe some drivers or, I dunno, thingies that are important for different types of hardware depending what type of rig you might build? Not sure, I don't know much about how any of that stuff works or what things I might want to have saved in regards to it.


EDIT: Just to clarify, by local AI "Doomsday Prepper" kit, I didn't necessarily mean literally for some actual real world doomsday thing of like a nuclear apocalypse/etc thing physically happening in the actual physical world (although I guess if you want to add in aspects to do with that, that can make it more fun and interesting if you have additional things you want to add in for that type of scenario, by all means, go ahead). But, yea I just meant it as an analogy/metaphor thing for like, an AI software doomsday type of thing where all these things we can download super easily and save on hard drives for now, all somehow becomes much more difficult to download if let's say all the governments suddenly try to ban everything, and ban VPNs and give 50 years prison sentences for torrenting, and so on and so on. To where maybe it's a situation where it's like "fuck... I wish I had downloaded all the main important things to have back when it was still super easy and convenient" and so on. I just am curious if I have all the main things covered or if I'm forgetting a few miscellaneous key things to also be sure to save just in case.

submitted by /u/DeepOrangeSky
[link] [comments]

Discussion (0)

Sign in to join the discussion. Free account, 30 seconds — email code or GitHub.

Sign in →

No comments yet. Sign in and be the first to say something.

More from r/LocalLLaMA