Hi, I want to share with you the way I figured out to easily archive reddit content with ArchiveTeam Warrior on NixOS. You can set it up fully in nix config!
Okay, first of all, you’ll need to enable docker or podman. I chose podman here:
virtualisation.podman = {
enable = true;
dockerCompat = true;
defaultNetwork.settings.dns_enabled = true;
};
After that, all you have to do is run the docker image! Here’s how I do it with podman:
virtualisation.oci-containers.backend = "podman";
virtualisation.oci-containers.containers = {
archive-team-warrior = {
image = "atdr.meo.ws/archiveteam/reddit-grab";
autoStart = true;
cmd = ["YOUR_USERNAME_HERE_FOR_LEADERBOARD"];
extraOptions = ["--network=host"];
};
};
This doesn’t start the full ArchiveTeam Warrior, but only the reddit grabber. That means you get no website to manage it at port 8001, and it just runs in the background, not disturbing you. I think it’s worth it to add these 14 LOC to your system configuration, to help archive reddit.
I saw another post today about ArchiveTeam Warrior and on a lark started up a Docker container.
But it occurred to me that maybe today isn’t the best day to be archiving things. Right?
With so many subreddits shut down, isn’t ArchiveTeam going to get a whole lot of “this sub is private” messages rather than actual content?
Hopefully the mothership is smart enough to gracefully account for that. Maybe centrally, they keep track of those pages and “reassign” those pages back out to be fetched again after a good number of hours (days?) have passed.