Hello, been a long time since I’ve last been active around the Quake scene, I’m still around but mostly lurking in the background.
As for the topic at hand, I like having a local archive of maps and mods for various games, especially for more niche communities or smaller release output that could potentially be lost to time. However I’ve since been lagging behind to do similar personal archives for bigger titles. Quake is one of those.
Is there a preferable or convenient method for grabbing the current map repository off Quaddicted without 1) tediously doing it one entry at a time or 2) potentially hammering the server/bandwidth too much, which I’m concerned about using this method for large number of files. Honestly, I’m not up to speed concerning methods outside of regular downloads or ftp transfers since I’ve never needed it until now, but perhaps Spirit already has something in mind for achieving a task like this effectively? Otherwise I’m willing to learn suitable options.
Yeah, there is an rsync endpoint for the whole /files/ tree
rsync rsync://www.quaddicted.com:26123/public
The singleplayer maps/mods are physically located in https://www.quaddicted.com/files/by-sha256/ nowadays to avoid filename collisions. All other places of those files (/filebase/, /files/maps/singleplayer/) are just symlinks. So if you want to grab just those:
That directory is ~35GB at the moment. Feel welcome update your clone regularly, this has virtually no impact on the server. In the future this is planned to grow substantially because I want to integrate all kinds of files into the archive.
To get a more usable file tree from it, you could move all the files into one directory, but there will be at least one duplicate filename already and many more in the future.
Booted into Linux for this process and the whole thing was quick and simple, got exactly what I asked for! For convenience I also automated a secondry archive folder by copying over every zip from these subdirectories. That gives me the original sha256 filebase for archival and another directory with loose files to utilise. I assume everything worked out at least, the file count sits around 2000+ zips. I’ll later do some filename comparisons between archives for duplicate filenames and see what my loose folder is missing.
