Hi Spirit,
I wonder if you would consider setting up a CRON job to run ‘ls -laR’ nightly and pipe the results to a file like ls-laR.gz. Perhaps covering the quaddicted.com/files/ directory tree, or more if possible?
I’ve never stopped looking for bot files for the Quake Bot Archive ( https://github.com/Jason2Brownlee/QuakeBotArchive ), and although there are now 215+ bots and 780 bot files in the archive, there are still 500+ files on the wishlist ( https://github.com/Jason2Brownlee/QuakeBotArchive/blob/main/research/wishlist.txt ).
I can’t help but wonder if there are files buried deep in your file archives, not exposed to the google index, that might be invaluable additions.
Going a step further, a script could be used to also pipe the ‘gzip -l’ contents of zip files in your file archive (or equivalent for 7z files), but that might be a step too far.