It'd be very easy to do that, but it would take some time to automatize it. Since it would take about as much time to finally change the database scheme to allow for archived records, I'd rather do that because it's more flexible.
The whole thing is about to go through a major clean-up, anyway.
--
Also, it can be used again.
I made a curl module for it, and it is now twice as fast. It also sends a unique User Agent to NS, which Sei suggested to me a long time ago. file_get_contents can't do that, but cURL is more versatile, so now it sends something like
Code:
EndoSpider/2.4pre-alpha rv:10 by ermarian.net (Used by: Ermarian on embassy.ermarian.net)
A problem: It doesn't seem to transmit progress in real-time anymore. Before, you could see what nation it was on because it immediately displayed the nations when it finished. Now it only transmits the page when the scan is complete. I'll try to change that later.
Anyway, the password you got earlier will now work again.
Some features to come in version 3:
- better version-tracking
- improved behavior analysis ("apathetic", "possible invader", "likely to swap", etc)
- archived records (FINALLY)
- better installing process/configuration
- possibly an XML scheme for exporting/importing data to other sites using EndoSpider (Eluvatar suggested this feature for reducing load on the NS server)
- tracking the load put on NS and allowing a "throttle".
But we're getting into daydream territory now. First I'll fix the bugs, then I'll start adding features.