TulipTools Internet Business Owners and Online Sellers Community

Full Version: Attack of the Spiders
You're currently viewing a stripped down version of our content. View the full version with proper formatting.
Pages: 1 2
[quote author=bargainbloodhound link=topic=162.msg903#msg903 date=1124709261]
[quote author=jezebel link=topic=162.msg884#msg884 date=1124665984]
Did you move the databases?    Toothy10
[/quote]

Not yet.  :-[  but we have an excuse.  Big Grin  We just finished changing the backend of the metasearch engine (the spider) so its now a command line C program instead of being PHP based.  The part the user sees is still written in PHP.  We just put it into service early Saturday and now we're playing with the timing of the searches so it could be a while before we move the databases.  So far the move to C seems to be helping cut down on the server load...we're still getting hit hard when certain spiders visit (and decide they'd like to use the related search terms that are returned to index the whole friggin'  Internet  :Smile  Angryfire ) but not as hard as before.
[/quote]

Seems to be working.  No more gazillion minute waits for this board to load.  Laughing7
Pages: 1 2