Search software

[FiberGuy]

Hey boardies!

Anyone know of software which the user can punch in keywords and it will search pre-selected web sites?

IE:

search for keyword "vintage fabric" at sites aaa.com, bbb.com, ccc.com, etc.

Does such an animal exist?

I do use Google's site search, but the problem is that it can only search the sites that are in the index, which can be weeks, sometimes months old.

[jezebel]

Compete Search Analytics is close to what you want

http://searchanalytics.compete.com/keyword_destination/

The Keyword Destination tool helps you understand what sites are benefiting the most from keyword phrases of interest. The tool helps you understand which sites are drawing the most traffic from each keyword phrase and how important different phrases are to each site for generating high quality traffic.

How do I use the tool? Simply enter a phrase into the input box, select "Broad Match" or "Exact Match" and then click the "Go!" button. Your report will generate in the table below.

http://searchanalytics.compete.com/site_referrals/

The Site Referral tool helps you understand what keywords are driving traffic to specific websites or categories. The tool highlights the most popular terms for your competitors and the market you're interested in, and the quality of the traffic websites generate from their search referrals.

[FiberGuy]

Thanks, jezebel, but it's not quite what I'm after.  Basically, the program would be a combination of GSiteCrawler (or a likeness) and a search platform of sorts.

As I mentioned above, I'm just not sure such a program exists.

[FiberGuy]

Maybe it would be simpler to explain if I fully stated what I'm after:

I go to live auctions/estate sales.  Auctioneers post sale bills on their web site.  I have some 200 auctioneer's sites bookmarked.  How could I search every site short of going to each one?

Google's "custom search engine" is nice, but indexing can be slow and auctioneers are notorious for waiting until the last week or two before an auction to post a sale bill and by the time G indexes them, the sale is long over.

[regic]

Setup a search engine on your site.

Sphider should work.  It's free  and will work on a Windows  server.

Allows spidering only the urls matching (or not matching) certain keywords or regular expressions.

http://www.sphider.eu/about.php

Orca search is another free one:
http://www.greywyvern.com/orca#sear

There's more here: http://www.hotscripts.com/PHP/Scripts_an...index.html

[FiberGuy]

[quote author=regic link=topic=17639.msg68851#msg68851 date=1207086641]
It's free  and will work on a Windows  server.[/quote]

Heyyy... I'm on a Linux server now, hon! 

I'll have a look at some of the programs you listed.  Ideally, the program would be stand alone and not sever based... but I'll see if I can work with something there. 

TANX!