Archive for August, 2009

Open-Search-Server, experiences? (open source web crawler) — Question

Was wondering what other’s experiences have been using the open source web crawler, Open Search Server.

http://www.open-search-server.com/

 
Does anyone know of any documentation that exists that details the GUI and what all the configurations, variables, and query parameters mean?

Also, has anyone used the xml api and had success getting data out of the index?

August 1, 2009 at 3:14 pm Leave a comment

Web Craweler Design — Article

Good article on web crawler design.

http://thinkpink.com/bp/WebCrawler/WWW94.html

August 1, 2009 at 9:52 am Leave a comment

View Hidden Website Directories — Tip

Here’s a tip on how- to View Hidden Website Directories

August 1, 2009 at 9:33 am Leave a comment

Writing a Web Crawler in Java — Article

Here’s a great article on how web crawlers work, their benefits, and the different reasons for writing one.

http://java.sun.com/developer/technicalArticles/ThirdParty/WebCrawler/

August 1, 2009 at 9:21 am Leave a comment


Calendar

August 2009
M T W T F S S
« Jul    
 12
3456789
10111213141516
17181920212223
24252627282930
31  

Posts by Month

Posts by Category


Follow

Get every new post delivered to your Inbox.