poster RR2003

Slide1: 

Goal: build a decentralized, distributed search engine framework no single point of failure not controlled by any one administration or corporation Design challenge: scalable, robust, and adaptable to changing topic popularity Approach: partition the search space by semantic topic using a hierarchical taxonomy generic topics are higher up, more specific topics are lower Nelson Tang (tang@cs.ucla.edu) and Lixia Zhang (lixia@cs.ucla.edu) http://irl.cs.ucla.edu/IDG/ Future work: measure effects of enhancements: system-wide 'Hot Topics' cache, cross-references, duplicate query detection other trace data: UCLA traffic, more traces needed! I N T E R N E T R E S E A R C H L A B Maintaining the IDG directory: Topical group: sports Topical group: tennis Manager: hockey Manager: golf Manager: tennis Proxy: tennis New York Los Angeles Manager: lessons Manager: players managers use locally-scoped multicast to limit their heartbeats a unicast channel connects the manager and proxy faraway managers use a proxy to maintain a presence in the other scope Associate topics with locations to reduce heartbeat bandwidth: Summary: IDG is framework for dencentralized, distributed search engine semantic taxonomy provides intuitive browsing design addresses scalability, adaptability, and robustness