20031014 MonaLisa Legrand

Slide1: 

Iosif Legrand California Institute of Technology

Slide2: 

Distributed Dynamic Services Architecture Hierarchical structure of loosely coupled services which are independent andamp; autonomous entities able to cooperate using a dynamic set of proxies or self describing protocols. They need a dynamic registration and discovery andamp; subscription mechanism For an effective use of distributed resources, these services should provide adaptability and self-organization (aggregation and hierarchical orchestration) Reliable on a large scale network distributed environment Avoid single points of failure Automatic re-activation of components and services Scalable andamp; Flexible for adding dynamically new services and automatically replicate existing ones to cope with time dependent load

Slide3: 

MonALISA Design Considerations Act as a true dynamic service and provide the necessary functionally to be used by any other services that require such information (Jini, interface to WSDL / SOAP) mechanism to dynamically discover all the 'Service Units' remote event notification for changes in the any system lease mechanism for each registered unit

Slide4: 

JINI – Network Services A Service Registers with at least one Lookup Service using the same ID. It provides information about its functionality and the URL addressed from where interested clients may get the dynamic code to use it. The Service must ask each Lookup Service for a lease and periodically renew it. If a Service fails to renew the lease, it is removed form the Lookup Service Directory. When problems are solved, it can re-register. The lease mechanism allows the Lookup Service to keep an up to date directory of services and correctly handle network problems. jar Web Server Publish the 'Interface' jar jar Web Server Publish the 'Interface' jar

Monitoring: Data Collection: 

Monitoring: Data Collection Farm Monitor WEB Server Dynamic Thread Pool SNMP get andamp; walk rsh | ssh remote scripts End-To-End measurements PULL Trap Agent (ucd – snmp) perl Trap Listener PUSH snmp trap Dynamic loading of modules or agents Configuration Control Other tools (Ganglia, MRT…)

Slide6: 

Lookup Service Service Monitor UNIT andamp; Data Handling Farm Monitor Data Cache Service andamp; DB Configuration Control (SSL) Lookup Service Predicates andamp; Agents Monitor Data Stores WEB Service WSDL SOAP Client (other service) Java Discovery Registration Client (other service) Web client data McKoi DB MySQL MDS UDP MySQL Other tools User defined loadable Modules to write /sent data Predicates andamp; Agents

Global Client for Farms and Network Connectivity: 

Global Client for Farms and Network Connectivity

Global Client / Dynamic Discovery: 

Global Client / Dynamic Discovery

Monitoring VRVS Reflectors : 

Monitoring VRVS Reflectors

Pseudo – Clients & Dedicated Repositories: 

Pseudo – Clients andamp; Dedicated Repositories

SUMMARY: 

SUMMARY MonALISA is able to dynamically discover all the 'Service Units' used by a community and through the remote event notification mechanism keeps an update state for the entire system Automatic andamp; secure code update (services and clients) . Dynamic configuration for services. Secure Admin interface. Access to aggregate farm values and all the details for each node Selected real time / historical data for any subscribed listeners Active filter agents to process the data and provided dedicated / customized information to other services or clients. Mobile Agents for decision support and global optimization. Dynamic proxies and WSDL andamp; WAP pages for services. Embedded SNMP support and interfaces with other tools ( LSF, PBS, Ganglia, Hawkeye, IEPM-BW…) Dedicate pseudo-clients for repository, WAP access or decision making units It proved to be a stable and reliable distributed service system. It is currently running at ~60 sites http://monalisa.cacr.caltech.edu