globus

The Globus Project: A Status Report: 

The Globus Project: A Status Report Ian Foster Carl Kesselman http://www.globus.org

Why “The Grid”?: 

Why 'The Grid'? New applications based on high-speed coupling of people, computers, databases, instruments, etc. Computer-enhanced instruments Collaborative engineering Browsing of remote datasets Use of remote software Data-intensive computing Very large-scale simulation Large-scale parameter studies

SF-Express: Distributed Interactive Simulation: 

SF-Express: Distributed Interactive Simulation P. Messina et al., Caltech Issues: Resource discovery, scheduling Configuration Multiple comm methods Message passing (MPI) Scalability Fault tolerance NCSA Origin Caltech Exemplar Argonne SP Maui SP '200 GB memory, 100 BIPs'

The Grid: 

The Grid 'Dependable, consistent, pervasive access to [high-end] resources' Dependable: Can provide performance and functionality guarantees Consistent: Uniform interfaces to a wide variety of resources Pervasive: Ability to 'plug in' from anywhere

Technical Challenges: 

Technical Challenges Complex application structures, combining aspects of parallel, multimedia, distributed, collaborative computing Dynamic varying resource characteristics, in time and space Need for high andamp; guaranteed 'end-to-end' performance, despite heterogeneity and lack of global control Interdomain issues of security, policy, payment

The Globus Project: 

The Globus Project Basic research in grid-related technologies Resource management, QoS, networking, storage, security, adaptation, policy, etc. Development of Globus toolkit Core services for grid-enabled tools andamp; applns Construction of large grid testbed: GUSTO Largest grid testbed in terms of sites andamp; apps Application experiments Tele-immersion, distributed computing, etc.

Globus Approach: 

Globus Approach A toolkit and collection of services addressing key technical problems Bag of services model Not a vertically integrated solution Distinguish between local and global services 'IP hourglass' model

Globus Approach: 

Globus Approach Focus on architecture issues Propose set of core services as basic infrastructure Use to construct high-level, domain-specific solutions Design principles Keep participation cost low Enable local control Support for adaptation Diverse global services Core Globus services Local OS A p p l i c a t i o n s

Layered Architecture: 

Layered Architecture Applications Core Services Metacomputing Directory Service GRAM Globus Security Interface Heartbeat Monitor Nexus Gloperf High-level Services and Tools DUROC globusrun MPI Nimrod/G MPI-IO CC++ GlobusView Testbed Status GASS

Core Globus Services: 

Core Globus Services Communication infrastructure (Nexus, IO) Information services (MDS) Network performance monitoring (Gloperf) Process monitoring (HBM) Remote file and executable management (GASS and GEM) Resource management (GRAM) Security (GSI)

Sample of High-Level Services : 

Sample of High-Level Services Communication andamp; I/O libraries MPICH, PAWS, RIO (MPI-IO), PPFS, MOL Parallel languages CC++, HPC++ Collaborative environments CAVERNsoft, ManyWorlds Others MetaNEOS, NetSolve, LSA, AutoPilot, WebFlow

GUSTO Computational Grid Testbed: November 1998: 

GUSTO Computational Grid Testbed: November 1998

Example Application Projects: 

Example Application Projects Real-time, collaborative analysis of data from X-Ray source (and electron microscope) Interactive modeling and data analysis Collaborative engineering ('tele-immersion') CAVERNsoft @ EVL, Metro @ ANL Distributed interactive simulation Record-setting SF-Express simulation Remote visualization and steering for astrophysics Including trans-Atlantic experiments