aronovich

Digital Library Concepts and Status: 

Digital Library Concepts and Status Eddie.Aronovich@cs.tau.ac.il School of computer science Tel-Aviv University

Acknowledgements: 

Acknowledgements Presentation is based on slides from: Roberto Barbera, University of Catania and INFN (EGEE Tutorial Roma, 02.11.2005) Mike Mineter, Concepts of grid computing Fabrizio Gagliardi, EGEE Project Director, CERN, Geneva, Switzerland (Naregi Symposium 2005 – Tokyo) Fabrizio Gagliardi, EGEE Project Director, CERN, Geneva, Switzerland (APAC, 27 September 2005) Guy Warner, NeSC Training Team (An Induction to EGEE for GOSC and the NGS NeSC, 8th December 2004 ) Service Oriented Architecture & Grid Computing by Marc Brooks, The MITRE Corporation Bridging WSRF services and the EGEE middleware, by Pedro Andrade - CERN, Geneva

e-Science: 

e-Science What is e-Science? Collaborative science that is made possible by the sharing across the Internet of resources (data, instruments, computation, people’s expertise...) Often very compute intensive Often very data intensive (both creating new data and accessing very large data collections) – data deluges from new technologies Crosses organisational boundaries Examples….

A good example: Particle Physics : 

A good example: Particle Physics Large amount of data produced in a few places: CERN, FNAL, KEK… Large worldwide organized collaborations (i.e. LHC CERN experiments) of computer-savvy scientists Computing and data management resources distributed world-wide owned and managed by many different entities Large Hadron Collider (LHC) at CERN in Geneva Switzerland: One of the most powerful instruments ever built to investigate matter

Orders of magnitude…: 

Orders of magnitude…

BLAST gridification: 

BLAST gridification UI Computing element Input file Computing element

Example of a Grid application: Breast Cancer Screening (I): 

Example of a Grid application: Breast Cancer Screening (I) Breast Screening Programme: Access to remote distributed data Courtesy of Peter Clarke

Example: Breast Screening (II): 

Example: Breast Screening (II) Courtesy of Peter Clarke Breast Screening Programme in the Grid: Requires ~ Gbit/s flows for remote access Will not be possible without scheduled guaranteed net-services

DL Evolution: 

DL Evolution knowledge management many virtual organizations digital texts repository + centralized catalogue + search service few large institutions 1996 2005 - … user = consumer user = producer&consumer

DLs today: 

DLs today The demand for DLs has recently grown considerably DLs are perceived as a necessary instrument to support communication and collaboration among the members of communities of interest The maintenance and management of a DL requires high investments and specialized personnel, multimedia handling requires high computational resources

DLs today: 

DLs today Many of the organizations that demand the usage of Digital Libraries are small, distributed, and dynamic DLs are often used to support temporary activities: Courses (training courses, technology transfer courses, etc) Exhibitions, Conferences Projects … DL services are required by many application domains: e-Health, e-Learning, e-Government, e-Science Corporate Knowledge Management …

Requirements: 

Requirements Live documents New information objects: Pollution map Table summarizing data from millions of satellite measures Graph reporting an analytical trend of certain information extracted from a vast amount of data

Requirements: 

Requirements The creation and handling of these documents require: Access to many different, large, heterogeneous information sources Use of specialized services High computing power Small virtual dynamic organizations usually do not have the instruments for satisfying these requirements Controlled resources sharing is the only possible solution: Information sources Services Computers and storage Technical staff

Digital Library Objectives: 

Digital Library Objectives Develop a Digital Library Test-bed Infrastructure that will allow members of dynamic virtual research organizations to create on-demand transient digital libraries based on shared computing, storage, multimedia, multi-type content and application resources

Slide15: 

DLCreation service Service C Service B Service A Service D Service E DILIGENT DL infrastructure Consumers Producers

What do we need more ?: 

What do we need more ? Processing power Storage Security aware integrative infrastructure Community aware environment Or what we may call….

EGEE project in 1K words : 

EGEE project in 1K words https://goc.grid-support.ac.uk/gridsite/monitoring/

Key concepts: 

Key concepts Virtual organisation: people and resources collaborating - across admin, organisational boundaries Single sign-on I connect to one machine – some sort of “digital credential” is passed on to any other resource I use, basis of: Authentication: How do I identify myself to a resource without username/password for each resource I use? Authorisation: what can I do? Determined by My membership of VO VO negotiations with resource providers Grid middleware runs on each resource User just perceives “shared resources” with no concern for location or owning organisation

The basis: authentication, authorisation, security: 

The basis: authentication, authorisation, security

Approaches to Security: 1: 

Approaches to Security: 1 The Poor Security House

Approaches to Security: 2: 

Approaches to Security: 2 The Paranoid Security House

Approaches to Security: 3: 

Approaches to Security: 3 The Realistic Security House

Grid security and trust -1: 

Grid security and trust -1 Providers of resources (computers, databases,..) need risks to be controlled: they are asked to trust users they do not know They trust a VO The VO trusts its users User’s need single sign-on: to be able to logon to a machine that can pass the user’s identity to other resources To trust owners of the resources they are using Build middleware on layer providing: Authentication: who wants to use/provide resource Authorisation: what the user is allowed to do Security: reduce vulnerability, e.g. from outside the firewall Non-repudiation: knowing who did what Digital credentials and the “Grid Security Infrastructure” middleware are the basis of production grids

Grid security and trust -2: 

Grid security and trust -2 Currently, achieved by Certification: User’s identity has to be certified by one of the national Certification Authorities (CAs) mutually recognized http://www.gridpma.org/, In IL - https://certificates.iucc.ac.il Resources are also certified by CAs User User joins a VO Digital certificate is basis of AA Identity passed to other resources you use, where it is mapped to a local account – the mapping is maintained by the VO Common agreed policies establish rights for a Virtual Organization to use resources

Grid security and trust -3: 

Grid security and trust -3 Certification and GSI provides Authentication Resource can trust user User can trust the resource provider …. So long as certificates are protected – they are your grid identity A basis for Authorisation so a VO can manage access to resources Resource providers trust the VO The VO trusts the user Mechanism for checking message integrity Messages are passed between machines Public/private key pairs protect message integrity as well as authentication Not (usually) encrypted but message-integrity is checked

Certificate Request: 

Certificate Request Private Key encrypted on local disk Certificate Request Public Key User generates public/private key pair. User send public key to CA along with proof of identity. CA confirms identity, signs certificate and sends back to user. slide based on presentation given by Carl Kesselman at GGF Summer School 2004 Public

Conclusions: 

Conclusions There is a need for DL Grid is a powerful infrastructure for DL Investments in grid projects are growing world-wide We are here to help you to join !

Whos who in EGEE-IL: 

Whos who in EGEE-IL David Horn Michal Finkelman-Reuven Eddie Aronovich NA3 (dissemination) team Vered Kunik Assaf Gotleib SA1 (technical) team Yan Ben-Hamou (TAU) Ofer Wald (OU) Lorne Levinson (WI) Max Kovgan (Technion)

Contacts: 

Contacts The Diligent Project http://diligentproject.org/ Israeli Academic Grid (IAG) http://iag.iucc.ac.il/ EGEE Website http://www.eu-egee.org How to test https://gilda.ct.infn.it