PRAGMA12 Resources

Slide1: 

PRAGMA 12 Resources WG Update

Slide2: 

PRAGMA Grid Testbed 32 Clusters from 29 institutions in 14 countries/regions (+ 7 in preparation) UZurich Switzerland NECTEC ThaiGrid Thailand UoHyd India MIMOS USM Malaysia CUHK HongKong ASGC NCHC Taiwan IOIT-HCM Vietnam AIST OsakaU UTsukuba TITech Japan BII IHPC NGO Singapore MU Australia APAC QUT Australia KISTI Korea JLU China SDSC USA CICESE Mexico UNAM Mexico UCN Chile UChile Chile UMC USA UUtah USA NCSA USA BU USA ASURC Costa Rica BESTGrid New Zealand CNIC GUCAS China AIST SDSC NGO NECTEC ThaiGrid 8 gfarm sites ASGC LZU China CNIC MIMOS

For the New Faces in the Room: 

For the New Faces in the Room Heterogeneous environment Minimal requirements Globus 2, 3, 4 Moving recommendations

New Sites: 

New Sites Recently joint APAC, Australia – myproxy server Binghamton University, USA Also preparing a sensor network application GUCAS – also a GEON node IHPC, Singapore IOIT-HCM, Vietnam NECTEC, Thailand UUtah, USA - CSE-online work has started and on-going Sites are in preparation Chinese University, Hongkong LanZhou Univerisity, China UTsukuba, Japan Queensland University of Technology, Australia Instituto Tecnologico de Costa Rica, Costa Rica Institute for Computing and Informatics Studies (ICIS), Poerto Rico

Other Work Status: 

Other Work Status Myproxy server setup and operational (APAC, Australia) Cross-sites reservation successful (AIST, CNIC, KISTI, MU, NCHC, NCSA, OsakaU, SDSC, UChile) Gfarm deployment Already deployed on AIST, ASGC, CNIC, MIMOS, SDSC, NECTEC, NGO, ThaiGrid First application: Amber (USM, Malaysia) CSE-online interfacing testbed Driven by UUtah, USA; In collaboration with APAC, Australia and ThaiGrid, Thailand PRAGMA CA services Experimental CA operational – has issued certs to 4 testbed sites Production CA server is setup and in final testing Nirmrod portal setup at UCSD, in final testing (UCSD, MU)

Applications and Middleware in Testbed http://goc.pragma-grid.net/applications/default.html: 

Applications and Middleware in Testbed http://goc.pragma-grid.net/applications/default.html Climate simulation Savannah/Nimrod (MU, Australia) MM5/Mpich-Gx (CICESE, Mexico; KISTI, Korea) Quantum-mechanics, quantum-chemistry: TDDFT, QM-MD, FMO/Ninf-G (AIST, Japan) Genomics iGAP/Gfarm/CSF (UCSD, USA; AIST, Japan; JLU, China) HPM: genomics (IOIT-HCM, Vietnam) mpiBlast/Mpich-G2 (ASGC, Taiwan) Organic chemistry Gamess-APBS/Nimrod (UZurich, Switzerland) Molecular simulation Siesta/Nimrod (UZurich, Switzerland; MU, Australia) Amber/Rsh ( USM, Malaysia) Computer Science Load Balancer (VAST-HCM, Vietnam) GriddLeS (MU, Australia)

Growing Data Grid: 

Growing Data Grid Gfarm based Dedicated Storage Nodes All resources can be clients Share Data and Middleware (not yet)

Grid Interoperation Experimentshttp://goc.pragma-grid.net/wiki/index.php/Main_Page#Grid_Inter-operations: 

Grid Interoperation Experiments http://goc.pragma-grid.net/wiki/index.php/Main_Page#Grid_Inter-operations OGF – Grid Interoperation Now (GIN), GIN-OPS continue Savanah fire simulation (PRAGMA - MU, Australia) PRAGMA, TeraGrid, OSG Another application planned by MU, Australia Peer-grid interoperation experiments PRAGMA->TeraGrid (October, 2006 – on-going) PRAGMA member runs application across both grids QM/MD/Ninf-G (AIST, Japan) Manual reservation, 7 sites in PRAGMA, 3 sites in TeraGrid

OSG-PRAGMA Interoperation Experimenthttp://goc.pragma-grid.net/wiki/index.php/OSG-PRAGMA_Grid_Interoperation_Experiments: 

OSG-PRAGMA Interoperation Experiment http://goc.pragma-grid.net/wiki/index.php/OSG-PRAGMA_Grid_Interoperation_Experiments Resources OSG FermilabGrid PRAGMA SDSC, USA NECTEC, Thailand NGO, Singapore ThaiGrid, Thailand Process Jan 4, 2007, identify who and how Coordinator, application drivers, resource supporters Wiki, application, requirements Jan 25, 2007, initial VTC Goals, Q/A exchange Start working Email immediately issues, solutions Weekly status, email, wiki Status Feb 26 - March 1, started application runs successfully A set of jobs are processed on the VO, collected, and updated for the next iteration. Learned Differences in grid environment effect users and applications Job submission Change RSL parameter Remove inter-node parallel execution Security policy Take work to setup access Account on gatekeeper node Large scale calculations are possible Middleware fault tolerance and flexible resource management is important

Peer-grid Interoperation Experimentshttp://goc.pragma-grid.net/wiki/index.php/Main_Page#Grid_Inter-operations: 

OSG<->PRAGMA (January, 2007 – on-going) Members from both grids run applications across both grids OSG - Spatial Interpolation (UIowa, USA) PRAGMA - FMO/Ninf-G (AIST, Japan) Both applications started run and will continue VDT and Rocks integration Peer-grid Interoperation Experiments http://goc.pragma-grid.net/wiki/index.php/Main_Page#Grid_Inter-operations

GIN Connectivity: 

GIN Connectivity

Good News: Real Science Being Done: 

Good News: Real Science Being Done Some published papers in 2006: Arzberger P, Papadopoulos P. PRAGMA: Example of Grass-Roots Grid Promoting Collaborative EScience Teams. CTWatch. Vol 2, No. 1 Feb 2006. www.ctwatch.org/quarterly/articles/2006/02/pragmaexample-of-grass-roots-grid-promoting-collaborativee-science-teams Abramson D, Lynch A, Takemiya H, Tanimura Y, Date S, Nakamura H, Jeong K, Hwang S, Zhu J, Lu Z, Amoreira C, Baldridge K, Lee H, Wang C, Shih HL, Molina T, Li, W, Arzberger P. Deploying Scientific Applications on the PRAGMA Grid testbed: Ways, Means and Lessons. IEEE/CCGRID International Workshop on Grid Computing, 2006, Singapore. Lee B-S, Tang M, Zhang J, Soon O Y, Zheng C, Arzberger P. Analysis of Jobs on a Multi-Organizational Grid Testbed. IEEE/CCGRID Int’l Workshop on Grid Computing, 2006, Singapore. Zheng C, Abramson D, Arzberger P, Ayuub S, Enticott C, Garic S, Katz M, Kwak J, Lee B S, Papadopoulos P, Phatanapherom S, Sriprayoonsakul S, Tanaka Y, Tanimura Y, Tatebe O, Uthayopas P. The PRAGMA Testbed: Building a Multi-Application International Grid. 2005 IEEE/CCGRID International Workshop on Grid Computing, 2006, Singapore. Li WW, Arzberger PW, Yeo CL, Ang L, Tatebe O, Sekiguchi S, Jeong K, Wuang S, Date S, Kwak JH. Proteome Analysis Using iGAP in Gfarm. The Second International Life Science Grid Workshop 2005, Grid Asia 2005, Singapore 2005. Wei X, Ding Z, Li W W, Tatebe O, Jiang J, et al. GDIA: A Scalable Grid Infrastructure for Data Intensive Applications. IEEE Int’l Conference on Hybrid Information Technology, ICHIT 2006, Cheju Island, Korea. Krishnan S, Baldridge K K, Greenberg J. P, Stearn B, Bhatia K. An End-to-End Web Services-Based Infrastructure for Biomedical Applications. Proceedings of Grid 2005, 6th IEEE/ACM Int’l Workshop on Grid Computing, November 13-14, 2005, Seattle, WA, U.S. … Special Issue of: International Journal of Web and Grid Services

Bad News: Under-Utilized Resources: 

Bad News: Under-Utilized Resources

Challenge: More Non-Grey Users: 

Challenge: More Non-Grey Users