Gentzsch W GRID today Latin Am

Slide1: 

Wolfgang Gentzsch, Managing Director MCNC Grid Computing & Networking Services The North Carolina Statewide Grid: Status, Roadmap, and Economic Expectations

CONTENTS: 

CONTENTS MCNC Grid Computing & Networking Services Grid examples Why should we care about Grid Computing ? Grid impact on North Carolina economy Why are we ready for Grid Computing ? Case Study: Grid Evolution in North Carolina

About MCNC: Private, Nonprofit Organization: 

About MCNC: Private, Nonprofit Organization 1980: Microelectronics Center of North Carolina, founded by NC General Assembly, non-profit organization Focus on technology-led economic development Expanded in 1985 to include NC Networking Provide high-speed network linking NC universities Common platform for statewide edu and research Operated NC Supercomputing Center 1988 - 2003 2003: GCNS, Grid Computing & Networking Services

Slide4: 

Grids for Research: NEES, Network for Earthquake Engineering Simulation NEESgrid links earthquake researchers across the U.S. with leading-edge computing resources and research equipment, allowing collaborative teams to plan, perform, and publish their experiments. Through the NEESgrid, researchers will: - perform tele-observation and tele-operation of experiments; - publish to and make use of a curated data repository using standardized markup; - access computational resources and open-source analytical tools; - access collaborative tools for experiment planning, execution, analysis, and publication.

Slide5: 

Grids for our Community: SURA SCOOP South-eastern Coastal Ocean Observing Program The Challenge: - More than half of the nation's tidal shores, and home to 80 million people - coastal zone is undergoing environmental and ecological changes - threaten the sustainability of the region's economies and marine resources The Solution: - develop a Grid of sensors and linked computers - fully integrating several observing systems in the southern region - provide data, in real-time and at high speed, for more reliable, accurate and timely information To help guide effective coastal stewardship, plan for extreme events, facilitate safe maritime operations, and support coastal military security.

Slide6: 

DAME is an e-Science pilot project, demonstrating the use of the GRID to implement a distributed decision support system for deployment in maintenance applications and environments Partners: Universities of York, Leads, Sheffield, Oxford and Rolls Royce On-line decision support systems: - access to remote resources (experts, computing, knowledge bases etc), - communications between key personnel and actors in the system, - control of information flow and data quality, - and the integration of data from diverse global sources within a strategic decision support system. Grids for Industry:

Slide7: 

Why Should We Care about Grids ? “It’s the next big thing!” Scott NcNealy, Sun Grid technologies advance Science and Education in that we can do things which haven’t been possible before. Grid infrastructure attracts and enables new businesses and creates new jobs, especially in today's rural areas. Grids make us more competitive by better utilizing resources.

Slide8: 

Why Should We Care about Grids ? The North Carolina Answers: Grid technologies advance Science and Education in that we can do things which haven’t been possible before. Grid infrastructure attracts and enables new businesses and creates new jobs, especially in today's rural areas. Grids make us more competitive by better utilizing resources.

Slide9: 

Why Should We Care about Grids ? The North Carolina Answers: Grid technologies advance Science and Education in that we can do things which haven’t been possible before. Attract bright students and faculty to North Carolina ! Grid infrastructure attracts and enables new businesses and creates new jobs, especially in today's rural areas. Grids make us more competitive by better utilizing resources.

Slide10: 

Why Should We Care about Grids ? The North Carolina Answers: Grid technologies advance Science and Education in that we can do things which haven’t been possible before. Attract bright students and faculty to North Carolina ! Grid infrastructure attracts and enables new businesses and creates new jobs, especially in today's rural areas. Moving from textile, tobacco, furniture to IT-based jobs ! Grids make us more competitive by better utilizing resources.

Slide11: 

Why Should We Care about Grids ? The North Carolina Answers: Grid technologies advance Science and Education in that we can do things which haven’t been possible before. Attract bright students and faculty to North Carolina ! Grid infrastructure attracts and enables new businesses and creates new jobs, especially in today's rural areas. Moving from textile, tobacco, furniture to IT-based jobs ! Grids make us more competitive by better utilizing resources. Bringing products ‘to market’ faster, with higher quality !

The Cohen Study 2003: Impact of Grid on North Carolina’s Economy: 

The Cohen Study 2003: Impact of Grid on North Carolina’s Economy Given: 1) adequate access to broadband infrastructure and 2) sufficient IT workforce, The deployment of high performance Grid and Web Services applications would contribute significant gains to North Carolina’s economy over 2010 baseline growth forecasts Source: Cohen E-NC Study 2003

Slide13: 

In Fact, NC Industry Trends Reflect These Challenges… Employment by North American Industry Classification System (NAICS) Source: The Employment Security Commission of NC, Labor Market Information

The Cohen Study: Summary of Findings: 

The Cohen Study: Summary of Findings An additional $10.1 billion in output An additional 1.5% in aggregate labor productivity An additional $7.2 billion in personal income An additional 24,000 jobs, the result of 55,700 new jobs created from increased industrial growth and 31,700 jobs lost due to the adoption of new Grid and Web services technologies and downsizing An additional $1.2 billion in expenditures for communications services, with 80-90% of the new spending devoted to the purchase of broadband access. Source: Cohen E-NC Study 2003

The Cohen Study: Future Growth Is Linked To Grids And Broadband Growth: 

The Cohen Study: Future Growth Is Linked To Grids And Broadband Growth This study finds that if a state wants to compete in the economy of the future, it will need to: Develop new computer & Internet skills in its workforce and the ability to work with broadband applications Insure it has a well-deployed broadband infrastructure so firms can interconnect to their branches, partners or subcontractors easily Develop institutions that build the new skills in its workforce and that support upgrading of broadband communications infrastructure as required to be competitive Pay special attention to traditional industries that are part of supply chains for Wal-Mart and Gap, but may be limited by Internet skills and slow connections to the Internet. Source: Cohen E-NC Study 2003

Big Economic Changes Are Coming: 

Big Economic Changes Are Coming Firms using clusters and grids will begin to use them to change their business processes. This could bring about a dramatic change from the way we now see business done. Different skills will rise to the fore. Computer literate work forces that use Internet and Grid applications will benefit the most from the new era of “connected” business. Firms without such skills will have a difficult time. States with clusters of these new skills will do well and be better able to compete in the global economy. Source: Cohen E-NC Study 2003

Economic Implications for NC:Why Clusters And Grids Are Important: 

Economic Implications for NC: Why Clusters And Grids Are Important Cluster computing and grids change the economics of doing complex computations since they lower costs dramatically Cluster software lets firms use interconnected small computers to do work that previously required a large supercomputer Grids connect different clusters across a corporate firewall Web services are software that supports sharing of incompatible data. When firms use clusters or grids, they can complete compute-intensive tasks in hours that previously required days This helps firms save costs -- less compute time is needed, as well as less time from programmers and software developers They also benefit from getting results faster, so that products can get to market sooner These cluster/grid users become more productive “growth centers” because they are more efficient and more competitive These firms are more dynamic. They spark economic growth throughout the state! Source: Cohen E-NC Study 2003

Slide19: 

Access: transparent, remote, secure, wireless Sharing: enable collaboration over the network Failover: migrate/restart applications automatically On Demand: get resources, when you need them Productivity: more work done in shorter time Virtualization: access compute services, not servers Heterogeneity: platforms, OSs, devices, software Resource Utilization: increase from 20% to 80+% Virtual Organizations: build & dismantle on the fly Achieve High Quality: 6 Sigma for the whole supply chain Benefits Department, Enterprise, and Global Grids

Slide20: 

But: There is Still Some Way to Go ! Grids are over-hyped: currently, they promise much more than they can really offer today. Grid technology is far from mature and complete. Grid standards are (mostly) still missing. Grids are very complex IT infrastructures. The problem of scale and fail. Grids bring new challenges: sharing resources, loosing direct control, software licensing, security, intellectual property, legal, social, political issues . . .

Slide21: 

Projects/Initiatives, Testbeds, and Companies Altair Avaki Axceleon Cassatt Datasynapse Egenera Entropia GridFrastructure GridIron GridSystems Gridwise GridXpert HP Utility Data Center IBM Grid Toolbox Kontiki Metalogic Noemix Oracle 10g Parabon Platform Popular Power Powerllel/Aspeed Proxima Softricity Sun N1 TurboWorx United Devices Univa . . . BIRN Condor-G DEISA Dame D-Grid EGA EnterTheGrid GGF Globus Globus Alliance GridBus GridLab GridPortal GRIDtoday GriPhyN I-WAY Knowledge Grid Legion MyGrid NMI OGCE OGSA OGSA-DAI OMII PPDG Semantic Grid TheGridReport UK eScience Unicore . . . CO Grid Compute-against-Cancer DeskGrid DOE Science Grid EEGE EuroGrid European DataGrid FightAIDS@home Folding@home GRIP NASA IPG NC BioGrid NC Startup Grid NC Statewide Grid NEESgrid NextGrid Nimrod Ninf NRC-BioGrid OpenMolGrid OptIPuter Progress SETI@home TeraGrid UniGrids Virginia Grid WestGrid White Rose Grid . . .

Slide22: 

Global Community Source: Ian Foster

Academic, Government, Private Researchersare Developing Innovative Grid Applications: 

Academic, Government, Private Researchers are Developing Innovative Grid Applications Immunology Mechanical modeling Aircraft design Circuit simulation Fluid mechanics Genomics Biotechnology Investment Analysis Weather modeling Bioinformatics Financial Modeling

Slide24: 

Why are Grids Ready for Business ? Grid technology and products exist Globus community, Globus Alliance, Globus Consortium Awareness of importance and benefits of grids Use cases, success stories Standards organizations Convergence of grid and web services Grid companies, grid products, grid-enabled applications But, grids are not (yet) ready for everybody !

Slide25: 

Internet Internet 2 NLR Blend of owned and leased fiber and circuits featuring resilient rings, fiber, and lambdas powered by Wave Division Multiplexers and routers. Internet

About the Network: A Foundation for Grid: 

About the Network: A Foundation for Grid MCNC-GCNS operates NCREN - NC Research & Education Network Advanced high-speed statewide network serves all NC public and most private NC universities Interconnects 180+ research, education, government and commercial organizations In operation for 20 years Network and video communications services: - Intercampus - Internet gateway access - Internet2/Abilene Research Network - Video (scheduled & on-demand) - National Lambda Rail (NLR) - NLR Experiments Support Center - Statewide Grid Services

North Carolina Bioinformatics Grid (2001): 

North Carolina Bioinformatics Grid (2001) One of the 1st grid testbeds in the US for collaborative life science research Applications Genome mapping Molecular modeling for drug discovery Computing resources from UNC Chapel Hill Duke University in Durham NC State University in Raleigh MCNC in Research Triangle Park Sponsors IBM and Sun Hybrid grid middleware platform Grid Portal, Compute and Data Grid, Workload Distribution, Security

North Carolina BioGrid (2002): 

North Carolina BioGrid (2002) IBM LTO Library Sun T3 IBM p690 SunFire 3800 FC Switch FC IBM eServer 1300 Development & Staging Client Workstation 10/100 MCNC /Res. Triangle Park, NC SunFire V880 Gig-E Client Workstation IBM eServer 1300 Gig-E Client Workstation IBM eServer 1300 Gig-E Client Workstation NC State / Raleigh UNC / Chapel Hill Duke / Durham Gig-E

MCNC Enterprise Grid (2003 – 2004): 

MCNC Enterprise Grid (2003 – 2004) Reconfigured compute, storage, data and application resources into enterprise grid architecture Provides on-demand access to HPC resources as part of statewide grid Available systems: 64-node Massively Parallel Processor (MPP) IBM Cluster w/ total 128 Intel 2.8 GHz, 32-bit CPUs running RedHat Linux Symmetric Multi-Processor (SMP) SGI server w/32 Intel 1.3 GHz 64-bit CPUs running a variant of Advanced Server RedHat Linux

The Enterprise Grid and MCNC’s Services Strategy: 

The Enterprise Grid and MCNC’s Services Strategy NCREN State-wide Grid Services Enterprise Grid Services Value-add Information Systems Services Self-serve Data Center Services DATA CENTER Hosting & Infrastructure Grid Computing GTEC, NLR and other Innovation Initiatives Information Security Services Data Archival Services Information Assurance DEPLOYMENT

Grid Technology Evaluation Center The Epicenter for Accelerated Grid Market Adoption: 

Grid Technology Evaluation Center The Epicenter for Accelerated Grid Market Adoption Influential Network of Key-Players Independent Lab: Eval & Testing Joint BizDev, PR & Marketing Grid Training & Education Customer Briefing Center From Innovation to Deployment Socio-Economical Mission

Slide32: 

Example: The North Carolina Start-up Grid With NC State University & Centennial Campus Incubator To help Start-ups overcome manifold obstacles To reduce Start-up risk and increase success To attract Start-ups to North Carolina To contribute to North Carolina’s economic growth

Slide33: 

The NC Statewide GRID… on NCREN Platform WSSU - EduGrid Wake Forest - I2 NCSA - Film Lib . NC A&T Engineering Grid MCNC Enterprise Grid NC BioGrid Computer Science Grid UNC - TV Digital Asset Management R1 Clusters, P690, Origin, Abilene, etc. ERC HPC Center Opto - electronics Software design Internet Internet 2 NLR Internet Internet 2 NLR Internet Internet 2 NLR Internet Internet 2 NLR

NC Grid over NCREN: 

NC Grid over NCREN The NCREN statewide network is the single-most important component in building the NC Statewide Grid NCREN connects distributed computing resources throughout the state Bridges the “digital divide” between urban and rural centers of the state Ensures that North Carolina higher education system can fully participate in national and int’l grid computing initiatives Maintains and enhances North Carolina’s ability to attract and retain high-technology industry and create new jobs

A Sampling of Current Grid Projects in NC: 

A Sampling of Current Grid Projects in NC GridNexus at UNC at Wilmington Workflow builder for grid applications www.gridnexus.org Southeastern Universities Research Association (SURA) Southeastern Coastal Ocean Observing Project (SCOOP) UNC Chapel Hill, RENCI, and MCNC Portal and grid infrastructure for running ADCIRC model BioPortal RENCI at UNC Chapel Hill Grid Computing CS Course Offered by WCU to campuses across the state via NCREN video service First offered in 2004 (30 students), again in Fall 2005 Video conference class at Western Carolina University through NCREN Video Network

U.S. National LambdaRail: 

BAT SAN STA CHI SLC HOU DAL SYR TUL PEN ELP KAN PHO LAX ALB PIT WDC OGD BOI CLE ATL POR RAL NYC SAA DEN SVL SEA JAC U.S. National LambdaRail Controlled by academic research community NLR Goals: Support experimental and production networks Foster networking research Promote next-generation applications (grid) Facilitate interconnectivity among high-performance research and education networks (like NCREN)

Global Lambda Integrated Facility: 

Global Lambda Integrated Facility GLIF is a consortium of institutions, organizations, and country National Research & Education Networks who voluntarily share optical networking resources and expertise to develop the Global LambdaGrid for the advancement of scientific collaboration and discovery GLIF is under the leadership of SURFnet and University of Amsterdam in The Netherlands.

Global Lambda Integrated Facility (GLIF)World Map – December 2004: 

Global Lambda Integrated Facility (GLIF) World Map – December 2004 Predicted international Research & Education Network bandwidth, to be made available for scheduled application and middleware research experiments by December 2004. www.glif.is Visualization courtesy of Bob Patterson, NCSA

Slide39: 

The Innovation Engine The Time Machines wgentzsch@mcnc.org http://www.mcnc.org Thank You ! The Steam Engine The Combustion Engine