GLOBAL RING NETWORK FOR ADVANCED APPLICATIONS DEVELOPMENT Russia-China-USA Science & Education Network : GLOBAL RING NETWORK FOR ADVANCED APPLICATIONS DEVELOPMENT Russia-China-USA Science & Education Network April 14, 2003 Greg Cole, Natasha Bulashova, National Center for Supercomputing Applications (NCSA)
University of Illinois at Urbana-Champaign (gcole@uiuc.edu, natasha@uiuc.edu)
Presentation Objectives : Presentation Objectives Update on US-Russian NaukaNet Program
Introduce Russia-China-USA GLORIAD program
NaukaNet Overview : NaukaNet Overview 5 year $4.1 million NSF Cooperative Agreement under HPIIS Program
Co-funded by Russian Ministry of Industry, Science & Technology
1998-2001: MIRnet
Univ of Tennessee
6 Mbps ATM Service (Moscow M9 - STARTAP)
2001-2002: FASTnet
NCSA, Univ of Illinois at Urbana-Champaign
45 Mbps ATM Service (Moscow M9 - STARTAP)
2002-[June, 2004]: NaukaNet
155 Mbps POS Service (Moscow M9 - Starlight)
Upgrade in 2003 to 2x155 Mbps POS Service 5 year goal
NaukaNet Traffic Growth, 1999 - 2003 : NaukaNet Traffic Growth, 1999 - 2003
NaukaNet Growth in IP Flows > 200 Mbytes : NaukaNet Growth in IP Flows > 200 Mbytes
Number of Unique IP Addresses Using NaukaNet, 2000-2002 : Number of Unique IP Addresses Using NaukaNet, 2000-2002
NaukaNet Traffic to Novosibirsk, Russia : NaukaNet Traffic to Novosibirsk, Russia
Slide13 : Top Institutional Users of NaukaNet in Russia Nov. 2002
Slide14 : Top Institutional Users of NaukaNet in U.S., Nov. 2002
Application Communities : Application Communities High Energy Physics
International Thermonuclear Experimental Reactor (ITER)
Atmospheric Sciences
Spallation Neutron Source
Space Sciences Cooperation
Astronomical Sciences/IVO
US-Russian Plutonium Disposition Project
Non-proliferation/Arms Control Program
US-Russia Materials Protection, Control & Accountability Program
Security Studies/Issues
Geosciences
Bioinformatics
NaukaNet: Congestion ahead : NaukaNet: Congestion ahead
Near-Future Plans : Near-Future Plans Add second OC3 Starlight - Moscow
Complete European exchange for Russia-Europe traffic
Improved (“live”) Monitoring System
Access Grid Node in Moscow
Switched Ethernet testbed project (Moscow-Novosibirsk)
New IPv6 Services / experimentation
June Conference in Moscow and St. Petersburg
Russian domestic infrastructure improvement
GLOBAL RING NETWORK FOR ADVANCED APPLICATIONS DEVELOPMENT Russia-China-USA Science & Education Network : GLOBAL RING NETWORK FOR ADVANCED APPLICATIONS DEVELOPMENT Russia-China-USA Science & Education Network
Why GLORIAD? : Why GLORIAD? Time to develop follow-on to NaukaNet program
Science applications demand it (HEP, ITER, NVO, Atmospheric Sciences, Spallation Neutron Source, Nanomaterials collaborations, network security, etc.)
Desire to extend S&E network in Russia to Far East
TransTelecom network in place
Highest level interest in US for improving US-China S&E cooperation
Highest level interest in Russia for improving Russia-China S&E cooperation
Good opportunity to develop general framework for tri-lateral cooperation around a most advanced S&E network
Introduction to GLORIAD : Introduction to GLORIAD Proposed network/program to be operational in 2004
Co-developed (and to-be-co-funded) by U.S., Russia, China
Expanded capacity for science and education collaboration (10 Gbps)
New “Global Ring” topology for reliability and new applications
Essential for supporting advanced S&E applications (particularly HEP, Astronomy, Atmospheric Sciences, optical network research, network security research)
Follow-on to US-Russian NaukaNet Program
Details (initial proposal) : Details (initial proposal) Layer 1: 10 Gbps Lambda ring across Russia, China, US (and the oceans between) (likely access point in Amsterdam also)
Layer 2: Switched Ethernet
Layer 3: IPv6
Program to develop network management, utilization, monitoring, resource allocation and scheduling tools
Program to develop Cyberinfrastructure supporting S&E collaboration
Program to educate potential users and to educate/inform continuously scientists/educators in all 3 countries about opportunities to collaborate
The 4 Layer GLORIAD Model : The 4 Layer GLORIAD Model Application Communities Collaboration Framework Sculpted Network Platform Lightwave/Lambda Network Scientists, educators, policy-makers, public organizations, students Middleware/grid tools, technologies tying together networks, computers and communities Ethernet (layer 2) switching, IPv6 migration, Network monitoring and management (scheduling, allocation) tools Lambda-based network; optical switching
Goal: Applications : Goal: Applications Network will carry the full mix of S&E traffic
Emphasis, however, on supporting single applications that need Gbps+ capacity
ITER-Grid (US, China have just (re-) joined)
HEP: LHC data distribution
National Astronomy Virtual Observatory
Climate change / atmospheric sciences
Digital Sky
Digital Earth
Wavelength Disk Drive (based on Canadian efforts)
Data mining, security monitoring and visualization
Large scale digital video services
Serving Major Science/Education Application Areas : Serving Major Science/Education Application Areas GLORIAD is being developed to serve global S&E collaborations. The following lists a few typical programs or program areas in which at least two (and in many cases, all three) of the countries jointly participate.
USA: International Space Station Alpha • DOE Arms Control Policy Studies • National Nanotechnology Initiative • Human Genomics • Nuclear Threat Initiative (NTI) • Grid Physics Network • Cooperative Threat Reduction Program • MPC&A • Antarctic Research Programs • Earth Observation • The Globe Program
Russia: ITER • Large Hadron Collider (LHC) • U.S.-Russia Joint Commission on Economic & Technological Cooperation • Seismic / Geological Research Programs • HERA-B (proton-electron accelerator) • Forest and Wildfire Research • Controlled Thermonuclear Fusion • Irkutsk Project • Junior Achievement • Simple Words Children’s Program • Neurosurgery International • Plasma Physics
China:Yangtze River / Three Gorges • Space Telescope Program • Large Radio Telescope (FAST / KARST) • U.S.-China National Laboratory Interactions in Arms Control / Nonproliferation • China Biodiversity Network • U.S.-China Joint S&T Commission • Russia-China Oil Pipeline Project • Shanghai Cooperation Organization
Technical Details (initial proposal) : Technical Details (initial proposal) Initial capability to switch multiple ethernet segments
Later capability to switch multiple lambdas (year 3)
Optical (initially, Ethernet) switches in Chicago (Starlight), Amsterdam (NetherLight), Moscow (RusLight), Novosibirsk (SiberLight), Beijing (ChinaLight), Hong Kong (HKLight)
Self-healing ring topology (ex: if network outage across Atlantic, US traffic to Moscow transits Pacific/China/Siberia)
IPv6 proposed for advanced applications, security, future of IP networking
A series of “Starlight” type facilities providing services for lambda-switching, ethernet-switching, IPv6 routing, IPv4 routing. Also, a testbed for advanced network research. : A series of “Starlight” type facilities providing services for lambda-switching, ethernet-switching, IPv6 routing, IPv4 routing. Also, a testbed for advanced network research.
Russian Backbone Network (RBnet) : Russian Backbone Network (RBnet)
China CSTNet (800 research facilities/institutions) : China CSTNet (800 research facilities/institutions)
US High Performance Network (Abilene, pictured here, is one of several US networks; others include DOE’s Esnet, NASA’s NREN, US Govt network, etc.) : US High Performance Network (Abilene, pictured here, is one of several US networks; others include DOE’s Esnet, NASA’s NREN, US Govt network, etc.)
Financing : Financing Proposed 5 year Project (2003-2008)
Backbone cooperatively managed by US, China, Russia partners
Project cooperatively funded by US, China, Russia.
US commitment anticipated at $2.5M annually
Proposal: each country funds transit across its territory.
US funds 1/2 circuit to Russia and 1/2 circuit to China.
Russia funds 1/2 circuit to US.
China funds 1/2 circuit to US.
Each country funds personnel, equipment, operations necessary for full program operation (i.e., distributed 24/7 NOC, training/support, security services, grid development, etc.)
Organizational Details : Organizational Details Russian Federation: Kurchatov Institute (Dr. Velikhov), Russian Academy of Science (Dr. Velikhov), Joint Supercomputing Center (RAS), Ministry of Industry, Science & Technology, Ministry of Communications, Ministry of Education, Ministry of Atomic Energy. (TransTelecom: likely network provider)
People’s Republic of China: CSTnet/CNIC, Chinese Academy of Science. (Dr. Jiang)
U.S.A.: University of Illinois National Center for Supercomputing Applications (lead university), National Computational Science Alliance, U.S. National Science Foundation, U.S. Department of Energy. (several telecomm companies being evaluated as possible network providers) Also, National Academy of Engineering, San Diego Supercomputing Center, Argonne National Laboratory, Oak Ridge National Laboratory, Sandia National Laboratory, International Center for Advanced Internet Research (ICAIR) at Northwestern University, others. (Challenge: must present a nation-wide consortium of U.S. S&E community to match interest/level of commitment in Russia and China)
Academician Evgeny Velikhov : Academician Evgeny Velikhov Academician, Russian Academy of Science
Academician-Secretary, Info. & Computing Division, RAS
President, RRC Kurchatov Institute
Science Advisor, President, Russian Federation
Leader, ITER
Leader, Russian NaukaNet (GLORIAD)
Founder and Director, Russian Junior Achievement
Mianheng Jiang : Mianheng Jiang Vice President, China Academy of Sciences (Computing and IT Division)
Telecommunications/IT developer in China
Leader, China GLORIAD program
Baoping Yan : Baoping Yan Director, Computer Network Information Center, China Academy of Sciences
Organizing Trip to Beijing December 7-16, 2002 : Organizing Trip to Beijing December 7-16, 2002
GLOBAL RING NETWORK FOR ADVANCED APPLICATIONS DEVELOPMENT Russia-China-USA Science & Education Network Organizing Trip with Chinese Academy of Sciences Computer Network Information Center (CNIC) December 7 - 16, 2002 Beijing, People’s Republic of China Visitors Acad. Evgeny Velikhov, Kurchatov Institute Natasha Bulashova, NCSA, University of Illinois Greg Cole, NCSA, University of Illinois : GLOBAL RING NETWORK FOR ADVANCED APPLICATIONS DEVELOPMENT Russia-China-USA Science & Education Network Organizing Trip with Chinese Academy of Sciences Computer Network Information Center (CNIC) December 7 - 16, 2002 Beijing, People’s Republic of China Visitors Acad. Evgeny Velikhov, Kurchatov Institute Natasha Bulashova, NCSA, University of Illinois Greg Cole, NCSA, University of Illinois
Trip Purpose : Trip Purpose Explore Opportunities to Expand the US-Russian NaukaNet S&E Program: with partners from Chinese Academy of Science (CAS), with CAS’ CSTnet and with a global ring network based on lightwave technology
Trip Results : Trip Results December 14, 2002
Memorandum of Understanding Signed by China (Jiang Mianheng), Russia (E. Velikhov), and US (G. Cole) to develop GLORIAD
Slide41 : Consensus Reached on GLORIAD program
With Plans for Program Development, Program Management, Network Topology, Technology, Science Collaborations Trip Results
The Memorandum of Understanding : The Memorandum of Understanding The Chinese Academy of Sciences represented by the Computer Network Information Center (CNIC), the Russian Research Center “Kurchatov Institute” and the US National Center for Supercomputing Applications (NCSA) of the University of Illinois jointly propose a new strategic framework for advancing S&E cooperation among the three countries and across the myriad disciplines comprising current and future collaborative research. Linking their scientific communities with an advanced S&E network and Grid-based services, the multi-national GLORIAD program will actively encourage and coordinate applications across multiple disciplines and provide for sharing such scientific resources as databases, instrumentation, computational services, software, etc. In addition to supporting active scientific exchange with network services, the program will provide a test bed for advancing the state-of-the-art in collaborative and network technologies – including Grid-based applications, optical network switching, an IPv6 backbone, network traffic engineering and network security. Supporting the increasing growth in global S&E cooperation, GLORIAD will cooperate with other national S&E networks and scientific resources as required.
Lightwave/Lambda Network : Lightwave/Lambda Network 10 Gbps Lambda Continuous Ring (segmented into multiple GigE ethernets)
Need to decide carrier issues, meet points, etc.
Russia’s network will be ready (to Russia-China border) in late 2003
China’s network will be ready (to Russia-China border) in early 2004
Important in later phase of project (year 3) that we have multiple lambdas (at least, when needed) and capability to switch lambdas on demand
Action Items : Action Items Determine carrier issues for trans-Atlantic and trans-Pacific links. Must choose carrier with stable financial base, excess lambda capacity, eagerness to work on large R&D project.
Finalize arrangements with Russian company TransTelecom
Finalize transit issues within and to/from China
Finalize network topology (optical nodes, facilities, equipment)
Resource Access/Scheduling System : Resource Access/Scheduling System Provide for ability to advance-schedule resource allocation requests end-to-end
Software system to automatically update network devices
Must handle Level 2 switching for end-to-end VLAN provisioning
Must handle Level 3 routing for providing improved QoS through core network (for example, using MPLS or other service)
Must by year 3 provide for scheduling/switching (at optical level) lightwaves
Must provide back-end reporting and surveying to determine how well network met customer’s needs
Collaboration Framework : Collaboration Framework Middleware/grid tools, technologies (“Cyberinfrastructure”)
Collaboration
Sharing of computational resources
Sharing of storage/data resources
Sharing of expensive/scarce instrumentation, sensor data, etc.
Global Grid Development : Global Grid Development GLORIAD will provide the network linking GRID communities in US, Russia and China (and, via Starlight and Netherlight, other countries)
Will support the general US-Russian NaukaGrid program and other focused Grid communities
ITER-Grid Development : ITER-Grid Development Dr. Velikhov’s goal: “Virtual ITER” sites with ready, immediate access to conferencing facilities, live data streams generated by experiments/operations, distributed access to computational resources, remote instrumentation, monitoring and control applications.
Need conferencing/lecture capabilities immediately (AG?)
Network needs will eventually exceed 10 Gbps
Preparing “concept paper” on what the ITER-Grid will be
Would like to propose joint development effort: NCSA, Argonne, ORNL, others?
Kurchatov Institute Conferencing Facilities : Kurchatov Institute Conferencing Facilities Currently based on several H.323 (polycom) devices
Would like to add Access Grid node
Useful for KI collaborations with NCSA, ORNL, Argonne, Sandia, ITER/fusion community
Useful model for other Russian sites (implement multicast network across Russian S&E network)
NaukaNet network capable
Application Communities : Application Communities GLORIAD is to focus on application communities - especially those with needs which could not be met without such an advanced network
First, need to identify and document needs of these communities
Second, need to educate/inform scientists, educators, students about potential services, capabilities
Third, need to continually inform/update broad community about opportunities of collaboration
Active interest in GLORIAD program : Active interest in GLORIAD program Signed Statement of the US-Russian Joint Committee for Science and Technology (J. Marburger, M.P. Kirpichnikov)
Presentation to President’s Science Advisory Council, Russian Federation
Signed Agreement (March 12, 2003) between 7 Russian Ministries, Russian Academy of Science & RRC Kurchatov Institute
Signed Statement of US-Russian S&T Commission : Signed Statement of US-Russian S&T Commission Informational and Telecommunication Technologies in Science and Education
The Committee gave a favorable appraisal of the results achieved through cooperation between the Russian Ministry of Industry, Science, and Technology (MIST) and the Russian Academy of Sciences (RAS) and the U.S. National Science Foundation (NSF) on high capacity computing and new generation computer networks, including under the NaukaNet (FASTnet) Project, carried out by the Interagency Supercomputer Center, the Russian Science Center Kurchatov Institute, the National Center for Supercomputing Applications (University of Illinois, Urbana-Champaign), and the Supercomputer Center at the University of California, San Diego.
The Committee recommended that U.S. and Russian cooperation partners continue their active cooperation and discussions of the potential of next-generation computing and networking projects, such as those envisioned as the "TERRA GRID" network and the Global Network For Advanced Application Development (GLORIAD).
Presentation to Russian S&T Council : Presentation to Russian S&T Council January 2003: The forum was the President's Science & Technology Council and the participants included -- in addition to the President (who presides over this council) -- the nation's most senior science officials (including the Minister of Science, Industry & Technology, the President of the Russian Academy of Science and the President of the Kurchatov Institute (Dr. Velikhov)), and also the Finance Minister (and Vice Premier), the Minister of Commerce, the Minister of Atomic Energy and the head of the National Security Council.
“Where the Kurchatov Institute leads, Russia follows”
(Russian President)
Signed Russian Agreement : Signed Russian Agreement On Wednesday, March 12, 2003, Dr. Velikhov placed the final signature on a document developed by 7 senior organizations in Russia indicating support and intention to pursue implementation of GLORIAD.
It was signed at the Minister level by Ministry of Industry, Science & Technology, Ministry of Communications, Ministry of Atomic Energy and Ministry of Education. Also, the President of the Russian Academy of Sciences signed on behalf of the Academy and Dr. Velikhov on behalf of Kurchatov Institute (and as project organizer/lead).
The agreement is to not only fund the international and networking parts of GLORIAD but also domestic infrastructure and programs to enable the science and education communities to utilize GLORIAD.
Finally, we understand that Russian federal funds are now obligated for GLORIAD -- from the above organizations -- the Ministry of Industry, Science & Technology will be the financially responsible organization.
GLORIAD Proposal : GLORIAD Proposal Ready in summer, 2003
Joint proposal preparation so that document is useful in US, Russia and China
Primary focus on applications served by unique network services as well as advanced network research development test bed
Beginning to coordinate closely with other HPIIS teams: TransPAC (J. Williams), EuroLink (T. DeFanti), Starlight (T. DeFanti, J. Mambretti) (next meetings: May 2003)
GLORIAD Management Team Issues : GLORIAD Management Team Issues Science and Network Policy
Cybersecurity
Export Control Issues
Technical Network Engineering
Grid Development
Corporate Relations
Government Relations
Cultural Affairs
Youth Programs/Applications
Evaluation and Audit
Other Events/Project Ideas/Plans : Other Events/Project Ideas/Plans April 14 discussions with Russian/Chinese partners (Washington)
Workshop in June (ship, St. Petersburg Russia)
International “Simple Words” program (global essay contest for children)
Program to encourage science/education collaboration among young people (School-Grid)
US-Russia-China Edu-Cultural Channel
… the end … (thank you!) : … the end … (thank you!)