cottrell icfa korea may05

Quantifying the Digital Divide from Within and Without: 

Quantifying the Digital Divide from Within and Without Les Cottrell, SLAC International ICFA Workshop on HEP Networking, Grid and Digital Divide Issues for Global e-Science, Daegu, Korea, May 23-27, 2005 www.slac.stanford.edu/grp/scs/net/talk05/icfa-korea-may05.ppt Initially funded by DoE Field Work proposal. Currently partially funded by US Department of State/Pakistan Ministry of Science & Technology

Goal: 

Goal Measure the network performance for developing regions From developed to developing & vice versa Between developing regions & within developing regions Use simple tool (PingER/ping) Ping installed on all modern hosts, low traffic interference, Provides very useful measures Originated in High Energy Physics, now focused on DD Persistent (data goes back to 1995), interesting history Monitoring site Remote site PingER coverage Jan 2005

Min-RTT to World: 

Min-RTT to World Measured from SLAC 118 countries, 345 sites Need contacts in uncolored > 600ms ≡ satellite (red) <100ms inside N. America January 2000 Japan via NY to SLAC Korea via W. Coast

Loss to the World: 

Loss to the World Loss is less distance dependent than RTT It has a big effect on perceived performance Good < 1%, acceptable < 3%, > 5-12% sessions time out Nb. Belorussia, Ukraine, Turkey, Africa, M East

World “Quality”: 

World “Quality” S.E. Europe, Russia: catching up Latin Am., Mid East, China: keeping up India, Africa: falling behind C. Asia, Russia, S.E. Europe, L. America, M. East, China: 4-5 yrs behind India, Africa: 7 yrs behind Important for policy makers Many institutes in developing world have less performance than a household in N. America or Europe

Seen from Europe: 

Seen from Europe From CERN similar conclusions

Losses: 

Losses US residential Broadband users have better access than sites in many regions From the PingER project

Loss to world from US: 

Loss to world from US Jan-May 2001 In 2001 <14% of the world’s population had Good or Acceptable Loss performance Loss Rate < 0.1 to 1 % 1 to 2.5 % 2.5 to 5 % 5 to 12 % > 12 % BUT by May 2003 It had improved to 63% & by May 2005 It had improved to 74%

Loss to Africa (example of variability): 

Loss to Africa (example of variability) Tertiary Education facility Note we cover most countries with many tertiary education centers (83% pop) Source IDRC

Digression on problems,esp. for developing regions: 

Digression on problems, esp. for developing regions Want > 1 site/country to avoid anomalies Hosts block pings or do not respond E.g. of top 25 Korean Universities (by Google search), only 7 respond to ping For Sri Lanka could only find 2 hosts out of 20 that respond Web hosts with TLDs in many developing countries have proxies in developed countries Use IP2Location.com, And traceroute to verify location, working on triangulation

From India: 

From India Asia (=India): only to itself 0.04%, i.e. good site E.Asia = JP, TW, CN; Balkans=GR,SI,HR; L. America=AR,BR,CL; Oceania=AU,NZ Poor Acceptable Good

From Pakistan RTT: 

From Pakistan RTT Some routes direct <40 ms Some via outside world > 150ms Direct / within country Note NUST (parent organization) but host is in California! HEC funding agency 10km away in ISL BUT this host is in US Proxy at NTC (ISP in Rawalpindi)

Pakistan Loss: 

Pakistan Loss NIIT/Rawalpindi since Feb’05 monitoring: NIIT to SLAC/US NIIT/PK 36 sites 26 in .pk But monitor site problems NIIT to NIIT

From Russia, Brazil : 

From Russia, Brazil As expected Brazil to L. America is good Actually dominated by Brazil to Brazil To Chile & Uruguay poor since goes via US (Miami) US, Europe & Japan similar NSK to Moscow used to be OK but loss went up in Sep. 2003 Fixed in Aug 04 GLORIAD kicks in last couple months Novosibirsk

Condition in Africa: 

Condition in Africa Working with Duncan Martin of TENET to get monitoring host in S. Africa Internet connectivity in tertiary education institutions in Africa is in general too expensive, poorly managed and inadequate to meet even basic requirements. As the recent ATICS (Africa Tertiary Institutions Connectivity Survey) survey for the African Virtual University showed, the average African university has bandwidth capacity equivalent to a broadband residential connection available in Europe, pays 50 times more for their bandwidth than their educational counterparts in the rest of the world, and fails to monitor, let alone manage, the existing bandwidth (ATICS 2005). As a result, what little bandwidth that is available becomes even less useful for research and education purposes. “Promoting African Research and Education Networking”, IDRC

Losses to Regions: 

Losses to Regions Within regions (bold-face italics) losses are generally good (<1%) Exceptions L. America, S. Asia Africa and S. Asia poor from US & Brazil (& Pakistan for S. Asia) 1-2.5% < 1% 2.5-5% >5%

Compare with TAI: 

Compare with TAI UN Technology Achievement Index (TAI) Note how bad Africa is

Collaborations/funding: 

Collaborations/funding Good news: Active collaboration with NIIT Pakistan to develop network monitoring including PingER (in particular management) Travel funded by US State department & Pakistan MOST for 1 year FNAL & SLAC continue support for PingER management and coordination Bad news (currently unfunded, could disappear): DoE funding for PingER terminated Proposal to EC 6th framework with ICTP, ICT Cambridge UK, CONAE Argentina, Usikov Inst Ukraine, STAC Vietnam VUB Belgium rejected, also proposal to IDRC/Canada February ‘04 rejected Working with ICTP and NIIT on proposals Hard to get funding for operational needs (~0.3 FTE) For quality data need constant vigilance (host disappear/move, security blocks pings, need to update remote host lists …), harder as more/remoter hosts

Summary: 

Summary Performance from U.S. & Europe is improving all over, for losses, RTT & throughput Performance to developed countries are orders of magnitude better than to developing countries Poorer regions 5-10 years behind Poorest regions Africa, Central & S. Asia Some regions are: catching up (SE Europe, Russia), keeping up (Latin America, Mid East, China), falling further behind (e.g. India, Africa) Routing in developing regions may not be optimal Within a region can be big differences between sites/countries, due to service providers

Further Information: 

Further Information PingER project home site www-iepm.slac.stanford.edu/pinger/ PingER methodology (presented at I2 Apr 22 ’04) www.slac.stanford.edu/grp/scs/net/talk03/i2-method-apr04.ppt ICFA/SCIC Network Monitoring report www.slac.stanford.edu/xorg/icfa/icfa-net-paper-jan05/20050206-netmon.doc ICFA/SCIC home site http://icfa-scic.web.cern.ch/ICFA-SCIC/ SLAC/NIIT collaboration http://maggie.niit.edu.pk/

Extra slides: 

Extra slides

Another view of Improvements: 

Another view of Improvements Increase in fraction of good sites From the PingER project

Countries covered: 

Countries covered Sites in 114 countries are monitored Goal to have 2 sites/country Reduce anomalies Orange countries are in developing regions and have only one site Megenta no longer have a monitored site (pings blocked)

Africa RTT (satellite use): 

Africa RTT (satellite use) We are working on ways to determine if a host is really in a country or a proxy host elsewhere Tertiary Education facility From the PingER project

African Region Performance: 

African Region Performance N. Africa has better connectivity; typically 8 years behind Europe, lot of variability West Africa East Africa South Africa North Africa Keeping up Keeping up Catching up Median 75% 25% Europe ’95-97

Within Developing Regions: 

Within Developing Regions In ’80s many Eu countries connected via US Today often communications within developing regions to go via developed region, e.g. Rio to Sao Paola goes directly within Brazil But Rio to Buenos Aires goes via Florida Doubles international link traffic, increases delays, increases dependence on others Within a region can be big differences between sites/countries, due to service providers