croswell

Uploaded from authorPOINTLite
Views:
 
Category: Entertainment
     
 

Presentation Description

No description available.

Comments

Presentation Transcript

CU Network Overview: 

CU Network Overview Alan Crosswell alan@columbia.edu

Outline: 

Outline A little about Columbia Wide area Internet[2] connections Metro area inter-campus network Main campus network Gigabit Ethernet experience Advanced networks and applications Future plans

Outline: 

Outline A little about Columbia Wide area Internet[2] connections Metro area inter-campus network Main campus network Gigabit Ethernet experience Advanced networks and applications Future plans

Columbia People : 

Columbia People 40K people: 5,700 CU undergrads 2,500 non-degree 12,000 grad students 3,000 Barnard, TC, UTS students 7,700 CU faculty 7,600 staff

Columbia Places: 

Columbia Places

Columbia Places: 

Columbia Places Morningside Heights campus - 116/Bway

Columbia Places: 

Columbia Places Morningside Heights campus - 116/Bway Health Sciences campus - 168/Bway

Columbia Places: 

Columbia Places Morningside Heights campus - 116/Bway Health Sciences campus - 168/Bway Lamont-Doherty Earth Observatory - Palisades

Columbia Places: 

Columbia Places Morningside Heights campus - 116/Bway Health Sciences campus - 168/Bway Lamont-Doherty Earth Observatory - Palisades several smaller facilities

Outline: 

Outline A little about Columbia Wide area Internet[2] connections Metro area inter-campus network Main campus network Gigabit Ethernet experience Advanced networks and applications Future plans

Internet & Internet2 too: 

Internet & Internet2 too OC-3 Commodity Internet (Applied Theory) currently 150 Mbps outbound/60 Mbps inbound

Internet & Internet2 too: 

Internet & Internet2 too OC-3 NYSERNet ATM Abilene OC-12 POS at NYC, Buffalo POPs vBNS, CANARIE OC-3 ATM at NYC POP

Internet & Internet2 too: 

Internet & Internet2 too RCN fast Ethernet Private Peering

Outline: 

Outline A little about Columbia Wide area Internet[2] connections Metro area inter-campus network Main campus network Gigabit Ethernet experience Advanced networks and applications Future plans

Metro Network: Lamont-Doherty: 

Metro Network: Lamont-Doherty DS-3 leased line ATM T-1 leased line backup

Metro Network: Health Sciences: 

Metro Network: Health Sciences 2 x 100 Mbps Ethernet microwave (23 GHz) DS-3 ATM microwave See also: Cornell Univ looking at dark fiber.

Outline: 

Outline A little about Columbia Wide area Internet[2] connections Metro area inter-campus network Main campus network Gigabit Ethernet experience Advanced networks and applications Future plans

Morningside Heights area: 

Morningside Heights area 10 Mbps Ethernet microwave to Carleton.

Morningside Heights area: 

Morningside Heights area 10 Mbps Ethernet microwave to Carleton. 11 Mbps IEEE 802.11b to three residences.

Morningside Heights area: 

Morningside Heights area 10 Mbps Ethernet microwave to Carleton. 11 Mbps IEEE 802.11b to three residences via… 100 Mbps 5.8GHz hop.

Morningside Heights area: 

Morningside Heights area 10 Mbps Ethernet microwave to Carleton. 11 Mbps IEEE 802.11b to three residences. 100 Mbps 5.8GHz hop. 420 Mbps 5.8GHz RSN™

Morningside Heights area: 

Morningside Heights area 10 Mbps Ethernet microwave to Carleton. 11 Mbps IEEE 802.11b to three residences. 100 Mbps 5.8GHz hop. 420 Mbps 5.8GHz RSN™ 9 T1s & 1 T3 to near-campus buildings.

Morningside Heights “ISP”: 

Morningside Heights “ISP” 736 V.90 dialups 5,700 student and faculty apartments in 143 nearby buildings

OCS: 

OCS Campus and Neighborhood POTS, CATV, and: ISDN (phasing out) DSL (~50-100 users) copper to switch room own DSL hub RCN Cable modems in six(?) buildings.

10baseT Ethernet: 

10baseT Ethernet 20,000 Ethernet ports 4,400 10baseT pillows in 15 undergrad halls 500 10baseT in 20 frats Mostly cat 3 wiring.

100baseT Ethernet: 

100baseT Ethernet 251ET: 72 Ultra-10s Server farm Rewired Mudd, CSB, CEPSR w/1500 cat5e jacks. All renovations & new construction are cat 5+ (~6 bldgs)

Separately administered School & Dept Nets: 

Separately administered School & Dept Nets Some gigE uplinked Business/Law (3com) Barnard College 100baseFX or FDDI (pending gigE): Law, Teachers College, Architecture Bringing old dept-run nets back into fold.

Outline: 

Outline A little about Columbia Wide area Internet[2] connections Metro area inter-campus network Main campus network Gigabit Ethernet experience Advanced networks and applications Future plans

GigE Core Network: 

GigE Core Network Centrally funded to upgrade all 10 Mbps shared ports to 10 Mbps switched with a gigabit Ethernet core. 4 Year $7.7M project (done) Replaced Cabletron and Xyplex shared hubs and FDDI backbone. Started as an ATM core. And stopped.

GigE Core Network: 

GigE Core Network Installation started summer 99. Core network. All Residence Halls. VIP academic & admin bldgs.

GigE Core Network: 

GigE Core Network Reverted early ATM OC-3 LANE bldgs to gigE (Butler, Journalism, Furnald, Carman, Watson, Computer Center). Converted school/dept LAN uplinks from 10 Mbps Ethernet to gigE or 100 Mbps.

A Building Hub: 

A Building Hub Catalyst 55xx, 4006, 29xx, 35xx Singly gigE uplinked to core switch/router New construction and cat5 renovations puts one of these typically every 3rd floor. No config changes needed by users. One or more VLANs with 802.1q trunk

Slide34: 

Edge Router Edge Router

Slide35: 

Edge Router Edge Router

Campus bldgs: Old copper: 

Campus bldgs: Old copper Cat 3: Unshielded twisted pair copper Was installed for phone system. Small FDFs. Vertical risers.

Campus bldgs: Old copper: 

Campus bldgs: Old copper Cat 3: Unshielded twisted pair copper Was installed for phone system. Small FDFs. Vertical risers. BDF.

Campus bldgs: shared Ethernet: 

Campus bldgs: shared Ethernet Cat 3 phone wiring was also good for: Apple LocalTalk IBM Token Ring (4M) Ethernet 10baseT Basement hubs were squirreled away in closets or hallways. Shared 10 Mbps bandwidth for bldg.

Campus bldgs: shared Ethernet: 

Campus bldgs: shared Ethernet Cat 3 phone wiring was also good for: Apple LocalTalk IBM Token Ring (4M) Ethernet 10baseT Basement hubs were squirreled away in closets or hallways. Shared 10 Mbps bandwidth for bldg.

Campus bldgs: New copper: 

Campus bldgs: New copper Cat 5e: Unshielded twisted pair copper New construction and renovation standard. Max. 100 meter run. Max. 1 floor vertical. 100 Mbps. RJ45 patch bays in floor closets.

Campus bldgs: switched Ether: 

Campus bldgs: switched Ether Ethernet switches in floor closets. 10/100 Mbps dedicated per jack.

Campus bldgs: switched Ether: 

Campus bldgs: switched Ether Ethernet switches in floor closets. 10/100 Mbps dedicated per jack. Gigabit Ethernet (1000 Mbps) fiber uplink per switch.

Campus bldgs: switched Ether: 

Campus bldgs: switched Ether Ethernet switches in floor closets. 10/100 Mbps dedicated per jack. Gigabit Ethernet (1000 Mbps) fiber uplink per switch. Standard closet size accomodates 2 racks.

Horizontal Wiring: 

Horizontal Wiring TIA-568 Commercial Building Standard for Telecommunications Cabling. 300 ft. maximum distance to closet. No more than one floor run vertically. Lucent Systimax category 5e+ plenum cable.

Outlet Placement: 

Outlet Placement TIA-569 Commercial Building Standard for Telecommunications Pathways & Spaces. Min. 1 outlex box/faceplate per workstation. Min. 1 outlet box/faceplate per 100 sq. ft. T568B jack pinout. 4 jacks per outlet (2 data, 2 phone).

Closets: 

Closets TIA-569 Commercial Building Standard for Telecommunications Pathways & Spaces. Standard says minimum 1 closet PER FLOOR. We cheap out w/1 per 3 floors.

Closets: 

Closets Bare minimum 4’Dx6’Wx7’H interior clearance. Double louvered doors opening out. Interior plywood walls. No other utilities!

Closets: 

Closets Electrical, Enviro. Two 20A dedicated single NEMA 5-20R. Utility outlet(s), lighting. Ventilation 75° F 12,000 BTUH

Closets: 

Closets Cable terminations EIA 19” relay racks. RJ45 patch bay horizontal jack wire. Telephone riser cross-connections. Network optical fiber risers.

Closets: 

Closets Electronics Network switch. UPS.

A Core Router: 

A Core Router Cisco Catalyst 6509 Redundant MSFC/2 router w/Supervisor II MSM->MSFC->MSFC/2 Concentrates several building hubs with gigE uplinks. Dual gigE uplinks to dual core L2 6509s Dual Power supplies w/dual UPS. Some generator backup (working on more).

A Core Switch: 

A Core Switch Catalyst 6509 Two of them at opposite sides of campus One’s currently on generator power Eight gigE uplinks from the eight switch/routers We might put routers in these too.

Older Network & Routers: 

Older Network & Routers FDDI backbone ATM OC-3 cloud Only thing left is two WAN DS-3 links. 7507s for WAN, FDDI, ATM Dual 100baseFX into core (for now) Temporarily gigE (due to bug in port channel support between 7507/6509).

Routing Protocols: 

Routing Protocols Interior routing: EIGRP Would like to stop being Cisco zombies and run OSPF one day. Exterior routing: BGP vBNS, Abilene NYSERNet schools & routers Applied Theory, Uunet, RCN All 6509 routers speak iBGP w/egress routers

Conversion “Issues”: 

Conversion “Issues” Had to convert right-angle 25pr telco connectors to straight-in! Had to convert 15A outlets to 20A. Long vs. short-haul GBICs. Expensive MM to SM conditioning cables. Pulled a lot of new SM fiber. Fiber testing: Plug and Pray.

Conversion “Issues”: 

Conversion “Issues” MSMs vs. MSFCs vs. MSFC/2s MSM: limited ACLs; No Appletalk routing. MSFC: too little RAM to run iBGP. DoS caused by unrestrained fast hosts on a fast network (p2p apps, etc.). Shaping outbound dorm traffic to 50 Mbps cost of Smartnet service contract.

Outline: 

Outline A little about Columbia Wide area Internet[2] connections Metro area inter-campus network Main campus network Gigabit Ethernet experience Advanced networks and applications Future plans

Advanced Networks & Applications: 

Advanced Networks & Applications Video Conferencing Voice over IP Multicast Wireless 802.11b IPv6 CDNs Network Management

H.323 video conferencing: 

H.323 video conferencing Internet2 Commons just starting up. Member of Videnet (www.cavner.org) Zydacron Z340, Z360 & COMstation. Cisco (Radvision) ISDN (H.320) gateway. Tandberg Codec 5000/RADvision VIU-323 Polycoms just work.

MPEG2 conferencing: 

MPEG2 conferencing Litton CAMVision 2 Full D1 720x480 video 48 kHz 384 kbps stereo audio 15.4 Mbps Amnis, Minerva, VBRICK

Voice over IP: 

Voice over IP Have a few Cisco phones. Telecom dept is deploying Siemens phones on a very limited basis. SIP (Session Initiation Protocol) is taking over the world. Switching our Cisco phones over to SIP cuz it’s cool and runs on a real OS.

Multicast: 

Multicast CGMP/IGMP snooping on Catalysts Cisco/Borg Collective at work. PIM sparse mode. MBGP, MSDP w/Abilene, vBNS, NYSERNet, Cornell. IGMPv3 & SSM soon. Main apps: Norton Ghost, Video

Multicast: 

Multicast A few conferences so far IPTV 2.0 and Osprey-100 card (H.261) In parallel with RealProducer G2. IPTV 3.0 and an Optibase MPEG2 D1. Used for several music events (MPEG1) and Virtual Internet2 Member Meeting 10/2-5. Does MPEG2 but viewers are licen$ed.

Multicast: 

Multicast Would rather be using a real operating system. Many equivalent apps that use multicast but that don’t work with each other (Real, WMT, vic/vat/IPTV, videocharger, Litton, etc.) Need to learn a lot about video production.

Wireless 802.11b: 

Wireless 802.11b Central outdoor campus spaces covered. Putting them in lounges, libraries, classrooms, Lerner, and so on. Roof-to-roof applications for backhoe protection and near-campus buildings. Linked NYAM across Central Park.

Campus bldgs: Wireless LANs: 

Campus bldgs: Wireless LANs IEEE 802.11b deployed on small scale today. Not as fast as wired Ethernet. Applications: Outdoors. Conference rooms. Lecture rooms.

IPv6: 

IPv6 IPv6 via NYSERnet/Abilene IPv4 tunnels. Global /48 assigned by NYSERNet. EUI-64 addressing (MAC address) Wireless subnet CS, AcIS subnets More as requested Bind9 IPv6 on curta.cc.ip6.columbia.edu

Content Delivery Network: 

Content Delivery Network Akamai 15-machine Edge Node Content Provider CVN Columbia Interactive Special events

Performance Management: 

Performance Management Surveyor NLANR Active Measurement Probe (AMP) NLANR PMA (OC3mon) – optical splitter Cricket Sampson Aperserv

Performance Management: 

Performance Management Policy routing Forcing non-I2 connector traffic to I1. CS I1 vs. I2 comparison project. QoS Shaping of outbound commodity traffic. Fair queuing. Security NBAR attempting to label Code Red, etc.

Outline: 

Outline A little about Columbia Wide area Internet[2] connections Metro area inter-campus network Main campus network Gigabit Ethernet experience Advanced networks and applications Future plans

Future Plans: 

Future Plans New Construction K-8 School @110th/Bway New School of Social Work @121st/Morn Expansion to apartments? Many are already passed by our fiber. Several have 1st floor networks for offices. Fiber routes pass UTS, MSM, I-house. Fiber routes to academic buildings are via apartments

NYC Dark Fiber Project: 

NYC Dark Fiber Project NYSERNet built & owned or leased. Fiber ring around Manhattan, parts of Bx. Cost target: <= current OC-3 local loops. 36 initial potential connectors Universities, Hospitals, Museums, NYPL Vendor-neutral ISP colo hotel(s) possible Even more important post-9/11.

www.columbia.edu/acis/networks/advanced: 

www.columbia.edu/acis/networks/advanced