åäº

ARC002IIS 與 Microsoft.com: 如何使用微軟技術架構高可用的網站平台 : ARC002 IIS 與 Microsoft.com: 如何使用微軟技術架構高可用的網站平台 胡士亮 平台架構技術副理 台灣微軟 開發工具暨平台推廣處


內容大綱 : 內容大綱 Microsoft.com 介紹 大小與規模 網路與系統架構 工具與監控平台 Global Load Balancing & Caching 運用 Load Balancing 進行技術更新 TCP/IP – Vista and Longhorn Changes


Microsoft.com 維運團隊 : Microsoft.com 維運團隊


Microsoft.com 網站到達率 : Microsoft.com 網站到達率 網站到達率概觀 全美第六大網站; 接觸 56.6M unique users, 占全美Internet使用者 37.2% – (September 05 – December 05)* 全球第三大網站; reaching 285.8M UU 6.4% 成長率 (December 04 – December 05)** 到達率超越所有科技公司網站 Apple: 全美第18大網站: 20.9M UU, 13.8% reach Netscape: 全美第51大網站: 11M UU, 7.3% reach Sony: 全美第140大網站: 5.6M UU, 3.7% reach SUN: 全美第265大網站: 3.5M UU, 2.4% reach IBM:全美第469大網站: 2.2M UU, 1.4% reach (US data provided for relative comparison*) *Nielsen/NetRatings December 2005 - (unique users in millions); **Worldwide data from comScore Media Metrix (Dec. 2004 – Dec. 2005).


Internet Hosting – 重要資料 : Internet Hosting – 重要資料 5 Internet Data Centers 2 Content Delivery Networks Akamai & Savvis vendor relationships Cache Downloads & Product Updates 1800+ 伺服器 500+ 伺服器在測試環境 (Dev  PPE) 110 Web Sites, 1000’s Apps 1100+ 線上資料庫, 1450+ Log Shipping 2nd 120+ Gigabits/sec 對外流量


微軟企業等級網站解決方案 : 微軟企業等級網站解決方案 Microsoft.com (80 Web Servers) 17M UUsers/Day & 70M Page Views/Day 10k Req/sec & 300K 同時連線數 IIS 設定 350 Virtual Roots, 190 IIS Web App, 12 App Pools Microsoft Update (160 Web Servers) 250M+ UClient scans/day (互動使用者 & 自動更新) 18k ASP.NET Req/sec & 1.1M 同時連線數 4 Gb/sec Web site 對外流量 (Web only…不包括下載!)


High Availability Architecture : High Availability Architecture


Slide9 : Web Site Availability


Slide10 : High Availability Architecture - Global Solutions & Networking


Slide11 : Global Solutions Content Caching Partners: Akamai & Savvis Global Load Balancing via DNS – Web Cluster Level Mgmt Health Checking and Automatic Fail-over Security Infrastructure Cisco Guards – Anomaly Detection & DOS Filtering Router ACLs Allow HTTP/S Only – Exceptions Require Review Router Architecture – Cookie Cutter Redundant Router and Switch Pairs with VLAN Segregation Simple, Scalable, Manageable, Repeatable Agility – Quickly Repurpose VLANs as Required High Availability Architecture - Global Solutions & Networking


Slide12 : High Availability Architecture - Web & Database Hosting


Slide13 : Standard Hosting Models Agility - Quickly Reallocate from System to System Efficiency - Less Staffing & Equipment Required Consistent Configurations Repeatable Infrastructure Architecture System Capacity for Resilience Active/Active to Leverage Multiple Data Centers High Availability Architecture - Web & Database Hosting


Leveraging x64 for Resilience : Leveraging x64 for Resilience Key Take Away's Hardware Costs – lower cost per server for x64 Hardware capable of running both x86 & x64 O/S Greater CPU and Memory capacities lend towards further Consolidation of systems or Reallocations


CPU Utilization Per Platform : CPU Utilization Per Platform Key Take Away's Huge Gains due to 64-bit H/W & Windows Platforms Seamless migration provided with WoW64 Enabled www.Microsoft.com to leverage saved infrastructure to enable Data Center Redundancy App Pool Recycles Eliminated – Enjoying the new 4GB VM address space running under WoW64!! Enabled more App Pools driving further Isolation of Code & Content in shared hosting models Leveraging x64 for Resilience


Slide16 : Key Take Away's Significantly Improved Response Times/Requests Explanation – Combo due to relieved CPU burdens and increased Physical and Virtual Memory Average Server Response Times - Compare Leveraging x64 for Resilience


Slide17 : Network Load Balancing (NLB) Clusters Main Load Balancing Solution Today Server Cluster Sizes: 3 – 8 Servers/Cluster Positives: Easy Mgmt – Knowledge within Team Free with Windows SKU’s Challenges: Switch Overhead Connection Affinity Application Layer Switching High Availability Architecture - Web & Database Hosting


Slide18 : Hardware Load Balancing Limited Use for App Layer Load Balancing Future – Greater Adoption for Non-NLB Features Positives: App Layer Load Balancing Connection Affinity Challenges: Added Complexity/Risks Costs – Hardware & People High Availability Architecture - Web & Database Hosting


Slide19 : Server Configurations Standard Server Hardware – Flexibility Identical Baseline O/S, IIS, ASP.NET Configurations Build Scripts for consistent site builds Application Code & Content Unique per Site File, Registry, Service, and Local Security Attributes Collected for Configuration Auditing and Reporting High Availability Architecture - Web & Database Hosting


High Availability Architecture - Remote Server Management : High Availability Architecture - Remote Server Management Integrated Lights Out (iLO) from HP Cold Reboot Power On/Off Debugging Over iLO – No More Crash Cart Imaging for Dog Food OS Builds RDP Over iLO Movement to “Lights Out” Datacenter


Tooling and Monitoring : Tooling and Monitoring


High Availability Architecture - Collecting, Monitoring, & Reporting : High Availability Architecture - Collecting, Monitoring, & Reporting IIS Log Monitor GAL Core ETW Data Site Scope Cluster Sentinel Keynote MOM Perf SMS AD Tools Services Layer SE Annotations MOM Events Cisco Guard


Global Load Balancing & Caching : Global Load Balancing & Caching


GLB & Caching - Deep Dive Introduction : GLB & Caching - Deep Dive Introduction Distributing Patches/Files to 300M+ Clients Partnership with 3 Providers Akamai, Savvis, & MSN Load Distributed via Global Load Balancing Health Checking and Fail-over Automated pulling of clusters to watermark Removal on demand for maintenance Load Shaping & Distribution Control load percentages to specific clusters Region specific traffic distribution Functions via DNS Resolution and Custom Logic from CDNs


Slide25 : GLB & Caching – Round Robin DNS x


Slide26 : GLB & Caching – Intelligent Load Balancing x 100%


GLB & Caching - Geo Targeting : GLB & Caching - Geo Targeting Load Shaping Based on Client Resolver Location Direct Traffic to Particular Clusters or Caching Provider as Appropriate Customer Experience Enhanced due to Improved Local Proximity Load Shaping Based on Client Location CDN Provider Proxies Requests – Responds with File Based on Location of Client


Slide28 : GLB & Caching - Caching & Load Regulation


GLB & Caching - Automatic Regulation Impact : GLB & Caching - Automatic Regulation Impact Prior to Automation Post Automation


GLB & Caching - Automatic Regulation Impact : GLB & Caching - Automatic Regulation Impact Flatten Egress Curves Managing Costs by Optimizing Usage of 95th Percentile Peak – Filling in Valleys Millions of Dollars Saved Distribute Egress Load Among Partners Reduce Staffing Requirements – Work/Life Balance Requires Discretionary Traffic


Leveraging Load Balancing for Technology Updates : Leveraging Load Balancing for Technology Updates Scenarios: Product Adoption - OS/Application Updates Hardware Technology Updates Methods: Utilize Local Load Balancing for Initial Testing Utilize Global Load Balancing for Cluster Level Tests Benefits: Facilitates Real Load Testing with Managed Risk Incrementally Increase Traffic Stress Testing with Real World Load – Very Difficult to Emulate Full Complexity in the Lab


Leveraging Load Balancing - cont Study Results: www.Microsoft.com Perf : Leveraging Load Balancing - cont Study Results: www.Microsoft.com Perf Objective: Stress a live production server to identify Max ability to serve HTTP traffic from www.Microsoft.com client requests


Leveraging Load Balancing - cont Comparative Study Results – MU Download System : Leveraging Load Balancing - cont Comparative Study Results – MU Download System Scenario Stress generated by live HTTP traffic from Microsoft Update Downloads 32bit Application Processes bottlenecked by 2GB Virtual Memory limit vs 4GB capabilities on 64bit operating system enabling Max Mbits/Sec Improved compute times on 64bit increased Req/Sec while lowering Concurrent Connections (ie. Improved HTTP Request Processing Times)


TCP/IP – Vista and Longhorn Changes : TCP/IP – Vista and Longhorn Changes


TCP/IP Improvements- What’s New in Vista and Longhorn : TCP/IP Improvements - What’s New in Vista and Longhorn Current Situation TCP/IP Throughput Limited in High Latency and/or High Loss Situations Application Buffering Issues Compound Issue What’s Coming Compound TCP – rapid TCP send window increases Receive Window Auto-Tuning – improved TCP receive window size adjustment NewReno – Fast Retransmits TCP Extended Statistics – Per connection perf data Port Auditing – Generate audit events on port usage


TCP/IP Improvements- Results of Client Testing : TCP/IP Improvements - Results of Client Testing Test Scenario Clients: Dual boot laptop (XP SP2 & Vista 5308) Test: Download (EN W2KSP4 ~135MB) from 4 locations (Tukwila, WA; San Jose, CA; Tampa, FL; & Frankfurt, Germany) Results Corporate network environment – 10Mb/s connection, low packet loss 5–7% relative speed gain in low latency scenarios (2-20msec RTT) >150% relative speed gain in mid/high latency scenarios (80-180msec RTT) Home network environment (Comcast cable modem) ~40% relative speed gain (16-330msec RTT)


TCP/IP Throughput Improvements- Client Results : TCP/IP Throughput Improvements - Client Results


TCP/IP Improvements- Results of Data Replication Testing : TCP/IP Improvements - Results of Data Replication Testing Test Scenario Server to server transfer over 30msec RTT Link W2K3 SP1   W2K3 SP1 with GigE NICs Longhorn   Longhorn with GigE NICs Same Server Hardware Results Win2k3  Win2k3: 10-12Mbs for file copy using robocopy This included TCP/IP and SMB tweaks to improve performance Longhorn   Longhorn: >300Mbs for same file copy job Default configuration of Longhorn server used


附錄 : 附錄


Microsoft.com OperationsOps Team Experiences & Online Resources : Microsoft.com Operations Ops Team Experiences & Online Resources Microsoft.com Operations Blog HTTP://Blogs.Technet.com/MSCOM Webcasts http://www.iis.net/default.aspx?tabid=2&subtabid=24 Whitepapers Microsoft.com Moves to x64 Version of Windows   Microsoft.com Standard Server Configurations Monitoring and Troubleshooting Microsoft.com Heavily Trafficked Microsoft.com Stabilized, Speeded by Microsoft ASP.NET 2.0 TechNet Magazine Web Site Configuration Management (Nov/Dec 2005) Microsoft.com Adoption of x64 Architecture (Jan/Feb 2006) Analyzing Denial of Service Attacks using LogParser & Netmon (March/April 2006)


Microsoft.com OperationsOps Team Experiences & Online Resources : Microsoft.com Operations Ops Team Experiences & Online Resources Webcasts Microsoft.com – High Availability Architecture (Level 200) Microsoft.com – Configuration Management of Web Farms (Level 200) Microsoft.com – Monitoring & Management of Enterprise Platform (Level 200) Microsoft.com – Troubleshooting & Debugging Web Hosting Environments (Level 300) MSCOM Operations Webcast: (Virtual Classroom Presentation for WW Services and IT Communites) MSCOM Table Partitioning March Debug Madness MSCOM Webcast Week March 27-31 Microsoft.com Operations Introduces Real World Debugging: Determining When You Have a Problem and Beginning the Initial Debugging (Level 300) Microsoft.com Operations Introduces Real World Debugging: Debugging CLR Internals (Level 300) Microsoft.com Operations Introduces Real World Debugging: Diagnosing Memory Leaks in ASP.NET Applications Microsoft.com Operations Introduces Real World Debugging: How to Tackle Problems in Dynamically Generated Assemblies (Level 300) Microsoft.com Operations Introduces Real World Debugging: Debugging Without the Debugger in IIS and ASP.NET (Level 300)


Slide42 : © 2006 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.