HP and Microsoft SQL Server Data Management Solutions

Views:
 
     
 

Presentation Description

No description available.

Comments

Presentation Transcript

HP Microsoft - SQL Data Management Solutions : 

HP Microsoft - SQL Data Management Solutions Ing. Eduardo Castro, PhD ecastro@grupoasesor.net http://ecastrom.blogspot.com http://comunidadwindows.org http://tiny.cc/comwindows

Resources : 

Resources All Up Data Warehouse: From SMP to Parallel Data Warehouse Dandy Weyn Sr. Technical Product Manager Brian Mitchell Sr. Premier Field Engineer Fast Track Data Warehouse V3.0New Features and Best Practices Michael Bassett Program Manager II Microsoft Jim Hautala Solutions Engineer HP

Market TrendsOrganizations are adopting to a services ready IT : 

Market TrendsOrganizations are adopting to a services ready IT Lower and streamline CAPEX and OPEX Reduce complexity Enable Scalable applications Align IT Business Needs High costs in deploying and maintaining disparate application solutions Protect your investment and lower TCO Managing silos and layers of technology Deploying and implementing multiple solutions Need for dynamic solutions that self provision Highly scalable application across all workloads ensuring business continuity Dynamic IT solutions that respond to changing business requirements Provide business intelligence and decision making capability

HP and Microsoft Expand Partnership Deliver solutions built on next generation Infrastructure-to-Application model : 

HP and Microsoft Expand Partnership Deliver solutions built on next generation Infrastructure-to-Application model #1 technology provider and #1 software provider deliver next generation datacenter and application platform Integrated roadmap for converged application platforms, comprehensive virtualization solutions, and integrated management offerings Optimized performance, reliability, availability, and push button simplicity for the industry’s top business applications Automatically provision, manage, and continuously self-tuned across datacenter and cloud environments 10X increased investment on more than 32,000 HP/Microsoft Frontline partners, plus HP/Microsoft Global expertise, and comprehensive services Leverage existing data center investment with joint solutions that are architected for today and future cloud environments $250M Joint Investment Industry’s most integrated technology stack Integrated virtualization and management Extensive GTM Innovation from Infrastructure to Application Confidence today and the future

So …What does all this mean for you? : 

So …What does all this mean for you?

Data Warehousing and the partnership : 

Data Warehousing and the partnership

Slide 7: 

Take 1 big SAN Add a little Server Add a bigger Server Add more networking

POTENTIAL PERFORMANCE BOTTLENECKS : 

POTENTIAL PERFORMANCE BOTTLENECKS FC SWITCH CPU Feed Rate HBA Port Rate Switch Port Rate SP Port Rate SQL Server Read Ahead Rate LUN Read Rate Disk Feed Rate

Data Warehouse Scope : 

Data Warehouse Scope Data Path Data Warehouse Analysis Services Cubes PerformancePoint Dedicated SAN, Storage Array Reporting Services Web Analytic Tools Integration Services ETL SharePoint Services Microsoft Office SharePoint Data Staging,Bulk Loading Supporting Systems BI Data Storage Systems Presentation Layer Systems Data Warehouse Scope (dashed) Excel Services Presentation Data Presentation Data

Microsoft Data Warehousing Offerings : 

Microsoft Data Warehousing Offerings Enterprise

Microsoft Data Warehouse Offerings : 

Microsoft Data Warehouse Offerings

Business Data Warehouse Appliance : 

Business Data Warehouse Appliance

Business Data Warehouse Appliance : 

Business Data Warehouse Appliance Agile Deploy in hours/days, not in months Easy to use through built-in dedicated tools to load and manage your data warehouse Designed for up to 5TB data warehouses Fast Track 3.0 compliant, license path to Fast-Track Complete Hardware + Software + Services Pre-tuned, pre configured, pre-installed. Turn on and go! Single point of contact for support Optimized Specifically for small to medium data warehouse workload Designed for performance, energy efficiency, and value by HP and Microsoft’s best engineers Security and reliability built in

Scenarios : 

Scenarios Small/Departmental Data Warehouse Spoke in EDW Hub and Spoke Architecture

What’s in the Box : 

What’s in the Box Server HP ProLiant DL370 G6 x 5670 4U rack-mount unit or pedestal 2x Westmere processors (12 cores) 96 GB of RAM Storage 24 x internal SFF SAS disks 2 x Smart Array controllers and SAS expander 2 TB physical user storage 2.7 – 5 TB compressed data

Slide 16: 

DDL and Data Load Wizard Appliance Quick Deployment Wizard Name the appliance Join a domain Specify appliance administrators Create staging and production databases Load data Check data fragmentation HP Appliance-Specific Software What’s in the Box: optimized software

Reference Architectures : 

Reference Architectures

Fast Track Data WarehouseWhat is it? : 

Fast Track Data WarehouseWhat is it? The SQL Server Fast Track initiative provides a basic methodology and concrete examples for deployment of balanced hardware and database configuration for a data warehouse workload.

Fast Track Data Warehouse Value Proposition : 

Fast Track Data Warehouse Value Proposition Predetermined balance across key system components. This minimizes the risk of over spending for CPU or storage resources that will never be realized at the application level. Predictable out-of-the-box performance. Fast Track configurations are built to capacity that already matches the capabilities of SQL Server application for a selected server and workload Workload-centric. Rather than being a one-size-fits-all approach to database configuration, the FTDW approach is aligned specifically with a data warehouse use case.

Fast Track Data Warehouse Workload Evaluation : 

Fast Track Data Warehouse Workload Evaluation Scan-Intensive Disk scan performance is more important than disk seek time. Nonvolatile Data is rarely changed once loaded. Changes must be managed to minimize fragmentation. Index-Light Nonclustered indexes are good for discrete lookups but bad for large scan performance. Partition-Aligned Simplify data lifecycle management and minimize fragmentation

Loading for Fast Track – Best Practices : 

Loading for Fast Track – Best Practices Minimizing logical fragmentation is key to Fast Track scan performance Minimizes Disk head movement Maintains high average request size (Think ~400k not 8k) Implies lower operation (IOP) counts to achieve high scan rates than traditionally seen with SQL Server. Sustain high average scan rates (up to 200 MB/s per RAID10 LUN)

Loading for Fast Track – Best Practices : 

Loading for Fast Track – Best Practices Key considerations for a Fast Track data load Data Architecture: Destination table, partitioning, and filegroup Source Data: Format & size System Resources: CPU & Memory

Load for Fast Track – Best Practices : 

Load for Fast Track – Best Practices New Methodologies for Fast Track 3.0 reduce load times New Initial load method using Staging Tables in final DB BCP to Heap table in staging Database Insert/Select to Staging Table in Final DB (1 Stage table for each partition) Create CI if needed Use partition switch to make staging tables partitions in final production table This method reduced load time by 50% as compared to initial load methods prescribed in Fast Track 2.0 Additional methods described in Fast Track 3.0 Reference Guide

Fast Track Data Warehouse Components : 

Fast Track Data Warehouse Components Software: SQL Server 2008 R2 Enterprise Windows Server 2008 R2 Configuration guidelines: Physical table structures Indexes Compression SQL Server settings Windows Server settings Loading Hardware: Tight specifications for servers, storage and networking ‘Per core’ building block Processing Networking Server Storage

Fast Track Solution Example : 

Fast Track Solution Example Intel Based Reference Architectures 2 Processor Configuration Server: HP ProLiant DL380 G7 with 2x 6-core Intel Xeon® 5680 Series CPUs Storage server: MSA Storage Scalability: 4 – 20 TB 4 Processor Configuration Server: HP ProLiant DL 580 G7 with 4X 8-core Intel Xeon® 7560 Series CPUs Storage server: MSA Storage Scalability: 20 – 40 TB 8 Processor Configuration Server: HP ProLiant DL 980 G7 with 8X 8-core Intel Xeon® 7560 Series CPUs Storage server: MSA Storage Scalability: 40 – 80 TB

HP Fast Track Architecture : 

HP Fast Track Architecture RAID10 Arrays vs RAID1 Reduce Management Complexity 8GB Storage Arrays New Load Procedures Bulk Insert To Staging Tables Insert/Select to Production/Staging Table Switch to Final DB Partition Use highest clock speed for best performance Use default settings on P2000 Arrays

DL980 G7 : 

DL980 G7 8 Socket, 64 core server 512GB RAM Current maximum size exceeds practical limit of single Fast Track Database Server tested using multiple fast track databases simultaneously 14GB/sec logical scan rate using less than 200 disk drives

Fast Track Testing : 

Fast Track Testing New methodology provides more stringent testing HP works with Microsoft to perform testing Test Harness uses simulated workloads from 5,10,20 and 40 concurrent queries Formal signoff once HP and Microsoft have optimally tuned configuration

HP Fast Track Futures : 

HP Fast Track Futures Fast Track HA Solution Direct Attached Storage HP Bladesystem Solid State Storage Other BI Systems OLTP SSIS

SQL Server Parallel Data Warehouse : 

SQL Server Parallel Data Warehouse

SQL Server Parallel Data Warehouse : 

SQL Server Parallel Data Warehouse Tier-1 Enterprise Data Warehouse Appliance Offering High scalability from tens to hundreds of terabytes High performance through the MPP system Flexibility and Choice Choice of deployment options through distributed architecture Most Comprehensive Solution Complete data warehouse solution spanning desktop, enterprise data warehouse, and data marts

Slide 33: 

CONTROL RACK DATA RACK

Slide 34: 

CONTROL RACK Client connections always go through the control node Contains no persistent user data Parallel Data Warehouse advantages: Processes SQL requests Prepares execution plan Orchestrates distributed execution Local SQL Server processes final query plan and aggregates results Provided by DataDirect Open database connectivity (ODBC), object linking and embedding database (OLE DB), Java Database Connectivity (JDBC), and ActiveX® Data Objects (ADO.net) client drivers Wire protocol (SeQuel link) Drivers are available for 32 bits and 64 bits CONTROL NODE

Slide 35: 

CONTROL RACK Provides high-capacity storage for data files from ETL processes Is available as a sandbox for other applications and scripts that run on the internal network Provides SQL Server Integration Services LANDING ZONE DWLoader or SQL Server Integration Services

Slide 36: 

CONTROL RACK Provides Integrated Backup Solution Integrates with 3rd party backup option Orderable in different sizes BACKUP NODE

Slide 37: 

DATA RACK Data Rack Servers 10 active + 1 passive HP ProLiant DL360 G7 compute nodes InfiniBand, FC and Ethernet switching, 42U rack Expansion Grow from 1–4 data racks, storage options, test/dev system Storage 10x HP StorageWorks MSA P2000 G3 Consists of COMPUTE NODES and STORAGE NODES

Slide 38: 

DATA RACK Data Rack Servers 10 active + 1 passive HP ProLiant DL360 G7 compute nodes InfiniBand, FC and Ethernet switching, 42U rack Expansion Grow from 1–4 data racks, storage options, test/dev system Storage 10x HP StorageWorks MSA P2000 G3 COMPUTE NODE Each MPP node is a highly tuned symmetric multi-processing (SMP) node with standard interfaces Provides dedicated hardware, database, and storage Runs SQL Server Spare Node provides failover in case of node failure Drives are configured as RAID 1

PDW – Client Connectivity : 

Client Drivers ETL Load Interface Support/Patching Corporate BackupSolution CONTROL RACK DATA RACK PDW – Client Connectivity

PDW – Query Processing : 

QUERY CONTROL RACK DATA RACK ??? ??? ??? ??? ??? ??? ??? ??? ??? ??? ??? ??? PDW – Query Processing

Administrative Console : 

Administrative Console https://controlnodeipaddress Dashboard Query activity Load activity Backup and restore Active locks Active sessions Alerts Appliance state

Parallel Data Warehouse Configuration Manager : 

Parallel Data Warehouse Configuration Manager Appliance topology Services status Network configuration Privileges

Flexible Business Alignment : 

Parallel database copy technology enables rapid data movement and consistency between EDW and data marts Create SQL Server 2008 R2, Fast Track Data Warehouse,and SQL Server Analysis Services Data Marts Supports user groups with very different service-level agreements (SLAs): Performance Capacity Loading Concurrency Flexible Business Alignment A distributed architecture gives you the flexibility to add or change diverse workloads or user groups while maintaining data consistency across the enterprise

Customers and Partners Investing with Confidence : 

Customers and Partners Investing with Confidence “HP and Microsoft are consistently our customers’ platform of choice because they deliver complete infrastructure and application solutions without locking customers in to specific products or architectures. This announcement demonstrates that through their strong partnership, HP and Microsoft deliver joint solutions today that support a vision of the future that clearly aligns with our customers vision of IT and the benefit of supporting business processes.”– Jörg Laufer, Director of Sales “We’ve taken a lot of the limits off of traditional IT thanks to the HP and Microsoft solution. Virtualization has freed the business to grow in new ways. We have been able to achieve a dynamic IT infrastructure and can almost double computing capacity on-demand and across the enterprise.” Matt Lavallee, Director of Technology, MLS Property Information Network, Inc. “Eaton and Associates realizes significant value in being a Frontline Partner. We depend On HP and Microsoft for infrastructure, virtualization, and application solutions that are Enterprise class but without the enterprise price tag to meet our growing customer needs” John Eaton – President, Eaton & Associates

Modernize your IT EnvironmentEvaluate and implement cloud ready infrastructure : 

Modernize your IT EnvironmentEvaluate and implement cloud ready infrastructure Contact your HP/Microsoft Sales Account Manager or Frontline Partner to learn more Implement Hyper-V, Exchange and SQL Server Integrate Insight Control for MS System Center Fast Track and Data Warehouse solutions SQL Server upgrade and consolidation Exchange Server upgradeand migration New Business Value services for Next generation application platform Performance and scalability optimization for SQL Server and Exchange Server HP P4000 Virtual SAN Appliance tune for Hyper-V Microsoft Core Infrastructure Virtualization Client and Virtualization Services Data Management Solutions around OLTP, DW, BI Upgrades or Migration of Messaging and Unified Communications solutions Private Cloud for Microsoft Engage Plan and Design Implement Protect Your Investment

Resources : 

Check out the joint solution www.hp.com/go/microsoft/infra2apps www.microsoft.com/go/hp For more information: Please contact your HP or Microsoft Account Manager /Sales lead Contact a HP-Microsoft Frontline Partner Resources

Resources : 

Resources All Up Data Warehouse: From SMP to Parallel Data Warehouse Dandy Weyn Sr. Technical Product Manager Brian Mitchell Sr. Premier Field Engineer Fast Track Data Warehouse V3.0New Features and Best Practices Michael Bassett Program Manager II Microsoft Jim Hautala Solutions Engineer HP

Slide 48: 

© 2009 Microsoft Corporation. All rights reserved. Microsoft, MSDN, the MSDN logo, and [list other trademarks referenced] are trademarks of the Microsoft group of companies.   The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation.  Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation.  MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED, OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

authorStream Live Help