By Jeff Spiller - HP HP Enterprise Data Warehouse / Parallel Data Warehouse Technical Lead
HP Enterprise Data Warehouse Appliance (EDW Version 1.4) has some great customer requested improvements. As many of you know, HP and Microsoft have partnered to provide customers with an industry leading massively parallel SQL Server platform. The HP EDW Appliance has been optimized and enhanced to support Microsoft SQL Server Parallel Data Warehouse Software (version AU3.5).
It should be noted Hadoop connectivity is available to support unstructured and semi-structured “big data” requirements. Structured data may be loaded into the EDW appliance using output from Hadoop MapReduce or by using ETL software.
Personally I prefer systems which can scale-out because they allow the ability to start small using ½ a data rack with 4 active compute nodes and grow to 40 active compute nodes in 4 data racks. The feature of providing close to linear scalability up to 480 active cores is useful to support most customers’ ever increasing workload and data volumes. The HP EDW Appliance is ideal for supporting structured big data requirements up to 610 TB.
I feel end users will be happier with the HP EDW Appliance (V 1.4) because of improvements in query response times and query throughput. In general, I would expect up to 2x performance gains for queries which tend to be CPU intensive and memory bound. Performance gains are a result of:
- Intel Core Microarchitecture Sandy Bridge processors used in HP ProLiant Gen 8 servers (see the HP Technology Brief titled Innovative technologies in HP ProLiant Gen8 servers)
- More memory per compute node (128GB in V1.4 vs. 64GB in V1.3 per Compute node)
- Faster memory in each server
- Larger tempdb space
- FDR Infiniband
- AU3.5 software more effectively taking advantage of Proliant Gen8 processor cores by exploiting NUMA technology to a greater degree
It should also be noted the new HP ProLiant Gen8 technology lays the foundation for a better managed HP EDW Appliance. Speaking of an easier to managed appliance, HP is the only company who provides a comprehensive HP EDW Appliance Support Pack Utility Suite, which includes the following tools:
- Firmware and Driver Validator
- Firmware and Driver Updater
- Hardware Diagnostics
- Device Password Update Utility
- HP EDW reports
The above tools make it easier to manage and maintain the HP EDW Appliance running the Microsoft Parallel Data Warehouse (PDW) software.
Finally, HP and Microsoft have simplified field upgrades for existing HP EDW customers by using HP’s Factory Express and HP/Microsoft Installation services.
Find out further details about the solution at the following link.