Rethink BI : Business Insights over Business Intelligence
The purpose of this business insights thought leadership blog is to share the HP point of view on industry trends such as Big Data and Real Time Analytics, and provide updates on key innovations and solutions.

The EDW evolution continues and it is Bigger, Faster and Better !

As some of you may have heard, during the week of November 6th, 2012 HP and Microsoft has announced the next generation of the Enterprise Data Warehouse (EDW) Appliance.

 

Let’s take a moment to discuss some major changes and feature enhancements....

“Big Data” definitions may vary based on your perspective

In my previous BLOG entry titled (What is big data and how big is BIG !), I touched on how the term “big data” can vary based upon your point of view.  This BLOG is an extension of that discussion.

IDC defines “big data” as being greater than 100 TB, growing at 60%+, at least two data sources, typically running on scale-out architecture.

Structured data

Companies try to mine data from internal (i.e. OLTP systems), as well as external sources to make strategic and tactical decisions for their business. In general, approximately 10% of the overall “big data pie” may be referred to as “structured big data”. The other 90% is unstructured or semi-structured data.

Over the past 20+ years, the industry has primarily focused helping businesses store massive amounts of structured data in data warehouses and data marts. Then this structured data in converted information when users leverage various tools to analyze the data.

Even if we assume that only 10% of a company’s data is structured, it is likely to be considered “big data” if you are a phone company, bank or stock exchange or broker. Each industry has its own type of structured big data which may be in the 10s or hundreds of terabytes range.

It is also common for this OLTP structured data to provide the truest representation of a company’s current state, past and future trends.

Search
Showing results for 
Search instead for 
Do you mean 
Follow Us


About the Author(s)
  • Technology marketing professional with over 25 years of experience in energy, semiconductor and IT industries.
  • Jeff Spiller has over 30 years experience in architecting highly available and scalable multi-tier platforms for a variety of Fortune 500 companies. He is currently HP’s technical lead for the Enterprise Data Warehouse (EDW) Appliance, optimized for Microsoft Parallel Data Warehouse (PDW) software. As a member of HP's ESS Performance and Solutions Engineering COE (Center of Excellence), Jeff has a proven track record for designing, tuning and performing capacity planning in OLAP, ROLAP, OLTP and consolidated environments.
  • Focused on cloud, virtualization and appliance solutions for HP technology.
  • HP Servers, Converged Infrastructure, Converged Systems and ExpertOne
The opinions expressed above are the personal opinions of the authors, not of HP. By using this site, you accept the Terms of Use and Rules of Participation