2/13/2014

The Data Revolution

Data is becoming fragmented.  Internally, from multiple Vendor systems.  Externally, newly created data sets.  One problem is merging them into a cohesive data set.  A second problem is storing the data.  The third problem is unstructured data.  Disparate data.  Volumes of data.  And Data formatting.  Back in the day, the mainframe captured all the data in VSAM flat files.  We then moved to Relational Databases.  Then Data Warehouses and Data Marts and Enterprise Data Warehouses.  Then Self Service Business Intelligence.  Then Big Data.  And what we have now is a mish mash of options, overwhelming amounts of data that doesn't fit together nicely and insufficient resource to process this data into information.  The data is fragmented.  The data storage devices are fragmented by multiple options.  And the number of Vendors arriving to this space is adding complexity.  What we need is a data ecosystem or data hub or data platform to digest all forms of data distributed across multiple commodity hardware servers accessible in real time by average users with built in security and low latency available in the Cloud or On-Premise or Hybrid options with accurate data consumable on demand without requiring a PhD or Data Scientist.  I think Cloudera's solution of the Enterprise Data Hub you can watch a video from the Strata conference here: http://www.youtube.com/watch?v=MCDN3DxYwEE&feature=youtu.be&utm_content=buffer512f4&utm_medium=social&utm_source=twitter.com&utm_campaign=buffer

The video is Vendor specific, however it applies to solving the current problem of tacking data.  We are witnessing the "Data Revolution" similar to the Industrial Revolution, where a new industry is being launched creating jobs and revolutionizing the world as we know it.  We are early in the cycle and things are shifting every day.  Technology is surging forward with new alternatives.  People are waking up to the power of information.  Business Models are being created and altered.  Huge influx of capital and resources are chasing the new Information Gold Rush.

What are you doing today to contribute to the Data Revolution?

No comments:

Post a Comment

Note: Only a member of this blog may post a comment.