Our partnership with Google Cloud has allowed me an opportunity to explore Google Cloud Platform's (GCP) Big Data and Cloud Data Warehouse technologies. I recently helped a client pursue a Proof of Concept in order to explore the viability of using GCP's Cloud Dataflow and BigQuery services in order to uplift their reporting and analytics capability.
We have been in the era of data-lakes for a few years now, the term has been thrown around by numerous industries as a solution to all of our data problems - a place to store all of our data. But how do we ensure that we prevent failures and make it work, what is the way forward?
Everyone usually has great intentions, the notion of having all your data sitting in one central place is a noble goal, though are you at risk, or have you already built a data-swamp?