Data Lake for Enterprises

Enterprise's current state

As explained briefly in the previous sections, the current state of enterprise data in an organization can be summarized in bullets points as follows:

• Conventional DW (Data Warehouse) /BI (Business Intelligence):
  • Refined/ cleansed data transferred from production business application using ETL.
  • Data earlier than a certain period would have already been transferred to a storage, which is hard to retrieve, such as magnetic tape storage.
  • Some of its notable deficiencies are as follows:
    • A subset of production data in a cleansed format exists in DW; for any new element in DW, effort has to be made
    • A subset of the data is again in DW, and the rest gets transferred to permanent storage
    • Usually, analysis is really slow, ...