Case Studies in Big Data Integration
I spoke with Aaron Werman, the Director of Big Data and Database Innovation at a major payment processing company, about the introduction and use of Hadoop in their data management environment. The company provides a seamless experience to merchants, allowing various payment forms. There’s a high chance that your last credit card authorization was processed by their gateways.
How they use Hadoop
The company has built a data lake in Hadoop (Cloudera distribution). They are not standardizing the data; there is no ETL. The “ingest reflects exactly the data as visible in source,” according to Werman. It involves transactional data collection with light formatting. ...