Chapter 9. Pivotal GemFire Extensions
GemFire-Greenplum Connector
Even though GemFire is built for rapid response time, Pivotal also produces an analytic relational database known as Greenplum. Greenplum was designed to provide analytic insights into large amounts of data. It was not designed for real-time response. Yet, many real-world problems require a system that does both. At Pivotal, we use GemFire for real-time requirements and the GemFire-Greenplum Connector to integrate the two.
The GemFire-Greenplum connector is a bidirectional, parallel data transfer mechanism. It is based on the Pivotal Greenplum Database’s ability to view data residing outside the normal Greenplum storage (external tables) and Greenplum’s parallel data transfer channel (gpfdist). Here’s a brief description of how this works.
The GemFire-Greenplum Connector (GGC) is an extension package built on top of GemFire that maps rows in Greenplum tables to plain-old Java objects (POJOs) in GemFire regions. With the GGC, the contents of Greenplum tables now can be easily loaded into GemFire, and entire GemFire regions likewise can be easily consumed by Greenplum. The upshot is that data architects no longer need to spend time hacking together and maintaining custom code to connect the two systems.
GGC functions as a bridge for bidirectionally loading data between Greenplum and GemFire, allowing architects to take advantage of the power of two independently scalable massively parallel ...
Get Scaling Data Services with Pivotal GemFire now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.
