Skip to Content
Scaling Data Services with Pivotal GemFire
book

Scaling Data Services with Pivotal GemFire

by Mike Stolz
January 2018
Beginner to intermediate
75 pages
1h 22m
English
O'Reilly Media, Inc.
Content preview from Scaling Data Services with Pivotal GemFire

Chapter 9. Pivotal GemFire Extensions

GemFire-Greenplum Connector

Even though GemFire is built for rapid response time, Pivotal also produces an analytic relational database known as Greenplum. Greenplum was designed to provide analytic insights into large amounts of data. It was not designed for real-time response. Yet, many real-world problems require a system that does both. At Pivotal, we use GemFire for real-time requirements and the GemFire-Greenplum Connector to integrate the two.

The GemFire-Greenplum connector is a bidirectional, parallel data transfer mechanism. It is based on the Pivotal Greenplum Database’s ability to view data residing outside the normal Greenplum storage (external tables) and Greenplum’s parallel data transfer channel (gpfdist). Here’s a brief description of how this works.

The GemFire-Greenplum Connector (GGC) is an extension package built on top of GemFire that maps rows in Greenplum tables to plain-old Java objects (POJOs) in GemFire regions. With the GGC, the contents of Greenplum tables now can be easily loaded into GemFire, and entire GemFire regions likewise can be easily consumed by Greenplum. The upshot is that data architects no longer need to spend time hacking together and maintaining custom code to connect the two systems.

GGC functions as a bridge for bidirectionally loading data between Greenplum and GemFire, allowing architects to take advantage of the power of two independently scalable massively parallel ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

AirBnbBlueOriginElectronic ArtsHomeDepotNasdaqRakutenTata Consultancy Services

QuotationMarkO’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.
Julian F.
Head of Cybersecurity
QuotationMarkI wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.
Addison B.
Field Engineer
QuotationMarkI’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.
Amir M.
Data Platform Tech Lead
QuotationMarkI'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
Mark W.
Embedded Software Engineer

You might also like

Time Series Databases: New Ways to Store and Access Data

Time Series Databases: New Ways to Store and Access Data

Ted Dunning, Ellen Friedman
Spring Data

Spring Data

Mark Pollack, Oliver Gierke, Thomas Risberg, Jon Brisbin, Michael Hunger

Publisher Resources

ISBN: 9781492027584