A Presto connector is a plug-in that connects the Presto engine to an external catalog. Presto connectors are available for a wide variety of data sources, including relational databases, NoSQL databases, and filesystems.
In this chapter, you’ll learn how to implement a custom connector.
First, we’ll describe the concept of the Service Provider Interface (SPI) provided by Presto, which defines the interfaces to build custom connectors, types, functions, and system access control in Presto.
Then, we’ll focus on the concept of connectors and how it’s implemented in Presto. Next, you’ll learn how to implement a custom connector and an alternative implementation, based on Apache Thrift, that enables the communication between Presto and external servers written in any language supported by Thrift, such as Python, PHP, and many more.
Finally, we’ll focus on Apache Pinot, which is a real-time distributed datastore, and how to connect it to Presto.
Service Provider Interface
An SPI is an interface you can use to extend a framework with third-party components. Presto implements its own SPI, as shown in Figure 3-1. The Presto SPI, which is within the Presto server, manages the communication between the Presto core and the external service providers.
Figure 3-1. The SPI architecture
A service provider, wanting to communicate with Presto, must implement a plug-in module, ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month, and much more.
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.
Julian F.
Head of Cybersecurity
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.
Addison B.
Field Engineer
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.
Amir M.
Data Platform Tech Lead
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.
