Learning Apache Apex
by Ananth Gundabattula, Thomas Weise, Munagala V. Ramanath, David Yan, Kenneth Knowles
JDBC input
The JDBC Poll Input Operator reads records from a table in the source database and emits them as tuples into the Apex processing pipeline.
The operator can function as bounded or unbounded source (it can continuously discover new rows as they are inserted into the table). The operator is idempotent for exactly-once processing and is designed to handle very large tables with parallel reads of non-overlapping key ranges through multiple partitions (the user specifies the partition count as operator property).
The operator requires an ordered column, based on which range queries can be formed. This is a given for those relational databases that use sequences for primary keys or the table should have an alternate (composite) unique ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access