November 2017
Beginner to intermediate
290 pages
7h 34m
English
As you work, you want quick feedback about how your pipeline is working. You can run the whole pipeline in a local process using DirectRunner. This is an in-process Java runner that runs extra checks to help ensure that your pipeline will be robust when it is really deployed.
For demonstrating the invocation, we will switch to the more full WordCount example that supports command-line configuration. You can get a project set up to run this by following https://beam.apache.org/get-started/quickstart-java/. For our purposes, run this command:
mvn archetype:generate \
-DarchetypeGroupId=org.apache.beam \
-DarchetypeArtifactId=beam-sdks-java-maven-archetypes-examples \
-DarchetypeVersion=2.2.0 ...Read now
Unlock full access