Chapter 7. Understand and address data latency requirements 269
Processing window
The ingest processing window is the period where the data is available for
processing by the ingest process. For example, if data is presented to the
data warehouse at 4 p.m. and the processing must be complete by 5 p.m.,
then the processing window is one hour.
Data volume
Data volume refers to the quantity of data presented for ingest during each
processing window. Consider both average and peak volumes and plan for
peak volumes.
7.1.2 Calculate the data ingest rate
Use the values from the SLOs to calculate the rate of ingest required for each of
the data sources. Express the target data ingest rate per data node as
megabytes per second (MBps).
Calculate the ...