Data Lake for Enterprises

Data Frames

Data Frames represent a window of time that allows for executing operations on the time-windowed dataset. One of the most common of such operations is executing SQL queries on the specific windowed dataset or Data Frame via a Spark session. This allows a quick analysis of data streamed into a given time window and performing of windowing operations. A Data Frame is generally seen as a set of columns that can be logically considered as a table but with optimizations to perform quick operations with a SQL-like interface provided by the Spark framework.