Data Engineering for Beginners

Data Engineering Glossary

ACID — 

Set of properties (Atomicity, Consistency, Isolation, Durability) ensuring reliable database transactions.

Ad Hoc Query — 

A one-time query created for a specific analysis purpose, not regularly scheduled.

Aggregate Function — 

A function that performs a calculation on a set of values (e.g., SUM, AVG).

Algorithm — 

A step-by-step method for solving a problem or performing a task.

Alias — 

Alternative name for a database table or column, often used for simplicity.

Anomaly Detection — 

Identifying unusual patterns in data that do not conform to expected behavior.

ANSI SQL — 

A standardized version of SQL agreed upon by the American National Standards Institute.

API — 

Application programming interface; allows software components to communicate.

Append-Only — 

A data storage model where new data is only added, not modified.

Array — 

A data structure that holds a collection of elements, typically of the same type.

Artificial Intelligence — 

The simulation of human intelligence processes by machines.

Asset — 

A valuable piece of data, system, or infrastructure in an organization.

Authentication — 

Verifying the identity of a user or system.

Authorization — 

Granting access permissions to users or systems.

Autoscaling — 

Automatically adjusting resources based on system load.

Availability — 

Measure of a system’s operational performance and uptime.

Backup — 

A copy of data stored separately to prevent data loss.

Batch Processing — 

Processing data ...