Loading data into your database is one of the most important tasks. You need to do this accurately and quickly. Here's how.
You'll need a copy of pgloader, which is available at http://github.com/dimitri/pgloader.
At the time of writing this book, the current stable version is 3.1.0. The 3.x series is a major rewrite, with many additional features, and the 2.x series is now considered obsolete.
PostgreSQL includes a command named
COPY that provides the basic data load/unload mechanism. The
COPY command doesn't do enough when loading data, so let's skip the basic command and go straight to pgloader.
To load data, we need to understand our requirements, so let's break this down into a step-by-step ...