Data Lake for Enterprises

Configure data source (ingestion)

In this section we will see how to configure our data source which will be considered as a source for data ingestion into our Data Lake.

1. Login into PostgreSQL database using a client (pgAdmin4) with the user postgres and respective credentials.
2. Create the source database that would have customer profile information. This database can be created using pgAdmin4 UI, let us name it as sourcedb.
3. Execute the following script to create the table:

CREATE TABLE public."customer"(     id integer NOT NULL,     first_name character varying COLLATE pg_catalog."default",     last_name character varying COLLATE pg_catalog."default",     dob date,     CONSTRAINT "customer_pkey" PRIMARY KEY (id))WITH (     OIDS = FALSE)TABLESPACE pg_default; ...