CONNECTOR · POSTGRES
Postgres — Logical replication CDC into the warehouse. The most common source we run.
CONNECTOR · POSTGRES
Postgres
Logical replication CDC into the warehouse. The most common source we run.
- categorySource · OLTP
- freshness targetp95 < 5 min via WAL CDC
- auth modelReplication role + SSL + IP allow-list
- sync modeStreaming CDC (logical decoding) + nightly snapshot
TABLES SYNCED
Full schema replication. Watermarks per table. SCD-type-2 supported on dimension tables.
SCHEMA · SAMPLE
schema.sqlSQL
CREATE TABLE stg_orders (
order_id TEXT NOT NULL,
customer_id TEXT NOT NULL,
order_ts TIMESTAMP NOT NULL,
amount_cents BIGINT NOT NULL,
CONSTRAINT pk_orders PRIMARY KEY (order_id)
);QUERY · SAMPLE
query.sqlSQL
0
SELECT
date_trunc( 1 , order_ts) AS d,
SUM(amount_cents) / 100.0 AS revenue
FROM {{ ref( 2 ) }}
WHERE status = 3
GROUP BY 1
ORDER BY 1 DESC;OPS NOTES
Watch out for: long-running transactions on the source clog the WAL. We monitor replication lag and page when it crosses the freshness contract.
Wire a real pipeline to your warehouse
30-min stack review. We come back with a scoped plan, an owner, and a freshness contract. No SDR, no slide deck.