josiete.com

OLTP

CDC: keep data in sync without copying everything again

A transactional database sends small blocks of changes to an analytical system

Imagine a shop with ten million orders in its database. The analytics team needs to query today’s sales, so it copies those orders into an analytical warehouse every night. If only ten thousand changed today, transferring all ten million again is slow and expensive. Change Data Capture (CDC) identifies the changes so the pipeline can send only what is needed.