Integrate your data through CDC (change data capture)

Integrate, analyze data faster and eliminate the need for bulk load updates. Use fewer system resources with CDC (change data capture).

How does it work?

icon
Our CDC extractor connects to the SQL server and downloads the so-called log (binary log).
icon
Using the binary log, the extractor is able to capture all events happening to each row in every table of your database instance. Whether it be an update, insertion or even deletion of a row.
icon
These events are then converted into a table in Keboola (usually SnowflakeDB) and replicate what your table actually looks like in your database server.

Keboola offers this functionality to both Keboola-provided and independent database backends

Ilu

What are the advantages?

It’s fast

Each replication starts where the last one finished, meaning no event gets processed twice.

It’s lightweight

Performance of the SQL server will in no way be affected by the replication.

It’s scalable

There's no limit on how many tables you can replicate - even 200+ tables is okay.

It’s automated

The whole process can be automated using a companion app. If new tables are added to your database, the companion app can fetch these and automatically add them to the replication process. The same applies to the schema changes.

Run a 100% data-driven business without any extra hassle.
Pay as you go, starting with our free tier.

How often can replication be run?

That's completely up to you. You can have the replication running once a day or even every 5 minutes. The CDC replication is fast enough to handle it.

Keboola supports these CDC technologies:

  • MySQL CDC
  • AWS Aurora CDC
  • Oracle CDC (in progress)
  • PostgreSQL CDC (in progress)