xufei.biz

CDC（Change Data Capture）

2 min read

定义

Change data capture describes the process of recording the change of data in a database. Typically, this means tracking when records are inserted, updated, and deleted along with the data itself.

捕获追踪数据库中数据的变化（CRUD操作），一般是分析数据库日志中的数据

Image Source

Azure Start Up CDC

-- 1. 检查当前数据库CDC状态
SELECT name, is_cdc_enabled 
FROM sys.databases 
WHERE name = ${DD_NAME};
 
-- 2. 如果未启用，启用CDC
USE 你的数据库名;
GO
 
EXEC sys.sp_cdc_enable_db;
GO
 
-- 3. 为表启用CDC
EXEC sys.sp_cdc_enable_table
    @source_schema = N'${schema_name}',
    @source_name   = N'${table_name}',
    @role_name     = NULL,
    @supports_net_changes = 1;
 
-- 4. 验证
SELECT name, is_cdc_enabled 
FROM sys.databases 
WHERE name =   ${DD_NAME};

案例

When to use change data capture

Change data capture is typically used to replicate data that is overwritten to another database. For example, replicating data from an operational database to a data warehouse. While the operational database may not need to store historical changes, it might be useful for analysis.

A few situations where you might use change data capture:

  • Replicate changes into a data warehouse or data lake
  • Replicate changes into Kafka (or other streaming tool) in a microservices architecture
  • Upgrade a database to a higher version with minimal downtime
  • Migrate data from database X to database Y with minimal downtime

Resource

Graph View

Backlinks