Page Comparison

...

You have a customer database that contains all customer information, including both current and historical data. The pipeline reads the entire dataset daily to capture changes (new customers, updates to existing customers) and write only these changes to the target, which is a CRM system.

• ALL Read Mode:
  The pipeline reads the entire customer dataset from the source, including all historical records.

• Incremental Save Mode:
  The pipeline updates the target with only the new or modified customer records. Unmodified records in the target are left intact.

Primary Key Selection for Incremental Mode:

When using Incremental Save Mode, EazyDi provides an option to select a primary key for the target. A dropdown containing all target columns is available, allowing users to choose a column to be used as the primary key, regardless of whether it already exists as the primary key in the target. This feature is especially useful in cases where the primary key needs to be updated or redefined.

Use Case:

• Synchronizing Changes: Ideal for scenarios where data changes frequently but only a portion of the dataset is updated each day, such as a customer or employee database where new entries or updates (e.g., contact info) need to be synchronized, while retaining older information. Change Tracking: The source system doesn’t track changes on its own, so you need to read the entire dataset but only write the necessary updates to the targetThe ability to select a primary key from all target columns offers additional flexibility in handling updates and synchronizing data correctly.

...

Summary of Scenarios:

...