...
Append Mode:
This mode appends the new records to the existing data in the target.
Use this mode when you want to add new data to the target without altering the existing records.
Suitable for use cases where historical data is retained and new records need to be appended regularly.
Overwrite Mode:
This mode overwrites all existing data in the target with the new data being processed.
Use this mode when you need to completely replace the target data with the latest dataset from the source.
Suitable for scenarios where data in the target should always reflect the most up-to-date version of the source data without retaining any older records.
Incremental Mode:
This mode updates the target with only the new or modified records from the source.
It updates existing records in the target or inserts new ones without removing any unmodified records.
Suitable for use cases where the target data needs to stay synchronized with changes in the source, such as updating customer records or inventory lists, while keeping previous data intact.
Additional Info on Incremental Save Mode: Primary Key Selection:
When using Incremental Save Mode in EazyDi, an additional option is provided to select a primary key for the target. This selection is available via a dropdown that lists all the columns in the target. Regardless of whether the primary key already exists in the target, users can choose any column from the dropdown to designate it as the primary key. This feature helps in scenarios where the primary key might need to be updated or redefined.
Use Case:
Custom Primary Key Selection: In cases where the target might not have a clear or fixed primary key, or where users want to adjust the key selection, the ability to choose a primary key from the available target columns provides flexibility in data synchronization.
Summary of Pipeline Modes :-
...