Creating a data replication task

Create a data replication task to efficiently and securely move data between supported data sources and targets. Data can be transformed and kept continually up-to-date with CDC.

There are two types of replication use case:

• Replicating data

• Landing data in a data lake

  Information noteWith all subscription tiers except the Qlik Talend Cloud Starter subscription, the replication use cases are split into separate replication task types: A "Replicate data" task for replication to databases and data warehouses, and a "Land data in data lake" task, for replication to cloud storage. With a Qlik Talend Cloud Starter subscription, there is no separate "Land data in data lake" task for cloud storage. Instead, the "Replicate data" task supports replication to all supported targets (databases, data warehouses, and cloud storage).

The data replication process consists of the following operations:

• Retrieving the data from the data source
• Transforming the data (optional)
• Loading the data to the target
• Keeping the data up-to-date with scheduled or real-time change capture

Set up connections to your data sources and targets

While it is possible to set up connections during task setup, best practice dictates that you define and verify your connections before you set up your replication task. This way, you when you set up your task, all you need to do is simply select the connectors you configured earlier.

Set up replication tasks