How to use Change Data Capture in Oracle (Step 1/4) Learn how to implement a Change Data Capture (CDC) in Oracle

Data warehousing involves the extraction and transportation of data from one or more databases into a target system or systems for analysis. But this involves the extraction and transportation of huge volumes of data and is very expensive in both resources and time.

The ability to capture only the changed source data and to move it from a source to a target system(s) in real time is known as Change Data Capture (CDC). Capturing changes reduces traffic across a network and thus helps reduce ETL time.

With this serie of four tutorials, you will learn how to implement a Change Data Capture under Oracle:
- [How to use Change Data Capture in Oracle (Step 1/4)]
- [How to use Change Data Capture in Oracle (Step 2/4)]
- [How to use Change Data Capture in Oracle (Step 3/4)]
- [How to use Change Data Capture in Oracle (Step 4/4)]

Release Notes:
A new type of CDC has been integrated in Talend Integration Suite 3.2.

The new CDC -only available now on Oracle and AS400- is based on the log file. As a consequence, the redo log mode is less intrusive than the Trigger mode, generated by Talend.The DBA will appreciate more this CDC version that the older.

Download it!

Do you want to practice?

Download tutorialProject.zip includes all the jobs needed to carry out this tutorial. Please, download it!

You can also:
Send it!

Share it!
Next Step: [How to use Change Data Capture in Oracle (Step 2/4)]

 


Step 1: Create the company's CRM system


Objective: Create a database containing the table Customers.

Create a new user in Oracle called DATA. To do this, open a Web browser and navigate to your Oracle administration page. Connect with the system user and click Home > Administration > Manage Database Users.

Next

Click Create and create the DATA user, assigning him all permissions by clicking Check All.

Next

Repeat the operation with the CDC user. To do this, open a Web browser and navigate to your Oracle administration page.

Connect with the system user and click Home > Administration > Manage Database Users.

Next
Create a new user in Oracle called DWH. To do this, open a Web browser and navigate to your Oracle administration page.


Connect with the system user and click Home > Administration > Manage Database Users.

Click Create and create the DWH user, assigning it all permissions by clicking Check All.

Next

Step 2: Give the rights to the users


Click on Home > SQL > SQL Commands > Enter Command.



Next

Allow the user to access all the views. To do so, execute the query below in Home > SQL > SQL Commands.

GRANT CREATE ANY VIEW to CDC
Click on Run.

Next

Allow the user to access all the tables. To do so, execute the query below in Home > SQL > SQL Commands:

GRANT CREATE ANY TABLE to CDC 

Click the Run button.
Next

Step 3: Create the DB connections from Talend Studio


In the Studio, click Repository > Metadata. Right-click Db Connections and select Create a connection. It opens the Database Connection  wizard. In the Name field, type in DATAOracle.


Click on Next.

Next

In the Database Settings area:
In the DB Type list, select the type of database you want to connect to.

In the Login and Password fields, fill in the login and password used to connect to the database.

In the Server field, fill in the name or IP address of the server on which the database is stored.

In the Port field, fill in the listening port number of the database server.

In the Database field, fill in the name of the database you want to connect to.

Click Check to verify the database connection and click on Finish.

Next

In the Studio, click Repository > Metadata. Right click Db Connections and select Create a connection. It opens the Database Connection  wizard. In the Name field, type in CDCOracle.


Click on Next.

Next
In the Database Settings area:

In the DB Type list, select the type of database you want to connect to.

In the Login and Password fields, fill in the login and password used to connect to the database.

In the Server field, fill in the name or IP address of the server on which the database is stored.

In the Port field, fill in the listening port number of the database server.

In the Database field, fill in the name of the database you want to connect to.

Click Check to verify the database connection, and click on Finish.
Next
In the Studio, click Repository > Metadata. Right-click Db Connections and select Create a connection. It opens the Database Connection  wizard. In the Name field, type in DWHOracle.


Click on Next.

Next
In the Database Settings area:
In the DB Type list, select the type of database you want to connect to.

In the Login and Password fields, fill in the login and password used to connect to the database.

In the Server field, fill in the name or IP address of the server on which the database is stored.

In the Port field, fill in the listening port number of the database server.

In the Database field, fill in the name of the database you want to connect to.

Click Check to verify the database connection and click on Finish.

 

    Download it!     Send it!     Share it!

Do you want to practice?

Download tutorialProject.zip includes all the jobs needed to carry out this tutorial. Please, download it!

Friends / colleagues may be interested in this tutorial? Send it to them!

You liked this tutorial ? Support it!

[ top ]