You are not logged in.
Announcement
Unanswered posts
|
Dear Community,
We have got a data mart project where we need to synch data from operational(production) database with our data mart.
We are going to implement data synchronization without using CDC for phase 1. In the mean time we will evaluate talend CDC for
phase 2.
I have read the forum and got the idea about implementing insert,update and delete operation from this
link http://www.talendforge.org/bugs/view.php?id=11196. Thanks to shong.It works for if production and data mart table structures ID match where reject will do insert otherwise update. My requirement is as followed. Please help me get the idea of which component do I need to complete the job. We are using MSSQL 2008 R2.
Example CASE: TWO PRODUCTION DB TABLES AND ONE DATA MART TABLE
Table Branch (production table)
branchID int primary key,
branchcode varchar(10)
Table Employee (production table)
employeeID int primary key,
employee code varchar(10)
branchID int Where branchID is the foreign key of branch table.
Data mart table branchEmployee
branchEmployeeID int primary key,
branchID,
branchCode,
employeeID,
employeeCode
TEST CASE 1:Create new branch.
branchID = 1
branchCode = "B101"
Run ETL will create a insert in branchEmployee table
branchEmployeeID=1
branchID=1
branchCode="B101"
employeeID=NULL
employeeCode=NULL
TEST CASE 2: Create new employee 1.
employeeID = 1
employeeCode = "E101"
branchID=1
Run ETL will create a update in branchEmployee table
branchEmployeeID=1
branchID=1
branchCode="B101"
employeeID=1
employeeCode="E101"
TEST CASE 3: Create new employee 2.
employeeID = 2
employeeCode = "E102"
branchID=1
Run ETL will create a insert in branchEmployee table
branchEmployeeID=1
branchID=1
branchCode="B101"
employeeID=2
employeeCode="E102"
I think many of you already have achieved this task. I would be grateful if someone can guide me about the work flow of components complete the process.
Thanks in advance.
Asif.