Talend community forum / Launching a talend job before displaying result in the Browser

sche4 · 2010-12-27 17:12:07

Tags: [database, date, development, MDM, oracle, tos]

Hi.

I have created domain model in Talend MDM CE to synchronize the MDM db data with an oracle table data (bi-direction).
Is it possible to launch a talend job when I click "Search" on the "Browse Records" tab?

I want to refresh mdm data with the oracle data before displaying the result of the search in the Browse Records tab

Thank you.

sche4 · 2010-12-28 16:25:45

any idea?

dafonso · 2011-01-03 12:37:31

Hi sche4,

I really don't think that is possible... at least without doing some changes on the MDM source code, which I think you shouldn't do. Of course that doesn't mean it is not possible. It sure is possible, almost everything is when you have the source code available.

On the other side, I really don't understand why would you want that behavior and why you are replicating your data on Oracle DB, turning it the Master Data Manager when that should be on MDM... That defeats the purpose of MDM, Master Data Management. Why would the data be on Oracle if it is Master Data?

Best regards,
Diogo

muraliv · 2011-01-06 01:07:29

Hi sche4,
I agree with dafonso, but I found something that may be what you need, check it out...

Go to > View (in MDM server tree structure)
> Click on Browse_items_<yourEntityName>
> Just below Description you see an option "Run this view results through a process"

I believe you could have a process that calls a refresh of data from oracle into MDM... hope this is what you need!

sche4 · 2011-01-06 09:58:26

Hello,

Thank's for the reply.
Muraliv, I have already try this but nothing happens when I launch the search.
But when I double-click a record to view all the attributes, It launch the talend job to refresh the MDM data base. When I click Refresh I get the oracle db data. So It don't work very well.

Dafonso, in MDM you may have to look up some fields from source system like CRM, ERP... So you have to synchronize your MDM with your sources when a user browse the data.

Best regards,
sche4

muraliv · 2011-01-06 13:45:05

sche4,
There are two ways to look at this technical issue and Design issue.

Design: I disagree that you want to refresh data every time someone wants to browse data. This is not efficient at all. You want to pull the data only once. I would execute the refresh talendMDM process(as a web service) when something changes on CRM/ERP/e.t.c. systems. I like to call this "PUSH TO talendMDM"

Technical issue: If there is a china wall between the CRM system and other applications, you cannot do anything there, and the only option is to "PULL FROM talendMDM". In this scenario, you don't want to pull data every time someone views/browse the data. You want to refresh the data for "that specific record" the user double clicks (only if there are changes). This is good for data that already exists in talendMDM. For new records created in CRM/ERP systems, You should have a batch process that runs every 30 mins...

Final note: It appears to me that you are trying to use talendMDM as a reporting tool. While you can do this, its not made for reporting purposes.

sche4 · 2011-01-06 15:03:29

I use it for reporting and updating only.

Thank you very much.

dafonso · 2011-01-13 01:21:41

sche4 wrote:
Dafonso, in MDM you may have to look up some fields from source system like CRM, ERP... So you have to synchronize your MDM with your sources when a user browse the data.

sche4,

I totally agree with muraliy.

muraliv wrote:
Design: I disagree that you want to refresh data every time someone wants to browse data. This is not efficient at all. You want to pull the data only once. I would execute the refresh talendMDM process(as a web service) when something changes on CRM/ERP/e.t.c. systems. I like to call this "PUSH TO talendMDM".

Your work is on the "source" side. I quoted source on purpose. Whem you start using MDM, MDM is the source... that's why they call it Master Data. You have to work on the feed from CRM/ERP/etc to MDM so that it is pushed to MDM, not the opposite.

sche4 · 2011-01-13 14:42:12

thank you dafonso

Sam

Announcement

Unanswered posts

#1 2010-12-27 17:12:07

Launching a talend job before displaying result in the Browser

#2 2010-12-28 16:25:45

Re: Launching a talend job before displaying result in the Browser

#3 2011-01-03 12:37:31

Re: Launching a talend job before displaying result in the Browser

#4 2011-01-06 01:07:29

Re: Launching a talend job before displaying result in the Browser

#5 2011-01-06 09:58:26

Re: Launching a talend job before displaying result in the Browser

#6 2011-01-06 13:45:05

Re: Launching a talend job before displaying result in the Browser

#7 2011-01-06 15:03:29

Re: Launching a talend job before displaying result in the Browser

#8 2011-01-13 01:21:41

Re: Launching a talend job before displaying result in the Browser

sche4 wrote:

muraliv wrote:

#9 2011-01-13 14:42:12

Re: Launching a talend job before displaying result in the Browser

Board footer