• Index
  •  » Talend Open Studio for Data Integration » Usage, Operation
  •  » tELTMap component link to standard tMap

#1 2007-09-03 16:07:21

pemen
Member
Company: EUROFINS
Registered: 2006-10-04
Posts: 59

tELTMap component link to standard tMap

Tags: [elt, mysql]

I need to have 5 source table in database with a lot of data in these tables.
It's not possible to us the standard DBInput for all tables because the lookup will be too big.
So the idea is to use different tELTInput connected to a tELTMap.
The tELTMap process the (big) query in the database and the output of this tELTMap go to
a standard tMap instead of tELTOutput. In this case the job can continue in the standard TALEND
process.

Is it possible ?

Offline

#2 2007-09-03 21:24:07

ccarbone
Administrator
Registered: 2006-09-19
Posts: 1212
Website

Re: tELTMap component link to standard tMap

pemen wrote:

I need to have 5 source table in database with a lot of data in these tables.
It's not possible to us the standard DBInput for all tables because the lookup will be too big.
So the idea is to use different tELTInput connected to a tELTMap.
The tELTMap process the (big) query in the database and the output of this tELTMap go to
a standard tMap instead of tELTOutput. In this case the job can continue in the standard TALEND
process.

Is it possible ?

Hi Pierre-Eric,
ELT components generate SQL query to insert/update/delete rows on one or several  DB tables.
My proposal is to split your job on 3 sub job :
1/ The first subjob used 5 ELTInput connected to a tELTMap. The tELTMap connected  to a tELTOutput (the staging table).
2/ A subjob (called by the previous subjob thanks a "Then run" link) will read the stagging data (tDBInput) and will be connected to your tMap.
3/ The last subjob (called by the previous subjob thanks a "Then run" link) will delete the temporary table (truncate stagging table).

Offline

#3 2007-09-04 08:57:14

pemen
Member
Company: EUROFINS
Registered: 2006-10-04
Posts: 59

Re: tELTMap component link to standard tMap

Hello,

Yes indeed it's what i'm thinking about after my post in this forum.
Right now, i'm working on modified version of ELTOracle adapt for MSSQL.
I will make the test and come back here for feedbacks.


Regards

Last edited by pemen (2007-09-04 10:29:05)

Offline

  • Index
  •  » Talend Open Studio for Data Integration » Usage, Operation
  •  » tELTMap component link to standard tMap

Board footer

Powered by FluxBB