Talend community forum / tParallelize question

Suri · 2009-08-03 22:58:21

Tags: [database, java, sybase, tParallelize]

Hi all,
I have a question on the usage of the tParallelize component. Since I have many databases to lookup info from before joining, is there a way for me to parallelize the lookups and then have the join happen. If possible would you please show me how? e.g.

I have data from a table in db1.table (300K) and will be joined with db2.table (300K) and db2.table_lkup (2K)

Is there not a way for me to parallelize the loading of db1.table and the result of db2.table and db2.table_lkup and have them join later?

Thanks for any responses.

shong · 2009-08-04 07:46:53

Hello
tParallelize is used to parallelize several subjobs.(see my screenshot) In your case, you can parallelize the loading of db1.table and the result of db2.table and db2.table_lkup in two temporary files, and afer these transcation, do the join in another subjob.

Best regards

shong

amitkhatua · 2012-05-20 09:17:17

hi shong,
is tParallelize available in TOS for MDM 5.0.2 community version? if so then could you please provide me some links where i can find the documents in that?

shong · 2012-05-20 15:24:59

amitkhatua wrote:
hi shong,
is tParallelize available in TOS for MDM 5.0.2 community version? if so then could you please provide me some links where i can find the documents in that?

Hi
The tParallelize component is only available in Talend Enterprise products.

Best regards
Shong

Announcement

Unanswered posts

#1 2009-08-03 22:58:21

tParallelize question

#2 2009-08-04 07:46:53

Re: tParallelize question

#3 2012-05-20 09:17:17

Re: tParallelize question

#4 2012-05-20 15:24:59

Re: tParallelize question

amitkhatua wrote:

Board footer