• Index
  •  » Talend Open Studio for Data Integration » Usage, Operation
  •  » optimization of Talend job with tnormalize

#1 2011-11-30 10:35:27

rtom
Guest

optimization of Talend job with tnormalize

Hello,

I have one field in a table which is a list of id separated by commas (as : '1,3,5,8').
I have in another table the label of these ids, then I would like to have in my final field, the list of label (as : 'Test, Acc, Prod, Finish').
I have found one way to solve this problem, using tnormalize and then tdenormalize. The problem is that my Talend job is very very slow if I put this part as lookup on my main flew, and it is not working if I put it in my main flew (I have Java memory error) because it manages more than 75000 lignes with a lot of columns.
Anyway, my question is, how can I manage this case ? Is there another way which could make my job being faster ?

Thank you for your help
Regards

#2 2011-12-01 06:19:10

pedro
Member
Registered: 2011-11-17
Posts: 3682

Re: optimization of Talend job with tnormalize

Hi
You may find more details in your another topic.
http://www.talendforge.org/forum/viewto … 608#p70608

Best regards!
Pedro


Only Paranoid Survive.

Offline

  • Index
  •  » Talend Open Studio for Data Integration » Usage, Operation
  •  » optimization of Talend job with tnormalize

Board footer

Powered by FluxBB