You are not logged in.

Unanswered posts



Important! This site has been replaced. All content here is read-only. Please visit our brand-new community at https://community.talend.com/. We look forward to hearing from you there!



#1 2017-03-16 13:44:48

Sankhedipika
Guest

Sankhedipika said:

set priority to read lookup files

Hi,
 
We have requirement to update main table (>30millions) based on business rules & lookup files. There are 46 lookup files with different schema & business rule. The priority to update is set for each lookup file & it need to done accordingly.
 
[table][tr][td]File Priority[/td]
[td]File Name[/td]
[/tr]
[tr][td]1[/td]
[td]AA.txt[/td]
[/tr]
[tr][td]3[/td]
[td]BB.txt[/td]
[/tr]
[tr][td]2[/td]
[td]XX.txt[/td]
[/tr]
[tr][td]4[/td]
[td]ZZ.txt[/td]
[/tr]
[/table]
 
In this case the update will happen in order: AA,XX,BB,ZZ

The solution which we can think is:
Main Table -->(Lookup AA.txt)-->tMap1--->(Lookup XX.txt)-->tMap2--->(Lookup BB.txt)-->tMap3--->(Lookup ZZ.txt)-->tMap4--->so on...
Is this approach feasible? Whether it is achievable with one tMap?

 
Please suggest optimum development approach for this scenario.
Thanks

#2 2017-04-05 09:58:40

Abcd123
Guest

Abcd123 said:

Re: set priority to read lookup files

Whether it's possible in Talend to set priority for lookup files?

#3 2017-04-05 21:36:48

vapukov
Member
470 posts

vapukov said:

Re: set priority to read lookup files

read file(tFileInputDelimited) -> sort file (tSortRows) -> iterate over sorted rows (tFlowToIterate)

Offline

Board footer

Talend Contributor Agreement - Talend Website Privacy Policy