I have multiple tables in a database which have the same structure. I would like to read the tables in series and do some transfomation and then load them into the target. If I put a Union the issue is that unless all the records are fetched it does not start processing also duplicates in union will get deleted.
Also every week new set of tables are created. So I would like to design a process something like filelist where I can populate the list of tables and then iterate it one by one. How do I implement the same in Talend