Hi

I use talend open studio 5.0

I have a delimited file which brings millions of records and I have to do checks on the fields (filters) and inner join to see if a field is valid.
Of a line I have to validate all fields and give all the possible errors in an audit table in database

So the only way I happened to read a file n times for validation or inner join to spend more

For performance not know if this is the best way to do this or is there another.

example


tfiledelimit -------------------> tjava ------------------> toracleoutput

tfiledelimit -------------------> tjava ------------------> toracleoutput

tfiledelimit -------------------> TMAP ------------------> toracleoutput

Regards,
Oscar Manso