1. When Talend does table update,   talend job will keep going, but other transaction will be lock. Until talend job is done.
I just found there is an option in advance(tMsSqlOutput)  to set commit number. I am going to set it from 10000 to 100. I hope this bulk load could be done during day time and this database is a transactional database. Do you see if there is any problem?

2. The lookup table and output table are different tables.

Thanks for your help.

I have a job to upload a large amount of flat file to update/insert to a database.

flatfile-->tMap-->tMSSqloutput
                |
             tMSSqlInput

1. When the job runs, it will lock the database.
Is there any good idea to make it commit fast and won't lock the table at run time?


2. tMSSqlInput is just a lookup to see if the ids in flatfile are in the database.
I use tMap to do this. So it takes very long to load the whole table into hard disk. Is there a good way to do the lookup?


Thanks.