I have a job that processes text files from an incoming directory. I want to be able to multithread this process so that the load can be balanced across a cluster of Job Servers (one job run per file, each run sent to a different job server). One way to do this is to have a FileWatcher trigger that can spawn new job processes, but when I try this, Talend waits for each run of the job to complete before the next one starts. So, the files are processed one at a time.

I would like to have a single job instance that can be run multiple times in parallel from a FileWatcher trigger.

Is this possible?

Last edited by better@camstar.com (2012-05-15 15:30:19)