Talend community forum / Phase and checkpoint in Talend?

peter19972008 · 2010-11-16 20:36:13

In Talend, can we put the job flow in different phases or use checkpoint just like Ab Initio does? or similiar usage.

You help is much appreciated.

camsellem · 2010-11-17 18:50:58

Are you talking about checkpoint for doing some kind of "Error Recovery" ?

peter19972008 · 2010-11-17 20:56:39

In Ab Initio, what it can do is

1) In the same subjob, you have row1, row2, row3, row4, you can specify row1 and row2 as phase 1, row3 and row4 as phase2, when it is executed, row1 and row2 will run first, once it is finished, row3 and row4 will start. This can avoid too many thread runing at the same time.

2) For the checkpoint, if the job failed at the 1000th record, when you restart the job, it will start from 1001th record

camsellem · 2010-11-17 22:14:30

Ok I see for phases Talend does not have such feature natively but you can "simulate" that behaviour using trigger link and buffer components (workaround)

Concerning the checkpoint we have this but this is not at row level. You can set it on "Onsubjobok" link and restart a job from a particular subjob.

peter19972008 · 2010-11-21 01:56:05

Thanks camsellem for your information.

How to use buffer components do workaround? Could you explain more?

Announcement

Unanswered posts

#1 2010-11-16 20:36:13

Phase and checkpoint in Talend?

#2 2010-11-17 18:50:58

Re: Phase and checkpoint in Talend?

#3 2010-11-17 20:56:39

Re: Phase and checkpoint in Talend?

#4 2010-11-17 22:14:30

Re: Phase and checkpoint in Talend?

#5 2010-11-21 01:56:05

Re: Phase and checkpoint in Talend?

Board footer