Talend community forum / First 50 columns from a Table

wulf · 2012-06-21 14:23:07

Hallo togehter,
i've got to read a Table in DB2 it has about 732 columns. i want to transfer 1:1 to another (mySql) Database.
but i get the error from "65535 Exceed.." is an JVM limit.
How can i split the Job.....

Is there an Idea ?

avdbrink · 2012-06-21 14:51:20

Hi,

The only idea that comes to mind is to make multiple (sub)jobs that load a different set of columns. So the first job transfers the primary key + a set of columns (250?) and two second jobs transfer the other 500 columns using the already transferred primary key.

Hope this helps.

Regards,
Arno

wulf · 2012-06-21 15:29:19

Ok ! i understand, but i'm not able to create the table in the mysql Database because of the ERROR "exceeding 65535...".
When i first create a table with the first 250 rows i have a mysql table with only 250 rows. When is start the second job with row 251 till row 500 i dont know if i'm able to tell to add the columns to the mysql table...

avdbrink · 2012-06-21 15:33:46

Hi,

So your destination table doesn't exist yet... well, that makes it a little more complicated...

I think you might want to create the table first, but I'm not sure this is an option for you of course.

Regards,
Arno

wulf · 2012-06-21 15:49:18

thats one of the problems yes, i wanted TOS to create the target database, so I haven't got to create a database manually.

Announcement

Unanswered posts

#1 2012-06-21 14:23:07

First 50 columns from a Table

#2 2012-06-21 14:51:20

Re: First 50 columns from a Table

#3 2012-06-21 15:29:19

Re: First 50 columns from a Table

#4 2012-06-21 15:33:46

Re: First 50 columns from a Table

#5 2012-06-21 15:49:18

Re: First 50 columns from a Table

Board footer