Talend community forum / Dynamic create file schema

dylanMa · 2012-04-28 10:17:10

Tags: [context, CSV file, database, development, mssql, PostgreSQL, schema]

hi,

I have a lot of tables and data,about 40 tables , I want to store their data in the disk file , i don't want to creat the schema again and again, the "tFileOutPutExcel" don't support dynamic schema,

What i want to do ?
-i hope have a subjob can execute TSQL and store the result in disk file，

ps:can't store the shcema in DB

how can i do it?

Last edited by dylanMa (2012-04-28 10:22:55)

shong · 2012-04-28 10:26:16

Hi
It is impossible with Talend Open Studio for Data Integration, you have to create many subjobs for each table mapping.

The dynamic schema feature is only available on Talend Enterprise Data Integration. You can create a single job with dynamic schema for mapping all the tables.

Best regards
Shong

dylanMa · 2012-04-28 10:33:54

Thanks for your answer,

I have a anthoer question,
i have a lot of tables , every table has about 8 million records, if i store them in the disk file, use it in the tMap component, can you give me some suggests?

shong · 2012-04-28 10:55:01

Hi
What type of transform will you do on tMap component? A simple job for extracting records from a table and store them into Excel file looks like:
tPostGreSqlInput--main--tFileOutputExcel

Best regards
Shong

Announcement

Unanswered posts

#1 2012-04-28 10:17:10

Dynamic create file schema

#2 2012-04-28 10:26:16

Re: Dynamic create file schema

#3 2012-04-28 10:33:54

Re: Dynamic create file schema

#4 2012-04-28 10:55:01

Re: Dynamic create file schema

Board footer