• Index
  •  » Talend Open Studio for Data Integration » Usage, Operation
  •  » How to create a dynamic schema mapping using Talend by reading schema.

#1 2012-01-02 13:07:32

umeshrakhe
Member
Registered: 2011-03-14
Posts: 229
Website

How to create a dynamic schema mapping using Talend by reading schema.

Hi All,
i have to develop one such job which will be use to load all kind of file based on my distention table schema .  i will have a XML file which has all the details of  Input Type , File Type, Delimiter Type, Number of Columns, Columns Validation ( Trim, data Type, remove unwanted char), out put, table schema, columns data type, constraints. etc.

So the thing is whenever i am load file it should pic all the details from config. file, and then apply validation to convert or correct the data types with other validation to remove or format the data. then again read the destination table schema and map with source schema and then load to destination. this is sort of information. so please any one can tell how to and what to use to accomplish this task.


Skype: macwintuch

Offline

#2 2012-01-04 09:08:51

pedro
Member
Registered: 2011-11-17
Posts: 3682

Re: How to create a dynamic schema mapping using Talend by reading schema.

Hi

Talend Open Studio doesn't support dynamically retrieve schema from an exist XML file.
I'm afraid you have to set all manually.

Besides, Talend Trade Version now supports dynamically retrieve schema from DB and files.
It is still impossible to retrieve from a XML file.

Best regards!
Pedro


Only Paranoid Survive.

Offline

#3 2012-01-05 05:22:03

umeshrakhe
Member
Registered: 2011-03-14
Posts: 229
Website

Re: How to create a dynamic schema mapping using Talend by reading schema.

Thank you Pedro,
i am having enterprise version, and i can use DB also, so is it possible in enterprise version if yes then, can you please suggest any link or demo so i can move ahead.


Skype: macwintuch

Offline

#4 2012-01-05 06:11:48

pedro
Member
Registered: 2011-11-17
Posts: 3682

Re: How to create a dynamic schema mapping using Talend by reading schema.

Hi

Even exterprise version can't support you retrieve schema from a XML file dynamically.

Best
Pedro


Only Paranoid Survive.

Offline

#5 2012-01-05 07:31:55

rogierlommers
Member
Registered: 2010-11-18
Posts: 132

Re: How to create a dynamic schema mapping using Talend by reading schema.

Maybe an experienced developer can create a custom component for this purpose?

Offline

#6 2012-01-05 09:59:46

avdbrink
Member
Company: Conspect Consulting & ICT
Registered: 2010-11-08
Posts: 360
Website

Re: How to create a dynamic schema mapping using Talend by reading schema.

Is there a sample job or any other sample available that shows us how this dynamically retrieval from DB schemes works?

Regards,
Arno

Offline

#7 2012-01-05 10:04:02

pedro
Member
Registered: 2011-11-17
Posts: 3682

Re: How to create a dynamic schema mapping using Talend by reading schema.

Hi Arno

If you are the user of Commercial Version, you can get some explanation and scenarios in the document.
Serch the chapter 'Dynamic Schema'.

Best regards
Pedro


Only Paranoid Survive.

Offline

#8 2012-01-05 10:22:12

avdbrink
Member
Company: Conspect Consulting & ICT
Registered: 2010-11-08
Posts: 360
Website

Re: How to create a dynamic schema mapping using Talend by reading schema.

Hi Pedro,

I already know about this possibility, but was hoping there were some new options which make it possible to have dynamic schema, on which you can perform transformations and such.

The Dynamic schema functionality offered by Talend right now does not match our requirements for dynamic schemes I suppose...

Thanks anyway!

Regards,
Arno

Offline

#9 2012-01-05 10:27:34

pedro
Member
Registered: 2011-11-17
Posts: 3682

Re: How to create a dynamic schema mapping using Talend by reading schema.

wink I will communicate with our development team for this feature.

From user respect, creating issue at BugTracker for new feature will be more effective.

Regards,
Pedro


Only Paranoid Survive.

Offline

#10 2012-01-05 10:56:49

avdbrink
Member
Company: Conspect Consulting & ICT
Registered: 2010-11-08
Posts: 360
Website

Re: How to create a dynamic schema mapping using Talend by reading schema.

Yeah, maybe we should create an issue... I'll reconsider that!

Thanks
Arno

Offline

  • Index
  •  » Talend Open Studio for Data Integration » Usage, Operation
  •  » How to create a dynamic schema mapping using Talend by reading schema.

Board footer

Powered by FluxBB