You are not logged in.

#1 2012-01-02 13:07:32

umeshrakhe
Member
401 posts

How to create a dynamic schema mapping using Talend by reading schema.

Hi All,
i have to develop one such job which will be use to load all kind of file based on my distention table schema .  i will have a XML file which has all the details of  Input Type , File Type, Delimiter Type, Number of Columns, Columns Validation ( Trim, data Type, remove unwanted char), out put, table schema, columns data type, constraints. etc.

So the thing is whenever i am load file it should pic all the details from config. file, and then apply validation to convert or correct the data types with other validation to remove or format the data. then again read the destination table schema and map with source schema and then load to destination. this is sort of information. so please any one can tell how to and what to use to accomplish this task.


Umesh

Offline

#2 2012-01-04 09:08:51

pedro
Member
3682 posts

Re: How to create a dynamic schema mapping using Talend by reading schema.

Hi

Talend Open Studio doesn't support dynamically retrieve schema from an exist XML file.
I'm afraid you have to set all manually.

Besides, Talend Trade Version now supports dynamically retrieve schema from DB and files.
It is still impossible to retrieve from a XML file.

Best regards!
Pedro


Only Paranoid Survive.

Offline

#3 2012-01-05 05:22:03

umeshrakhe
Member
401 posts

Re: How to create a dynamic schema mapping using Talend by reading schema.

Thank you Pedro,
i am having enterprise version, and i can use DB also, so is it possible in enterprise version if yes then, can you please suggest any link or demo so i can move ahead.


Umesh

Offline

#4 2012-01-05 06:11:48

pedro
Member
3682 posts

Re: How to create a dynamic schema mapping using Talend by reading schema.

Hi

Even exterprise version can't support you retrieve schema from a XML file dynamically.

Best
Pedro


Only Paranoid Survive.

Offline

#5 2012-01-05 07:31:55

rogierlommers
Member
136 posts

Re: How to create a dynamic schema mapping using Talend by reading schema.

Maybe an experienced developer can create a custom component for this purpose?

Offline

#6 2012-01-05 09:59:46

avdbrink
Member
360 posts

Re: How to create a dynamic schema mapping using Talend by reading schema.

Is there a sample job or any other sample available that shows us how this dynamically retrieval from DB schemes works?

Regards,
Arno

Offline

#7 2012-01-05 10:04:02

pedro
Member
3682 posts

Re: How to create a dynamic schema mapping using Talend by reading schema.

Hi Arno

If you are the user of Commercial Version, you can get some explanation and scenarios in the document.
Serch the chapter 'Dynamic Schema'.

Best regards
Pedro


Only Paranoid Survive.

Offline

#8 2012-01-05 10:22:12

avdbrink
Member
360 posts

Re: How to create a dynamic schema mapping using Talend by reading schema.

Hi Pedro,

I already know about this possibility, but was hoping there were some new options which make it possible to have dynamic schema, on which you can perform transformations and such.

The Dynamic schema functionality offered by Talend right now does not match our requirements for dynamic schemes I suppose...

Thanks anyway!

Regards,
Arno

Offline

#9 2012-01-05 10:27:34

pedro
Member
3682 posts

Re: How to create a dynamic schema mapping using Talend by reading schema.

wink I will communicate with our development team for this feature.

From user respect, creating issue at BugTracker for new feature will be more effective.

Regards,
Pedro


Only Paranoid Survive.

Offline

#10 2012-01-05 10:56:49

avdbrink
Member
360 posts

Re: How to create a dynamic schema mapping using Talend by reading schema.

Yeah, maybe we should create an issue... I'll reconsider that!

Thanks
Arno

Offline

#11 2014-05-28 11:53:02

ksultania
Member
136 posts

Re: How to create a dynamic schema mapping using Talend by reading schema.

Hey,

Is it possible to accomplish the above task in Talend now?

Hey avdbrink,
Can you please guide how you accomplished the above task.
Thanks!

Last edited by ksultania (2014-05-28 13:01:18)

Offline

#12 2014-05-28 13:41:46

kzone
Member
1525 posts

Re: How to create a dynamic schema mapping using Talend by reading schema.

hi ksultania,

this post has beeb published a long time ago ...

Now you've got dynamic schema but only with 'TIS' version.

regards
laurent


Manage your data before data manages You !!!
http://www.synotis.fr/

Offline

#13 2014-05-28 13:54:08

ksultania
Member
136 posts

Re: How to create a dynamic schema mapping using Talend by reading schema.

Hey kzone,

I came across Dynamic schema feature, but it helps only in taking dynamic schema from input source. Is it possible to map this schema to a fixed output schema dynamically?


Also, can you suggest where to learn from and how to learn talend to be productive?

Last edited by ksultania (2014-05-28 14:07:28)

Offline

#14 2014-05-28 14:18:43

kzone
Member
1525 posts

Re: How to create a dynamic schema mapping using Talend by reading schema.

talend help is a great place to learn a lot about Talend.

for example with Dynamic schema : https://help.talend.com/pages/viewpage. … Id=5671283

regards
laurent


Manage your data before data manages You !!!
http://www.synotis.fr/

Offline

#15 2014-05-29 05:18:49

ksultania
Member
136 posts

Re: How to create a dynamic schema mapping using Talend by reading schema.

I came across Dynamic schema feature, but it helps only in taking dynamic schema from input source. Is it possible to map this schema to a fixed output schema dynamically? (that is making tMap feature dynamic)

Thanks for your suggestion.

Offline

#16 2014-05-29 07:43:41

xdshi
Talend Team


Re: How to create a dynamic schema mapping using Talend by reading schema.

Hi ksultania,

For your scenario, it need to change column value dynamically.
We are working on your anther topic Forum 36256 topic Mapping Dynamic Schema to a Fixed Destination Schema, then come back to you asap.


Best regards
Sabrina


What we can do is to make sure that Talend will be your best choice!

Offline

#17 2014-05-29 08:11:38

ksultania
Member
136 posts

Re: How to create a dynamic schema mapping using Talend by reading schema.

Thank you.
Appreciate the help.

Offline

Board footer

Talend Contributor Agreement - Talend Website Privacy Policy