i have to develop one such job which will be use to load all kind of file based on my distention table schema . i will have a XML file which has all the details of Input Type , File Type, Delimiter Type, Number of Columns, Columns Validation ( Trim, data Type, remove unwanted char), out put, table schema, columns data type, constraints. etc.
So the thing is whenever i am load file it should pic all the details from config. file, and then apply validation to convert or correct the data types with other validation to remove or format the data. then again read the destination table schema and map with source schema and then load to destination. this is sort of information. so please any one can tell how to and what to use to accomplish this task.
Talend Open Studio doesn't support dynamically retrieve schema from an exist XML file.
I'm afraid you have to set all manually.
Besides, Talend Trade Version now supports dynamically retrieve schema from DB and files.
It is still impossible to retrieve from a XML file.
Only Paranoid Survive.
Thank you Pedro,
i am having enterprise version, and i can use DB also, so is it possible in enterprise version if yes then, can you please suggest any link or demo so i can move ahead.
I already know about this possibility, but was hoping there were some new options which make it possible to have dynamic schema, on which you can perform transformations and such.
The Dynamic schema functionality offered by Talend right now does not match our requirements for dynamic schemes I suppose...
Is it possible to accomplish the above task in Talend now?
Can you please guide how you accomplished the above task.
Last edited by ksultania (2014-05-28 13:01:18)
I came across Dynamic schema feature, but it helps only in taking dynamic schema from input source. Is it possible to map this schema to a fixed output schema dynamically?
Also, can you suggest where to learn from and how to learn talend to be productive?
Last edited by ksultania (2014-05-28 14:07:28)
talend help is a great place to learn a lot about Talend.
for example with Dynamic schema : https://help.talend.com/pages/viewpage. … Id=5671283
Manage your data before data manages You !!!
I came across Dynamic schema feature, but it helps only in taking dynamic schema from input source. Is it possible to map this schema to a fixed output schema dynamically? (that is making tMap feature dynamic)
Thanks for your suggestion.
For your scenario, it need to change column value dynamically.
We are working on your anther topic Forum 36256 topic Mapping Dynamic Schema to a Fixed Destination Schema, then come back to you asap.
What we can do is to make sure that Talend will be your best choice!