Talend community forum / Writing a component creation tutorial

saburo · 2011-09-02 16:31:48

Hello all,
in the last few months I gathered a bit of experience in creating component,s so I thought it might be useful to others to (try to) summarize what I learnt.

I wrote the first part of the tutorial, you can find it here, I just went through the basic concepts so far, but indeed I may expand to more advanced ones if someone finds it useful.

The page can be found here : http://www.powerupbi.com/talend/compone … ion_1.html

Please feel free to send remarks, suggestions etc.

shong · 2011-09-05 03:09:07

Hi
Great work! Thank you saburo, I had a looked at your website and saw that you do a great contribution to open source and Talend.

Best regards
Shong

saburo · 2011-09-05 12:42:30

Thanks Shong.

I posted the second part of the tutorial, tonight I will start writing the next one.

The url is here : http://powerupbi.com/talend/componentCreation_2.html

Last edited by saburo (2011-09-05 12:42:55)

saburo · 2011-09-07 08:28:02

Hello all,
part 3 of the tutorial is out :

http://www.powerupbi.com/talend/compone … ion_3.html

Sorry you will have to be patient for part 4, as I will be traveling starting today for about one week.

Best regards,
Francesco

shong · 2011-09-07 09:56:07

saburo wrote:
Hello all,
part 3 of the tutorial is out :

http://www.powerupbi.com/talend/compone … ion_3.html

Sorry you will have to be patient for part 4, as I will be traveling starting today for about one week.

Best regards,
Francesco

ah,
yes, have a good trip!

Best regards
Shong

saburo · 2011-09-12 16:51:10

Hello, I just posted part 4 of the tutorial, you can find it here :

http://powerupbi.com/talend/componentCreation_4.html

sunner888 · 2011-09-13 10:27:08

good..

saburo · 2011-09-14 09:27:30

Hello part 5 is out here : http://www.powerupbi.com/talend/compone … ion_5.html

I am currently writing part 6 and planning to release it this week.

Topics covered so far :
Lesson 1 : Component basics - Templates and java output code
Lesson 2 : The three parts of a components
Lesson 3 : Component files, the XML descriptor
Lesson 4 : Working with the java jet templates
Lesson 5 : Component parameters
Lesson 6 : (Planned for release this week) Working with data connectors

saburo · 2011-09-15 17:17:48

Hello, part 6 of the tutorial is out, it covers the basics concepts about connectors which will be further developed in part 7 (which will focus on schema, metadata associated to connections).

Part 6 can be found here :
http://powerupbi.com/talend/componentCreation_6.html

Part 7 will be released next week.

saburo · 2011-09-19 12:42:52

Hello, as promised, part 7 is out ( here http://powerupbi.com/talend/componentCreation_7.html ).
In this lesson I guide the reader in the creation of a CSV input component.

Part 8 will focus instead on output components, we will create one of them.
Also, with a processing component (has both input and output) we will show how it is possible to output less records than the ones in input.

I would be happy to receive some honest feedback from you so I can adjust accordingly for the next lessons.

saburo · 2011-09-24 20:08:31

Hello, part 8 of the tutorial is out here : http://powerupbi.com/talend/componentCreation_8.html

In this lesson I guide the reader in the creation of an output component (that writes an xml file with metadata and records that it receives from the input connection).

I would like to thank all those who sent their feedback, as a general rule, feel free to contact me should you have questions.

saburo · 2011-09-27 17:12:27

Hello again,
part 9 of the tutorial is out, it covers the case of a component that outputs a number of records lower than the ones it receives in input.

The page can be found here : http://powerupbi.com/talend/componentCreation_9.html
The code of the component created in the tutorial is downloadable at that address as well.

Best Regards

saburo · 2011-10-04 11:42:02

Hello, I just released lesson 10 of the tutorial.
This quite a "special" one, because in this lesson I do some reverse engineering of an existing component (tFileInputJSON) to fulfill a request posted in this thread : http://www.talendforge.org/forum/viewto … 200#p66200

So this lesson explains how to modify an existing component, by adding the "die on error" functionality.
I was not able to test the modified component yet, so it is totally possible there are few mistakes here and there, however I hope someone of you could try it out and eventually correct where I made mistakes.
I explained every single modification I made, so shoudl not be difficult

Ah, the link is here ; http://powerupbi.com/talend/componentCreation_10.html

shong · 2011-10-31 07:17:56

Dear Saburo

You have finished so much work! Thank you for your patience and persistence.

Best regards
Shong

saburo · 2011-10-31 07:54:00

Thanks, I may add a few more lessons in the future, but I believe those I already released should cover pretty much what's needed to get started.
If anyone has specific request I may consider them for new lessons.

Also feel free to post questions and comments, as usual.

Bye.

dchambon · 2011-11-04 09:55:25

Thanks a lot Saburo !!!!!

mpa · 2011-11-04 16:29:21

Started reading your tutorial! Very interesting man!

Thanks a lot for your effort! :-)

Regards

pcoffre · 2011-12-16 18:05:10

Hi,

Thanks to a Team member, I discovered this thread and the very good contributions Saburo was able to make.
As this is a very interesting forum thread, that can benefit to all the Community, I've "stickied" it (a request from the Team member - thanks a lot Imad!) on the Component creation forum.

Thanks for your contributions Saburo!

Best,
Pcoffre.

saburo · 2011-12-17 12:17:38

Wow, I am honoured to be "stuck" there

I might add a few more articles in the future, will keep announcing them here should it be the case.

Last edited by saburo (2011-12-17 12:23:20)

pcoffre · 2011-12-22 15:54:56

That's great, thanks again for your contributions saburo!

Best,
Pcoffre.

saburo · 2012-05-15 09:43:00

Hello, I have been busy with other things for quite some time, but I received some feedback on my tutorial, so I decided to add another lesson here : http://powerupbi.com/talend/componentCreation_11.html

It's about component design methodology and debugging.
I am not sure it's a proper methodology or approach, it simply kind of works for me, so I though I might share it.

Happy coding!

pedro · 2012-05-15 09:46:02

Hi

That's so great. Thanks for your work.

Regards,
Pedro

saburo · 2012-06-02 17:47:17

Hello everybody,
I noticed my tutorial is quite used lately (I hope it proves useful), but I also noticed that many coders jump into component creation (which is cool, don't stop!) disregarding routines.
Sometimes routines can provide a simpler, cleaner solution to many tasks, so I decided to create a tutorial on this topic, it can be found here :

http://powerupbi.com/talend/routinesCreation_1.html

I know there are already some good tutorials around on the subject, but I wanted to highlight the differences with components when it comes to coding.

Regards,
Francesco

vinod_talend · 2012-08-09 15:22:54

Hi Francesco,

Really amazing work... Thanks a lot for helping all of us to get started...

--
Vinod

xsasiela · 2013-03-04 17:47:03

Hi Francesco!

Great Tuto! It's a good approach for beginning of component building.

Well done guy!

Xavier

Announcement

Unanswered posts

#1 2011-09-02 16:31:48

Writing a component creation tutorial

#2 2011-09-05 03:09:07

Re: Writing a component creation tutorial

#3 2011-09-05 12:42:30

Re: Writing a component creation tutorial

#4 2011-09-07 08:28:02

Re: Writing a component creation tutorial

#5 2011-09-07 09:56:07

Re: Writing a component creation tutorial

saburo wrote:

#6 2011-09-12 16:51:10

Re: Writing a component creation tutorial

#7 2011-09-13 10:27:08

Re: Writing a component creation tutorial

#8 2011-09-14 09:27:30

Re: Writing a component creation tutorial

#9 2011-09-15 17:17:48

Re: Writing a component creation tutorial

#10 2011-09-19 12:42:52

Re: Writing a component creation tutorial

#11 2011-09-24 20:08:31

Re: Writing a component creation tutorial

#12 2011-09-27 17:12:27

Re: Writing a component creation tutorial

#13 2011-10-04 11:42:02

Re: Writing a component creation tutorial

#14 2011-10-31 07:17:56

Re: Writing a component creation tutorial

#15 2011-10-31 07:54:00

Re: Writing a component creation tutorial

#16 2011-11-04 09:55:25

Re: Writing a component creation tutorial

#17 2011-11-04 16:29:21

Re: Writing a component creation tutorial

#18 2011-12-16 18:05:10

Re: Writing a component creation tutorial

#19 2011-12-17 12:17:38

Re: Writing a component creation tutorial

#20 2011-12-22 15:54:56

Re: Writing a component creation tutorial

#21 2012-05-15 09:43:00

Re: Writing a component creation tutorial

#22 2012-05-15 09:46:02

Re: Writing a component creation tutorial

#23 2012-06-02 17:47:17

Re: Writing a component creation tutorial

#24 2012-08-09 15:22:54

Re: Writing a component creation tutorial

#25 2013-03-04 17:47:03

Re: Writing a component creation tutorial

Board footer