Talend community forum / Passing the filename that you are parsing to schema.

jgomes · 2011-11-22 17:16:09

Does anyone in this community know how to pass the filename that you're parsing as one of the columns in the main flow.
I am trying to parse about 400 csv files and would like to include an additional column in the main flow that will that will have the name of the csv file that is being processed.
All of these file sources are located in the same directory. Java.

***All of these files are going to be merged into a single MySQL table.

Last edited by jgomes (2011-11-22 17:25:28)

pedro · 2011-11-23 04:11:53

Hi
You may create your job like this:
tFileList--tFileInputExcel--tMap--tMysqlOutput
The following pictures will give you more details.

Best regards!
Pedro

Uploaded Images

Last edited by pedro (2011-11-23 04:18:14)

avdbrink · 2011-11-23 07:55:48

Hi Pedro,

I know the solution works, but I have a question about why you are using a variable to put the filename in and not put the filename in the output column directly?
I thought using the variable might reduce performance, because for each row, the variable is filled isn't it?

Regards,
Arno

pedro · 2011-11-23 08:11:25

Hi, Arno.
Thank you for your feedback.
You are right. My fault.

Best regards!
Pedro

Announcement

Unanswered posts

#1 2011-11-22 17:16:09

Passing the filename that you are parsing to schema.

#2 2011-11-23 04:11:53

Re: Passing the filename that you are parsing to schema.

#3 2011-11-23 07:55:48

Re: Passing the filename that you are parsing to schema.

#4 2011-11-23 08:11:25

Re: Passing the filename that you are parsing to schema.

Board footer