#1 2008-04-15 18:54:53

Tobman
Guest

csv File matching

Tags: [csv, java, List]

Hi,

right up front: I'm new to talend!

I have 3000 csv files that each consists of roughly 1000 rows, each row being identified by an ID. Several other variables are in those rows.
I would like to merge the files into one, so that each row contains the value to one ID from the different files:

ID variable1-file1 variable1-file2 variable1-file3 etc.

I tried using:

t_FileInputDelimited -> tUnite -> tAggregateRow

with the "list" function for the variable in tAggregateRow. It works, that the data is merged to each ID, but the problem is that the variables are not in order, but randomly listed.

Many thanks for any other ideas how to do this!

Cheers,
Tobi

#2 2008-04-16 05:06:41

shong
Talend team
Registered: 2007-08-29
Posts: 10305
Website

Re: csv File matching

Hello

with the "list" function for the variable in tAggregateRow. It works, that the data is merged to each ID, but the problem is that the variables are not in order, but randomly listed.

Using a tSortRow to sort the data.
try:
tFileList-->t_FileInputDelimited -> tUnite -> tAggregateRow-->tSortRow

Best regards

         shong


Email:shong@talend.com
Choose Talend, Enjoy Talend!
New & Event: Talend Help Center
Talend-->the leader of open source data management and application integration solutions!

Offline

Board footer

Powered by FluxBB