Talend community forum / tFileInputEBCDIC: slow processing --> any tunig possible?

Open Data SolutionsData Management solutionswarehouseOpen StudioBusinessExtract Transform LoadETL

You are not logged in.

Announcement

[2013-05-06] Boston Area User Group Meetup
[2013-05-02] NOTICE TO ALL TALENDFORGE USERS: maintenance completed
[2013-04-26] Talend Open Studio's 5.3.0 release is available
[2013-04-12] Ready for testing - Talend Open Studio's 5.3.0RC2 release is available
[2013-04-11] Talend’s corporate pages and groups on social media

Unanswered posts

parseDate change from 5.0.3 to 5.2.2? by Kwags300
Errors during startup of Talend by psahai
How do [...] by slowenthal
Problem whit context variable in query. by Ginetto
Problem with SELECT a.name AS a_name, b.name AS b_name input by kacper
get last row that raised an oracle exception while using tOracleOutput by ed.pag
Component to Connet,Retrieve data from MS OLAP Cube by talend_bso1

Pages: 1

Post reply

Index
» Talend Open Studio for Data Integration » Usage, Operation
» tFileInputEBCDIC: slow processing --> any tunig possible?

#1 2010-08-10 14:31:58

Renke: Guest

tFileInputEBCDIC: slow processing --> any tunig possible?

Tags: [CSV file, delimited file, ebcdic, java, performance]

Hi,

I'm trying to convert a large EBCDIC file (30 mil. rows) to a CSV file. I'm getting an average speed of 20,000 rows/sec (25 minutes total) which is not very satisfying.

The question is: are there any tuning options?
When I take a look at the Windows TaskManager I see that the process is just using one of the four CPUs.

Thanks for your help!
Renke

Quote

Post reply

Pages: 1

Index
» Talend Open Studio for Data Integration » Usage, Operation
» tFileInputEBCDIC: slow processing --> any tunig possible?

Board footer

Jump to