You are not logged in.
Announcement
Unanswered posts
|
#1 2010-09-20 17:22:50
- ricole
- Member
- Registered: 2010-09-20
- Posts: 14
Performance
Hi all,
i have some performence problem with my job which contains a tmap with 2 input tables:
- the first one has 11 columns and about 2 500 000 rows
- the second (lookup) has 3 columns and about 2 200 000 rows
I am loading an empty output table.
The lookupup table 's load took 48 s. Otherwise, the main flow is very slow, about 60 row/s.
How can i improve the main flow performance ?
Technical environnement:
- Oracle database (10g)
- TIS (v 3.23)
Thanks for your help.
Offline
#2 2010-09-21 05:44:26
Re: Performance
Hi.
1. Try to create the db connection on tOracleInput replace using the existing connection created on tOracleConnection.
2. Add where keyword in the query to filter records if possible.
3. Store the lookup records on disk file on tMap instead of memory.
Best regards
Shong
Email:shong@talend.com
Choose Talend, Enjoy Talend!
New & Event: Talend Help Center
Talend-->the leader of open source data management and application integration solutions!
Offline