#1 2011-06-02 07:43:52

Jaideep
Guest

SLOW PERFORMANCE

How do i increase the performance , data is getting loaded from one table to another in the same database .

#2 2011-06-02 08:15:05

jaideep
Guest

Re: SLOW PERFORMANCE

target action on data is update or insert ...
4 million records .. Sql server 2008..
10 rows/s , please help me increase the performance

#3 2011-06-02 19:29:28

JohnGarrettMartin
Member
Registered: 2009-01-07
Posts: 762

Re: SLOW PERFORMANCE

updating a large table will always be slow. A good technique is to separate the inserts and updates into separate batches rather than mix them all up together.

If thats too much, indexing your update key columns will help. When talend is configured for "update or insert" It will issue a SELECT COUNT(*) query with the update key (advanced settings->field options) columns as the where clause. if it gets count > 0 it will issue an update; if zero an insert.

Offline

#4 2011-06-03 08:58:16

jaideep
Guest

Re: SLOW PERFORMANCE

Hi john ,

Can you explain the above steps ?

Board footer

Powered by FluxBB