• Index
  •  » Talend Open Studio for Data Integration » Usage, Operation
  •  » script execution vs normal execution

#1 2007-03-13 18:12:58

anahb
Member
Registered: 2007-03-13
Posts: 17

script execution vs normal execution

I launch a treatment sort on a file and I recover it in another. time that takes is different each time I do it why?normally it will be the same.
one more when I takes script Perl and I excute it in line of order, that gives another execution time.
there is someone who can explain that please.
thank you good afternoon.

Offline

#2 2007-03-13 18:28:52

cantoine
Talend team
Registered: 2006-09-19
Posts: 715
Website

Re: script execution vs normal execution

Hi,

What type of Job have you designed ?
How many differences in execution time did you find ?

It's possible that your system is busy and that this increases the time of other executions.

Regards.

Offline

#3 2007-03-14 10:16:01

anahb
Member
Registered: 2007-03-13
Posts: 17

Re: script execution vs normal execution

i don't think so, the job i designed is simple one fileinputdelimited row1(main) sortrow row2(main) fileoutputdelimited the componnent sort makes simple sorting on a one column thats all.
and execution isnot the same.

Offline

#4 2007-03-14 11:08:08

plegall
Member
Registered: 2006-09-19
Posts: 1586
Website

Re: script execution vs normal execution

anahb, give us the total execution times you find in several cases, please.

Offline

#5 2007-03-15 17:59:53

anahb
Member
Registered: 2007-03-13
Posts: 17

Re: script execution vs normal execution

ok thats it the file in input had 127Mo contain 62 column and 140109row
normal execution 1st time: 85.0 sec
normal execution 2nd time:72.8 sec
normal execution 3rd time:77.8 sec
perl execution (the script) 1st time: 81 sec
perl execution (the script) 2ndt time: 62 sec
perl execution (the script) 3rd time: 71 sec

normal execution : with talend and his GUI
perl execution : execution of script with commande 'perl test.pl'

Offline

#6 2007-03-15 18:08:03

anahb
Member
Registered: 2007-03-13
Posts: 17

Re: script execution vs normal execution

oh i forgot my computer configuration
pentium (R) D CPU 3.40GHZ (2 CPUs)
1014Mb RAM

Offline

#7 2007-03-15 18:09:34

plegall
Member
Registered: 2006-09-19
Posts: 1586
Website

Re: script execution vs normal execution

In my opinion, you have other applications/process running on the computer while TOS job is executing. This can explain the 15% to 30% differences.

Having a faster execution outside TOS GUI is also understandable: the script output is not communicating with Java GUI.

Offline

#8 2007-03-15 18:24:40

anahb
Member
Registered: 2007-03-13
Posts: 17

Re: script execution vs normal execution

ok.
why not use an application like client/server in that way we can execute the script in an other machine (server) free which will be dedicated for that.

Offline

  • Index
  •  » Talend Open Studio for Data Integration » Usage, Operation
  •  » script execution vs normal execution

Board footer

Powered by FluxBB