Performance test scenario 2

Result table

Exec time (in sec.)PerlOShardwareUserNote
TOS 2.1.1
20.8 5.8.7 Ubuntu 6.06 (2.6.15, 686) ASUS laptop 2GB, Intel Core Duo T2400@1.83GHz plegall
TOS 2.2.0M1
16.9 5.8.7 Ubuntu 6.06 (2.6.15, 686) ASUS laptop 2GB, Intel Core Duo T2400@1.83GHz plegall

Overview

In this second performance test scenario, we read a MySQL data source containing 1,000,000 lines and a lookup data source file with 5,000 lines.

job design overview

Here we have exactly the same job as in Scenario 1 but the main input is a MySQL table. This benchmark shows how performances change when using a database as input instead of a simply delimited file.

Run the test

  1. download the Talend Open studio workspace with a project BENCH to import in your workspace
  2. open the scenario_02 job
  3. modify the datadir context variable (be sure to have a subfolder named output inside specified location)
  4. modify the db* context variable to connect to your MySQL database
  5. generate the data with the 2 subjobs starting with a tRowGenerator
  6. deactivate the 2 data generator subjobs
  7. activate the main subjob
  8. go in the Run Job view, check the Exec time option, run the job
 
performances/scenario_2.txt · Last modified: 2011/12/17 03:52 (external edit)
 
 
Recent changes RSS feed Driven by DokuWiki