Talend community forum / Exporting a job that contains subjobs doesn't work

kolojay · 2009-03-02 12:34:23

Hello everybody,

I've just found a problem when exporting a job that should run on a linux server. The job "jobAB" contains only two element of type tRunJob and should execute "JobA" and after that "JobB". Quite easy so far.

I uploaded the files to our server and tried executing the .sh file what returned the error message "Exception in thread "main" java.lang.NoClassDefFoundError: xxx/yyy/JobA" - the class "JobA" couldn't be found. I thing the problem are the .jar files, JobAB.jar is contains some files and also .class files, but JobA.jar and JobB.jar are nearly empty and only contain a folder "Manifest".

But if I export "JobB" everything is okay, the "JobB.jar" contains all needed files and could be executed correctly.

For me it looks like there is a bug in TOS and the .jar files of subjobs are created correctly. Maybe there is a developer of Talend who reads this post and could say whether this is a (known?) bug or not. For the moment I found a solution in exporting and executing every small job separately, but this will be a problem if the number of subjobs increases.

Best regards
Christian

kzone · 2009-03-02 13:53:07

hi,

If you open your file.sh with your preferred editor you can see that it's "only" a command line that launch instruction "java -cp . etc"
with some path in relative syntax .

So if you move your .sh in another directory (or somethink else) those path won't be "recognized" .
So you have to keep structure and arborescence of the export job
or rewrite with absolute path.

pravu · 2009-03-02 14:36:02

Hi,

This not a bug in TOS. Because the same kind of jobs are created by me many times and those are in production.

Please check the steps you have followed to accomplish your job execution. Please see the examples.

Thanks and Regards,
Pravu Mishra.

Volker Brehm · 2009-03-05 21:02:48

Hi Christian,

I had the same problem as you. Which version do you use. For me it reproducible but I didn't found the time to do further analysis. And I will do that before open a bug. I get the problem if I export a job with subjobs. For the main job it works but the jars of the subjob are empty (except the manifest). If I export the subjob one after another and replace the empty jars with this ones all works as designed.

Bye
Volker

kzone · 2009-03-25 14:22:49

hi,

get same problems on export script with subjob

Version: 3.0.3
Build id: r21383-20090126-2207

... and Have already perform those kind of export with success.

So got those errors when launch .sh :

Code:

raulier@ub-raulier:~/Bureau/WEBJOB/job_Manage_integration/job_Manage_integration$ sh ./job_Manage_integration_run.sh 
Exception in thread "main" java.lang.NoClassDefFoundError: rdo_test_context/job_f1400rep_0_1/job_F1400REP
    at rdo_test_context.job_manage_integration_0_1.job_Manage_integration.tRunJob_1Process(job_Manage_integration.java:365)
    at rdo_test_context.job_manage_integration_0_1.job_Manage_integration.runJobInTOS(job_Manage_integration.java:7311)
    at rdo_test_context.job_manage_integration_0_1.job_Manage_integration.main(job_Manage_integration.java:7203)
Caused by: java.lang.ClassNotFoundException: rdo_test_context.job_f1400rep_0_1.job_F1400REP
    at java.net.URLClassLoader$1.run(URLClassLoader.java:217)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:205)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:323)
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:268)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:336)
    ... 3 more

first I've have nothing in the job_f1400rep_0_1.jar except the Manifest (no class) , but got the src (java)

NoClassDefFoundError: rdo_test_context/job_f1400rep_0_1/job_F1400REP

... just have a "contexts repository" throws this path rdo_test_context/job_f1400rep_0_1/.

So seems that subjob job_f1400rep_0_1 isn't "interpreted'" and classe cannot be excecuted .... (or perhaps i'm wrong).

have I done something wrong ..?
How can I find errors !,

thanks for your help .

Edit : works fine with Volker tip ...

Uploaded Images

Last edited by kzone (2009-03-25 14:29:59)

Volker Brehm · 2009-03-25 22:14:54

Hi kzone,

could you please take a look into your logfile (your workspace/.metadata/.log). I'll do the same tomorrow. Maybe we could find the reason there...

Bye
Volker

kolojay · 2009-03-26 10:25:00

Hi Volker,

I just exported a job that contains subjobs, same error as ervery time: the JAR files of the subjobs are only 1 kb big. But in the log file there is no entry! Everything seems to be okay but it isn't.

Exporting all subjobs and copying the JAR files is my workaround, too. But that costs time :-(

Best regards,
Christian

kzone · 2009-03-26 16:02:30

hi,

too much work this morning to look at .log , sorry !

so clean my log file and launch Talend ...no special infos i think

!SESSION 2009-03-26 15:52:19.195 -----------------------------------------------
eclipse.buildId=unknown
java.version=1.6.0_0
java.vendor=Sun Microsystems Inc.
BootLoader constants: OS=linux, ARCH=x86, WS=gtk, NL=fr
Command-line arguments: -os linux -ws gtk -arch x86

!ENTRY org.talend.libraries 1 0 2009-03-26 15:52:24.925
!MESSAGE 2009-03-26 15:52:24,923 INFO org.talend.repository.model.ProxyRepositoryFactory - raulier@landes-mutualite.fr logged on RDO-test-context

.... export job script ( no more logs written) !

Still have subjob jar empty except manifest !

....

Uploaded Images

Volker Brehm · 2009-03-26 16:06:53

Yes,

I've the same effect, jars are empty and no log entry.

TOS 3.0.3 / SUN VM 1.6 / Windows

@Talend: Is there any additional debug capability we could activate?

Bye
Volker

nSmolyniec · 2009-04-17 16:31:14

Hello,

I confirm there is a bug.
When you export to an autonomous job, the jar file of the main job is ok, but not those of the child jobs.
For the moment, I've found one solution : as the export to a webservice seems to be ok, I get the jar files of the subjobs from this one!

Hope all will be ok soon.
Regards,

Nicolas

P.S. : I'm on Talend 3.0.4

Last edited by nSmolyniec (2009-04-17 16:33:50)

youssef · 2009-04-17 16:47:57

Hi all,
I'm using Talend 3.0.4 on windows xp and everything is ok. I can export jobs including subjobs with no problems. I can't reproduce your "bug".

Regards,
Youssef

kolojay · 2009-04-21 12:44:34

Okay, obviously I'm not the only user with this Bug. Currently my version number is 3.0.4.r22547 and I'm using Windows XP on a 64 bit machine. May the 64 bit be the problem? Because the problem is there there...

Maybe on 27th April it will be better with Open Studio 3.1?

Best regards,
Christian

nSmolyniec · 2009-04-21 13:59:57

Hello,

I've got the same in 32bit (on Win XP & TOS 3.0.4).
I'll look at the logs later.

Bye,

Nicolas

Last edited by nSmolyniec (2009-04-22 19:00:23)

nSmolyniec · 2009-04-22 18:59:37

Hi again,

Still the same bug, whatever the options picked.
No log entry for it into the Talend logs.

Best regards,

Nicolas

kolojay · 2009-05-05 13:33:21

And also still the same bug with the new version TOS 3.1, that has been released today. I think it must be caused by varios factors on some systems, maybe it's a Java problem?!

Best regards
Christian

nSmolyniec · 2009-05-14 18:00:05

Hi everybody!

Well, for the moment, I do not encounter this bug anymore with TOS 3.1.0 (whereas it still occurs in 3.0.4).
Some stuff may have been improved and it's nice to see the "progress information".
Strange for you kolojay.

Best regards,

Nicolas

pravu · 2009-05-15 09:32:10

Hi,

I am still using 2.4.3 because I got some other defects in 3.0.

Is it all right to use version 3.1.0

Thanks and Regards,
Pravu Mishra.

EOSS · 2009-06-08 17:41:50

FYI, I am using TOS 3.1.0 ans still encountering the problem. JAR files of sub-jobs are empty.
O.S. Windows VISTA

shong · 2009-06-09 03:48:57

Hello EOSS

Please check if there are some blank space in your export path.

Best regards

shong

Lee Eason · 2009-10-07 22:29:06

I ran into this exact issue today and after quite a bit of searching and troubleshooting I found that I have reproduced this bug in version 3.2.0 RC1 r29643-20090911-0631. I am running Windows XP (32bit) and Java 1.6.0_15. What I am seeing is that any job that is a subjob of another job will not be exported properly as an autonomous job. The .jar files it spits out are 1KB. If you take those same jobs out of the subjob or export them independently then the export works fine and you can copy those JARs back into the main job to fix the problem.

saladspoon · 2010-05-27 00:24:28

Talend, any update on this? I have the same problem on TIS 4.0.1. Exporting war with subjobs - sometimes, the subjob only has the manifest folder, not the folder contain the classes. Other times, it contains classes of other subjobs -- causing massive bloating of the war file. Also, there are cases where the subjob classes are referencing different job classes altogether!

A little background, we just recently migrated from TOS 3.2.1 to TIS 4.0.1 (export jobs from TOS and import into TIS). On my client machine (windows 32, java 1.6), I have both TOS and TIS installed.

Also when I open some of the jobs after import, it prompts for context updates - for whatever reasons. I saved the job and export and still have this issue....

Please help, very stuck.

bazinou · 2010-05-27 10:32:31

A little background, we just recently migrated from TOS 3.2.1 to TIS 4.0.1 (export jobs from TOS and import into TIS). On my client machine (windows 32, java 1.6), I have both TOS and TIS installed.

Also when I open some of the jobs after import, it prompts for context updates - for whatever reasons. I saved the job and export and still have this issue....

I have the same problem, and more (.jar bigger than the same exported with TOS 3.2) ....
http://www.talendforge.org/forum/viewtopic.php?id=10875

I've created a project test case that produce the problem an send it to the Talend team, but no response at this time.

Announcement

Unanswered posts

#1 2009-03-02 12:34:23

Exporting a job that contains subjobs doesn't work

#2 2009-03-02 13:53:07

Re: Exporting a job that contains subjobs doesn't work

#3 2009-03-02 14:36:02

Re: Exporting a job that contains subjobs doesn't work

#4 2009-03-05 21:02:48

Re: Exporting a job that contains subjobs doesn't work

#5 2009-03-25 14:22:49

Re: Exporting a job that contains subjobs doesn't work

Code:

#6 2009-03-25 22:14:54

Re: Exporting a job that contains subjobs doesn't work

#7 2009-03-26 10:25:00

Re: Exporting a job that contains subjobs doesn't work

#8 2009-03-26 16:02:30

Re: Exporting a job that contains subjobs doesn't work

#9 2009-03-26 16:06:53

Re: Exporting a job that contains subjobs doesn't work

#10 2009-04-17 16:31:14

Re: Exporting a job that contains subjobs doesn't work

#11 2009-04-17 16:47:57

Re: Exporting a job that contains subjobs doesn't work

#12 2009-04-21 12:44:34

Re: Exporting a job that contains subjobs doesn't work

#13 2009-04-21 13:59:57

Re: Exporting a job that contains subjobs doesn't work

#14 2009-04-22 18:59:37

Re: Exporting a job that contains subjobs doesn't work

#15 2009-05-05 13:33:21

Re: Exporting a job that contains subjobs doesn't work

#16 2009-05-14 18:00:05

Re: Exporting a job that contains subjobs doesn't work

#17 2009-05-15 09:32:10

Re: Exporting a job that contains subjobs doesn't work

#18 2009-06-08 17:41:50

Re: Exporting a job that contains subjobs doesn't work

#19 2009-06-09 03:48:57

Re: Exporting a job that contains subjobs doesn't work

#20 2009-10-07 22:29:06

Re: Exporting a job that contains subjobs doesn't work

#21 2010-05-27 00:24:28

Re: Exporting a job that contains subjobs doesn't work

#22 2010-05-27 10:32:31

Re: Exporting a job that contains subjobs doesn't work

Board footer