Talend community forum / Problem exporting SDI jobs. Please I need some help urgently.

Alex_spain2 · 2010-12-22 16:49:52

Tags: [autonomous, bug, deployment, error, export, java, library, SDI]

I have recently started to use SDI plugin (4.1.0 installed in TOS 4.1.1) and SDI components in my jobs. Everything was fine running them in Talend but the big problem came when exporting them as Autonomous jobs.
These exported scripts seem to lack of ANY of the libraries needed by the SDI components, so they won't run (neither on Windows or Linux).
I don't know if its normal, a bug, or some configuration I missed or a bad installation of the SDI plugin.
I have looked in all the forum and bug tracker but nothing came up. It has to be only me who has this strange problem.
Some of the components I use are:
s2DPointReplacer
sProj
sShapeFileOutput
And some of the SDI libraries that should have been exported with the jobs and are not, so the jobs are throwing classNotFound are:
geoapi-2.2-M1.jar
gt-metadata-2.5-M3.jar
hsqldb-1.8.0.7.jar
jai_core-1.1.3.jar
gt-referencing-2.5-M3.jar
jscience.jar
gt-epsg-hsql-2.5-M3.jar

Some of them I had to download from internet because in the plugin libraries have another name and I don't know them.
Do I need to know which libraries are used and do a tLibraryLoad for all?

I need to export the jobs and give them so they can be launched as is, and I can't do that without doing lot of classpath and library searching.

Please, anyone can help me?

Fxp · 2010-12-22 17:36:26

Hi alex,
I can't reproduce the issue with tRowGenerator > s2DPointReplacer > sShapefileOutput.
After export all required lib are in the lib folder.
Could you check that in the modules tab, you have the jar file loaded (at least for sShapefileOutput and sGeoOutput).

Cheers.

Francois

Alex_spain2 · 2010-12-23 11:01:44

Fxp wrote:
Hi alex,
I can't reproduce the issue with tRowGenerator > s2DPointReplacer > sShapefileOutput.
After export all required lib are in the lib folder.
Could you check that in the modules tab, you have the jar file loaded (at least for sShapefileOutput and sGeoOutput).

Cheers.

Francois

Can you post the list of libs after export?
The job launched as autonomous job fine then?

Trying to find out now which is the "modules tab" and which jar do you mean...

Fxp · 2010-12-23 11:06:17

Hi, the list of libs is based on the IMPORTS section of the component's configuration (see sGeoInput_java.xml for example).
For the module tab, menu Window>Show View>Other, search the module one.

HTH.

Francois

Alex_spain2 · 2010-12-23 11:24:00

Found the modules tab. Lot of jars loaded for the SDI components. But almost none of them are exported with the job.

Image of modules tab:
[img]http://img35.imageshack.us/img35/7357/mwsnap20101223111527.jpg[/img]

Lib folder of my exported job:
[img]http://img827.imageshack.us/img827/2278/mwsnap20101223111558.jpg[/img]

Alex_spain2 · 2010-12-23 11:39:10

It's strange. In a job which only has s2DPointReplacer and sProj, all libs that shows in Modules tab are really exported. But the job fails to launch, with this:

java.lang.NoClassDefFoundError: org/opengis/referencing/FactoryException

It's the job that I showed the lib folder in the previous post.

Alex_spain2 · 2010-12-23 11:43:59

Now I exported a job with sProj and sShapeFileOutput and exported all libs and worked FINE.
So the problem are with jobs with s2DPointReplace and sProj only...

Alex_spain2 · 2010-12-23 11:57:00

I'm starting to think that the bug is only with s2DPointReplacer and/or sProj. That uses jar that are not exported. If used with sShapeFileOutput they get the jars they need to work.
A job with only s2DPointReplacer and sProj will not export right to work as autonomous

Alex_spain2 · 2010-12-23 12:04:36

Almost confirmed my point. After adding a sShapeFileOutput (that does nothing) to a job that only used sProj and wasnt working, so the libs of sShapeFileOutput are exported, and the job started working ok as autonomous.
The problem/bug/whatever has to be in the list of jars that sProj (or/and s2DReplacer) claim to need, that is not enough.

Alex_spain2 · 2010-12-23 12:26:48

So, if someone wants to try it:

THIS DOESN'T WORK WHEN EXPORTED:
[img]http://img825.imageshack.us/img825/3750/mwsnap20101223122328.jpg[/img]

THIS WORKS WHEN EXPORTED (but has 14MB more of libraries weight...):
[img]http://img406.imageshack.us/img406/8138/mwsnap20101223122543.jpg[/img]

Announcement

Unanswered posts

#1 2010-12-22 16:49:52

Problem exporting SDI jobs. Please I need some help urgently.

#2 2010-12-22 17:36:26

Re: Problem exporting SDI jobs. Please I need some help urgently.

#3 2010-12-23 11:01:44

Re: Problem exporting SDI jobs. Please I need some help urgently.

Fxp wrote:

#4 2010-12-23 11:06:17

Re: Problem exporting SDI jobs. Please I need some help urgently.

#5 2010-12-23 11:24:00

Re: Problem exporting SDI jobs. Please I need some help urgently.

#6 2010-12-23 11:39:10

Re: Problem exporting SDI jobs. Please I need some help urgently.

#7 2010-12-23 11:43:59

Re: Problem exporting SDI jobs. Please I need some help urgently.

#8 2010-12-23 11:57:00

Re: Problem exporting SDI jobs. Please I need some help urgently.

#9 2010-12-23 12:04:36

Re: Problem exporting SDI jobs. Please I need some help urgently.

#10 2010-12-23 12:26:48

Re: Problem exporting SDI jobs. Please I need some help urgently.

Board footer