Talend community forum / Running scheduled jobs on Linux

Joshua71 · 2011-03-02 17:10:50

Tags: [cron, deployment, error, export, java]

Dear all,

I know this has been answered several times,....but I am bewilded what's best and how to successfully implement a working job.

This is what I found so far - according to forum experts

1. Export job
2. Using the crontab tab in TOS - you can crontab -e to paste in the copied cron code

But I wasn't unsure how it exactly works with the exported job.

I'm on CentOS (linux), using TOS Version: 4.1.1
Build id: r50363-20101022-0331

This is what I've normally done so far myself...

The job has child jobs.
Using Crontab in TOS, I copy the long script...

Code:

30 14 * * 1,2,3,4,5  /usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0/jre/bin/java -Xms256M -Xmx1024M -cp /home/talend/TOS-All-r50363-V4.1.1/lib/java/httpcore-4.0.jar:/home/talend/TOS-All-r50363-V4.1.1/lib/java/poi-3.6-20091214.jar:/home/talend/TOS-All-r50363-V4.1.1/lib/java/httpmime-4.0.1.jar:/home/talend/TOS-All-r50363-V4.1.1/lib/java/httpclient-4.0.1.jar:/home/talend/TOS-All-r50363-V4.1.1/lib/java/poi-ooxml-schemas-3.6-20091214.jar:/home/talend/TOS-All-r50363-V4.1.1/lib/java/activation.jar:/home/talend/TOS-All-r50363-V4.1.1/lib/java/log4j-1.2.15.jar:/home/talend/TOS-All-r50363-V4.1.1/lib/java/poi-scratchpad-3.6-20091214.jar:/home/talend/TOS-All-r50363-V4.1.1/lib/java/filecopy.jar:/home/talend/TOS-All-r50363-V4.1.1/lib/java/geronimo-stax-api_1.0_spec-1.0.jar:/home/talend/TOS-All-r50363-V4.1.1/lib/java/jxl.jar:/home/talend/TOS-All-r50363-V4.1.1/lib/java/dom4j-1.6.1.jar:/home/talend/TOS-All-r50363-V4.1.1/lib/java/jakarta-oro-2.0.8.jar:/home/talend/TOS-All-r50363-V4.1.1/lib/java/xmlbeans-2.3.0.jar:/home/talend/TOS-All-r50363-V4.1.1/lib/java/mail.jar:/home/talend/TOS-All-r50363-V4.1.1/lib/java/paloIX3.jar:/home/talend/TOS-All-r50363-V4.1.1/lib/java/poi-contrib-3.6-20091214.jar:/home/talend/TOS-All-r50363-V4.1.1/lib/java/javacsv.jar:/home/talend/TOS-All-r50363-V4.1.1/lib/java/poi-ooxml-3.6-20091214.jar:/home/talend/TOS-All-r50363-V4.1.1/lib/java/commons-logging-1.1.1.jar:/home/talend/TOS-All-r50363-V4.1.1/workspace/.Java/classes::/home/talend/TOS-All-r50363-V4.1.1/lib/java: financial.folder_watch_0_1.Folder_watch --context=Default $*

into crontab -e
save and exit, however on occassions, I get Java errors although it worked fine within TOS environment.

Can you please give me detailed steps on how to best implement correct cron.

Excel files, TOS and cron are on the same machine.

Many thanks
Josh

JohnGarrettMartin · 2011-03-02 21:15:04

looks like your doing everything correctly-- if you can show us the errors you are getting, we can provide some help.

Joshua71 · 2011-03-03 10:52:13

Am I right to understand, that there is no need to export job is there? It's only needed if I'm running it on another server?

I've got three jobs in cron - Here are the errors I'm getting...

Message 1

Code:

Message 1:
From talend@centdev.sodc  Thu Mar  3 09:40:01 2011
Date: Thu, 3 Mar 2011 09:40:01 GMT
From: root@centdev.sodc (Cron Daemon)
To: talend@centdev.sodc
Subject: Cron <talend@centdev> /usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0/jre/bin/java -Xms256M -Xmx1024M -cp /home/talend/TOS-All-r50363-V4.1.1/lib/java/httpcore-4.0.jar:/home/talend/TOS-All-r50363-V4.1.1/lib/java/poi-3.6-20091214.jar:/home/talend/TOS-All-r50363-V4.1.1/lib/java/httpmime-4.0.1.jar:/home/talend/TOS-All-r50363-V4.1.1/lib/java/httpclient-4.0.1.jar:/home/talend/TOS-All-r50363-V4.1.1/lib/java/poi-ooxml-schemas-3.6-20091214.jar:/home/talend/TOS-All-r50363-V4.1.1/lib/java/activation.jar:/home/talend/TOS-All-r50363-V4.1.1/lib/java/log4j-1.2.15.jar:/home/talend/TOS-All-r50363-V4.1.1/lib/java/poi-scratchpad-3.6-20091214.jar:/home/talend/TOS-All-r50363-V4.1.1/lib/java/filecopy.jar:/home/talend/TOS-All-r50363-V4.1.1/lib/java/talend_file_enhanced_20070724.jar:/home/talend/TOS-All-r50363-V4.1.1/lib/java/geronimo-stax-api_1.0_spec-1.0.jar:/home/talend/TOS-All-r50363-V4.1.1/lib/java/jxl.jar:/home/talend/TOS-All-r50363-V4.1.1/lib/java/paloIX.jar:/home/talend/TOS-All-r50363-V4.1.1/lib/java/dom4j-1.6.1.jar:/home/talend/TOS-All-r50363-V4.1.1/lib/java/jakarta-oro-2.0.8.jar:/home/talend/TOS-All-r50363-V4.1.1/lib/java/xmlbeans-2.3.0.jar:/home/talend/TOS-All-r50363-V4.1.1/lib/java/mail.jar:/home/talend/TOS-All-r50363-V4.1.1/lib/java/paloIX3.jar:/home/talend/TOS-All-r50363-V4.1.1/lib/java/poi-contrib-3.6-20091214.jar:/home/talend/TOS-All-r50363-V4.1.1/lib/java/javacsv.jar:/home/talend/TOS-All-r50363-V4.1.1/lib/java/poi-ooxml-3.6-20091214.jar:/home/talend/TOS-All-r50363-V4.1.1/lib/java/commons-logging-1.1.1.jar:/home/talend/TOS-All-r50363-V4.1.1/workspace/.Java/classes::/home/talend/TOS-All-r50363-V4.1.1/lib/java: housing.main_housing_0_1.MAIN_HOUSING --context=Default $*
Content-Type: text/plain; charset=UTF-8
Auto-Submitted: auto-generated
X-Cron-Env: <SHELL=/bin/sh>
X-Cron-Env: <HOME=/home/talend>
X-Cron-Env: <PATH=/usr/bin:/bin>
X-Cron-Env: <LOGNAME=talend>
X-Cron-Env: <USER=talend>

Exception in thread "main" java.lang.NoClassDefFoundError: housing/main_housing_0_1/MAIN_HOUSING
Caused by: java.lang.ClassNotFoundException: housing.main_housing_0_1.MAIN_HOUSING
        at java.net.URLClassLoader$1.run(URLClassLoader.java:217)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:205)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:323)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:268)
        at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:336)

Message 2

Code:

Message 2:
From talend@centdev.sodc  Thu Mar  3 09:45:01 2011
Date: Thu, 3 Mar 2011 09:45:01 GMT
From: root@centdev.sodc (Cron Daemon)
To: talend@centdev.sodc
Subject: Cron <talend@centdev> /usr/lib/jvm/java-1.6.0-openjdk-1.6.0.0/jre/bin/java -Xms256M -Xmx1024M -cp /home/talend/TOS-All-r50363-V4.1.1/lib/java/httpcore-4.0.jar:/home/talend/TOS-All-r50363-V4.1.1/lib/java/poi-3.6-20091214.jar:/home/talend/TOS-All-r50363-V4.1.1/lib/java/httpmime-4.0.1.jar:/home/talend/TOS-All-r50363-V4.1.1/lib/java/httpclient-4.0.1.jar:/home/talend/TOS-All-r50363-V4.1.1/lib/java/poi-ooxml-schemas-3.6-20091214.jar:/home/talend/TOS-All-r50363-V4.1.1/lib/java/activation.jar:/home/talend/TOS-All-r50363-V4.1.1/lib/java/log4j-1.2.15.jar:/home/talend/TOS-All-r50363-V4.1.1/lib/java/poi-scratchpad-3.6-20091214.jar:/home/talend/TOS-All-r50363-V4.1.1/lib/java/filecopy.jar:/home/talend/TOS-All-r50363-V4.1.1/lib/java/geronimo-stax-api_1.0_spec-1.0.jar:/home/talend/TOS-All-r50363-V4.1.1/lib/java/jxl.jar:/home/talend/TOS-All-r50363-V4.1.1/lib/java/dom4j-1.6.1.jar:/home/talend/TOS-All-r50363-V4.1.1/lib/java/jakarta-oro-2.0.8.jar:/home/talend/TOS-All-r50363-V4.1.1/lib/java/xmlbeans-2.3.0.jar:/home/talend/TOS-All-r50363-V4.1.1/lib/java/mail.jar:/home/talend/TOS-All-r50363-V4.1.1/lib/java/paloIX3.jar:/home/talend/TOS-All-r50363-V4.1.1/lib/java/poi-contrib-3.6-20091214.jar:/home/talend/TOS-All-r50363-V4.1.1/lib/java/javacsv.jar:/home/talend/TOS-All-r50363-V4.1.1/lib/java/poi-ooxml-3.6-20091214.jar:/home/talend/TOS-All-r50363-V4.1.1/lib/java/commons-logging-1.1.1.jar:/home/talend/TOS-All-r50363-V4.1.1/workspace/.Java/classes::/home/talend/TOS-All-r50363-V4.1.1/lib/java: financial.folder_watch_0_1.Folder_watch --context=Default $*
Content-Type: text/plain; charset=UTF-8
Auto-Submitted: auto-generated
X-Cron-Env: <SHELL=/bin/sh>
X-Cron-Env: <HOME=/home/talend>
X-Cron-Env: <PATH=/usr/bin:/bin>
X-Cron-Env: <LOGNAME=talend>
X-Cron-Env: <USER=talend>

Exception in thread "main" java.lang.NoClassDefFoundError: financial/folder_watch_0_1/Folder_watch
Caused by: java.lang.ClassNotFoundException: financial.folder_watch_0_1.Folder_watch
        at java.net.URLClassLoader$1.run(URLClassLoader.java:217)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.net.URLClassLoader.findClass(URLClassLoader.java:205)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:323)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:268)
        at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:336)

Job 3 - Seems to work fine as expected.

Niveditha · 2011-12-12 13:37:57

Hi ,

I am facing issues in running a package as a scheduled job in windows shceduler, where as the talend package runs fine without any issues.

Windows 2003 server.

Someone please help

Thank you
Niveditha

walkerca · 2011-12-12 13:47:15

Have you run your job using the exported .bat file from a DOS prompt on the target server?

omie · 2013-02-19 08:16:57

Hi,
Can we schedule job using LINUX but that machine does not have Talend install. it will success or we need talend install inside.

Regards,
Ommie

Announcement

Unanswered posts

#1 2011-03-02 17:10:50

Running scheduled jobs on Linux

Code:

#2 2011-03-02 21:15:04

Re: Running scheduled jobs on Linux

#3 2011-03-03 10:52:13

Re: Running scheduled jobs on Linux

Code:

Code:

#4 2011-12-12 13:37:57

Re: Running scheduled jobs on Linux

#5 2011-12-12 13:47:15

Re: Running scheduled jobs on Linux

#6 2013-02-19 08:16:57

Re: Running scheduled jobs on Linux

Board footer