Talend community forum / Out Of Memory Error

mrali7 · 2012-03-21 08:14:56

Hi ,
i have a problem Talend gives me OutOfMemory Error while there is 4 GB free memory ,
any advise.

Thanks
Ali

Uploaded Images

pedro · 2012-03-21 08:18:37

Hi Ali

You extract so many rows from db. It caused OutOfMemory Erro.

This topic is related to [Forum, topic 22778] tfileInputExcel with excel2007 format read issue.
Hope this will help you.

Regards,
Pedro

mrali7 · 2012-03-21 11:30:36

Hi pedro ,
the problem still exists after enabling "Use specific JVM arguments"
kindly advise

note :- there is still 4 GB memory free space.
Regards
Ali

pedro · 2012-03-22 04:26:03

Hi Ali

Could you show me the values of JVM arguments?
You'd better increment them.
Using jvisualvm.exe in %Java_Home%\bin can monitor the memory using of this job.

Regards,
Pedro

mrali7 · 2012-03-22 07:26:53

Hi pedro ,
sorry i can't find this file in this directory , i googled this file and i'm not able to get it .
any advise.

Thanks
Ali

mrali7 · 2012-03-22 08:53:33

Hi Pedro ,
i got it i installed JDK 6 to get it , please find attached image

Uploaded Images

pedro · 2012-03-22 08:59:43

Hi

In this image, I can see that the xmx is still 1024M.
You'd better increase it into 1/4 of your total memory.

Regards,
Pedro

mrali7 · 2012-03-22 09:53:56

Hi pedro ,
please find attached error when i increased the Xmx 1024 to Xmx 2048

Thanks
Ali

Uploaded Images

pedro · 2012-03-22 09:55:20

Hi Ali

This is because the value of xmx exceeds 1/4 of your memory...

If still this issue can't be fixed after you increase the value, you'd better optimize your job.
Don't add any useless columns.
Don't extract so many rows at any one time.

Regards,
Pedro

mrali7 · 2012-03-22 12:37:35

Hi Pedro ,
Total memory is 8 GB so why 2048M is not working ?
and when i made it 1536M it works but it gives me another error i don't know what does it mean ?
see attached image

Uploaded Images

pedro · 2012-03-23 03:11:56

Hi

It seems that you have solved outofmemoryerror.
The job comes to tAS400Input_2.
The routines.system.RunStat.stopThreadStat caused concurrentmodificationException.
This class is predefined in Talend. It's weird.

Can this issue recur?

Regards,
Pedro

mrali7 · 2012-03-25 08:01:38

Hi Pedro ,
Yeah it always happens till now i can't execute my job successfully .
please advise.

Regards
Ali

pedro · 2012-03-26 04:42:51

Hi Ali

I have tried to find the reason but failed.
Here is an issue on BugTracker.
It seems you'd better change the setting of tMap.
Or you know clearly how to reproduce this issue. Report it on BugTrakcer.

Regards,
Pedro

mrali7 · 2012-03-27 10:13:18

Hi Pedro ,
when i remove the statistices as described in the bug the OutOfMemory exception appears again ,
really i'm tired from this and till now i'm not able to run mu job successfully
and i don't know why this happends as i have a lot of free memory space
please help on this.

Regards,
Ali

pedro · 2012-03-27 10:15:23

Hi Ali

Please report it on BugTracker.

Regards,
Pedro

mhirt · 2012-03-27 11:13:50

The error that you met with your memory is a basic limit of 32bits JVM with Windows memory addressing (http://stackoverflow.com/questions/1712 … windows-xp)

If you switch to a 64bits JVM, you will be able to address much more memory (assuming that windows find enough contiguous free memory)

mrali7 · 2012-03-28 07:41:42

Hi mhirt ,
JDK 6 64bit is installed already how can i sure that Talend uses the 64bit version ?
also what about "Xmx" parameter its by default 1024 and my Total memory is 8 GB
please advise

Regards
Ali

Announcement

Unanswered posts

#1 2012-03-21 08:14:56

Out Of Memory Error

#2 2012-03-21 08:18:37

Re: Out Of Memory Error

#3 2012-03-21 11:30:36

Re: Out Of Memory Error

#4 2012-03-22 04:26:03

Re: Out Of Memory Error

#5 2012-03-22 07:26:53

Re: Out Of Memory Error

#6 2012-03-22 08:53:33

Re: Out Of Memory Error

#7 2012-03-22 08:59:43

Re: Out Of Memory Error

#8 2012-03-22 09:53:56

Re: Out Of Memory Error

#9 2012-03-22 09:55:20

Re: Out Of Memory Error

#10 2012-03-22 12:37:35

Re: Out Of Memory Error

#11 2012-03-23 03:11:56

Re: Out Of Memory Error

#12 2012-03-25 08:01:38

Re: Out Of Memory Error

#13 2012-03-26 04:42:51

Re: Out Of Memory Error

#14 2012-03-27 10:13:18

Re: Out Of Memory Error

#15 2012-03-27 10:15:23

Re: Out Of Memory Error

#16 2012-03-27 11:13:50

Re: Out Of Memory Error

#17 2012-03-28 07:41:42

Re: Out Of Memory Error

Board footer