I'm importing data from one SQL DB to another SQL DB using tMSSqlInput. However, I am receiving the following error.
Error Message -
"Exception in thread "Thread-0" java.lang.OutOfMemoryError: Java heap space..."
Is there a way around this error?
Is there a way to specify batch rows to insert at a time? Would that be a work around?
Any help is appreciated!
did you try to change your jvm arguments.
Try a search into the forum with java heap errors ... a lot of messages around this kind of 'problems' !
perhaps your solution is there !
hope it help
Last edited by lraulier (2010-07-03 11:58:30)
individuals are more important than any process (Grady Booch)
Can you post a screenshot of your job plz ? I dont think the exception is coming from the MSSQLinput component since the jtds drivers used by our component has already a value (look at this -> http://www.talendforge.org/bugs/view.php?id=8095&nbn=9)
Are you using a tMap ? tAggregateRows ? tSortRows ?
Looks like altering jvm is in the Talend batch file. How would I do in with Talend Design Studio? I am simply running the job in Design Studio, getting the memory error.
I've attached the components I am using, and it is erroring out between tMSSqlInput and tHashOutput. tHashOuput, I have "Data write model" to "Persistent to file", and the hash file is located in D drive, which I have set "Max memory heap size(MB)" to 6000.
Any other thoughts based on the components I am using?
Let me know if you have problem viewing my attached image.
BTW, I found jvm settings under Preference, Run/Debug. I reset -Xmx256M to -Xmx1280M. However, I still received out of memory error.
"Exception in thread "main" java.lang.OutOfMemoryError: Java heap space
Any help is appreciated.
I had a similar issue when reading data from mysql tables. Only workaround for me was to use a loop and a context variable and read the total x million rows from tmysqlinput in buckets of 1 million rows (as defined in the where clause of the input component: ID between x and y).
maybe this'll help!
I have checked TMSSqlinput advanced properties but I did not find any stream related link.