• Index
  •  » Talend Open Studio for Data Integration » Usage, Operation
  •  » Generation Mode of tAdvancedFileOutputXML

#1 2008-07-17 09:31:29

jojo
Member
Registered: 2008-07-10
Posts: 15

Generation Mode of tAdvancedFileOutputXML

Hi,

I designed and exported a job that should generate a big XML file using tAdvancedFileOutputXML with generation mode "Slow with no memory consumed".

The problem is that the file generation is conditioned by the memory allocation to the Java VM in the batch file of the exported job, and therefore ends with an out-of-memory exception in case the memory allocation is below the file size. But, shouldn't the generation mode option mentioned above prevent from such a dependency?

Splitting up the output file didn't help as well, same problem.

Thanks!


Uploaded Images

Last edited by jojo (2008-07-17 09:32:27)

Offline

#2 2008-07-22 16:18:23

jojo
Member
Registered: 2008-07-10
Posts: 15

Re: Generation Mode of tAdvancedFileOutputXML

Just to keep that task alive! ;-)

Thanks for your comprehension!

Offline

#3 2008-07-28 09:40:51

jojo
Member
Registered: 2008-07-10
Posts: 15

Re: Generation Mode of tAdvancedFileOutputXML

Easier question then:

What effect (technical background) does the generation mode "Slow with no memory consumed" have?

Thanks!

Offline

#4 2008-07-28 14:48:43

Mbaroudi
Member
Registered: 1970-01-01
Posts: 45

Re: Generation Mode of tAdvancedFileOutputXML

I have the same problem Jojo, are you able to split your xml file please ?

Offline

#5 2008-07-28 16:43:04

jojo
Member
Registered: 2008-07-10
Posts: 15

Re: Generation Mode of tAdvancedFileOutputXML

Hi Mbaroudi,

as I mentioned, splitting up the file into more files didn't help. I tried that workaround too, after I experienced the mentioned memory dependency when generating one big file.

The strange thing is that, even if I have chosen the split-up option, the memory dependency is the same as if I would not split up the file. Clearly, you can't eliminate a java heap space problem by splitting up the file.

This is my experience.

Offline

  • Index
  •  » Talend Open Studio for Data Integration » Usage, Operation
  •  » Generation Mode of tAdvancedFileOutputXML

Board footer

Powered by FluxBB