You are not logged in.

Unanswered posts



Important! This site has been replaced. All content here is read-only. Please visit our brand-new community at https://community.talend.com/. We look forward to hearing from you there!



#1 2014-10-02 18:29:02

osdeadlock
Member
31 posts

osdeadlock said:

Records not inserted into mysql table

Tags: [mysql, PostgreSQL]

Hello all,
Doing a relatively simple move from PostgreSQL into MySQL, though the operation is successful it does not insert any record into the specified MySQL table.
Testing talend as a new ETL tool and i'm still navigating my way around all its' functionality. I'll appreciate any help.

Thank you all.

Offline

#2 2014-10-02 19:46:16

jlolling
Member
3186 posts

jlolling said:

Re: Records not inserted into mysql table

At first take care the option Die on error is on. Now you can spot probably errors.
Next, if you use a separate tMysqlConnection take care you also use tMysqlCommit triggered with OnSubjobOk starting with the first component in the last writing flow.
For more help, please post a image of your job, so we can spot further possible pitfalls.


Talend Certified working for cimt objects AG in Berlin

Offline

#3 2014-10-02 20:04:00

osdeadlock
Member
31 posts

osdeadlock said:

Re: Records not inserted into mysql table

I thought i posted this with my original post. Yes the option "die on error" is on.

 Many thanks for your time.


mini_blob_20141002-2104.png

Last edited by osdeadlock (2014-10-02 20:05:31)

Offline

#4 2014-10-02 20:06:01

jlolling
Member
3186 posts

jlolling said:

Re: Records not inserted into mysql table

Ok, now the image is visible. I take a look at it.
I would say, this is fairly straight forward and should work. Do you see some error messages in the Job console window. I would bet you will see some.

Last edited by jlolling (2014-10-02 20:08:11)


Talend Certified working for cimt objects AG in Berlin

Offline

#5 2014-10-02 21:03:06

osdeadlock
Member
31 posts

osdeadlock said:

Re: Records not inserted into mysql table

No errors - below is the output from the job console window.

Starting job DataLoadMySQL at 14:01 02/10/2014.

[statistics] connecting to socket on port 3726
[statistics] connected
[statistics] disconnected
Job DataLoadMySQL ended at 14:01 02/10/2014. [exit code=0]

Offline

#6 2014-10-02 21:11:55

jlolling
Member
3186 posts

jlolling said:

Re: Records not inserted into mysql table

GO to the Job view and here to the register Extras&Logs and switch on Log output.
What do you have set as Action on data?


Talend Certified working for cimt objects AG in Berlin

Offline

#7 2014-10-02 21:26:00

osdeadlock
Member
31 posts

osdeadlock said:

Re: Records not inserted into mysql table

Action on data is set to "insert".. I deleted the table.
mini_blob_20141002-2226.png

Last edited by osdeadlock (2014-10-02 21:26:21)

Offline

#8 2014-10-02 21:33:06

jlolling
Member
3186 posts

jlolling said:

Re: Records not inserted into mysql table

The only possible explanation is you have managed to avoid showing log output ;-). Currently I do not have any idea what could be wrong in your job. I would start debugging in such - seldom - case.
I do usually much more complex things with a MySQL database, so I am a bit at loss with your problem. You could post the component settings of the output component, perhaps this brings more light in your issue.


Talend Certified working for cimt objects AG in Berlin

Offline

#9 2014-10-02 21:39:41

osdeadlock
Member
31 posts

osdeadlock said:

Re: Records not inserted into mysql table

I just posted the component settings of the output component.

Offline

#10 2014-10-02 21:41:01

jlolling
Member
3186 posts

jlolling said:

Re: Records not inserted into mysql table

Sorry, the resolution of your picture is by far to low to spot anything on it. Please use a bit higher solution.
I see you use an separate connection for the output component and the flow does not trigger anything after it. Please trigger with OnSubjobOk starting from your input component a tMysqlCommit. Now it is clear, you write and write and does nothing with the connection, not commit or close. Of course you will not see any data in your table.

It looks like you have added the connection somewhere on your job without handling the possibility of failure.
I would trigger from the tMysqlConnection with OnSubjobOk your flow (connect the trigger to the start component of your job).
We would have a much quicker solution of your problem if would have posted the whole picture of yur job and not only a snippet.

Last edited by jlolling (2014-10-02 21:46:04)


Talend Certified working for cimt objects AG in Berlin

Offline

#11 2014-10-02 22:01:22

osdeadlock
Member
31 posts

osdeadlock said:

Re: Records not inserted into mysql table

Beautiful - Many thanks. Works well now, learning curve.
I've moved data into a MongoDB and didn't have to, assumed wrongly.
Thank you again.

Offline

#12 2014-10-02 22:34:20

jlolling
Member
3186 posts

jlolling said:

Re: Records not inserted into mysql table

Yes the actions in a MongoDB are atomic transactional. Thats because you do not need an explicit commit. But the MySQL usually works transactional. You can configure the tMysqlConnection also als auto commit. In this case you would not need an explicit commit.


Talend Certified working for cimt objects AG in Berlin

Offline

Board footer

Talend Contributor Agreement - Talend Website Privacy Policy