You are not logged in.

Unanswered posts



Important! This site has been replaced. All content here is read-only. Please visit our brand-new community at https://community.talend.com/. We look forward to hearing from you there!



#1 2010-10-21 15:06:00

vik_o
Member
6 posts

vik_o said:

[resolved] problem with tMysqlOutput and Encoding

Tags: [bug, database, mysql]

Firstly, I would like to say hello. I am new to the forums and new to Talend.
I have been encountering a problem, and I am unsure if something is wrong or if I have missed a step.
I need export data from Excel to MySQL. The part data contain Russian characters.

Tracert in inside TOS - all look well.

Result in table of MySql is wrong.   

Does anyone know what the problem is?

Last edited by vik_o (2010-10-21 15:15:38)

Offline

#2 2010-10-21 20:44:07

vik_o
Member
6 posts

vik_o said:

Re: [resolved] problem with tMysqlOutput and Encoding

problem solving - need pass the jdbc parameter to force utf8 encoding "noDatetimeStringSync=true&characterEncoding=utf8"

Offline

#3 2010-10-22 18:35:01

Peter
Member
74 posts

Peter said:

Re: [resolved] problem with tMysqlOutput and Encoding

Vik,
I tried your solution - it does not work for me. I have the same set as yours: data flows from Excel into MySQL table.
I have slight difference - there are couple other components in between.

    tFileInputExcel --> tFilterRow --> tMap -->tMysqlOutput

Encoding = UTF8 is set on tFileInputExcel and tMysqlOutput components. I added your suggestion: "noDatetimeStringSync=true&characterEncoding=utf8"
and doesn't seem to work.
Is there anything else you did?

Thank you for your help!

Peter.

Offline

#4 2010-10-22 20:12:18

vik_o
Member
6 posts

vik_o said:

Re: [resolved] problem with tMysqlOutput and Encoding

Hi, Peter.
Sorry for my English.

In the beginning, I have many variants job. The result was identical - bad.

After parameter addition all was normalized.

When the parameter isn't present, Talend send to MySql string "SET NAMES latin1".

After parameter addition    "characterEncoding=utf8"  - Talend any more doesn't send a line "SET NAMES latin1"

I think that further, the coding established on the server is important.

In my case, I have next MySql serever parameters - DEFAULT CHARSET=utf8 COLLATE=utf8_unicode_ci.     


Vik

Offline

#5 2013-06-27 11:41:24

Sudha0025
Member
5 posts

Sudha0025 said:

Re: [resolved] problem with tMysqlOutput and Encoding

Hi Once try with this.....this worked for me....

add "useOldUTF8Behavior=true" in JDBC additional parameter....

Offline

#6 2015-01-30 07:36:49

ShaliniSasi
Member
1 post

ShaliniSasi said:

Re: [resolved] problem with tMysqlOutput and Encoding

Hi everyone, 
I am having an issue with my job.
I am sending the records to SharePoint using tSoap. My records are having some international characters (like Ö etc.)
When I am running the webservice job through Talend Open Studio I am not getting any error. But when I am running the same job from Windows Scheduler using services it is not supporting those international characters, I am getting below error :
 
SUPPLIER Webservice Job 2015-01-29 14:50:00 Starting Job
0
||<soapenv:Fault xmlns:soapenv=""><faultcode>soapenv:Server</faultcode><faultstring>com.ctc.wstx.exc.WstxIOException: Invalid UTF-8 middle byte 0x54 (at char #319, byte #127)</faultstring><detail /></soapenv:Fault>
||<soapenv:Fault xmlns:soapenv=""><faultcode>soapenv:Server</faultcode><faultstring>java.lang.ArrayIndexOutOfBoundsException: read(buf,-380,4380), cbuf[4000]</faultstring><detail /></soapenv:Fault>
||<soapenv:Fault xmlns:soapenv=""><faultcode>soapenv:Server</faultcode><faultstring>com.ctc.wstx.exc.WstxIOException: Invalid UTF-8 middle byte 0x50 (at char #315, byte #127)</faultstring><detail /></soapenv:Fault>
||<soapenv:Fault xmlns:soapenv=""><faultcode>soapenv:Server</faultcode><faultstring>java.lang.ArrayIndexOutOfBoundsException: read(buf,-380,4380), cbuf[4000]</faultstring><detail /></soapenv:Fault>
|<ns:putSUPPLIERResponse xmlns:ns=""><ns:return xmlns:xsi="" xsi:type="ns:Return_Status"><ns:Errors>Error while updating row 0 for DataElement with meta id 213051, Message: Cannot insert the value NULL into column 'PARMA_CODE', table 'PPSS_qa2.dbo.MR_SUPPLIER'; column does not allow nulls. INSERT fails., Error Code: 515, SQL: INSERT INTO MR_SUPPLIER (PARMA_CODE, PARMA_DESC, LAST_UPDATED_BY, LAST_UPDATE_DATE, CREATED_BY, CREATE_DATE, EMAIL, FAX_NUMBER, TELEPHONE_NUMBER, INBOUND_FREIGHT_GROUP, COUNTRY, ZIP_CODE, STATE, CITY, ADDRESS2, ADDRESS1, EXTRACTION_TIME) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)&#xD;
Column:PARMA_CODE, Value:null&#xD;
Column:PARMA_DESC, Value:null&#xD;
Column:LAST_UPDATED_BY, Value:null&#xD;
Column:LAST_UPDATE_DATE, Value:null&#xD;
Column:CREATED_BY, Value:null&#xD;
Column:CREATE_DATE, Value:null&#xD;
Column:EMAIL, Value:null&#xD;
Column:FAX_NUMBER, Value:null&#xD;
Column:TELEPHONE_NUMBER, Value:null&#xD;
Column:INBOUND_FREIGHT_GROUP, Value:null&#xD;
Column:COUNTRY, Value:null&#xD;
Column:ZIP_CODE, Value:null&#xD;
Column:STATE, Value:null&#xD;
Column:CITY, Value:null&#xD;
Column:ADDRESS2, Value:null&#xD;
Column:ADDRESS1, Value:1&#xD;
Column:EXTRACTION_TIME, Value:null</ns:Errors><ns:Num_Deletes>0</ns:Num_Deletes><ns:Num_Inserts>0</ns:Num_Inserts><ns:Num_Updates>0</ns:Num_Updates><ns:Record_Name>SUPPLIER</ns:Record_Name></ns:return></ns:putSUPPLIERResponse>|
SUPPLIER Webservice Job 2015-01-29 14:50:01 Ending Job
 
 
Do I need to check some setting or something to make it work.
 
Any suggestion would be appreciated, Thanks in advance.
 
Cheers,
Shilly

 

Offline

Board footer

Talend Contributor Agreement - Talend Website Privacy Policy