Pages: 1

Post reply

  • Index
  •  » Talend Open Studio for Data Integration » Usage, Operation
  •  » Japanese Characters in CSV file to tLogRow...

#1 2012-06-01 20:35:11

webarnes99
Member
Registered: 2011-05-19
Posts: 18

Japanese Characters in CSV file to tLogRow...

Hello --

I am trying to insert some data from a CSV file to a SOAP web service and I am having problems with the characters passing to the Web Service.  Basically, I have the CSV file set to UTF-8 character set and the preview of the file looks normal.  I then setup a dataflow to a tLogRow and the characters come out as ?????.  Any help is appreciated.

Thanks,

wes

Offline

#2 2012-06-04 05:29:55

pedro
Member
Registered: 2011-11-17
Posts: 3682

Re: Japanese Characters in CSV file to tLogRow...

Hi Wes

Make sure that the encoding of this csv file is the same with tFileInputDelimited component(Advanced settings->Encoding).

Regards,
Pedro

Only Paranoid Survive.

Offline

#3 2012-06-06 04:55:01

webarnes99
Member
Registered: 2011-05-19
Posts: 18

Re: Japanese Characters in CSV file to tLogRow...

Hi Pedro --

Apologies for taking so long to get back to you and thanks for your prompt reply, I have been very pleased with the level of assistance and assistance I have received from the community.

I have checked the encoding is set to UTF-8 in the delimited input advanced settings.  I have taken some screenshots for your review.


Uploaded Images

Offline

#4 2012-06-06 05:13:41

pedro
Member
Registered: 2011-11-17
Posts: 3682

Re: Japanese Characters in CSV file to tLogRow...

Hi

Please show us the encoding of this csv file.
To get the encoding of a csv file, you might follow these steps.
1: Change the suffix of this csv file into txt.
2: Open this txt file and select File->Save as.
3: A "Save as" window appears. Change the encoding drop-down list into UTF-8.
4: Change the suffix of this file back to csv.
Then try your job again.
Does it work fine?

Regards,
Pedro

Only Paranoid Survive.

Offline

#5 2012-06-06 05:31:08

webarnes99
Member
Registered: 2011-05-19
Posts: 18

Re: Japanese Characters in CSV file to tLogRow...

Hi Pedro --

I have performed the steps you outlined and the output has produced the same result.  I have uploaded the file incase you want to give it a try yourself and see if you have the same behavior. 

Strike that I cannot upload the file so if you would like me to email it, let me know and I can send it to you.

Last edited by webarnes99 (2012-06-06 05:32:32)

Offline

#6 2012-06-06 05:32:58

pedro
Member
Registered: 2011-11-17
Posts: 3682

Re: Japanese Characters in CSV file to tLogRow...

Hi

Please send this file to me and I will test it for you.

Regards,
Pedro

Only Paranoid Survive.

Offline

#7 2012-06-06 05:43:12

pedro
Member
Registered: 2011-11-17
Posts: 3682

Re: Japanese Characters in CSV file to tLogRow...

Hi

Which version of TOS do you use?
Which OS?
I test it under TOS 5.1.0 and WINXP.

It works fine as the following image no matter what encoding I select.
Try "Custom"->"Unicode"?

Regards,
Pedro


Uploaded Images

Only Paranoid Survive.

Offline

#8 2012-06-06 05:46:27

webarnes99
Member
Registered: 2011-05-19
Posts: 18

Re: Japanese Characters in CSV file to tLogRow...

I am using TOS Version: 5.0.2 Build id: r78327-20120216-0244 on Windows 2008.

I just tried UNICODE and that did not work either.  I will try updating TOS and report back.

Offline

#9 2012-06-06 05:54:27

pedro
Member
Registered: 2011-11-17
Posts: 3682

Re: Japanese Characters in CSV file to tLogRow...

Hi

I don't think this is related to TOS version. Because it works fine under TOS 5.0.2 in my local machine....

Regards,
Pedro

Only Paranoid Survive.

Offline

Post reply

Pages: 1

  • Index
  •  » Talend Open Studio for Data Integration » Usage, Operation
  •  » Japanese Characters in CSV file to tLogRow...

Board footer

Powered by FluxBB