Talend community forum / Post a reply

Open Data SolutionsData Management solutionswarehouseOpen StudioBusinessExtract Transform LoadETL

You are not logged in.

Announcement

[2013-05-06] Boston Area User Group Meetup
[2013-05-02] NOTICE TO ALL TALENDFORGE USERS: maintenance completed
[2013-04-26] Talend Open Studio's 5.3.0 release is available
[2013-04-12] Ready for testing - Talend Open Studio's 5.3.0RC2 release is available
[2013-04-11] Talend’s corporate pages and groups on social media

Unanswered posts

Need help with avoiding regeneration for Connection password changes by merwin
parseDate change from 5.0.3 to 5.2.2? by Kwags300
Errors during startup of Talend by psahai
How do [...] by slowenthal
Problem whit context variable in query. by Ginetto
Problem with SELECT a.name AS a_name, b.name AS b_name input by kacper
get last row that raised an oracle exception while using tOracleOutput by ed.pag

Index
» Usage, Operation
» Problem with the t_DBInput Component.

Post a reply

Write your message and submit

Name

E-mail

Message

[quote=ptremblay]Bonjour,

I created a job that just reads from a DBF file with t_DBInput component and dumped its content straight into a CSV delimited file (t_FileOutputDelimited) to find to my complete horror that there are discrepancies between the input and the output in some of the columns of some of the records (2 of the records out of a total of 2298 recs). Not all the records are wrong only some columns and not always the same columns.

The worst part is that if I run the same job with the same data source set, I get sometimes more records that are different (4 out or 2298 recs – which implies that the records with problems are different than the previous run!!

I verified the schema and everything looks fine.

When I read the DBF source file with the program that produced it, I can attest that something is wrong with the t_DBInput component.

I would tend to think that the t_DBInput component is not ready for prime time.

Any suggestions to fix this issue are welcomed.

Thanks.
PM[/quote]

Options

Never show smilies as icons for this post

Click in the dark area of the image to send your post.

Go back

Topic review (newest first)

ptremblay: 2011-09-20 14:57:27

Bonjour Shicong,

The file as been sent to your email address.

BTW: I used EasyFrom (http://www.easyfrom.net/) to move the DBF file to MSSQL and the data is exactly as it should be. When I use the job I gave you, there are records where match_ref in the source are different than the ones in the target csv file.

I suspect tDB_Input.

Let me know what you find. The file is attached and "tos" is the password used.

Thanks.
PM

shong: 2011-09-20 02:57:02

Hi
I don't use DB2 component, db2 is my data source name here.;( Maybe you give me a different DBF file?

I open the SQL builder and fresh the database structure. see my screenshot.

What's the difference on column master_ref column?

Best regards
Shong

ptremblay: 2011-09-19 22:50:25

Bonjour Shong,

Thanks for your assistance with this.

The number of rows is OK for me too.

I've double-checked and I refreshed the schema to my original Visual Fox Pro DBF file produced by the application I'm using and I still have the same issue.

I compared the schema from the one I had in TOS repository and compared it with the tools provided by the application. They are both identical.

I don't understand exactly why you used DB2 and how you created it but the schema you showed is different than the one I have in the DBF file provided.

Bottom line is that I still have a difference in the master_ref column (at least) in the DBF file and the one transferred into the CSV file generated.

I still cannot trust the t_DBInput componenet for now.

Let me know if you still want to work on this issue.

PS: I just sent you few snapshots to your email address since I cannot attached these jpg files properly through the forum.

Cheers.
PM

shong: 2011-09-19 03:44:55

Hi
Sorry for delay!

I tested your job and it always return 2298 rows. I found another problem in your job, the order of columns on schema does not match the table definition, for example, the first field in table is base_score.

Best regards
Shong

ptremblay: 2011-09-07 17:12:45

Bonjour Shong,

As usual, you've been quick to respond.

I sent the files to your talend email address.

Thanks.
PM

shong: 2011-09-07 10:16:41

Hi

It is possible to send me the job with DBF file for further testing?

Best regards
Shong

ptremblay: 2011-09-06 21:53:51

Bonjour,

I created a job that just reads from a DBF file with t_DBInput component and dumped its content straight into a CSV delimited file (t_FileOutputDelimited) to find to my complete horror that there are discrepancies between the input and the output in some of the columns of some of the records (2 of the records out of a total of 2298 recs). Not all the records are wrong only some columns and not always the same columns.

The worst part is that if I run the same job with the same data source set, I get sometimes more records that are different (4 out or 2298 recs – which implies that the records with problems are different than the previous run!!

I verified the schema and everything looks fine.

When I read the DBF source file with the program that produced it, I can attest that something is wrong with the t_DBInput component.

I would tend to think that the t_DBInput component is not ready for prime time.

Any suggestions to fix this issue are welcomed.

Thanks.
PM

Announcement

Unanswered posts

Post a reply

Topic review (newest first)

Board footer