Pages: 1

Post reply

  • Index
  •  » Talend Open Studio for Data Integration » Usage, Operation
  •  » Salesforce exctact - 100 Rows Missing

#1 2011-10-12 00:16:38

BRM
Member
Registered: 2011-05-23
Posts: 11

Salesforce exctact - 100 Rows Missing

Tags: [mysql]

I am having a rather perplexing issue with a Salesforce extract that I am hoping someone can help me with.  I am attempting to extract the Contact table in my SF account to an amazon RDS database (MySQL 5) for use with BIRTonDemand.  The talend extract reports the correct number of rows in the table (3546) however the resulting table in MySQL has only 3446.  I extracted the data from SF using the apex data loader and compared it to the MySQL data and the missing rows are all consecutive (based on the date created in SF) between 11/13/09 and 10/27/10.  There are 146 rows in the contacts table that were created after that that extract fine.

I am not getting any key violations or any errors during the job that would suggest there was some problem with the table.

So I'm stumped.  Does anyone have any ideas?


Uploaded Images

Last edited by BRM (2011-10-12 00:18:43)

Offline

#2 2011-10-12 02:24:21

BRM
Member
Registered: 2011-05-23
Posts: 11

Re: Salesforce exctact - 100 Rows Missing

An update...

I changed the job so the SF data extracts to a *.csv file on my local machine and then a subjob uploads the *.csv to MySQL.  For some reason this works fine.

Offline

#3 2011-10-12 15:45:44

pcoffre
Talend Team
Registered: 2009-03-26
Posts: 528
Website

Re: Salesforce exctact - 100 Rows Missing

Hi BRM,

Thanks for the update.

Best,
Pcoffre.

Follow Talend on Twitter, Linkedin, Facebook and the forum.
Download and try Talend solutions

Offline

#4 2011-10-12 17:23:50

janhess
Member
Company: Newcastle University
Registered: 2009-05-19
Posts: 1137

Re: Salesforce exctact - 100 Rows Missing

Could this be some sort of commit issue?

Offline

#5 2011-10-12 17:26:56

BRM
Member
Registered: 2011-05-23
Posts: 11

Re: Salesforce exctact - 100 Rows Missing

What would I do to investigate?  My workaround works but is klugy.

Offline

#6 2011-10-12 17:41:51

janhess
Member
Company: Newcastle University
Registered: 2009-05-19
Posts: 1137

Re: Salesforce exctact - 100 Rows Missing

you could try a tMySQLCommit linked with a on sub job ok from the load. Depends on whether the table is innodb.
The other thing to do is link a tLogRow to the mysql output on a reject link. That will show if there are any rejects.

Last edited by janhess (2011-10-12 17:50:49)

Offline

Post reply

Pages: 1

  • Index
  •  » Talend Open Studio for Data Integration » Usage, Operation
  •  » Salesforce exctact - 100 Rows Missing

Board footer

Powered by FluxBB