Unanswered posts

#1 2012-06-02 19:08:40

tpk
Member
Registered: 2012-01-20
Posts: 178

tOracleSCD Job Failed

Hi Team,


I am doing SCD Type 2 job but it is getting failed please help me where i am wrong. Kindly i am in dam need to accomplish this job. Please help me.

I am uploading images of my job. I am using the latest version TOS 5.1.1 community version. I had installed and have pointed my older version work space to this new version. I had run sample jobs run in the older version in the new version and the jobs had run successfully, so i don't think that this is a version problem. Kindly help me why my SCD job is getting failed.

Or do  i need to import any libraries or any kind of some thing like that please please..............help me out

Thanks and Regards,
Pavan


Uploaded Images

Last edited by tpk (2012-06-02 19:12:53)

Offline

#2 2012-06-03 17:47:45

tpk
Member
Registered: 2012-01-20
Posts: 178

Re: tOracleSCD Job Failed

Hi Team,

Any update please give me a solution on how to successfully accomplish the job in TOS 5.1.1

Thanks and Regards,
Pavan

Offline

#3 2012-06-04 04:27:16

pedro
Member
Registered: 2011-11-17
Posts: 3682

Re: tOracleSCD Job Failed

Hi Pavan

I still remember I saw your complex query several days before.
The warning explains why you encounter this issue.
The columns in schema are different from those of this query.
You'd better check it.

Regards,
Pedro


Only Paranoid Survive.

Offline

#4 2012-06-26 11:44:04

tpk
Member
Registered: 2012-01-20
Posts: 178

Re: tOracleSCD Job Failed

Hi Pedro,

As you suggested i tried using tParseRecordSet and tFilterRow instead of tOracleInput but the same JETException comes up and in the Code tab no code is generated.
Please help me out, due to this i am not able to accomplish SCD type 2
or Is there any other work around to accomplish SCD type 2?

There is a schema difference which displays in the warning what schema difference is there, how to debug what are the columns that are different from the select query?

I tried to print the output of Select query used in tOracleInput using a tLogRow and the output is displayed so this conforms that there is no problem with the tOracleInput component, but when i add tOracleSCD to Input component job is throwing an error

Thanks and Regards,
Pavan

pedro wrote:

Hi Pavan

I still remember I saw your complex query several days before.
The warning explains why you encounter this issue.
The columns in schema are different from those of this query.
You'd better check it.

Regards,
Pedro

Offline

#5 2012-06-26 16:57:24

tpk
Member
Registered: 2012-01-20
Posts: 178

Re: tOracleSCD Job Failed

Hi Talend Team,

Any Ideas why the above error is displayed? Please help me out. I will put in a simple way about my job description, I have a Complex query which has joins and case stmts and calculations which i use in my tOracleInput and i map the output of the select query to tOracleSCD as SCD type 2 in SCD component, when i run the job i get JETException.

Please help me out.

Thanks and Regards,
Pavan

Offline

#6 2012-06-30 12:09:52

shong
Talend team
Registered: 2007-08-29
Posts: 10305
Website

Re: tOracleSCD Job Failed

Hi Pavan

You don't configure the tOracleSCD component completely, the surrogate keys is not set yet.  The surrogate key column generate a unique key for each record in the table. The job code will be generated correctly while you set the surrogate key.

About the warning message "the query is different from the schema",  you can edit the query that select column one by one and define its corresponding schema to see what's wrong.

Best regards
Shong


Email:shong@talend.com
Choose Talend, Enjoy Talend!
New & Event: Talend Help Center
Talend-->the leader of open source data management and application integration solutions!

Offline

#7 2012-07-01 15:02:14

tpk
Member
Registered: 2012-01-20
Posts: 178

Re: tOracleSCD Job Failed

Hi Shong,

I thank you very much for the reply, i tried using a sequence and started executing the job but to my interest i am getting the attached error. I tried to manually enter the precision value between 1 and 38 by clicking the Edit schema button on the tOracleSCD component but that does not help, still the error comes, what should be done to overcome these error.

And i had few questions, first is the question related to the previous comment you had written, can you elaborate more about the quote below, i am confused i could not understand clearly, how can i edit the query that query contains my business logic and i am not supposed to change

shong wrote:

About the warning message "the query is different from the schema",  you can edit the query that select column one by one and define its corresponding schema to see what's wrong.

Second question, Is it mandatory to define Surrogate Key in the SCD component, I have a SKU column which is unique so that column doesn't serve as the key for the job


I am attaching the error which i am getting so kindly look in to it and help me out.

Thanks and Regards,
Pavan


Uploaded Images

Offline

#8 2012-07-02 10:28:06

tpk
Member
Registered: 2012-01-20
Posts: 178

Re: tOracleSCD Job Failed

Hi Shong/Team,

Any updates on how to resolve the issue?
Thanks in advance!

Thanks and Regards,
Pavan

Offline

#9 2012-07-02 14:02:17

tpk
Member
Registered: 2012-01-20
Posts: 178

Re: tOracleSCD Job Failed

Hi Team,

Any updates? Kindly shower your ideas on me!

Thanks and Regards,
Pavan

Offline

#10 2012-07-05 07:20:27

tpk
Member
Registered: 2012-01-20
Posts: 178

Re: tOracleSCD Job Failed

Hi Team,

Can any one help me why this error is coming? Please help me i am in dammn need for this.

Thanks and Regards,
Pavan

Offline

#11 2012-07-06 08:36:20

shong
Talend team
Registered: 2007-08-29
Posts: 10305
Website

Re: tOracleSCD Job Failed

Hi Pavan

Sorry for delay, I am busy with other projects these days.

I tried to manually enter the precision value between 1 and 38 by clicking the Edit schema button on the tOracleSCD component but that does not help, still the error comes, what should be done to overcome these error.

You don't define the precision for the column with NUMERIC datatype while creating the table or the precision value out of 1-38. You can see more information about this exception in the below topic:
http://www.techonthenet.com/oracle/errors/ora01727.php

To fix the error, you have to change the table and specify the precision between 1 and 38 for the NUMBERIC datatype.

Second question, Is it mandatory to define Surrogate Key in the SCD component, I have a SKU column which is unique so that column doesn't serve as the key for the job

Yes, you have to define a surrogate key to generate a unique key for each rows. The target SCD table looks like:
surrogate_id;SKU;name;start_time;end_time
1;1;shong;2012-07-04 10:12:11;2012-07-06 12:10:14
2;1;shong1;2012-07-06 12:10:14;null
3;2;Pavan;2012-07-05 10:12:10;null
4;3;Mike;2012-04-05 10:15:36;null
...

Here, the SKU column is the source key used to check that if the key already exists in the target table.
Best regards
Shong


Email:shong@talend.com
Choose Talend, Enjoy Talend!
New & Event: Talend Help Center
Talend-->the leader of open source data management and application integration solutions!

Offline

#12 2012-07-06 10:01:44

tpk
Member
Registered: 2012-01-20
Posts: 178

Re: tOracleSCD Job Failed

Hi Shong,

I thank you very much for your rocking answer, really this answer is very helpful and regarding Surrogate Key explanation i am spell bound.

Thanks you very much once again! I will definitely try and let you know the results.

Thanks and Regards,
Pavan


shong wrote:

Sorry for delay, I am busy with other projects these days.

I tried to manually enter the precision value between 1 and 38 by clicking the Edit schema button on the tOracleSCD component but that does not help, still the error comes, what should be done to overcome these error.

You don't define the precision for the column with NUMERIC datatype while creating the table or the precision value out of 1-38. You can see more information about this exception in the below topic:
http://www.techonthenet.com/oracle/errors/ora01727.php

To fix the error, you have to change the table and specify the precision between 1 and 38 for the NUMBERIC datatype.

Second question, Is it mandatory to define Surrogate Key in the SCD component, I have a SKU column which is unique so that column doesn't serve as the key for the job

Yes, you have to define a surrogate key to generate a unique key for each rows. The target SCD table looks like:
surrogate_id;SKU;name;start_time;end_time
1;1;shong;2012-07-04 10:12:11;2012-07-06 12:10:14
2;1;shong1;2012-07-06 12:10:14;null
3;2;Pavan;2012-07-05 10:12:10;null
4;3;Mike;2012-04-05 10:15:36;null
...

Here, the SKU column is the source key used to check that if the key already exists in the target table.

Last edited by tpk (2012-07-06 10:02:48)

Offline

Board footer

Powered by FluxBB