You are not logged in.
I am loading file use the TOS job:
tfileinputdelimited --(main)--> tOracleOutput
and my rejected_records table with columns (rejected_record, error_field). The rejected_record will be having the entire rejected record and the error_field will be having the field on which the issue is.
the fourth column is date in target table. however, we got the value as "june" instead of date. Talend successfully loads the first record. Now i need to implement the job in such a way the value in the rejected_records table will be as
Created a job as below to handled the rejected records.
tFileInputDelimited --(main)--> tOracleOutput
tmap --(main)--> tOracleOutput
1. the input file has got over 10 fields delimited by ,
2. error scenario: expected - date field in column 3 but file has got a string (that record needs to be rejected)
the issue observed is all values after the above error-ed field are flowing as null.
Is there a way to capture the actual values of each field (even though error fields) from file?
In the attached sample file
error at line 1: 12/312011 expected: 12/31/2011
error at line 3: 10044a expected: 100444
also attached the data in the rejected records table
To make sure you get every value from the input file you could move the validation check of your data to a second component (use tSchemaComplianceCheck for example). This will make sure all data is read from the source file and put into a row. You can than, after the schema check use this rows .toString() method to get ALL data available in the source data.
Hope this helps.
I have a problem concerning the rejected records.
Description of my process :
- Input : read an apache log file (tApacheLogInput)
- Output : tFileOutputDelimited
Issue : The process does not generate the rejected records.
Could someone give me a help about this issue ?
For example, i read a file of 600 000 records and my process generates an excel output file of 567 422 records.
The difference represents 32 578 records which have been rejected.
So i would like to know how to generate a file containing these rejected records and why these records are rejected.
Thanks for your help.