Post a reply

Write your message and submit

Options

Click in the dark area of the image to send your post.

Go back

Topic review (newest first)

strpdsnk
2008-09-18 20:21:29

should be able to replace blanks and nulls in 2.4.3:  [Bugtracker] bug 5109

strpdsnk
2008-09-04 21:51:24

ok so I DLed TOS 3.0.0M3 to check this out, and you are totally correct, there is a "generate code" button that passes all the columns through automatically!

strpdsnk
2008-09-03 18:25:25

I would DL the newest TOS version, but I am using TIS, so I'll have to wait until the new version of that comes out.
But if the new tJavaRow can do all that, it sounds very promising for what I want/need to do.

Thanks!

nkxx
2008-09-03 11:31:44

Because tReplace uses the java "replaceAll" function, which throws a nullPointerException for null values.

I advice you to download TOS 3.0.0 and fetch the tJavaRow component from this version, because it is said to generate automatically the code for your 300+ columns. (like a "guess" button)

You can also modify your tJavaRow component. There is a parameter to change to copy all the rows from the input flow to the output flow. You then just have to write the code for the columns you want to modify.

strpdsnk
2008-09-03 01:50:01

well, obviously this isn't turning out to be simple

the problem is that I do not want to list out the 300+ columns in tJavaRow
and I know how to do what I want in tMap, but its not as clean as I would like (because you can't designate the output schema by referencing a schema in the repository: http://www.talendforge.org/bugs/view.php?id=4923)

so, thats why I want to know how to replace null values with tReplace
and I don't see why I shouldn't be able to replace null values with tReplace, it seems kind of dumb that that functionality wouldn't be available

nkxx
2008-09-01 17:50:42

Well, according to me the answer is simple : to replace null values you have to use a tJavaRow. And indeed you have to write the code for every field (except if you feel like modifying lightly the component's code).

strpdsnk
2008-08-29 19:43:34

Ok, I changed all of the fields I want to replace to Strings, but I still don't know how to replace the Null values

error:

Exception in component tReplace_1
java.lang.NullPointerException
    at bbfiletransform_test.copy_of_mbs_0_9.Copy_of_MBS.tFileInputDelimited_1Process(Copy_of_MBS.java:35351)
    at bbfiletransform_test.copy_of_mbs_0_9.Copy_of_MBS.tJava_1Process(Copy_of_MBS.java:39319)
    at bbfiletransform_test.copy_of_mbs_0_9.Copy_of_MBS.runJobInTOS(Copy_of_MBS.java:41967)
    at bbfiletransform_test.copy_of_mbs_0_9.Copy_of_MBS.main(Copy_of_MBS.java:41730)

output:

Starting job Copy_of_MBS at 13:44 29/08/2008.
[statistics] connecting to socket on port 4002
[statistics] connected
2008-08-29 13:44:23|BTf3Bi|BTf3Bi|BTf3Bi|3704|BBFILETRANSFORM_TEST|Copy_of_MBS|_wJIOQHOdEd20SMTXuGEkfQ|0.9|HardcodedValues||begin||

***tJava_1 - START***

2008-08-29 13:44:23.877
2008-08-29
13:44:23.877
h:/talend/BB_MBS__Reformat.txt

***tJava_1 - END***

SourceFile    CurrentDateTime    CurrentDate    CurrentTime    SECURITIES    ERROR_CODE    NUM_FLDS    ID_BB_COMPANY    LONG_COMP_NAME    COUNTRY_ISO    SHORT_NAME    SECURITY_TYP    MARKET_SECTOR_DES    QUOTE_TYP    DAY_CNT    PAR_AMT    MTG_FIRST_PAY_DT    CPN    MTG_ORIG_AMT    ISSUE_DT    ISSUE_PX    MATURITY    CRNCY    EXCH_CODE    CPN_FREQ    MTG_COLLAT_TYP    CPN_TYP    MTG_FACTOR_DT    DAYS_ACC    DELIVERY_TYP    FIRST_SETTLE_DT    _144A_FLAG    IS_ACCRED_INV    CALLABLE    CONVERTIBLE    FLOATER    MTG_IS_PAID_OFF    OID_BOND    PRVT_PLACE    IS_REG_S    LEAD_MGR    MARKET_SECTOR    MTG_AMORT_TYP    MTG_ARM_SUBTYP    MTG_CMO_CLASS    MTG_CMO_GROUP    MTG_CMO_SERIES    MTG_COLLAT_DT    MTG_COLLAT_SEASONING    MTG_COMPLIANCE_CODE    MTG_CUR_PAY_RT    MTG_DEAL_TYP    MTG_EST_ACC_RT    MTG_FACTOR_NUM_DT    MTG_FACTOR_SET_DT    MTG_FFIEC_TEST    MTG_GEN_TICKER    MTG_GEO    MTG_IS_MEGA    MTG_LOOKBACK    MTG_NOTL_PRINC_FLAG    MTG_ORIG_SERV_LINE1    MTG_ORIG_WAC    MTG_ORIG_WAL    MTG_ORIG_WAM    MTG_PAY_CAP    MTG_PAY_DELAY    MTG_PER_RT_CAP    MTG_POOL_FACTOR    MTG_POOL_NUMBER    MTG_POOL_TYP    MTG_PREPAY_TYP    MTG_RT_CHG_FREQ    MTG_SERV    MTG_SMMEA_STAT    MTG_STATED_DT    MTG_TRANCHE_TYP    MTG_TYP    MTG_WAM_NXT_RST    NXT_CALL_DT    NXT_CALL_PX    NXT_CPN_DT    NXT_PUT_DT    NXT_PUT_PX    MTG_FLT_NXT_RST    NXT_SINK_AMT    PREV_CPN_DT    ID_BB_UNIQUE    SEC_DATE_2A_7    SECURITY_DES    SECURITY_TYP2    SETTLE_DT    STATE_CODE    TICKER    RESET_IDX    TRADE_STATUS    MTG_CALL_PCT    MTG_CRED_PROV    MTG_PREV_CPN    CUR_CPN    MIN_PIECE    ISSUER    NAME    ISSUER_BULK    CNTRY_OF_DOMICILE    CNTRY_OF_INCORPORATION    ID_BB_PARENT_CO    REDEMP_CRNCY    COLLAT_ARM_INDEX_1    COLLAT_ARM_INDEX_2    COLLAT_ARM_INDEX_3    COLLAT_ARM_INDEX_ALL    ID_CUSIP    ID_CUSIP_8_CHR    ID_ISIN    ID_CUSIP_REAL    ID_SEDOL1    ID_VALOREN    RTG_FITCH    FITCH_EFF_DT    RTG_FITCH_LONG    RTG_FITCH_LONG_RATING_DT    RTG_FITCH_NO_WATCH    RTG_FITCH_OUTLOOK    RTG_FITCH_OUTLOOK_DT    RTG_FITCH_SHRT    RTG_FITCH_SHRT_RATING_DT    RTG_MOODY    MOODY_EFF_DT    RTG_MOODY_LONG    RTG_MDY_LONG_RATING_DT    RTG_MOODY_NO_WATCH    RTG_MOODY_SHRT    RTG_MDY_SHRT_RATING_DT    RTG_MOODY_WATCH    RTG_MOODY_WATCH_DT    RTG_SP    SP_EFF_DT    RTG_SP_LONG    RTG_SP_LONG_RATING_DT    RTG_SP_NO_WATCH    RTG_SP_SHRT    RTG_SP_SHRT_RATING_DT    INDUSTRY_GROUP    INDUSTRY_SECTOR    INDUSTRY_SUBGROUP_NUM    MTG_SPREAD_TO_TSY_MID    LAST_UPDATE_DT    PX_ASK    PX_BID    PX_LAST    PX_MID    QUOTE_ASK    QUOTE_BID    QUOTE_MID    AMT_OUTSTANDING    CNVX_MID    COLLAT_ARM_PERCENT_ALL    COLLAT_ARM_PERIODIC_CAP_1    COLLAT_ARM_PERIODIC_CAP_2    COLLAT_ARM_PERIODIC_CAP_3    COLLAT_ARM_PERIODIC_CAP_ALL    COLLAT_ARM_PERCENT_1    COLLAT_ARM_PERCENT_2    COLLAT_ARM_PERCENT_3    COLLAT_ARM_WA_CAP_1    COLLAT_ARM_WA_CAP_2    COLLAT_ARM_WA_CAP_3    COLLAT_ARM_WA_CAP_ALL    COLLAT_ARM_WA_FLOOR_1    COLLAT_ARM_WA_FLOOR_2    COLLAT_ARM_WA_FLOOR_3    COLLAT_ARM_WA_FREQ_1    COLLAT_ARM_WA_FREQ_2    COLLAT_ARM_WA_FREQ_3    COLLAT_ARM_WA_FREQ_ALL    COLLAT_ARM_WA_GROSS_MARGIN_1    COLLAT_ARM_WA_GROSS_MARGIN_2    COLLAT_ARM_WA_GROSS_MARGIN_3    COLLAT_ARM_WA_GROSS_MARGIN_ALL    COLLAT_ARM_WA_NET_MARGIN_ALL    COLLAT_ARM_WA_RESET_DATE_1    COLLAT_ARM_WA_RESET_DATE_2    COLLAT_ARM_WA_RESET_DATE_3    COLLAT_ARM_WA_RESET_DATE_ALL    COLLAT_ARM_WAC_1    COLLAT_ARM_WAC_2    COLLAT_ARM_WAC_3    COLLAT_ARM_WAC_ALL    COLLAT_ARM_WA_FLOOR_ALL    COLLAT_ARM_WA_NET_MARGIN_1    COLLAT_ARM_WA_NET_MARGIN_3    DAYS_TO_MTY_TDY    DUR_ADJ_MID    DUR_MID    INT_ACC    MOST_RECENT_REPORTED_FACTOR    MTG_ACC_RT    MTG_ACC_RT_START_DT    MTG_AMORT_WAM    MTG_AMT_OUT_FACE    MTG_BALLOON_WAM    MTG_CARD_MPR    MTG_CREDIT_SCORE_WAVG    MTG_EFF_CNVX_MID    MTG_EFF_DUR_MID    MTG_EXS_SPREAD    MTG_FACTOR    MTG_FACT_SET_DT_STRT_NEXT_ACC_DT    MTG_FACTOR_INT_PAY    MTG_FACTOR_PAY_DT    MTG_GEN_CPR_12M    MTG_GEN_CPR_1M    MTG_GEN_CPR_3M    MTG_GEN_CPR_6M    MTG_INT_DEFERRED    MTG_INT_DIST    MTG_INT_SHORTFALL    MTG_LOAN_AGE    MTG_LOAN_MRGN    MTG_LOAN_SIZE_WAVG    MTG_LOCK_WAM    MTG_ORIG_LFLOOR_AVG    MTG_PL_CPR_12M    MTG_PL_CPR_1M    MTG_PL_CPR_3M    MTG_PL_CPR_6M    MTG_PORT_YLD    MTG_PREPAY_SPEED    MTG_PX_SPD    MTG_QRT_AOLS_MAX    MTG_QRT_ASOF_DT    MTG_QRT_AOLS_MED    MTG_QRT_LTV_MED    MTG_QRT_SCORE_MAX    MTG_QRT_SCORE_MED    MTG_STATED_NUM_DT    MTG_STATED_WALA    MTG_STATED_WARM    MTG_WAC_CALC    MTG_WAC_WAVG    MTG_WACPN    MTG_WAL    MTG_WALA_CALC    MTG_WAM    MTG_WAM_WAVG    MTG_WAOCS    MTG_WHLN_LTV    MTG_WHLN_NUMBER_LOAN    MTG_WHLN_WALA    MTY_YEARS    OAS_SPREAD_ASK    OAS_SPREAD_BID    OAS_SPREAD_MID    YLD_CUR_ASK    YLD_CUR_BID    YLD_CUR_MID    YLD_VAL_32ND_MID    YLD_YTC_MID    YLD_YTM_MID    YLD_YTP_MID    FLT_SPREAD    MTG_LIFE_CAP    MTG_LIFE_FLOOR    REFIX_FREQ    YLD_CNV_BID    YLD_CNV_ASK    YLD_CNV_MID    CUM_LOSS_PCT    CURR_CREDIT_SUPPORT    CURR_CUM_LOSS_AMT    MTG_2_4_FAMILY_CURR    MTG_AMORT_TYPE_LEVEL_FRM_CURR    MTG_BAL    MTG_CONDOMINIUM_CURR    MTG_CUR_PRINC_PAY    MTG_CUR_PAY_DT    MTG_DELQ_90PLUS_CUR    MTG_FACTOR_PRINC_PAY    MTG_NORTHERN_CA_CURR    MTG_PREV_BAL    MTG_PRINC_LOSSES    MTG_PUD_CURR    MTG_QRT_AGE_25    MTG_QRT_AGE_75    MTG_QRT_AGE_MAX    MTG_QRT_AGE_MED    MTG_QRT_AGE_MIN    MTG_QRT_AOLS_25    MTG_QRT_AOLS_75    MTG_QRT_AOLS_MIN    MTG_QRT_CPN_25    MTG_QRT_CPN_75    MTG_QRT_CPN_MAX    MTG_QRT_CPN_MED    MTG_QRT_CPN_MIN    MTG_QRT_LTV_25    MTG_QRT_LTV_75    MTG_QRT_LTV_MAX    MTG_QRT_LTV_MIN    MTG_QRT_MTY_25    MTG_QRT_MTY_75    MTG_QRT_MTY_MAX    MTG_QRT_MTY_MED    MTG_QRT_MTY_MIN    MTG_QRT_SCORE_25    MTG_QRT_SCORE_75    MTG_QRT_SCORE_MIN    MTG_QRT_TERM_25    MTG_QRT_TERM_75    MTG_QRT_TERM_MAX    MTG_QRT_TERM_MED    MTG_QRT_TERM_MIN    MTG_SINGLE_FAMILY_CURR    MTG_SOUTHERN_CA_CURR    MTG_WHLN_WALTV    ORIG_CREDIT_SUPPORT    MTG_WHLN_GEO1    MTG_WHLN_GEO2    MTG_WHLN_GEO3    MTG_WHLN_GEO4    MTG_PRINC_DIST    MTG_CURR_LOAN_SIZE_WAVG    MTG_DEAL_CUR_COLLAT_AMT    RTG_FITCH_WATCH    RTG_FITCH_WATCH_DT    RTG_SP_WATCH    RTG_SP_WATCH_DT    MTG_FIRST_RESET_CAP_UP    MTG_WA_ORIG_LOAN_SIZE    ARM_WA_MONTHS_TO_INIT_RST    COLLAT_ARM_LOAN_TYP_1    MTG_AMORT_TYPE_ARM_CURR
Exception in component tReplace_1
java.lang.NullPointerException
    at bbfiletransform_test.copy_of_mbs_0_9.Copy_of_MBS.tFileInputDelimited_1Process(Copy_of_MBS.java:36695)
    at bbfiletransform_test.copy_of_mbs_0_9.Copy_of_MBS.tJava_1Process(Copy_of_MBS.java:40664)
    at bbfiletransform_test.copy_of_mbs_0_9.Copy_of_MBS.runJobInTOS(Copy_of_MBS.java:43312)
    at bbfiletransform_test.copy_of_mbs_0_9.Copy_of_MBS.main(Copy_of_MBS.java:43075)

***tJava_2***

2008-08-29 13:44:24|BTf3Bi|BTf3Bi|BTf3Bi|BBFILETRANSFORM_TEST|Copy_of_MBS|HardcodedValues|6|Java Exception|tJava_2||1
562 milliseconds
2008-08-29 13:44:24|BTf3Bi|BTf3Bi|BTf3Bi|3704|BBFILETRANSFORM_TEST|Copy_of_MBS|_wJIOQHOdEd20SMTXuGEkfQ|0.9|HardcodedValues||end|success|562
[statistics] disconnected
Job Copy_of_MBS ended at 13:44 29/08/2008. [exit code=0]

tJava_1

Code:

System.out.println("");
System.out.println("***tJava_1 - START***");
System.out.println("");

context.CurrentDateTime = TalendDate.getDate("yyyy-MM-dd HH:mm:ss.SSS");

context.CurrentDate = TalendDate.getDate("yyyy-MM-dd");
context.CurrentTime = TalendDate.getDate("HH:mm:ss.SSS");

System.out.println(context.CurrentDateTime);
System.out.println(context.CurrentDate);
System.out.println(context.CurrentTime);
System.out.println(context.NewFile);

System.out.println("");
System.out.println("***tJava_1 - END***");
System.out.println("");

tJava_2

Code:

System.out.println("");
System.out.println("***tJava_2***");
System.out.println("");

tJava_3

Code:

System.out.println("");
System.out.println("***tJava_3***");
System.out.println("");
strpdsnk
2008-08-27 22:21:17

I won't use tJavaRow then.

I'll convert the Date to a String, but how do I match on a null string?

jandry
2008-08-27 22:16:36

That is normal of the tJavaRow... if you are going to use that component instead of the tReplace you need to specify all of the columns that you want to pass through it.

output_row.id = input_row.id;
output_row.name = input_row.name;
etc.

For the tReplace you need to set the Date column to a String.  The replaceAll function in java requires 2 string parameters, the first being a regex expression that finds the value you are looking to replace and the second is the value that you want to use to replace the value in the regex.  If this is the course you choose you can always parse the date from the string later if you need to use it for some other reason.

strpdsnk
2008-08-27 20:49:30

After looking at the code used in tReplace (pic 1), I tried using a tJavaRow (pic 2).  But only the two columns I designated in tJavaRow printed out with values, the rest were nulls

Starting job Copy_of_MBS at 14:49 27/08/2008.
2008-08-27 14:49:13|BiThmL|BiThmL|BiThmL|3036|BBFILETRANSFORM_TEST|Copy_of_MBS|_wJIOQHOdEd20SMTXuGEkfQ|0.9|HardcodedValues||begin||

***tJava_1 - START***

Wed Aug 27 14:49:14 EDT 2008
h:/talend/BB_MBS__Reformat.txt

***tJava_1 - END***

SourceFile    CurrentDateTime    SECURITIES    ERROR_CODE    NUM_FLDS    ID_BB_COMPANY    LONG_COMP_NAME    COUNTRY_ISO    SHORT_NAME    SECURITY_TYP    MARKET_SECTOR_DES    QUOTE_TYP    DAY_CNT    PAR_AMT    MTG_FIRST_PAY_DT    CPN    MTG_ORIG_AMT    ISSUE_DT    ISSUE_PX    MATURITY    CRNCY    EXCH_CODE    CPN_FREQ    MTG_COLLAT_TYP    CPN_TYP    MTG_FACTOR_DT    DAYS_ACC    DELIVERY_TYP    FIRST_SETTLE_DT    _144A_FLAG    IS_ACCRED_INV    CALLABLE    CONVERTIBLE    FLOATER    MTG_IS_PAID_OFF    OID_BOND    PRVT_PLACE    IS_REG_S    LEAD_MGR    MARKET_SECTOR    MTG_AMORT_TYP    MTG_ARM_SUBTYP    MTG_CMO_CLASS    MTG_CMO_GROUP    MTG_CMO_SERIES    MTG_COLLAT_DT    MTG_COLLAT_SEASONING    MTG_COMPLIANCE_CODE    MTG_CUR_PAY_RT    MTG_DEAL_TYP    MTG_EST_ACC_RT    MTG_FACTOR_NUM_DT    MTG_FACTOR_SET_DT    MTG_FFIEC_TEST    MTG_GEN_TICKER    MTG_GEO    MTG_IS_MEGA    MTG_LOOKBACK    MTG_NOTL_PRINC_FLAG    MTG_ORIG_SERV_LINE1    MTG_ORIG_WAC    MTG_ORIG_WAL    MTG_ORIG_WAM    MTG_PAY_CAP    MTG_PAY_DELAY    MTG_PER_RT_CAP    MTG_POOL_FACTOR    MTG_POOL_NUMBER    MTG_POOL_TYP    MTG_PREPAY_TYP    MTG_RT_CHG_FREQ    MTG_SERV    MTG_SMMEA_STAT    MTG_STATED_DT    MTG_TRANCHE_TYP    MTG_TYP    MTG_WAM_NXT_RST    NXT_CALL_DT    NXT_CALL_PX    NXT_CPN_DT    NXT_PUT_DT    NXT_PUT_PX    MTG_FLT_NXT_RST    NXT_SINK_AMT    PREV_CPN_DT    ID_BB_UNIQUE    SEC_DATE_2A_7    SECURITY_DES    SECURITY_TYP2    SETTLE_DT    STATE_CODE    TICKER    RESET_IDX    TRADE_STATUS    MTG_CALL_PCT    MTG_CRED_PROV    MTG_PREV_CPN    CUR_CPN    MIN_PIECE    ISSUER    NAME    ISSUER_BULK    CNTRY_OF_DOMICILE    CNTRY_OF_INCORPORATION    ID_BB_PARENT_CO    REDEMP_CRNCY    COLLAT_ARM_INDEX_1    COLLAT_ARM_INDEX_2    COLLAT_ARM_INDEX_3    COLLAT_ARM_INDEX_ALL    ID_CUSIP    ID_CUSIP_8_CHR    ID_ISIN    ID_CUSIP_REAL    ID_SEDOL1    ID_VALOREN    RTG_FITCH    FITCH_EFF_DT    RTG_FITCH_LONG    RTG_FITCH_LONG_RATING_DT    RTG_FITCH_NO_WATCH    RTG_FITCH_OUTLOOK    RTG_FITCH_OUTLOOK_DT    RTG_FITCH_SHRT    RTG_FITCH_SHRT_RATING_DT    RTG_MOODY    MOODY_EFF_DT    RTG_MOODY_LONG    RTG_MDY_LONG_RATING_DT    RTG_MOODY_NO_WATCH    RTG_MOODY_SHRT    RTG_MDY_SHRT_RATING_DT    RTG_MOODY_WATCH    RTG_MOODY_WATCH_DT    RTG_SP    SP_EFF_DT    RTG_SP_LONG    RTG_SP_LONG_RATING_DT    RTG_SP_NO_WATCH    RTG_SP_SHRT    RTG_SP_SHRT_RATING_DT    INDUSTRY_GROUP    INDUSTRY_SECTOR    INDUSTRY_SUBGROUP_NUM    MTG_SPREAD_TO_TSY_MID    LAST_UPDATE_DT    PX_ASK    PX_BID    PX_LAST    PX_MID    QUOTE_ASK    QUOTE_BID    QUOTE_MID    AMT_OUTSTANDING    CNVX_MID    COLLAT_ARM_PERCENT_ALL    COLLAT_ARM_PERIODIC_CAP_1    COLLAT_ARM_PERIODIC_CAP_2    COLLAT_ARM_PERIODIC_CAP_3    COLLAT_ARM_PERIODIC_CAP_ALL    COLLAT_ARM_PERCENT_1    COLLAT_ARM_PERCENT_2    COLLAT_ARM_PERCENT_3    COLLAT_ARM_WA_CAP_1    COLLAT_ARM_WA_CAP_2    COLLAT_ARM_WA_CAP_3    COLLAT_ARM_WA_CAP_ALL    COLLAT_ARM_WA_FLOOR_1    COLLAT_ARM_WA_FLOOR_2    COLLAT_ARM_WA_FLOOR_3    COLLAT_ARM_WA_FREQ_1    COLLAT_ARM_WA_FREQ_2    COLLAT_ARM_WA_FREQ_3    COLLAT_ARM_WA_FREQ_ALL    COLLAT_ARM_WA_GROSS_MARGIN_1    COLLAT_ARM_WA_GROSS_MARGIN_2    COLLAT_ARM_WA_GROSS_MARGIN_3    COLLAT_ARM_WA_GROSS_MARGIN_ALL    COLLAT_ARM_WA_NET_MARGIN_ALL    COLLAT_ARM_WA_RESET_DATE_1    COLLAT_ARM_WA_RESET_DATE_2    COLLAT_ARM_WA_RESET_DATE_3    COLLAT_ARM_WA_RESET_DATE_ALL    COLLAT_ARM_WAC_1    COLLAT_ARM_WAC_2    COLLAT_ARM_WAC_3    COLLAT_ARM_WAC_ALL    COLLAT_ARM_WA_FLOOR_ALL    COLLAT_ARM_WA_NET_MARGIN_1    COLLAT_ARM_WA_NET_MARGIN_3    DAYS_TO_MTY_TDY    DUR_ADJ_MID    DUR_MID    INT_ACC    MOST_RECENT_REPORTED_FACTOR    MTG_ACC_RT    MTG_ACC_RT_START_DT    MTG_AMORT_WAM    MTG_AMT_OUT_FACE    MTG_BALLOON_WAM    MTG_CARD_MPR    MTG_CREDIT_SCORE_WAVG    MTG_EFF_CNVX_MID    MTG_EFF_DUR_MID    MTG_EXS_SPREAD    MTG_FACTOR    MTG_FACT_SET_DT_STRT_NEXT_ACC_DT    MTG_FACTOR_INT_PAY    MTG_FACTOR_PAY_DT    MTG_GEN_CPR_12M    MTG_GEN_CPR_1M    MTG_GEN_CPR_3M    MTG_GEN_CPR_6M    MTG_INT_DEFERRED    MTG_INT_DIST    MTG_INT_SHORTFALL    MTG_LOAN_AGE    MTG_LOAN_MRGN    MTG_LOAN_SIZE_WAVG    MTG_LOCK_WAM    MTG_ORIG_LFLOOR_AVG    MTG_PL_CPR_12M    MTG_PL_CPR_1M    MTG_PL_CPR_3M    MTG_PL_CPR_6M    MTG_PORT_YLD    MTG_PREPAY_SPEED    MTG_PX_SPD    MTG_QRT_AOLS_MAX    MTG_QRT_ASOF_DT    MTG_QRT_AOLS_MED    MTG_QRT_LTV_MED    MTG_QRT_SCORE_MAX    MTG_QRT_SCORE_MED    MTG_STATED_NUM_DT    MTG_STATED_WALA    MTG_STATED_WARM    MTG_WAC_CALC    MTG_WAC_WAVG    MTG_WACPN    MTG_WAL    MTG_WALA_CALC    MTG_WAM    MTG_WAM_WAVG    MTG_WAOCS    MTG_WHLN_LTV    MTG_WHLN_NUMBER_LOAN    MTG_WHLN_WALA    MTY_YEARS    OAS_SPREAD_ASK    OAS_SPREAD_BID    OAS_SPREAD_MID    YLD_CUR_ASK    YLD_CUR_BID    YLD_CUR_MID    YLD_VAL_32ND_MID    YLD_YTC_MID    YLD_YTM_MID    YLD_YTP_MID    FLT_SPREAD    MTG_LIFE_CAP    MTG_LIFE_FLOOR    REFIX_FREQ    YLD_CNV_BID    YLD_CNV_ASK    YLD_CNV_MID    CUM_LOSS_PCT    CURR_CREDIT_SUPPORT    CURR_CUM_LOSS_AMT    MTG_2_4_FAMILY_CURR    MTG_AMORT_TYPE_LEVEL_FRM_CURR    MTG_BAL    MTG_CONDOMINIUM_CURR    MTG_CUR_PRINC_PAY    MTG_CUR_PAY_DT    MTG_DELQ_90PLUS_CUR    MTG_FACTOR_PRINC_PAY    MTG_NORTHERN_CA_CURR    MTG_PREV_BAL    MTG_PRINC_LOSSES    MTG_PUD_CURR    MTG_QRT_AGE_25    MTG_QRT_AGE_75    MTG_QRT_AGE_MAX    MTG_QRT_AGE_MED    MTG_QRT_AGE_MIN    MTG_QRT_AOLS_25    MTG_QRT_AOLS_75    MTG_QRT_AOLS_MIN    MTG_QRT_CPN_25    MTG_QRT_CPN_75    MTG_QRT_CPN_MAX    MTG_QRT_CPN_MED    MTG_QRT_CPN_MIN    MTG_QRT_LTV_25    MTG_QRT_LTV_75    MTG_QRT_LTV_MAX    MTG_QRT_LTV_MIN    MTG_QRT_MTY_25    MTG_QRT_MTY_75    MTG_QRT_MTY_MAX    MTG_QRT_MTY_MED    MTG_QRT_MTY_MIN    MTG_QRT_SCORE_25    MTG_QRT_SCORE_75    MTG_QRT_SCORE_MIN    MTG_QRT_TERM_25    MTG_QRT_TERM_75    MTG_QRT_TERM_MAX    MTG_QRT_TERM_MED    MTG_QRT_TERM_MIN    MTG_SINGLE_FAMILY_CURR    MTG_SOUTHERN_CA_CURR    MTG_WHLN_WALTV    ORIG_CREDIT_SUPPORT    MTG_WHLN_GEO1    MTG_WHLN_GEO2    MTG_WHLN_GEO3    MTG_WHLN_GEO4    MTG_PRINC_DIST    MTG_CURR_LOAN_SIZE_WAVG    MTG_DEAL_CUR_COLLAT_AMT    RTG_FITCH_WATCH    RTG_FITCH_WATCH_DT    RTG_SP_WATCH    RTG_SP_WATCH_DT    MTG_FIRST_RESET_CAP_UP    MTG_WA_ORIG_LOAN_SIZE    ARM_WA_MONTHS_TO_INIT_RST    COLLAT_ARM_LOAN_TYP_1    MTG_AMORT_TYPE_ARM_CURR
h:/talend/BB_MBS__Reformat.txt|08-27-2008|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
h:/talend/BB_MBS__Reformat.txt|08-27-2008|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
h:/talend/BB_MBS__Reformat.txt|08-27-2008|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
h:/talend/BB_MBS__Reformat.txt|08-27-2008|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
h:/talend/BB_MBS__Reformat.txt|08-27-2008|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
h:/talend/BB_MBS__Reformat.txt|08-27-2008|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
h:/talend/BB_MBS__Reformat.txt|08-27-2008|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
h:/talend/BB_MBS__Reformat.txt|08-27-2008|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||

***tJava_3***

2008-08-27 14:49:15|BiThmL|BiThmL|BiThmL|3036|BBFILETRANSFORM_TEST|Copy_of_MBS|_wJIOQHOdEd20SMTXuGEkfQ|0.9|HardcodedValues||end|success|1390
Job Copy_of_MBS ended at 14:49 27/08/2008. [exit code=0]

strpdsnk
2008-08-27 20:38:34

When I try to use tReplace for a Date column (pic 1), I get this output:

Starting job Copy_of_MBS at 14:26 27/08/2008.
2008-08-27 14:26:03|FMeo08|FMeo08|FMeo08|2704|BBFILETRANSFORM_TEST|Copy_of_MBS|_wJIOQHOdEd20SMTXuGEkfQ|0.9|HardcodedValues||begin||

***tJava_1 - START***

Exception in thread "main" java.lang.Error: Unresolved compilation problem:
    The method replaceAll(String, Date) is undefined for the type Date

    at bbfiletransform_test.copy_of_mbs_0_9.Copy_of_MBS.tFileInputDelimited_1Process(Copy_of_MBS.java:36470)
    at bbfiletransform_test.copy_of_mbs_0_9.Copy_of_MBS.tJava_1Process(Copy_of_MBS.java:40321)
    at bbfiletransform_test.copy_of_mbs_0_9.Copy_of_MBS.runJobInTOS(Copy_of_MBS.java:42884)
    at bbfiletransform_test.copy_of_mbs_0_9.Copy_of_MBS.main(Copy_of_MBS.java:42652)
Wed Aug 27 14:26:03 EDT 2008
h:/talend/BB_MBS__Reformat.txt

***tJava_1 - END***

Job Copy_of_MBS ended at 14:26 27/08/2008. [exit code=0]

strpdsnk
2008-08-27 20:32:46

Do I need to change the default value in the schema (specifically the one used in tFilterColumns) to anything in particular?
Should I use the simple or advanced mode in tReplace - if the values I want to replace with are context variables?

I want to replace null values in String and Date type fields.


When I try to use tReplace for a String column, this is the error I get in the output (pic 6):

Exception in component tReplace_1
java.lang.NullPointerException
    at bbfiletransform_test.copy_of_mbs_0_9.Copy_of_MBS.tFileInputDelimited_1Process(Copy_of_MBS.java:36450)
    at bbfiletransform_test.copy_of_mbs_0_9.Copy_of_MBS.tJava_1Process(Copy_of_MBS.java:40244)
    at bbfiletransform_test.copy_of_mbs_0_9.Copy_of_MBS.runJobInTOS(Copy_of_MBS.java:42807)
    at bbfiletransform_test.copy_of_mbs_0_9.Copy_of_MBS.main(Copy_of_MBS.java:42575)

and this is the entire output: (tLogRow_2 does print out the first row of information from tFileInputDelimited, the header

Starting job Copy_of_MBS at 14:01 27/08/2008.
2008-08-27 14:01:25|PEsMLM|PEsMLM|PEsMLM|3636|BBFILETRANSFORM_TEST|Copy_of_MBS|_wJIOQHOdEd20SMTXuGEkfQ|0.9|HardcodedValues||begin||

***tJava_1 - START***

Wed Aug 27 14:01:26 EDT 2008
h:/talend/BB_MBS__Reformat.txt

***tJava_1 - END***

SourceFile    CurrentDateTime    SECURITIES    ERROR_CODE    NUM_FLDS    ID_BB_COMPANY    LONG_COMP_NAME    COUNTRY_ISO    SHORT_NAME    SECURITY_TYP    MARKET_SECTOR_DES    QUOTE_TYP    DAY_CNT    PAR_AMT    MTG_FIRST_PAY_DT    CPN    MTG_ORIG_AMT    ISSUE_DT    ISSUE_PX    MATURITY    CRNCY    EXCH_CODE    CPN_FREQ    MTG_COLLAT_TYP    CPN_TYP    MTG_FACTOR_DT    DAYS_ACC    DELIVERY_TYP    FIRST_SETTLE_DT    _144A_FLAG    IS_ACCRED_INV    CALLABLE    CONVERTIBLE    FLOATER    MTG_IS_PAID_OFF    OID_BOND    PRVT_PLACE    IS_REG_S    LEAD_MGR    MARKET_SECTOR    MTG_AMORT_TYP    MTG_ARM_SUBTYP    MTG_CMO_CLASS    MTG_CMO_GROUP    MTG_CMO_SERIES    MTG_COLLAT_DT    MTG_COLLAT_SEASONING    MTG_COMPLIANCE_CODE    MTG_CUR_PAY_RT    MTG_DEAL_TYP    MTG_EST_ACC_RT    MTG_FACTOR_NUM_DT    MTG_FACTOR_SET_DT    MTG_FFIEC_TEST    MTG_GEN_TICKER    MTG_GEO    MTG_IS_MEGA    MTG_LOOKBACK    MTG_NOTL_PRINC_FLAG    MTG_ORIG_SERV_LINE1    MTG_ORIG_WAC    MTG_ORIG_WAL    MTG_ORIG_WAM    MTG_PAY_CAP    MTG_PAY_DELAY    MTG_PER_RT_CAP    MTG_POOL_FACTOR    MTG_POOL_NUMBER    MTG_POOL_TYP    MTG_PREPAY_TYP    MTG_RT_CHG_FREQ    MTG_SERV    MTG_SMMEA_STAT    MTG_STATED_DT    MTG_TRANCHE_TYP    MTG_TYP    MTG_WAM_NXT_RST    NXT_CALL_DT    NXT_CALL_PX    NXT_CPN_DT    NXT_PUT_DT    NXT_PUT_PX    MTG_FLT_NXT_RST    NXT_SINK_AMT    PREV_CPN_DT    ID_BB_UNIQUE    SEC_DATE_2A_7    SECURITY_DES    SECURITY_TYP2    SETTLE_DT    STATE_CODE    TICKER    RESET_IDX    TRADE_STATUS    MTG_CALL_PCT    MTG_CRED_PROV    MTG_PREV_CPN    CUR_CPN    MIN_PIECE    ISSUER    NAME    ISSUER_BULK    CNTRY_OF_DOMICILE    CNTRY_OF_INCORPORATION    ID_BB_PARENT_CO    REDEMP_CRNCY    COLLAT_ARM_INDEX_1    COLLAT_ARM_INDEX_2    COLLAT_ARM_INDEX_3    COLLAT_ARM_INDEX_ALL    ID_CUSIP    ID_CUSIP_8_CHR    ID_ISIN    ID_CUSIP_REAL    ID_SEDOL1    ID_VALOREN    RTG_FITCH    FITCH_EFF_DT    RTG_FITCH_LONG    RTG_FITCH_LONG_RATING_DT    RTG_FITCH_NO_WATCH    RTG_FITCH_OUTLOOK    RTG_FITCH_OUTLOOK_DT    RTG_FITCH_SHRT    RTG_FITCH_SHRT_RATING_DT    RTG_MOODY    MOODY_EFF_DT    RTG_MOODY_LONG    RTG_MDY_LONG_RATING_DT    RTG_MOODY_NO_WATCH    RTG_MOODY_SHRT    RTG_MDY_SHRT_RATING_DT    RTG_MOODY_WATCH    RTG_MOODY_WATCH_DT    RTG_SP    SP_EFF_DT    RTG_SP_LONG    RTG_SP_LONG_RATING_DT    RTG_SP_NO_WATCH    RTG_SP_SHRT    RTG_SP_SHRT_RATING_DT    INDUSTRY_GROUP    INDUSTRY_SECTOR    INDUSTRY_SUBGROUP_NUM    MTG_SPREAD_TO_TSY_MID    LAST_UPDATE_DT    PX_ASK    PX_BID    PX_LAST    PX_MID    QUOTE_ASK    QUOTE_BID    QUOTE_MID    AMT_OUTSTANDING    CNVX_MID    COLLAT_ARM_PERCENT_ALL    COLLAT_ARM_PERIODIC_CAP_1    COLLAT_ARM_PERIODIC_CAP_2    COLLAT_ARM_PERIODIC_CAP_3    COLLAT_ARM_PERIODIC_CAP_ALL    COLLAT_ARM_PERCENT_1    COLLAT_ARM_PERCENT_2    COLLAT_ARM_PERCENT_3    COLLAT_ARM_WA_CAP_1    COLLAT_ARM_WA_CAP_2    COLLAT_ARM_WA_CAP_3    COLLAT_ARM_WA_CAP_ALL    COLLAT_ARM_WA_FLOOR_1    COLLAT_ARM_WA_FLOOR_2    COLLAT_ARM_WA_FLOOR_3    COLLAT_ARM_WA_FREQ_1    COLLAT_ARM_WA_FREQ_2    COLLAT_ARM_WA_FREQ_3    COLLAT_ARM_WA_FREQ_ALL    COLLAT_ARM_WA_GROSS_MARGIN_1    COLLAT_ARM_WA_GROSS_MARGIN_2    COLLAT_ARM_WA_GROSS_MARGIN_3    COLLAT_ARM_WA_GROSS_MARGIN_ALL    COLLAT_ARM_WA_NET_MARGIN_ALL    COLLAT_ARM_WA_RESET_DATE_1    COLLAT_ARM_WA_RESET_DATE_2    COLLAT_ARM_WA_RESET_DATE_3    COLLAT_ARM_WA_RESET_DATE_ALL    COLLAT_ARM_WAC_1    COLLAT_ARM_WAC_2    COLLAT_ARM_WAC_3    COLLAT_ARM_WAC_ALL    COLLAT_ARM_WA_FLOOR_ALL    COLLAT_ARM_WA_NET_MARGIN_1    COLLAT_ARM_WA_NET_MARGIN_3    DAYS_TO_MTY_TDY    DUR_ADJ_MID    DUR_MID    INT_ACC    MOST_RECENT_REPORTED_FACTOR    MTG_ACC_RT    MTG_ACC_RT_START_DT    MTG_AMORT_WAM    MTG_AMT_OUT_FACE    MTG_BALLOON_WAM    MTG_CARD_MPR    MTG_CREDIT_SCORE_WAVG    MTG_EFF_CNVX_MID    MTG_EFF_DUR_MID    MTG_EXS_SPREAD    MTG_FACTOR    MTG_FACT_SET_DT_STRT_NEXT_ACC_DT    MTG_FACTOR_INT_PAY    MTG_FACTOR_PAY_DT    MTG_GEN_CPR_12M    MTG_GEN_CPR_1M    MTG_GEN_CPR_3M    MTG_GEN_CPR_6M    MTG_INT_DEFERRED    MTG_INT_DIST    MTG_INT_SHORTFALL    MTG_LOAN_AGE    MTG_LOAN_MRGN    MTG_LOAN_SIZE_WAVG    MTG_LOCK_WAM    MTG_ORIG_LFLOOR_AVG    MTG_PL_CPR_12M    MTG_PL_CPR_1M    MTG_PL_CPR_3M    MTG_PL_CPR_6M    MTG_PORT_YLD    MTG_PREPAY_SPEED    MTG_PX_SPD    MTG_QRT_AOLS_MAX    MTG_QRT_ASOF_DT    MTG_QRT_AOLS_MED    MTG_QRT_LTV_MED    MTG_QRT_SCORE_MAX    MTG_QRT_SCORE_MED    MTG_STATED_NUM_DT    MTG_STATED_WALA    MTG_STATED_WARM    MTG_WAC_CALC    MTG_WAC_WAVG    MTG_WACPN    MTG_WAL    MTG_WALA_CALC    MTG_WAM    MTG_WAM_WAVG    MTG_WAOCS    MTG_WHLN_LTV    MTG_WHLN_NUMBER_LOAN    MTG_WHLN_WALA    MTY_YEARS    OAS_SPREAD_ASK    OAS_SPREAD_BID    OAS_SPREAD_MID    YLD_CUR_ASK    YLD_CUR_BID    YLD_CUR_MID    YLD_VAL_32ND_MID    YLD_YTC_MID    YLD_YTM_MID    YLD_YTP_MID    FLT_SPREAD    MTG_LIFE_CAP    MTG_LIFE_FLOOR    REFIX_FREQ    YLD_CNV_BID    YLD_CNV_ASK    YLD_CNV_MID    CUM_LOSS_PCT    CURR_CREDIT_SUPPORT    CURR_CUM_LOSS_AMT    MTG_2_4_FAMILY_CURR    MTG_AMORT_TYPE_LEVEL_FRM_CURR    MTG_BAL    MTG_CONDOMINIUM_CURR    MTG_CUR_PRINC_PAY    MTG_CUR_PAY_DT    MTG_DELQ_90PLUS_CUR    MTG_FACTOR_PRINC_PAY    MTG_NORTHERN_CA_CURR    MTG_PREV_BAL    MTG_PRINC_LOSSES    MTG_PUD_CURR    MTG_QRT_AGE_25    MTG_QRT_AGE_75    MTG_QRT_AGE_MAX    MTG_QRT_AGE_MED    MTG_QRT_AGE_MIN    MTG_QRT_AOLS_25    MTG_QRT_AOLS_75    MTG_QRT_AOLS_MIN    MTG_QRT_CPN_25    MTG_QRT_CPN_75    MTG_QRT_CPN_MAX    MTG_QRT_CPN_MED    MTG_QRT_CPN_MIN    MTG_QRT_LTV_25    MTG_QRT_LTV_75    MTG_QRT_LTV_MAX    MTG_QRT_LTV_MIN    MTG_QRT_MTY_25    MTG_QRT_MTY_75    MTG_QRT_MTY_MAX    MTG_QRT_MTY_MED    MTG_QRT_MTY_MIN    MTG_QRT_SCORE_25    MTG_QRT_SCORE_75    MTG_QRT_SCORE_MIN    MTG_QRT_TERM_25    MTG_QRT_TERM_75    MTG_QRT_TERM_MAX    MTG_QRT_TERM_MED    MTG_QRT_TERM_MIN    MTG_SINGLE_FAMILY_CURR    MTG_SOUTHERN_CA_CURR    MTG_WHLN_WALTV    ORIG_CREDIT_SUPPORT    MTG_WHLN_GEO1    MTG_WHLN_GEO2    MTG_WHLN_GEO3    MTG_WHLN_GEO4    MTG_PRINC_DIST    MTG_CURR_LOAN_SIZE_WAVG    MTG_DEAL_CUR_COLLAT_AMT    RTG_FITCH_WATCH    RTG_FITCH_WATCH_DT    RTG_SP_WATCH    RTG_SP_WATCH_DT    MTG_FIRST_RESET_CAP_UP    MTG_WA_ORIG_LOAN_SIZE    ARM_WA_MONTHS_TO_INIT_RST    COLLAT_ARM_LOAN_TYP_1    MTG_AMORT_TYPE_ARM_CURR
Exception in component tReplace_1
java.lang.NullPointerException
    at bbfiletransform_test.copy_of_mbs_0_9.Copy_of_MBS.tFileInputDelimited_1Process(Copy_of_MBS.java:36469)
    at bbfiletransform_test.copy_of_mbs_0_9.Copy_of_MBS.tJava_1Process(Copy_of_MBS.java:40318)
    at bbfiletransform_test.copy_of_mbs_0_9.Copy_of_MBS.runJobInTOS(Copy_of_MBS.java:42881)
    at bbfiletransform_test.copy_of_mbs_0_9.Copy_of_MBS.main(Copy_of_MBS.java:42649)

***tJava_2***

2008-08-27 14:01:26|PEsMLM|PEsMLM|PEsMLM|BBFILETRANSFORM_TEST|Copy_of_MBS|HardcodedValues|6|Java Exception|tJava_2||1
2008-08-27 14:01:26|PEsMLM|PEsMLM|PEsMLM|3636|BBFILETRANSFORM_TEST|Copy_of_MBS|_wJIOQHOdEd20SMTXuGEkfQ|0.9|HardcodedValues||end|success|1047
Job Copy_of_MBS ended at 14:01 27/08/2008. [exit code=0]

Board footer

Powered by FluxBB