Unanswered posts

#1 2007-10-01 17:20:20

nferay
Member
Company: Habitat 76 Rouen France
Registered: 2006-09-25
Posts: 62
Website

trssinput

Why we cannot use trssinput as tfilefetch in order to compute many rss url ?

http://www.talendforge.org/forum/viewto … 5474#p5474

Thanks in advance for your help

Offline

#2 2007-10-02 05:55:30

nrousseau
Talend team
Registered: 2006-09-19
Posts: 119
Website

Re: trssinput

The big difference is that the tRSSInput is an "input" component, so it can't accept the main links as it will create a new flow. (can only accept Iterate / ThenRun/ conditional links)
So you could do the same kind, but it will be a little more complicated...

I will try to check if we can allow the Iterate link at the output of the tJavaRow (or tPerlRow), but i think it's ok.

Difference will be:

dbInput ---row--->  tJavaRow ---Iterate---> tRSSInput ---row---> (...)


In the tJavaRow to store the data use:
    globalMap.put("current_url",input_row.url);

in the tRSSInput to read, use:
   (String)globalMap.get("current_url")


If you want to try, in TOS go to the folder :
plugins\org.talend.designer.components.localprovider_2.2.0.RC1_r5798\components (or equivalent for another version of course)

Then in the tJavaRow folder, edit the java xml, and instead of :
<CONNECTOR CTYPE="ITERATE" MAX_OUTPUT="0" MAX_INPUT="0"/>

set:
<CONNECTOR CTYPE="ITERATE" MAX_OUTPUT="1" MAX_INPUT="0"/>


Nicolas

Offline

#3 2007-10-02 09:23:57

nferay
Member
Company: Habitat 76 Rouen France
Registered: 2006-09-25
Posts: 62
Website

Re: trssinput

I tested your solution and i have this error

Starting job lireflux at 09:22 02/10/2007.
Exception in thread "main" java.lang.Error: Unresolved compilation problem:
    Duplicate local variable i

    at flux_rss.lireflux.lireflux.tFileInputExcel_1Process(lireflux.java:330)
    at flux_rss.lireflux.lireflux.tJava_1Process(lireflux.java:562)
    at flux_rss.lireflux.lireflux.runJob(lireflux.java:639)
    at flux_rss.lireflux.lireflux.main(lireflux.java:584)
Job lireflux ended at 09:22 02/10/2007. [exit code=1]

Offline

#4 2007-10-02 10:56:28

nrousseau
Talend team
Registered: 2006-09-19
Posts: 119
Website

Re: trssinput

Can you tell me which component you use ? Then we can resolve for the 2.2.

I guess it's something like:

tFileInputExcel---row--->  tJavaRow ---Iterate---> tRSSInput ---row---> ????


[edit] I've seen the problem finally. There is a problem in this case between the tFileInputExcel and tRSSInput (it works with other components).

Last edited by nrousseau (2007-10-02 11:17:11)

Offline

#5 2007-10-03 11:47:34

nferay
Member
Company: Habitat 76 Rouen France
Registered: 2006-09-25
Posts: 62
Website

Re: trssinput

I use

tFileInputExcel---row--->  tJavaRow ---Iterate---> tRSSInput ---row---> tFileOutputExcel

I use excel for a test, after we will use Oracle

Offline

#6 2007-10-03 17:42:05

nferay
Member
Company: Habitat 76 Rouen France
Registered: 2006-09-25
Posts: 62
Website

Re: trssinput

I made a test with oracle

toracleinput -main--> Tjavarow -Iterate--> rssinput -main--> toracleoutput

In the tJavaRow to store the data, i use:
    globalMap.put("current_url",input_row.url);

in the tRSSInput to read, i use:
   (String)globalMap.get("current_url")

I have this error

Starting job lireflux_oracle at 17:36 03/10/2007.
[statistics] connecting to socket on port 4173
[statistics] connected
Exception in component tRSSInput_1
[statistics] disconnected
java.net.MalformedURLException
    at java.net.URL.<init>(Unknown Source)
    at java.net.URL.<init>(Unknown Source)
    at java.net.URL.<init>(Unknown Source)
    at flux_rss.lireflux_oracle.lireflux_oracle.tOracleInput_1Process(lireflux_oracle.java:324)
    at flux_rss.lireflux_oracle.lireflux_oracle.tJava_1Process(lireflux_oracle.java:167)
    at flux_rss.lireflux_oracle.lireflux_oracle.runJob(lireflux_oracle.java:716)
    at flux_rss.lireflux_oracle.lireflux_oracle.main(lireflux_oracle.java:654)
Job lireflux_oracle ended at 17:36 03/10/2007. [exit code=1]

it seems that I have a problem with my URL, , however they are correct

Offline

#7 2007-10-05 11:22:52

nferay
Member
Company: Habitat 76 Rouen France
Registered: 2006-09-25
Posts: 62
Website

Re: trssinput

When i debug my job, i execute String rssurltRSSInput_1 = (String) globalMap.get("current_url"); before globalMap.put("current_url", row2.URLBLOG);

?? I don't understand

Offline

#8 2007-10-05 23:52:40

mhirt
Talend team
Registered: 2006-09-19
Posts: 1638

Re: trssinput

Here is the best way to develop this job.

Regards,


Uploaded Images

Offline

#9 2007-10-08 17:00:48

nferay
Member
Company: Habitat 76 Rouen France
Registered: 2006-09-25
Posts: 62
Website

Re: trssinput

There are problems with the new release 2.2. Simple job like

trssinput ---main---> tLogRow

don't work

Starting job unFLUX at 16:58 08/10/2007.
Exception in thread "main" java.lang.Error: Unresolved compilation problem:

    at testrss.unflux.unFLUX.main(unFLUX.java:337)
Job unFLUX ended at 16:58 08/10/2007. [exit code=1]

Offline

#10 2007-10-08 21:20:25

mhirt
Talend team
Registered: 2006-09-19
Posts: 1638

Re: trssinput

You're right there is a bug in tRSSnput in 2.2.0.

Can you crate a bug in our bugtracker ?

Thanks for our support,

Regards,

Offline

#11 2007-10-09 08:57:56

nferay
Member
Company: Habitat 76 Rouen France
Registered: 2006-09-25
Posts: 62
Website

Offline

#12 2007-10-19 18:50:49

nferay
Member
Company: Habitat 76 Rouen France
Registered: 2006-09-25
Posts: 62
Website

Re: trssinput

Hello
Can you tell me when the new version 2.2.1 released

I wait for my problem with RSS

thanks

Offline

#13 2007-10-22 03:56:40

shong
Talend team
Registered: 2007-08-29
Posts: 10305
Website

Re: trssinput

Hi nferay

the next version 2.2.1 will be available very soon...

Best regards

         shong


Email:shong@talend.com
Choose Talend, Enjoy Talend!
New & Event: Talend Help Center
Talend-->the leader of open source data management and application integration solutions!

Offline

Board footer

Powered by FluxBB