You are not logged in.

Unanswered posts



Important! This site has been replaced. All content here is read-only. Please visit our brand-new community at https://community.talend.com/. We look forward to hearing from you there!



#1 2016-10-04 01:02:09

vapukov
Member
470 posts

vapukov said:

Talend ESB 6.2.1 - kafka cMessageEndpoint errors

Hello,
I have a few Jobs in Talent Open Studio for BigData connecting with kafka - everything fine and stable
as well - few routes with ActiveMQ and RabbitMQ in Talent ESB

But when I try to create new route for use same principles (and same connection details) with kafka - I have error:
"Exception in thread "main" java.lang.NoClassDefFoundError: scala/Product
at java.lang.ClassLoader.defineClass1(Native Method) ... "


URI - "kafka:192.168.20.107:9092?topic=t1&zookeeperHost=192.168.20.107&zookeeperPort=2181&groupId=uwr1"

component cKafka work, but unstable - can read portions of messages, than freeze (may be it settings problem, now I looking for other error)

Would be thankful for any ideas for check

Best regards, Vladmini_Screen_Shot_2016-10-04_at_1.04.07_PM.png.png

Last edited by vapukov (2016-10-04 01:03:34)

Offline

#2 2016-10-11 09:40:56

xdshi
Talend Team


xdshi said:

Re: Talend ESB 6.2.1 - kafka cMessageEndpoint errors

Hi,
What does your new route look like? Could you please show us your component setting screenshot which will be helpful for us to address your issue?
Best regards
Sabrina


What we can do is to make sure that Talend will be your best choice!

Offline

#3 2016-10-13 13:08:52

vapukov
Member
470 posts

vapukov said:

Re: Talend ESB 6.2.1 - kafka cMessageEndpoint errors

xdshi wrote:

Hi,
What does your new route look like? Could you please show us your component setting screenshot which will be helpful for us to address your issue?
Best regards
Sabrina

Hi Sabrina,
All in original message, but screenshots attached
and consumer and producer work fine with Kafka from Open Studio Big Data, but not from ESB

mini_Screen_Shot_2016-10-14_at_1.05.45_AM.png.png mini_Screen_Shot_2016-10-14_at_1.06.06_AM.png.png
mini_Screen_Shot_2016-10-14_at_1.06.17_AM.png.png  mini_Screen_Shot_2016-10-14_at_1.05.58_AM.png.png

Offline

#4 2016-10-13 13:12:24

vapukov
Member
470 posts

vapukov said:

Re: Talend ESB 6.2.1 - kafka cMessageEndpoint errors

if use dedicated Kafka component in ESB - it work, but:
1) only once - if route started after producer
2) not always receive all messages
3) no visible errors, but job or work or not, and never not work for new messages coming after start

mini_Screen_Shot_2016-10-14_at_1.08.44_AM.png.png

Offline

#5 2017-03-04 19:53:35

palas
Member
2 posts

palas said:

Re: Talend ESB 6.2.1 - kafka cMessageEndpoint errors

Hi I can's see cMessageEndpoint in ESP Open Studio, neither in Data Integrator. 
Appreciate if you guide me on how to get these additional components.


-Regards

Offline

#6 2017-03-05 08:51:19

vapukov
Member
470 posts

vapukov said:

Re: Talend ESB 6.2.1 - kafka cMessageEndpoint errors

palas wrote:

Hi I can's see cMessageEndpoint in ESP Open Studio, neither in Data Integrator. 
Appreciate if you guide me on how to get these additional components.


-Regards

it's name - cMessagingEndpoint and it part of Talend Open Studio for ESB when You create new route

Offline

#7 2017-03-05 08:55:41

vapukov
Member
470 posts

vapukov said:

Re: Talend ESB 6.2.1 - kafka cMessageEndpoint errors

by the way - I not resolve this problem, and as solution was chosen ActiveMQ as much stable 
difference in performance on our tasks not so critical

will have plan re-test it in feature, with 1.0. 

Offline

#8 2017-03-05 19:40:58

archenroot
Member
237 posts

archenroot said:

Re: Talend ESB 6.2.1 - kafka cMessageEndpoint errors

@palas - you need to switch to Mediation view in Talend Studio
@vapukov - It would be really helpful if you raise a bug about this and attach complete testing project as well.

On the other hand, from the message you have it looks quite clear that you are missing scala lib in your path. So either you didn't downloaded all dependencies for the component, or you have some buggy studio version (you can recompile from source yourself).

It is something related to:

 <dependency>
        <groupId>org.scala-lang</groupId>
        <artifactId>scala-library</artifactId>
        <version>xxx</version>
    </dependency>
    <dependency>
        <groupId>org.scala-lang</groupId>
        <artifactId>scala-xml</artifactId>
        <version>xxx</version>
    </dependency>

Could be caused by version bump as well.


Emperor wants to control outer space Yoda wants to explore inner space that's the fundamental difference between good and bad sides of the Force

Offline

#9 2017-03-06 19:14:43

palas
Member
2 posts

palas said:

Re: Talend ESB 6.2.1 - kafka cMessageEndpoint errors

Thanks @vapukov
I found it in Routes .

Now I am facing some issue:
My connection string is
"rabbitmq://'104.199.xxx.xxx:5672/amq.fanout?username=user&password=password&vhost=/&queue=test_queue&connectionTimeout=300"

I tied variation without vhost and connectionTimeout.
But, always same error:

Starting job RabbitMQ_Consumer1 at 23:42 06/03/2017.

[statistics] connecting to socket on port 3649

[statistics] connected
Failed to create route RabbitMQ_Consumer1_cMessagingEndpoint_1: Route(RabbitMQ_Consumer1_cMessagingEndpoint_1)[[From[rabbitm... because of Failed to resolve endpoint: rabbitmq://'104.199.xxx.xxx:5672/amq.fanout?password=password&queue=test_queue&username=user due to: No component found with scheme: rabbitmq
org.apache.camel.FailedToCreateRouteException: Failed to create route RabbitMQ_Consumer1_cMessagingEndpoint_1: Route(RabbitMQ_Consumer1_cMessagingEndpoint_1)[[From[rabbitm... because of Failed to resolve endpoint: rabbitmq://'104.199.xxx.xxx:5672/amq.fanout?password=password&queue=test_queue&username=user due to: No component found with scheme: rabbitmq
         at org.apache.camel.model.RouteDefinition.addRoutes(RouteDefinition.java:201)
         at org.apache.camel.impl.DefaultCamelContext.startRoute(DefaultCamelContext.java:974)
         at org.apache.camel.impl.DefaultCamelContext.startRouteDefinitions(DefaultCamelContext.java:3301)
         at org.apache.camel.impl.DefaultCamelContext.doStartCamel(DefaultCamelContext.java:3024)
         at org.apache.camel.impl.DefaultCamelContext.access$000(DefaultCamelContext.java:175)
         at org.apache.camel.impl.DefaultCamelContext$2.call(DefaultCamelContext.java:2854)
         at org.apache.camel.impl.DefaultCamelContext$2.call(DefaultCamelContext.java:2850)
         at org.apache.camel.impl.DefaultCamelContext.doWithDefinedClassLoader(DefaultCamelContext.java:2873)
         at org.apache.camel.impl.DefaultCamelContext.doStart(DefaultCamelContext.java:2850)
         at org.apache.camel.support.ServiceSupport.start(ServiceSupport.java:61)
         at org.apache.camel.impl.DefaultCamelContext.start(DefaultCamelContext.java:2819)
         at org.apache.camel.main.Main.doStart(Main.java:127)
         at org.apache.camel.support.ServiceSupport.start(ServiceSupport.java:61)
         at org.apache.camel.main.MainSupport.run(MainSupport.java:138)
         at rabbitmq.rabbitmq_consumer1_0_1.RabbitMQ_Consumer1.run(RabbitMQ_Consumer1.java:153)
         at rabbitmq.rabbitmq_consumer1_0_1.RabbitMQ_Consumer1.runJobInTOS(RabbitMQ_Consumer1.java:215)
         at rabbitmq.rabbitmq_consumer1_0_1.RabbitMQ_Consumer1.main(RabbitMQ_Consumer1.java:185)
Caused by: org.apache.camel.ResolveEndpointFailedException: Failed to resolve endpoint: rabbitmq://'104.199.xxx.xxx:5672/amq.fanout?password=password&queue=test_queue&username=user due to: No component found with scheme: rabbitmq
         at org.apache.camel.impl.DefaultCamelContext.getEndpoint(DefaultCamelContext.java:594)
         at org.apache.camel.util.CamelContextHelper.getMandatoryEndpoint(CamelContextHelper.java:79)
         at org.apache.camel.model.RouteDefinition.resolveEndpoint(RouteDefinition.java:211)
         at org.apache.camel.impl.DefaultRouteContext.resolveEndpoint(DefaultRouteContext.java:107)
         at org.apache.camel.impl.DefaultRouteContext.resolveEndpoint(DefaultRouteContext.java:113)
         at org.apache.camel.model.FromDefinition.resolveEndpoint(FromDefinition.java:69)
         at org.apache.camel.impl.DefaultRouteContext.getEndpoint(DefaultRouteContext.java:89)
         at org.apache.camel.model.RouteDefinition.addRoutes(RouteDefinition.java:1052)
         at org.apache.camel.model.RouteDefinition.addRoutes(RouteDefinition.java:196)
         ... 16 more
Job RabbitMQ_Consumer1 ended at 23:42 06/03/2017. [exit code=1]
 
mini_Screen_Shot_2017-03-06_at_23.44.58.png_20170306-1017.png

Last edited by palas (2017-03-06 19:17:52)

Offline

#10 2017-03-06 22:05:39

vapukov
Member
470 posts

vapukov said:

Re: Talend ESB 6.2.1 - kafka cMessageEndpoint errors

generally - this topic about Kafka :-) and anybody will try to open is Kafka related
if You have problem with RabbitMQ - open (or add to old) related to RabbitMQ

by the way in Your case - all in error text:

"rabbitmq://'104.199.xxx.xxx:5672/amq.fanout?username=user&password=password&vhost=/&queue=test_queue&connectionTimeout=300"

 Failed to resolve endpoint: rabbitmq://'104
You have wrong character in address - '

Last edited by vapukov (2017-03-06 22:06:00)

Offline

Board footer

Talend Contributor Agreement - Talend Website Privacy Policy