• Index
  •  » Talend Open Studio for Data Integration » Usage, Operation
  •  » mysql and SSH port tunneling forwarding

#1 2008-03-09 22:51:10

shaferj
Member
Company: Levolor
Registered: 2008-03-09
Posts: 21

mysql and SSH port tunneling forwarding

Tags: [mysql, perl, ssh]

Hello, I have been evaluating talend as means to perform various ETL tasks and have been very impressed with the capabilities of the tool.  One common need that I have will be accessing remote MySQL Databases via port forwarding / tunneling.

Does anyone have recommendations / experience on the best way to setup this capability within talend?

Regards,
- John

Offline

#2 2008-03-09 23:00:55

plegall
Member
Registered: 2006-09-19
Posts: 1586
Website

Re: mysql and SSH port tunneling forwarding

I have a permanent SSH tunnel which maps local port 12345 to remote port 3306:

Code:

$ ssh -L12345:localhost:3306 remote_user@remote_host

In TOS, in a Perl project, I set the remote host to '127.0.0.1' (and not localhost, it doesn't work) and port to 12345. I do it everyday and it works fine.

Offline

#3 2008-03-09 23:16:59

shaferj
Member
Company: Levolor
Registered: 2008-03-09
Posts: 21

Re: mysql and SSH port tunneling forwarding

Thank you very much for the reply. 

I have been experimenting with a permanent ssh tunnel, however the issue that I have seem to run into is connection reliability.  This is mostly due to corporate access policies that are outside of my control.  Because of this our connection tends to get severed periodically throughout the day. 

I am trying to come up with a way that I could open and close the tunnel when making requests to the database giving me the ability to trap and restart jobs as connectivity issues arise.  A way to have a dependency on a tunnel initiated from within Talend would be the ideal, but I'll take any suggestions.

Thanks again.

- John

Offline

#4 2008-03-10 00:29:20

plegall
Member
Registered: 2006-09-19
Posts: 1586
Website

Re: mysql and SSH port tunneling forwarding

Can you confirm you're working on an Unix? so that I can investigate the right way.

Offline

#5 2008-03-10 00:45:29

shaferj
Member
Company: Levolor
Registered: 2008-03-09
Posts: 21

Re: mysql and SSH port tunneling forwarding

Currently I am working on Windows, but only for the purpose of experimentation. I am very satisfied with the Talend Open Studio and its capabilities and will be moving to a Linux Box for complete testing and deployment within a week or so.  Linux will be the platform the of choice that this application will be running on.

I really appreciate your taking the time to investigate this.

- John

Offline

#6 2010-04-06 11:38:48

akempkens
Member
Company: Think Network GmbH, Munich
Registered: 2010-03-26
Posts: 16
Website

Re: mysql and SSH port tunneling forwarding

Hi,

Do you see a possibility to establish such a tunnel on the fly, e.g. using the Talend ssh component?

Alex


Transparent solutions based on Open Source Technology
Supported by the knowledge of Think Network (http://www.thinknetwork.com)

Offline

#7 2011-08-19 22:18:40

donald scott
Guest

Re: mysql and SSH port tunneling forwarding

i am also trying to connect to a mysql server in an environment that uses ssh tunnels.  I have a putty terminal open, but i am also tunneling to the svn. seems like there is some confusion, and in the past they have just copied full copies of DB to their machines to get around the issue.  i would rather get this working correctly so that going forward development is more efficient. 

any suggestions would be very helpful.

  • Index
  •  » Talend Open Studio for Data Integration » Usage, Operation
  •  » mysql and SSH port tunneling forwarding

Board footer

Powered by FluxBB