I need a job deployed in TACs of dev, UAT, prod, that basically connects to respective Hadoop clusters and does a tHDFSList on “/” (root directory).
The component settings of the tHDFSList component need to be externalized to context variables;So, that we can provide appropriate parameters for dev/UAT/Prod environments using context files.
This Job will be deployed and set to execute for every 30 mins and on-fail(exceptions)…should trigger email to the respective teams.
Could you please take a look at this document about:TalendHelpCenter:Centralizing+HDFS+metadata to see if it is what you are looking for?
If you need to use an environmental context to define the parameters of this connection, click the "Export as context" button to open the corresponding wizard.
What we can do is to make sure that Talend will be your best choice!