You are not logged in.

Unanswered posts



Important! This site has been replaced. All content here is read-only. Please visit our brand-new community at https://community.talend.com/. We look forward to hearing from you there!



#1 2017-04-03 01:34:03

th_talend
Member
19 posts

th_talend said:

[resolved] List all the directory for a given HDFS path

Hi,
I need your help!!!.
I want to list all the directory/folder for the given HDFS path. So I used the following job


mini_blob.png

Afte I run the job I got only below log. 

[statistics] connecting to socket on port 4067
[statistics] connected
[WARN ]: org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
[statistics] disconnected
Job Read_HDFS_file ended at 20:25 02/04/2017. [exit code=0]


I expected the list of folder in the tlogrow output, but got nothing. please see the above log. Please let me know If I miss something here..

Last edited by th_talend (2017-04-03 01:35:46)

Offline

#2 2017-04-03 04:04:17

chillies57
Member
5 posts

chillies57 said:

Re: [resolved] List all the directory for a given HDFS path

Can you post tHDFSList properties ?

Offline

#3 2017-04-03 04:38:17

th_talend
Member
19 posts

th_talend said:

Re: [resolved] List all the directory for a given HDFS path

chillies57 wrote:

Can you post tHDFSList properties ?

Here is the tHDFSList screen shot.. 
Under "data/stage/retail" path, I have folders (example datafolder1, datafolder2..etc). I want to print these folder names only in tlogrow. To understand it better, I have simplified the requirement.  

mini_blob_20170402-2037.png

FYI, I tried to list the names from unix box using similar approach and it worked well.

Last edited by th_talend (2017-04-03 04:44:38)

Offline

#4 2017-04-03 22:23:21

th_talend
Member
19 posts

th_talend said:

Re: [resolved] List all the directory for a given HDFS path

Hi, 
I resolved it myself. I removed "*.*" from filemask and then it worked well. 

mini_blob_20170403-1423.png

Offline

Board footer

Talend Contributor Agreement - Talend Website Privacy Policy