Talend community forum / Java Date Pattern Frequency shows no results for dd/MM/yyyy hh:mm aaa

alanc · 2011-10-11 06:04:00

Tags: [date frequency, datetime, delimited file, java, regex]

I am trying to profile a date a column in a delimited file, where the values are in the format 'dd/MM/yyyy hh:mm aaa'. In other words, datetimes like:

- 24/12/2010 10:28 AM
- 9/01/2011 10:28 PM

In the Column Analysis I have applied a datetime indicator with the Java regex '[1-3]{0,1}[\d]/[0-1][\d]/[\d]{4}\s[\d]{0,2}:[\d]{1,2}\s[AP]M'.

According to the Pattern Test View, this regex matches the format.

Yet when I execute the analysis, the Date Pattern Frequency Table shows nothing.

Can anyone suggest what is going wrong?

scorreia · 2011-10-11 14:29:57

Hi,

did you choose to execute the analysis with the "Java engine" (see at the bottom of the analysis settings page)?

alanc · 2011-10-12 00:40:09

The "Execution engine" field appeared to be disabled with Java selected by default (I presume because the data being profiled was in a delimited file and not a database)

alanc · 2011-10-12 04:12:57

Update:
In the preceding Column Analysis, my connection to the delimited file specified that my Date column was of the Date datatype (which was then classed as an "Interval" by the Column Analysis).

Manually changing the "Datamining Type" value to something else didn't seem to make a difference - I still got zero results in the Date Frequency Table.

However, by creating a new connection to my delimited file, in which my date column is specified as text rather than as a Date, I can get Talend Open Profiler to generate results for a Pattern Frequency Table (as opposed to a Date Frequency Table).

This might be useful, if you didn't already know that your datetime data followed a consistent format - although I'm still more interested in how to get a real Date or Year Frequency Analysis.

scorreia · 2011-10-12 11:27:51

Hi,

I did not realize that you were analyzing a file. Otherwise, I would not have asked my question. File profiling always uses the Java engine of course.

unfortunately, these date indicators don't work as expected on a file. I have reported an issue about it: http://jira.talendforge.org/browse/TDQ-3759

Announcement

Unanswered posts

#1 2011-10-11 06:04:00

Java Date Pattern Frequency shows no results for dd/MM/yyyy hh:mm aaa

#2 2011-10-11 14:29:57

Re: Java Date Pattern Frequency shows no results for dd/MM/yyyy hh:mm aaa

#3 2011-10-12 00:40:09

Re: Java Date Pattern Frequency shows no results for dd/MM/yyyy hh:mm aaa

#4 2011-10-12 04:12:57

Re: Java Date Pattern Frequency shows no results for dd/MM/yyyy hh:mm aaa

#5 2011-10-12 11:27:51

Re: Java Date Pattern Frequency shows no results for dd/MM/yyyy hh:mm aaa

Board footer