Example job for the dynamic schema routine

Contains all of the items and a sample job for using the dynamic schema routine that I uploaded yesterday. There's a spreadsheet in the documentation section of the repository that contains two worksheets. One of them has the columns in the correct order, the other does not. The zip also contains the routine, metadata for the file, and context items.

Routine for Dynamic Schemas

Java routine for dealing with dynamic schemas. As an example, say you have a defined Excel spreadsheet that contains a given number of columns. The number of these columns is static and there is a predefined schema into which it must fit. The caveat is according to the business rules, the columns for the schema may be in a different order than they actually appear in the excel spreadsheet. This is a dynamic schema, meaning the order of the columns can change but they still must meet a defined schema.

tNulltoDefault

Allows the user to get rid of nulls in the data flow. The component changes nulls into default values.

byte = 0
short = 0
int = 0
long = 0L
float = 0.0F
double = 0.0
BigDecimal = 0.0
char = \u0000
boolean = false
String = ""
Date = now

DOES NOT CHANGE

byte[]
List
Object

tFileInputPropertiesExtended

Extension of fileInputProperties. Can use el expression in properties file

tMD5Sum

This component outputs the MD5 Checksum of a specified file.

tWebDavDelete

This component deletes a file with webdav protocol.

It is based on the tWebDavPut component from Jean-Sébastien Darges (Merci !)

Extract the file to this directory "TOS-Win32-r26090-V3.1.3\plugins\org.talend.designer.components.localprovider_3.1.3.r26090\components" (adapt with your TOS version) and start/restart TOS.

It works with newer versions 3.1.X since you specify the family of the component in the .xml file.

Have fun !

tFileChooser

select one file to use


the full file name is : ((String)globalMap.get("tFileChooser_1_FULL_FILE_NAME"))
the file is : ((String)globalMap.get("tFileChooser_1_FILE_NAME"))
the path is : ((String)globalMap.get("tFileChooser_1_PATH_NAME"))
globalMap on file extention choosed: ((String)globalMap.get("tFileChooser_1_FILE_EXT"))

tFBSL

tFBSL routine for Talend

Welcome to the the tFBSL routine code for Talend 3.x series !
This will explain to you how to install and use the tFBSL routine for Talend software.

BTW, what does FBSL for Talend?
Talend is a great ELT software,that runs under Java platform, but unfortunately we can not make
graphical plugins easily, nor windows, nor dialogs on the fly with it!
People that are familiar with Windows environment are always using their mouse and click onto graphical
widgets to interact with this operating system, that seems quite natural.
But if you are familiar with Windows and fond of Talend, you've probably been noticed that no widget
tool is actually provided for developing nice and sweet graphical interfaces!
So, my programming language project called FBSL (development started in 2001) has evolved since
years and is capable of interpreting and creating powerful and complex graphical user interfaces with
ease by the way of one of its two engine, and FBSL.DLL is the one that we'll use via Talend / Java class!

Are you ready?
Ok let's go!

TalendJodaTime

Sample routine to use JODA time

copy joda-time-1.6.jar to lib/java folder

tFileList

THIS COMPONENT IS OBSOLETE : use bcFileListExt instead, which includes theses features and file sort options.

Evolution of Talend's original tFileList component :
- optimization of generated java code (suppression of useless variables, loop optimisation, etc.)
- exclude file mask is now a table where various filemasks can be excluded at the same time
- even if a file matches more than one filemask, it is sent only one in the "iterate" link to be processed

Perl version of this component is unchanged.

Frequency table of hours

This indicator helps to analyze the most frequent day hours that appear in date time columns.

Sample Standard Deviation

This indicator computes the sample standard deviation of any numerical column

Variance

This indicator computes the variance of numeric columns

Trimmed

evaluate the number of data which are correctly trimmed

Week Frequency

aggregates Date fields into weeks

Duplicate Rows

this indicator counts the number of duplicate rows.
It's different from the system indicator called "duplicate count" because it counts the number of duplicate rows, not the number of duplicate values.

Length Range Frequency

get length ranges of data.

group data according to their length range.
Ranges are the following:
data of length < 10
data of length < 20
data of length < 30
data of length >= 30
null data

Order of Magnitude

measure the order of magnitude of numerical data

phone_area_code_freq

Area codes of American phone numbers

udi_average_yearly_income

parses $50K - $70K and return the average value