Talend Exchange is the place where Talend community can share items related to Talend opensource products, such as Data Integration, Data Quality and Data Master Management. Contribution is open to any user, no specific validation is needed. As soon as you have your forum account, you automatically get a Talend Exchange account.


tGoogleAnalyticsInput


  • Author: jlolling
  • Categories: Java, Component
  • First revision date: 2012-06-03
  • Latest revision date: 2013-02-21
  • Compatible with: Data Integration releases 4.1.3, 4.2.0, 4.2.0M1, 4.2.0M2, 4.2.0M3, 4.2.0M4, 4.2.0RC1, 4.2.0RC2, 4.2.0RC3, 4.2.1, 4.2.2, 4.2.3, 4.2.4, 5.0.0, 5.0.0M1, 5.0.0M2, 5.0.0M3, 5.0.0M4, 5.0.0M5, 5.0.0RC1, 5.0.0RC2, 5.0.0RC3, 5.0.1, 5.0.2, 5.1.0, 5.1.0M1, 5.1.0M2, 5.1.0RC1, 5.1.1, 5.1.2, 5.1.3, 5.2.0, 5.2.0M1, 5.2.0M2, 5.2.0RC1, 5.2.0RC2, 5.2.1, 5.2.2, 5.3.0, 5.3.0M1, 5.3.0M2, 5.3.0M3, 5.3.0RC2
  • Downloads: 629

About: Lets you query Google Analytics data.
You find this component in the palette in section Business->Google.
This component use the latest GA-API version 3 (Java API 1.12) and OAuth-API 2.0.
A configured service account is needed and must be added to your Analytics Account (+profile).
Component returns (after):
- error_message,
- amount or rows used to create result set
- flag if data are sampled
- number of lines delivered
The dimensions and metrics are defined in the notation of the Google API.
In the Advance section you can optimize the perfomance by changing the fetch size and avoid problems by changing the timeout (also used for read timeout).
There is also an advanced option to reuse the client (avoid multiple logins in iterations).
Contact: jan.lolling@cimt-ag.de
Do not hesitate to contact me if you have proposals or experiences problems, especially for the common typical problems Talend causes in case of user components.
Please read the help page linked in the component detail page.

Related links

Revision list

expand/collapse all

Revision 1.11 168 Downloads, Released on 2013-02-21
Download revision 1.11

Compatible with: 5.3.0, 5.3.0RC2, 5.3.0M3, 5.3.0M2, 5.3.0M1, 5.2.2, 5.2.1, 5.2.0, 5.2.0RC2, 5.2.0RC1, 5.2.0M2, 5.2.0M1, 5.1.3, 5.1.2, 5.1.1, 5.1.0, 5.1.0RC1, 5.1.0M2, 5.1.0M1, 5.0.2, 5.0.1, 5.0.0, 5.0.0RC3, 5.0.0RC2, 5.0.0RC1, 5.0.0M5, 5.0.0M4, 5.0.0M3, 5.0.0M2, 5.0.0M1, 4.2.4, 4.2.3

Advanced Option to limit the maximum number of delivered rows. Keep the attribute empty or set it to 0 to avoid limitation.

Revision 1.10 49 Downloads, Released on 2013-01-11
Download revision 1.10

Compatible with: 5.2.1, 5.2.0, 5.2.0RC2, 5.2.0RC1, 5.2.0M2, 5.2.0M1, 5.1.3, 5.1.2, 5.1.1, 5.1.0, 5.1.0RC1, 5.1.0M2, 5.1.0M1, 5.0.2, 5.0.1, 5.0.0, 5.0.0RC3, 5.0.0RC2, 5.0.0RC1, 5.0.0M5, 5.0.0M4, 5.0.0M3, 5.0.0M2, 5.0.0M1, 4.2.4, 4.2.3

New release of Google Reporting API v3-rev24-1.12.0-beta used.

Revision 1.9 126 Downloads, Released on 2012-09-12
Download revision 1.9

Compatible with: 5.2.1, 5.2.0, 5.2.0RC2, 5.2.0M2, 5.2.0M1, 5.1.1, 5.1.0, 5.1.0RC1, 5.1.0M2, 5.1.0M1, 5.0.2, 5.0.1, 5.0.0, 5.0.0RC3, 5.0.0RC2, 5.0.0RC1, 5.0.0M5, 5.0.0M4, 5.0.0M3, 5.0.0M2, 5.0.0M1, 4.2.4, 4.2.3, 4.2.2, 4.2.1

Code generation optimization.
Avoid problems with not null values.

If you expierence problems with missing jars, please delete the file configuration/ComponentCache.javacache and restart Studio. (If you use the commandline do the same for it!).
If that does not help - please keep in mind these are all problems caused by Talend not by the component - do following:
1. copy the component to any directory (and keep this dir in mind) of your computer
2. In Preferences set Talend Component Development directory to the former choosed directory where you copied the component to
3. Switch to the component development perspective
4. right klick with the mouse on component dir and choose Push components to palette. After doing that, the Generation Engine should restart automatically.

That cause Talend to intergrate components in the strongest way.

Revision 1.8 24 Downloads, Released on 2012-09-05
Download revision 1.8

Compatible with: 5.2.0M2, 5.2.0M1, 5.1.1, 5.1.0, 5.1.0RC1, 5.1.0M2, 5.0.0RC3, 5.0.0RC2, 5.0.0RC1, 5.0.0M5, 5.0.0M4, 5.0.0M3, 5.0.0M2, 5.0.0M1, 4.2.4, 4.2.3, 4.2.2, 4.2.1, 4.2.0, 4.2.0RC3, 4.2.0RC2, 4.2.0RC1, 4.2.0M4

New API version r15 1.8.0 used. This is necessary to avoid conflicts with the new component tGoogleAnalyticsMCFInput which depends on this version.
There is a problem with the code generator if this component has no out going connections attached. In this case the code generator fails, because of this component need an out going connection it shouldn t be a problem.

If you expierence problems with missing jars, please delete the file configuration/ComponentCache.javacache and restart Studio. (If you use the commandline do the same for it!).
If that does not help - please keep in mind these are all problems caused by Talend not by the component - do following:
1.copy thes component to any location of your computer
2. In Preferences set Talend Component Development directory to the directory where you copied the component
3. Switch to the component development perspective
4. klick with mous on component and choose Push components to palette.

That cause Talend to intergrate components in the strongest way.

Revision 1.7 35 Downloads, Released on 2012-08-18
Download revision 1.7

Compatible with: 5.1.1, 5.1.0, 5.1.0RC1, 5.1.0M2, 5.1.0M1, 5.0.2, 5.0.1, 5.0.0, 5.0.0RC3, 5.0.0RC2, 5.0.0RC1, 5.0.0M5, 5.0.0M4, 5.0.0M3, 5.0.0M2, 5.0.0M1, 4.2.4, 4.2.3, 4.2.2, 4.2.1

Problem solved with dimension ga:date. Please ensure, that schema has date pattern yyyyMMdd (double qouted) for ga:date dimension.
The locale for number format is now requiered. Fortunately the default value is set correctly, so there is no need to change that in 99,99% of all cases.

Revision 1.6 42 Downloads, Released on 2012-07-31
Download revision 1.6

Compatible with: 5.1.1, 5.1.0, 5.1.0RC1, 5.1.0M2, 5.1.0M1, 5.0.2, 5.0.1, 5.0.0RC3, 5.0.0RC2, 5.0.0RC1, 5.0.0M5, 5.0.0M4, 5.0.0M3, 5.0.0M2, 5.0.0M1, 4.2.4, 4.2.3, 4.2.2, 4.2.1, 4.2.0, 4.2.0RC3, 4.2.0RC2, 4.2.0RC1, 4.2.0M4, 4.2.0M3, 4.2.0M2, 4.2.0M1, 4.1.3

French translation added (special thanks to Nicolas Marchand and my wife Doris)

Revision 1.5 85 Downloads, Released on 2012-06-20
Download revision 1.5

Compatible with: 5.1.1, 5.1.0, 5.1.0RC1, 5.1.0M2, 5.1.0M1, 5.0.2, 5.0.1, 5.0.0, 5.0.0RC3, 5.0.0RC2, 5.0.0RC1, 5.0.0M5, 5.0.0M4, 5.0.0M3, 5.0.0M2, 5.0.0M1, 4.2.4, 4.2.3, 4.2.2

* New library version google-analytics-lib used (v1.7.1 beta)
* Problem with \"invalid grant\" (or in former version \"login required\") error solved:
This problem happens if the application runs in the future from Google point of view, means if the local clock is a bit to early.
To avoid that problem, there is a new advanced option to add a time offset into the past to be sure that the component runs always in the past from googles point of view, otherwise refreshing access token fails.
* Dimensions are not requiered anymore.

Revision 1.4 21 Downloads, Released on 2012-06-14
Download revision 1.4

Compatible with: 5.1.1, 5.1.0, 5.1.0RC1, 5.1.0M2, 5.1.0M1, 5.0.2, 5.0.1, 5.0.0, 5.0.0RC3, 5.0.0RC2, 5.0.0RC1, 5.0.0M5, 5.0.0M4, 5.0.0M3, 5.0.0M2, 5.0.0M1, 4.2.4, 4.2.3, 4.2.2

Bugs fixed:
If running in iteration with reusage client, start index will not start index at 1
NullPointerException if last paging returns zero data sets.

Revision 1.3 18 Downloads, Released on 2012-06-14
Download revision 1.3

Compatible with: 5.1.1, 5.1.0, 5.1.0RC1, 5.1.0M2, 5.1.0M1, 5.0.2, 5.0.1, 5.0.0, 5.0.0RC3, 5.0.0RC2, 5.0.0RC1, 5.0.0M5, 5.0.0M4, 5.0.0M3, 5.0.0M2, 5.0.0M1, 4.2.4, 4.2.3, 4.2.2

Fixed client reusage.
Improved client sharing with key extension.
The Key to reuse the client will build by:
component id + jobName + optinal given additional key (to separate the clients if you plan to run the same job simultaniously)

Revision 1.2 32 Downloads, Released on 2012-06-08
Download revision 1.2

Compatible with: 5.1.1, 5.1.0, 5.1.0RC1, 5.1.0M2, 5.1.0M1, 5.0.2, 5.0.1, 5.0.0, 5.0.0RC3, 5.0.0RC2, 5.0.0RC1, 5.0.0M5, 5.0.0M4, 5.0.0M3, 5.0.0M2, 5.0.0M1, 4.2.4, 4.2.3, 4.2.2, 4.2.1

adds more return values,
improved performance,
totals can included into the resultset
Please be aware, that the componente job properties will be reset if you use an older version already in your jobs!

Revision 1.0 29 Downloads, Released on 2012-06-03
Download revision 1.0

Compatible with: 5.1.1, 5.1.0, 5.1.0RC1, 5.1.0M2, 5.1.0M1, 5.0.2, 5.0.1, 5.0.0, 5.0.0RC3, 5.0.0RC2, 5.0.0RC1, 5.0.0M5, 5.0.0M4, 5.0.0M3, 5.0.0M2, 5.0.0M1, 4.2.4, 4.2.3, 4.2.2, 4.2.1

first tested version

Reviews (8)

 Having trouble getting it to work. By abdul.rehman on May 23, 2013
Hi,

Can anyone tell me that what am i missing? Thanks.

http://www.talendforge.org/forum/viewtopic.php?id=29714

regards,
Was this review helpful to you? Yes No Report
 dependency still not found By mlindman on March 6, 2013
I tried the steps for problemsolving, but I'm still getting the error "Module cimt.talendcomp.gaanalytics-1.5.0-jar-with-dependencies.jar required"

Is there something that would prevent this module from working on Enterprise version (with svn)?

Are there any steps I could take to fix this manually?
Was this review helpful to you? Yes No Report
 Directeur Informatique By Pierret on February 13, 2013
One functionality missing.

This is a great component and it works fine but Iit's not possible to limit the results. I don't want to store all the results in my database. Is it possible to add a parameter to set max-results?

Thanks
Was this review helpful to you? Yes No Report
 Can't make it work with Talend 5.1.1 By atienza on February 13, 2013
I just downloaded the last version but when trying to launch the job, I get errors (in the code windows) indicating this :
de.cimt.talendcomp.googleanalytics.GoogleAnalyticsInput
"de. cannot be resolved"
Did I miss anything in the installation process ?
Was this review helpful to you? Yes No Report
 Great component By BZIKHA Rabi on January 15, 2013
I already use this component.It's very good and it is important in Datamanagement.

Tanks,
Was this review helpful to you? Yes No Report
 Great Tool By ketan_dangi on September 21, 2012
Other then initial installation problem its really great tool.
Was this review helpful to you? Yes No Report
 Jar not found Issue By ketan_dangi on September 11, 2012
After downloading above latest version and two steps still getting "...1.4-dependency.jar not found".

Was this review helpful to you? Yes No Report

After fresh install its works fine. By ketan_dangi on September 21, 2012
After installing again above error no longer exist. now I can say this is really great tool
 Great component! By mkeyes on July 18, 2012
Works like a charm, and since it uses OAuth it is about as future proof as you can get. Two suggestions from the author to get it to work right out of the box:

1) After you create your service account key in the Google API Console add your service account email as a user of the GA profiles you're using.
2) Delete the ComponentCache.javacache in the configuration subdirectory and restart Studio to get rid of the "jar not found" error after install.

After I did these two steps it worked perfectly.

Was this review helpful to you? Yes No Report

\"error\" : \"invalid_grant\" while running the simple job with tGoogleAnalytics revision 1.11 By ashish.s on April 5, 2013
Exception in component tGoogleAnalyticsInput_1 com.google.api.client.auth.oauth2.TokenResponseException: 400 Bad Request { \"error\" : \"invalid_grant\" } at com.google.api.client.auth.oauth2.TokenResponseException.from(TokenResponseException.java:103) at com.google.api.client.auth.oauth2.TokenRequest.executeUnparsed(TokenRequest.java:303) at com.google.api.client.auth.oauth2.TokenRequest.execute(TokenRequest.java:323) at com.google.api.client.googleapis.auth.oauth2.GoogleCredential.executeRefreshToken(GoogleCredential.java:340) at com.google.api.client.auth.oauth2.Credential.refreshToken(Credential.java:505) at com.google.api.client.auth.oauth2.Credential.intercept(Credential.java:266) at com.google.api.client.http.HttpRequest.execute(HttpRequest.java:857) at com.google.api.client.googleapis.json.GoogleJsonResponseException.execute(GoogleJsonResponseException.java:182) at com.google.api.client.googleapis.services.GoogleClient.executeUnparsed(GoogleClient.java:279) at com.google.api.client.http.json.JsonHttpRequest.executeUnparsed(JsonHttpRequest.java:207) at com.google.api.services.analytics.Analytics$Data$Ga$Get.execute(Analytics.java:1622) at de.cimt.talendcomp.googleanalytics.GoogleAnalyticsInput.executeDataQuery(GoogleAnalyticsInput.java:260) at de.cimt.talendcomp.googleanalytics.GoogleAnalyticsInput.executeQuery(GoogleAnalyticsInput.java:303) at dheeraj.gtest_0_1.gtest.tGoogleAnalyticsInput_1Process(gtest.java:493) at dheeraj.gtest_0_1.gtest.runJobInTOS(gtest.java:822) at dheeraj.gtest_0_1.gtest.main(gtest.java:690) [statistics] disconnected
Submit review
Name:*
Email:*
Title:*
Please select your rating*
Review:*


Version Author Released on Rating Downloads
Regex

US Zipcode Validation

 3.1.2 mhallam 2009-07-07
83

matches only if 5 numerics are presentnot matches if less than 5 numerics
Zipcode should be of 5 numerics

Regex

Swedish personnummer with accepted foreigners

 3.1.2 mhallam 2009-07-07
67

with a "P", "T", or "F" instead of the first of the four last numbers.

This code fixes the problem, but does not check the validity of the date, or the last number.

Regex

Swedish Personal Nr (Personnummer)

 3.1.2 mhallam 2009-07-07
65

Simple regex for the Swedish personal number. It's in the form: YYMMDD-xxxx where xxxx is an arbitrary number from 0000-9999.

791231-1234

Regex

UK Vehicle Registration Plate Number Plate

 3.1.2 mhallam 2009-07-07
52

AB12 RCY|||CD07 TES|||S33 GTT|||Y999 FVBab12 rcy|||CD07 TIS|||S34 GTT|||Z999 FVB

UK Vehicle Registration Plate / Number Plate format as specified by the DVLA. Accepts both "Prefix" and "New" style. Allows only valid DVLA number combinations as not all are supported. Registration number must be exactly as is displayed on car, hence all letters must be in uppercase and a space seperating the two sets of characters.

Regex

Phone Brazil

 3.1.2 mhallam 2009-07-07
56

011 5555-1234|||(011) 5555 1234|||(11) 5555.1234|||1155551234(011 5555-1234|||(01) 5555 1234|||(11) 0555.1234|||(11) 5555 abcd


Matches Brazilian phone numbers, includes DDD (long-distance call) with or without 0. Accepts characters -, . and [space] as separators.

Regex

No special chart

 3.1.2 mhallam 2009-07-07
32

QDE|||QDE#RF

Allow only 3 charcters or number without any special characters

Regex

Mobile number of India

 3.1.2 mhallam 2009-07-07
38

This expression will be useful to check mobile
number of India. This expression will check
various types of number like number in local
format or international number separated by
hyphen(-) or not.

Regex

International phone number

 3.1.2 mhallam 2009-07-07
61

Matches most international formated phonenumber.

Regex

International Passport

 3.1.2 mhallam 2009-07-07
34

? 9 characters made up of a combination of numbers and/or letters. Where less than 9 characters it will be padded out to the right with chevrons (

Regex

ISBN Checker

 3.1.2 mhallam 2009-07-07
53

Expression to check for a valid ISBN number

Version Author Released on Rating Downloads
Export

Product Demo

 3.0 ctoum 2012-05-31
427

Product & families, with Cafepress pictures.

Data-Model

Clinical Trials: Janus Model Basics

 1.0 jaymce 2010-11-22
283

This is a model of the basic of the Janus Clinical Data Repository.
http://www.fda.gov/ForIndustry/DataStandards/StudyDataStandards/ucm155327.htm
Data-Model

D* Demo Model

 1.0 ctoum 2010-08-13
512

Model used in the D* Demo.

Export

Talendshop Demo

 1.0 ctoum 2010-08-04
1062

Talendshop Demo (Demo Project)


49 ms