You are not logged in.

Unanswered posts



Important! This site has been replaced. All content here is read-only. Please visit our brand-new community at https://community.talend.com/. We look forward to hearing from you there!



#1 2017-03-29 13:35:10

kasspedro
Member
1 post

kasspedro said:

Help with Update on Hive

Tags: [, database, date]

Hi everyone!
I'm a new talend user and i'm trying to do an update on a hive table. My problem is that a have some data that changed and i want to create a new row on the hive table for the new data and update the old one timestamp. It's something like:
ID     CITY    TIMESTAMP                        TIMESTAMP_END
2       NY      2009-10-02 16:52:30     2009-10-05 17:52:30
2    MIAMI 2009-10-05 17:52:30      NULL
In the above case, I had a change on the field CITY, so i updated the TIMESTAMP_END, to know when this data was changed, to keep track of the data state on a period of time, and the knew data was inseted without a TIMESTAMP_END, so i know its the most recent state of the data for the ID 2.
I want to check on Talend if the new data I receive is already there, so I do this update and insert the data, otherwise I just insert the data.
Can anyone please help me? I just cant find a way to check this and update the hive table.
Thank you.

Offline

#2 2017-04-07 09:48:56

xdshi
Talend Team


xdshi said:

Re: Help with Update on Hive

Hi,
Have you already centralized the connection information to the Hive database in your studio? Could you please try to retrieve the table schema of interest from the connected Hive database to see if the new data you receive is already there?
TalendHelpCenter:Centralizing+Hive+metadata

Best regards
Sabrina


What we can do is to make sure that Talend will be your best choice!

Offline

Board footer

Talend Contributor Agreement - Talend Website Privacy Policy