Talend community forum / Post a reply

Open Data SolutionsData Management solutionswarehouseOpen StudioBusinessExtract Transform LoadETL

You are not logged in.

Announcement

[2013-05-06] Boston Area User Group Meetup
[2013-05-02] NOTICE TO ALL TALENDFORGE USERS: maintenance completed
[2013-04-26] Talend Open Studio's 5.3.0 release is available
[2013-04-12] Ready for testing - Talend Open Studio's 5.3.0RC2 release is available
[2013-04-11] Talend’s corporate pages and groups on social media

Unanswered posts

Discover Talend's new v5.3 big data developer tools on May, 29 2013 by pcoffre
Talend MDM Server log messages by erop
tFileInputXML [...] by hotline_crlr
tNetezzaInput [...] by Davy.Huijgens
LDAP timeout? by fvalentim
Deployment question regarding [...] by rhuiser
General question about jobservers and runtimes ... by rbadev

Index
» Usage, Operation
» Creating two joined output rows in different tables from one input row

Post a reply

Write your message and submit

Name

E-mail

Message

[quote=ShaunWinters]I'm currently porting an old proprietary custom CMS to Wordpress, and I'm attempting to move over the post data (contained in the [b]content[/b] table) from the original CMS while retaining all the extra data that's contained in the old CMS [b]content[/b] table's structure. Wordpress has a [b]posts[/b] table that only contains the bare essentials, while the rest of the post data is stored in the [b]postmeta[/b] table.

I have no problem creating the new Wordpress [b]posts[/b] record, but my problem is that the [b]posts[/b] table generates a new primary key, one that is not shared with the original [b]content[/b] table.... and the [b]postmeta[/b] table needs to be keyed on the key that the mysql DB generates.

Now I've figured out how to use tMysqlLastInsertID and OnSubjobOK to pass on the new key .... but I'm lost on this part:

..... How can I pass on the data from the [b]content[/b] table when it's not keyed on the same ID?

I don't have anywhere to store the [b]content[/b] row's primary key in the new [b]posts[/b] row .... how can I get these two keys associated so I can return and extract the pertinent data from the [b]content[/b] table to store in the [b]postmeta[/b] table?

I'm at a complete loss of what to do, and this is a time sensitive project. Any help would be *greatly* appreciated.[/quote]

Options

Never show smilies as icons for this post

Click in the dark area of the image to send your post.

Go back

Topic review (newest first)

alevy: 2011-09-21 04:21:32

What was the problem with my suggestion?

ShaunWinters: 2011-09-21 03:03:33

I'd still like to know how to do this properly, if anyone's willing to indulge me

ShaunWinters: 2011-09-19 16:17:37

Well for now, as a workaround, (and against my better judgement) I've added a new field to the Wordpress posts table to store the old CMS content ID... I'm just running two separate processes now.

I'm blown away that I even had to resort to this kind of hack for such a seemingly simple task.

alevy: 2011-09-18 13:06:59

I think what you want is:
content --> tMap -order1-> posts --> tMysqlLastInsertID --> tSetGlobalVar (to store the new ID)
-order2-> tSplitRow (separate into three records and put in the new ID from the globalMap) --> postmeta

You can't use the ID from the globalMap directly in tMap because of Don't populate output row until ready to execute branch.

ShaunWinters: 2011-09-16 16:44:38

Shong, the problem is that I don't know how to structure my job. Showing you a screenshot of my current attempts would be fruitless as I know they're entirely wrong.

I can show you an example of want I want though (though my actual solution will contain many more fields):

Input table:
[content]
content.id
content.name
content.body
content.category
content.company

Output tables:
[posts]
posts.id
posts.name
posts.body

[postmeta]
postmeta.id
postmeta.postid
postmeta.metakey
postmeta.metavalue

Data flow:
posts.id = (automatically assigned by mysql)
posts.name = content.name
posts.body = content.body

(new postmeta record)
postmeta.id = (automatically assigned by mysql)
postmeta.postid = posts.id (as generated by the related posts insert)
postmeta.metakey = "old_id"
postmeta.metavalue = content.id

(new postmeta record)
postmeta.id = (automatically assigned by mysql)
postmeta.postid = posts.id (as generated by the related posts insert)
postmeta.metakey = "category"
postmeta.metavalue = content.category

(new postmeta record)
postmeta.id = (automatically assigned by mysql)
postmeta.postid = posts.id (as generated by the related posts insert)
postmeta.metakey = "company"
postmeta.metavalue = content.company

shong: 2011-09-16 16:32:16

Hi
Can you upload a screenshot of job? It will be helpful for us understanding your problem.

Best regards
Shong

ShaunWinters: 2011-09-16 15:35:17

This is starting to seem like a hopeless cause. Does anyone have any clue what I'm doing wrong?

ShaunWinters: 2011-09-15 23:43:08

I should add, I'm using TOS Version: 4.2.2 Build id: r63143-20110622-0628

ShaunWinters: 2011-09-15 23:06:52

Please ignore the "tos3.0.0" tag... that was a misclick

ShaunWinters: 2011-09-15 22:59:38

I'm currently porting an old proprietary custom CMS to Wordpress, and I'm attempting to move over the post data (contained in the content table) from the original CMS while retaining all the extra data that's contained in the old CMS content table's structure. Wordpress has a posts table that only contains the bare essentials, while the rest of the post data is stored in the postmeta table.

I have no problem creating the new Wordpress posts record, but my problem is that the posts table generates a new primary key, one that is not shared with the original content table.... and the postmeta table needs to be keyed on the key that the mysql DB generates.

Now I've figured out how to use tMysqlLastInsertID and OnSubjobOK to pass on the new key .... but I'm lost on this part:

..... How can I pass on the data from the content table when it's not keyed on the same ID?

I don't have anywhere to store the content row's primary key in the new posts row .... how can I get these two keys associated so I can return and extract the pertinent data from the content table to store in the postmeta table?

I'm at a complete loss of what to do, and this is a time sensitive project. Any help would be *greatly* appreciated.

Announcement

Unanswered posts

Post a reply

Topic review (newest first)

Board footer