question

rmahon avatar image
rmahon asked

ETL load from 3 data sources

I have 3 data sources. Students, Teachers, and Non-Teachers (all the data pulled is in the same layout and aliased the same). Students and Teachers come from the same database but the "Non" comes from a different. If have been working on this for almost a day trying to get the output to a flat file (csv). The hang up is, the Student and Teachers sources have "user_id" of integer - (DT_I4) and the Non-Teachers user_id is varchar(12) - DT_STR example Exxxxxxx. I have attempted join things using a Derived Column, Merge, Merge Join, etc. I either get an error due to datatype or I get rows with ,,,,,. One thing I would like to add...some Teachers and Non-Teachers exist in both data sources. In this case, I want to use the Teachers source in the destination and disregard the Non-Teacher data. Any insight would be gratefully accepted. Thanks.
etlssis2012derived-column
1 comment
10 |1200

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.

I would suggest 1.stage the data from txt file in a database.. 2. Do all your manipulations 3. generate the text files
0 Likes 0 ·

0 Answers

·

Write an Answer

Hint: Notify or tag a user in this post by typing @username.

Up to 2 attachments (including images) can be used with a maximum of 512.0 KiB each and 1.0 MiB total.