In this final section we look at the data load. Here we will use the same tUnpivot row component to transpose the actual row data into columns and assign the column values from the column_config file.
In this we will use the same file name from the tFileList component. the only change we will apply is to add Default value as “Null”to the columns as follows
Then we will use Primary Columns as our unpivot columns.
In the first tMap, we map FileName and the pivot columns as follows
In Second tMap, we will use the Variables to write the column order expressions.
This also has the look up from the column_config file joining with FileName and MeasureName.
and the final file looks as below
Please share your comments feedback below.
Please find the job I created along with the files HERE.
Dynamic Schema Main Create Column Mapping Unpivot Manage Order