Skip to main content
SUBMITTED

DW_SourceTable

  • March 11, 2019
  • 6 replies
  • 29 views

Is it possible to add a field DW_SourceTable in the default fields, so you can trace in the data were this is coming from. At a project I have database names like below:

6401 - Company 1$Appointment
6401 - Company 2$Appointment
6409 - Company 1$Appointment

6 replies

Forum|alt.badge.img

For many of my records, the existing DW_Source is literal "View". I always expected that field to hold the source table... Man was I disappointed when I discovered that it holds database names. I'm curious, does anyone use the existing DW_Source?

Anyway, I agree with your suggestion, although I would have it replace the source database field. Or have some project/repo level standard where we can choose which of these to add.


Forum|alt.badge.img
  • Contributor
  • March 11, 2019

DW_SourceCode actually identifies the source DB, not the source table.

We use DW_SourceCode actively when consolidating multiple of the same systems. E.g. accounting software that have a database per company (like Exact Online or Unit4 Venice), or multiple Navisions when our customers start buying each other and want to have operational reporting running quickly.

We include DW_SourceCode in the primary keys and in the lookups to make sure no cross-database lookups are performed.

This works well when doing all the heavy lifting in the Stage databases and using the DW purely for storage purposes.

DW_SourceTable field would be a welcome addition so that you indeed have:

- DW_SourceCode = source db

- DW_SourceTable = source table in that source db

Has been discussed already here as well: https://support.timextender.com/hc/en-us/community/posts/115011850126-Source-identifier-when-merging-multiple-simple-mode-tables


Niels Jonker
Contributor
Forum|alt.badge.img+1
  • Contributor
  • June 7, 2023

I see this suggestion is already 4 years old but in my opinion it would be add a DW_SourceTable field to the system fields by default or give the option to add it by default for your project. I know it can be done per table under advanced settings but I’d like to add it to all tables.


Thomas Lind
Community Manager
Forum|alt.badge.img+5
  • Community Manager
  • June 8, 2023

@Niels Jonker 

You should add that as a Idea. For example as a option you could set on the Data Area level or DWH.


Niels Jonker
Contributor
Forum|alt.badge.img+1
  • Contributor
  • June 8, 2023

@Thomas Lind I can do that but I thought it would be better to upvote this existing idea and add my suggestion to it. Should I still create a new idea?


Thomas Lind
Community Manager
Forum|alt.badge.img+5
  • Community Manager
  • June 8, 2023

This is about the DW_SourceCode field. Isn’t it about the Source Code field instead?

I would see that as a different thing as the DW_SourceCode already exists.