Follow

New field in an incremental table doesn't populate

Symptoms:

After adding a new field to an incremental table, that field remains entirely or partially NULL.

Error Message:

None

Underlying problem:

Incremental tables update only new or changed records by design.  Without additional intervention, the new field will only be populated for records created or modified after the field was added.

Solution:

The easiest and safest way to address this is to do a full load of the incremental table with the new field.  However, that can sometimes be time consuming if the table is very large. 

In some cases, the field can be updated manually.  If the new field is a custom field with a transformation, the transformation can be applied directly to the table manually with an UPDATE command.

If the new field is a lookup, it's possible to copy out the section of the Data Cleansing Script that performs the lookup and run it manually as well.  Since the script to applies the lookup to the raw table, you will need to make a minor modification to apply the update to the valid table instead.

If the new field comes directly from the data source, your options may be more limited.  If the data source and the TX DWA database are located on the same server, it may be possible to join the valid TX DWA table and the source table together to perform an update.  If the two databases are not co-located, you may have to do a full load of the table to populate the field.

Was this article helpful?
1 out of 1 found this helpful
Have more questions? Submit a request

2 Comments

  • 0
    Avatar
    Joost Romijn

    How can I quickly do a full load on an incremental loaded table? 

    Edit: found it in the Online Learning:

    A full load can be run manually on a table by Deploying & Executing it, clicking the "Review Tasks" button in the Deploy/Execute menu, then selecting the following deployment steps.

    Edited by Joost Romijn
  • 0
    Avatar
    Doug Wynkoop

    Yep, that's it exactly!  I'm glad the online courses were helpful - I really cannot recommend them enough.  For anyone who wants to have a look at that training, you can find it at learn.timextender.com.

Please sign in to leave a comment.