Solved

ODX Server timestamp

  • 25 February 2021
  • 5 replies
  • 98 views

Badge

Is there a way to get the timetamp of when a table was transferred from source to ODX Server? Like the DW_Timestamp. The only system field i can find is odx_batch_number. 

icon

Best answer by Christian Hauggaard 23 January 2023, 11:06

View original

5 replies

Userlevel 6
Badge +5

Sorry for the late reply. You can view standard transfers from data source to ODX storage in the ODX execution log, by right clicking on the ODX instance and selecting “View Execution Log”

 

However, there is currently no way to directly query this execution log data.

A workaround would be to add a query table with a new column GETDATE(). 

Another potential workaround could be to extract the timestamp from the latest created table folder in your data lake for the relevant data source (assuming you are using data lake ODX storage). 

 

 

Userlevel 2
Badge +1

Hi @Christian Hauggaard ,

Is it likely that these type of system fields will become available in ODX server tables? Adding a query table for something like this seems like a workaround that requires more manual work, which I would like to avoid. The latest timestamp of a refresh is relevant to show in dashboards, so end-users can see how ‘old’ the data is that they are looking at.

 

NOTE: with an ADF data source it is not even possible to add query tables as far as I can see.

Badge

Hi,

are there any news regarding ODX timestamps?

We have a customer where the MDW runs quite some time and we need to know, when the ODX tasks  are actually finished (local SQL Server storage for ODX). The customer has also >15 data sources, each with several dozen tables. Query tables would work, but that would be quite a lot of work to add this for all tables. It would be ideal to have an overview on a per table basis. As we are using incremental loads for several tables, we can’t use the tablename to get the info. Has someone found a way to show this?

 

Cheers,

Kai

Userlevel 6
Badge +5

Hi @KajEmergo and @KaiMueller  

In the new version it is possible to use the TimeXtender API to extract some of this info. It shows which transfer task completed at a specific time, however it does not currently show which tables (i.e. which tables are included in the transfer task)

Please feel free to submit a product idea

Userlevel 5
Badge +5

Hi @KaiMueller 

I was not on this originally. 

I made a guide for DW incremental load. When you look at the _I table it has some date fields.

The DW_INC_ODXBatchTimeStamp is the date when the folder was created.

If there was new data, the date for the  DW_INC_ODXBatchTimeStamp field would be updated with that, so it is what you are looking for.

Reply