Prepare

When having an historic snapshot table in TimeXtender MDW, based on a table insert, I need to limit the table somehow to prevent it from growing too large. I want to limit the [Date] field for only 1 year of data. Because it's based on a table insert, there are no fields available in the table to use for a table “Data selection rule”. I can only place a data filter on the table insert which only has data of 1 day.My historic table works like this: Actual table (snapshot of today) Historic table (table insert, daily, of actual table, so it stacks up the daily snapshots)(TX version 20.10.43.64)

As you know in TX you can have a lotof data areas that in the SQL data base are schemas.In SSMS you can group the objects in folders based on their schema using this addon:https://github.com/nicholas-ross/SSMS-Schema-Folders Hope this helps. 

I’m using Timextender version 6521.1 and I get an error when using hard deletes on a incremental table. If I choose no deletes it works just fine, soft deletes also throw me and error. As far as I could tell from these notes incremental loading should be fully supported. Things I have checked:Primary key on the table in the ODX Incremental load is setup in the ODX Incremental load is setup on the Snowflake table. I’m not quite sure if this is just a bug or I missed something obvious. This is the first table i’m trying to load incremental in Snowflake. This is the error it throws at me:System.AggregateException: One or more errors occurred. ---> Snowflake.Data.Client.SnowflakeDbException: Error: Error parsing the parquet file: Invalid: Parquet file size is 0 bytes  Row 0 starts at line 0, column   If you would like to continue loading when an error is encountered, use other values such as 'SKIP_FILE' or 'CONTINUE' for the ON_ERROR option. For more information on loading options, plea

Hi,We have been using ADF for transferring data from our ODX storage account to Azure SQL database for a long time but now our manual and scheduled reloads get stuck in ADF.It looks as if TX does not pass the runtime to ADF. This is required because our storage account is behind a private endpoint so we need to use an IR that resolves in our VNet in Azure.Do you have any idea why the runtime does not appear on the pipeline? As you can see there is no runtime assigned to this run:  Normally the runtime appears in ADF:  We are on TX 20.10.45 by the way.Would love to hear from you!

Hi all,My first post here. My company is currently using legacy TX but I started poking around the new version. I was a bit surprised to find out that passwordless authentication methods are not supported yet. Are there plans to support managed identity authentication in the legacy or new version?Our company security policy requires password expiration even on service accounts so you can imagine the hazard to update them in many places regularly.TX MDW SSMS 

Current advice on partitioning on a non-date field calls for creating a partitioning “bucket” using field transformations. While attempting to follow the instructions outlined here I encountered a problem. Partitioning works by creating a calculated field in the valid table that has the capacity to handle NULL values if the partition template is so configured. However, that same field, along with the calculated default value, is also present in the Raw table. This means that when anyone following TimeXtender’s guidance for non-date transformations executes the table, that execution will fail with the error “Cannot insert the value NULL into column ‘DW_PartitionKey’”Is this a bug, or does the documentation for creating partitions need to be updated? 

Good morning All,We are encountering the following:We have history tables that use the DW_SourceCode as part of the primary key. This is because we have multiple sources with the same structure which are merged together in one table after ODX. As primary keys can overlap in the different sources, we need the DW_SourceCode to make distinguish the data coming from one or other source. Also we need history as the sources have a tight cleanup system and we need to keep track of information ourselves. While developing some of the tables, the DW_SourceCode was somehow not included in the primary key in the first deployment and this was corrected afterwards. TimeXtender also reflects this: Although deployment was successful, the computed column definition of the surrogate hashkey was not altered: The problem we're having now is that the history is matched based on the surrogate hashkey. Now wrong records are updated (type 1 history) because the hashkey matches but actually shouldn't because t

One of my colleagues made a change to an incremental field on a very large table, not realizing that this would force a full load. We only realized what had happened halfway through our promotion, but since we needed to make changes to that table anyway, we proceeded. Reloading that table and its downstream tables took five days. Luckily, a long weekend greatly reduced the impact of that reload on our users. We have now begun our next promotion cycle.  Unfortunately, despite the fact that the table in question was reloaded in our development environment, differential deployment is again forcing a full reload of that table. We really can’t afford to spend a week reloading this table a second time. We’d love to know why the flag remains flipped in the first place, how we can avoid this happening in the future, and how we can avoid this extremely costly reload, as it is blocking our ability to promote urgently needed changes into production. 

TimeXtender beings almost all tasks by checking to see if the objects involved currently exist. It does this by querying SQL Server system views. However, this does not take into account a very unusual property of system views: querying them naively can result in SQL Server attempting to get a lock on the underlying system metadata tables. When it does this is wildly inconsistent - sometimes it will try to get a lock on the table when doing only a simple SELECT, other times it will only attempt to get a lock when certain joins are used. This isn’t really documented anywhere I’ve been able to find, but I have observed it in action many times. The problem is that SQL Server schema changes write to those metadata tables, which also locks them. And as long as the change is occurring, the tables stay locked.  This becomes an issue when rebuilding indexes. This is a very frequent occurrence curing TimeXtender execution as it happens whenever a table is fully reloaded. For large tables, this

v20.10.35.64I’ve got a History table with ± 16 million rows in PROD and ± 2.3 million rows in TEST. To increase loading times I tried to delete some columns of the table, first in TEST. Here I was able to successfully Deploy & Execute the History table with Differential + Managed deployment, which finished in several minutes.However, when I try the same procedure in PROD it keeps stuck on the step Deploy Valid Table Structure as shown below. I also tried to Deploy with Differential Deployment unchecked, but with no result. It just keeps loading forever.Anybody an idea? 

Hi,We are setting up a new Azure environment for a client and we are having some issues with the Azure SQL DB.The app server VM is based on the one available in the Azure marketplace:https://azuremarketplace.microsoft.com/en-us/marketplace/apps/timextender.timextender-app-server?tab=OverviewThe issue occurs when we try to test the storage connection for the MDW instance. When we try to use Azure AD integrated or password authentication we get the error that adalsql.dll is not able to load when we test the connection in the desktop app.Azure AD integrated authenticationAzure AD password authenticationThe URL leads to a 404 not found: http://go.microsoft.com/fwlink/?LinkID=513072I found these two posts about AAD integrated auth, but it is not clear to me if it is possible or not to get it to work:I didn’t find any discussions about the Azure AD password authentication.Are these not supposed to work as authentication methods for a DW instance deployed in an Azure SQL DB? If they are, is t

Hi all,  I am relatively new to SQL. Although with help and searching, I am making progress, I am not succeeding with the following question. Based on a date, I can easily set a filter in my reports to look ahead for x period of time. However, when a holiday comes into view, my report becomes blank. For this, I am looking for an index/row_number/sequence that skips the holiday dates. Can I set up a Custom Field for this within my BaseCalendar?

At a customer, we are developing in a team of 2 on  TimeXtender 6536.1 .The Team development feature is switched on and, like in the 20.10.nn.mm  version, I would expect the refresh button to bring out any deployments that my colleague makes and vice versa.But this doesn’t happen so. Only by closing an instance and re-opening it, do the deployed modifcations appear.Are we the only ones experiencing this? Or are there others?We know that you can use workitems to show others what you’re working on, to avoid working on the same objects, but would expect a refresh to also show new items, if one depends on the  others work to proceed. 

I am trying to convert TX to single database and stuck here-- Set the source databaseUSE DVH_PROD_ODX; -- Source databaseDECLARE @SourceDatabase NVARCHAR(MAX) = 'DVH_PROD_ODX'; -- Source databaseDECLARE @SourceSchema NVARCHAR(MAX) = 'ODX_TZ'; -- Source schema in the source databaseDECLARE @TargetDatabase NVARCHAR(MAX) = 'DVH_PROD_MDW'; -- Target databaseDECLARE @TargetSchema NVARCHAR(MAX) = 'ODX_TZ'; -- Target schema in the target database-- Declare variables for table name and dynamic SQLDECLARE @TableName NVARCHAR(MAX);DECLARE @SQL NVARCHAR(MAX);-- Create a cursor to loop through tables in the source schemaSET @SQL = N'DECLARE table_cursor CURSOR FOR ' + N'SELECT t.TABLE_NAME ' + N'FROM INFORMATION_SCHEMA.TABLES t ' + N'WHERE t.TABLE_SCHEMA = ''' + @SourceSchema + '''' + N' AND EXISTS ( ' + N'SELECT 1 ' + N'FROM '+ @TargetDatabase + N'.INFORMATION_SCHEMA.TABLES t2 ' + N'WHERE t2.TABLE_NAME = t.TABLE_NAME ' + N'AND t2.TABLE_SCHEMA = ''' + @TargetSchema + '''' + N')';EXEC sp_executesql

Hi!We have installed TimeXtender and ODX on an Azure VM (TimeXtender 6536.1). They are both running in ADF.I have installed TimeXtender Desktop locally on my own computer (outside of the VM) and I’m able to log in and open the instances. However, when I try to execute a table I get this error:-Execute Execution Package Execution Queue Default 'Failed'    No DNS entries exist for host <nameofVM>.    No such host is knownI am connected to the same network as the TimeXtender VM ('nameofVM') through a VPN connection.Is this setup not supported or am I missing some network configurations?

Hi!I want to download TimeXtender Desktop 6521.1 (not the newest one). Where do I find it?

I've created view, and successfully deployed and executed, but while previewing the table it says timeout error, but that view I can open it in SSMS server, it takes 2 minutes to execute the view in server.what are steps or setting i should change to preview it in Timextender.

Hi, I am in the proces of migrating old Power BI managed data sources to our data warehouse in TimeXtender. However, in power query I use a function called List.Dates to create a row for each data between two dates. The data in this situation is sick days. Example below of what I need it to become: Sickdatefrom SickdateTo Sickday 1-1-2024 3-1-2024 1-1-2024 1-1-2024 3-1-2024 2-1-2024  In summary: I need to be able to add the Sickday column in TimeXtender just like I do in Power Query. I couldn't find anything online related to this subject. I am reading all thsis data from a CSV file by the way.

TimeXtender Version 20.10.35.64I'm integrating 6 SQL databases/sources from the same ERP at the moment and want to set up incremental loading on my data source & DSA. I followed the basic steps but it seems like refreshing the incremental DSA tables takes way longer than a full load.The ODX datasources incremental LOAD tasks from all 6 data sources finish under 60 seconds, but the DSA load for e.g. AP_Products table now takes almost 15 minutes, for ± 40.000 rows, against 3 minutes for a full load.  My Last modified DateTime column is ‘Date_Captured’ and is applied on the tables below. For all the 4 tables the PK's are set up.  In the DSA I included column ‘Source’ in every table, which represents DW_SourceCode, to the PK of the tables to have an unique identifier per row. However, it looks like I'm doing something wrong or i’m missing a step, since it takes forever to refresh these DSA tables now

I have two tables Groups and GroupMembers. I need to get in GroupMember ONLY the members of the groups in the Groups table (INNER JOIN).The only way in TX without using views is: But it's not really a mistake.How can I do it?

I have just downloaded the ODX Server and TimeXtender and it looks like TimeXtender has a new version: 6534.1 are there release notes coming for this?

As shown in figure, Sales Ord Is My Base Table, and second table is Sales_ORD_LN_PROD_FAM,what i want to do is, Fetch PROD_FAM_NO,SALES_ORD_LN_NO column in to Sales Ord Table,Sales_Ord_No is same column in both Table,Is there any way to do it,

I have a very big table with millions of records.I’ve divided it in three mappings : aggregate, historical and current.If I need to do a full load only for the current mapping, what can I do it?

CREATE VIEW [Demo].[INVC_T] AS    SELECT        R.[ACCT_DT],        R.[SPLIT_FROM_INVC_NO],        R.[REMIT_TO_ADDR_NO],        R.[USER_INVC_NO],        R.[UPDT_PERS_NO],        R.[UPDT_DT_TIME],        R.[TOTALS_UPDT_DT_TIME],        R.[SHIP_TO_ADDR_NO],        R.[SEG_NO],        R.[RECUR_INVC_NO],        R.[PRINT_INVC_STATUS],        R.[PMT_TERMS_CD],        R.[JE_NO],        R.[INVC_TYPE_CD],        R.[INVC_STATUS_CD],        R.[INVC_SRC_CD],        R.[INVC_NO],        R.[INVC_DUE_DT],        CAST( ([INVC_DT]) >= DATEADD(week, -10, GETDATE()) AS datetime) AS [INVC_DT],        R.[INSUR_AMT],        R.[FRGHT_AMT],        R.[CUST_TYPE_CD],        R.[CURR_RATE],        R.[CURR_CD],        R.[CLOSE_DT],        R.[BILL_TO_CUST_NO],        R.[ACCT_YR],        R.[ACCT_PER],        R.[PMT_METH_CD],        R.[CREDIT_CARD_FLAG],        [DW_Id],        [DW_Batch],        [DW_SourceCode],        [DW_TimeStamp],        [DW_ODXBatchNumber],        [DW_ODXBatchId]    FROM        [Demo].[INVC_R]

We are just started to use ODX server as a source for our countries that are migrated to Business Central in Azure. On our DEV environment i want to limit the data to only get entries after a certain date. Normally i would use a data selection rule on Posting Date Greater or Equal 2021-01-01When i want to do that on ODX server as a data source i get:Conversion failed when converting date and/or time from character string.I have tried every date notation i can think of but i always get this same error.Anyone any idea on how to filter dates from the ODX Server?