Skip to main content
To homepage To homepage

TimeXtender Desktop Q&A

Ask questions and find answers about TimeXtender Data Integration and TimeXtender Classic desktop applications

742 Topics
devin.tiemens
TimeXtender Xpert
devin.tiemensTimeXtender Xpert
posted in Jobs & Executions
Jobs/ tasks UTC v.s. Daylight saving time

 Hi everybody, Probably unnecessary but for the ones living/working in Europe I just wanted to inform that daylight saving time will change to winter time this weekend. This means that for those who have an ODX server or the “new” version (6XXX) of TimeXtender, the scheduled tasks/jobs will take place one hour earlier than currently set.This also brought me to the question how we could automate this? Any thoughts about this? Maybe an option in TimeXtender to use local time instead of UTC?Kind regards,Devin

2596
ruben.ruhulessin
Starter
J
Contributor
jyothi.dosiContributor
asked in Ingest
CommonDataService Connector

HI Team, Please can you help me understand how to connect TX with common data service connector? I am trying to bring the data from D365 field service to TX. With Power BI i can use common data service connector and extract the data from FS. But i want to use TX to do ETL. Please help!!

1062
Christian Hauggaard
Community Manager
sierd.zuiderveld
Contributor
sierd.zuiderveldContributor
asked in Jobs & Executions
Execution package nests itself?

Hi all, We experience a weird issue where our execution package seems to run itself? This happens for a total of 3 times in the execution. Then, when it succeeds it'll kick off the next package where it will happen again. This just started to occur in the past week, before everything worked normally.  Has anyone else experienced this? This is the setup of the package.  Any help would be appreciated. 

1473
Christian Hauggaard
Community Manager
sierd.zuiderveld
Contributor
sierd.zuiderveldContributor
asked in Ingest
Primary Key Violation using Incremental Offset

Hey all,  We use incremental load in the ODX on a datetime field and we use an offset of 3 days (again in ODX). Now we've noticed that when we load a table from ODX to the data warehouse (even when full loading) that the _R table can contain duplicate records. In our Data Lake each increment is a parquet file of the last 3 days of data, since we load every day these files can overlap by 2 days. I believe this overlap is the cause of the duplicates in our _R table.  What happens next is that the Error report gets spammed with “Violation of primary key constraint” (which is true). But our Valid table does have the expected result. A full load transfer task solves the issue, but of course we do not want to do that all the time.   Is this the intended design? Is there a page that explains how the ODX handles these parquet files before inserting them into the Raw table? Any suggestions or insights on how to handle this issue would be greatly appreciated.

1958
J
Contributor
K
Contributor
KarankadamContributor
asked in Prepare
Error While Previewing Table

I've created view, and successfully deployed and executed, but while previewing the table it says timeout error, but that view I can open it in SSMS server, it takes 2 minutes to execute the view in server.what are steps or setting i should change to preview it in Timextender.

311
Thomas Lind
Community Manager
Søren Sørensen
Contributor
Søren SørensenContributor
asked in Jobs & Executions
%Instance% parameter in the notification subject

The %Status% and %ExecutionPackage% work nicely in the subject line of notifications but I can’t make the %Instance% parameter work.Does anyone have a fix for this?(aside from creating instance-specific jobs/notifications and type the instance name in the subject line)

1072
Thomas Lind
Community Manager
R
Contributor
r.depagterContributor
asked in Prepare
Each date as individual row based on from and to dates

Hi, I am in the proces of migrating old Power BI managed data sources to our data warehouse in TimeXtender. However, in power query I use a function called List.Dates to create a row for each data between two dates. The data in this situation is sick days. Example below of what I need it to become: Sickdatefrom SickdateTo Sickday 1-1-2024 3-1-2024 1-1-2024 1-1-2024 3-1-2024 2-1-2024  In summary: I need to be able to add the Sickday column in TimeXtender just like I do in Power Query. I couldn't find anything online related to this subject. I am reading all thsis data from a CSV file by the way.

511
Thomas Lind
Community Manager
K
Contributor
KCMTContributor
asked in Ingest
How to set up Source based incremental load with seperate Date and Timestamp column

EditOffset value in incremental rule is not available for my Tx version I suppose. UpdateDate is a DateTime column and my UpdateTS an Integer. I’ll see if I can combine them in a single field somehow in the backend.TX20.10.35.64I try to set up incremental loading with a separate Date & Time column but can't seem to find the right way. Found an older source below indicating it's not possible, since it results in a OR clause instead of a AND clause.I am also not able to set up a distraction on my date column to say UpdateDate - 1 day for some reason. Is there another way to do this in the meantime instead of only the date column?Is source based incremental load possible on separate date and time fields? – TimeXtender Support  

1447
daniel
TimeXtender Xpert
wouter.goslinga
TimeXtender Xpert
wouter.goslingaTimeXtender Xpert
asked in Ingest
Issue with connecting adlsgen2 to ODX

I have a new Azure VM that I am installing with the latest version of the ODX server in preparation of upgrading from TX 20.10 to the new version.I have a new adlsgen2 storage account available as storage for the ODX. A service principal (enterprise application) in the Entra ID is created with a (confirmed working) secret.I have added the ODX Instance in the portal with the following configuration:  The app reg has Owner rights on the adlsgen2:  Still I get a 403 error when trying to create the storage container (the container does not already exist):  

702
wouter.goslinga
TimeXtender Xpert
A
Explorer
AndrewSExplorer
asked in Jobs & Executions
Changing transformation in History table

Hi Folks,I have a painful process that involves uploading csv files into my ODX on ad-hoc basis. In the DSA, i use transformations to pull the existing fields apart into various new fields. This table has history enabled to track when key values change. I then push to the MDW, minus some of the ugly data and using SCD To and From dates to track changing dimensions.A new set of entries with some extra parenthesis broke my job. I have a new set of case statements to deploy to the DSA history table, but as I went to deploy it, I panicked. The normal deploy and execute for a table without history will clear existing data and reload from scratch. Does the same happen with a history table?This table would be a nightmare to rebuild.TX version 19.11.7.64

2124
Thomas Lind
Community Manager
K
Contributor
KCMTContributor
asked in Prepare
Incremental Load ODX and DSA with multiple Data sources set up - DSA load takes forever

TimeXtender Version 20.10.35.64I'm integrating 6 SQL databases/sources from the same ERP at the moment and want to set up incremental loading on my data source & DSA. I followed the basic steps but it seems like refreshing the incremental DSA tables takes way longer than a full load.The ODX datasources incremental LOAD tasks from all 6 data sources finish under 60 seconds, but the DSA load for e.g. AP_Products table now takes almost 15 minutes, for ± 40.000 rows, against 3 minutes for a full load.  My Last modified DateTime column is ‘Date_Captured’ and is applied on the tables below. For all the 4 tables the PK's are set up.  In the DSA I included column ‘Source’ in every table, which represents DW_SourceCode, to the PK of the tables to have an unique identifier per row. However, it looks like I'm doing something wrong or i’m missing a step, since it takes forever to refresh these DSA tables now

1642
K
Contributor
rvgfox
Problem Solver
rvgfoxProblem Solver
asked in Prepare
Inner join in staging area

I have two tables Groups and GroupMembers. I need to get in GroupMember ONLY the members of the groups in the Groups table (INNER JOIN).The only way in TX without using views is: But it's not really a mistake.How can I do it?

1091
Christian Hauggaard
Community Manager
ignacio
Contributor
ignacioContributor
asked in Ingest
How to set as TX administrator

Hi team,  How is the process to set my account as TX administrator? Now I am a user and I can't run ODX 's transfer option or create a new schedule

562
Thomas Lind
Community Manager
rory.smith
TimeXtender Xpert
rory.smithTimeXtender Xpert
asked in Ingest
What rights are needed to be able to create roles in the ODX Server to define access

 I am trying to set up access to some tables in the ODX. when I try to add a role and search for an Azure AD user I get the error: Service request failed: Code: Authorization_RequestDenied ...Module: TimeXtender.ODX.EngineTimeXtender.ODX.Engine.ODXFaultException   at TimeXtender.ODX.Engine.ODXEngine.SendServiceRequest[C,T](WcfServerSettings serverSettings, Func`3 func)   at TimeXtender.DataManager.AddODXSecurityRoleWizard_MemberSelectStep.<>c__DisplayClass11_0.<SearchClicked>b__0()   at TimeXtender.DataManager.ConnectingThread.ExecuteConnectingThread(Object dummy)Service request failed: Code: Authorization_RequestDenied ...Module: timeXtenderTXModelInterface.ExceptionWrapperException   at TimeXtender.DataManager.ConnectingThread.HandleError()   at TimeXtender.DataManager.ConnectingThread.Execute(String title, Int32 progressSteps, List`1 actions)   at TimeXtender.DataManager.AddODXSecurityRoleWizard_MemberSelectStep.SearchClicked(Object sender, EventArgs e) This setup is a V

23216
rory.smith
TimeXtender Xpert
K
Contributor
KajEmergoContributor
asked in Ingest
Azure data storage table folder has invalid meta data

We are facing a problem with a ODX data lake storage table. The problems are appearing at two points in our Data Warehouse:The ODX transfer tasks gives the warning “Table folder X is used by another table with id Y” When using the ‘Preview’ option from TX interface in ODX storage we get the error “The azure data lake gen2 data storage table folder has invalid meta data. The ODX must transfer the table again”Using ‘Synchronize objects’ on ODX server does not do anything at all. Moreover, executing the table in DSA still works without errors and seems to contain new data. Also, in our Azure storage account we can see the transfer task adds new versions of the table every day (scheduled transfer task) even though it gives us the warning 1).By the way, the table ID that the error on ODX transfer task gives us does not correspond with the TableId that we can see in the _model.json file in the corresponding folder in our Azure storage account. Where should the table ID from the first error p

2777
devin.tiemens
TimeXtender Xpert
rory.smith
TimeXtender Xpert
rory.smithTimeXtender Xpert
asked in Prepare
New version of TimeXtender?

I have just downloaded the ODX Server and TimeXtender and it looks like TimeXtender has a new version: 6534.1 are there release notes coming for this?

641
J
Contributor
P
Explorer
PepijnExplorer
asked in Deliver
Can I connect one semantic model to multiple PowerBI workspaces?

Hi everyone,I’m coming across some specific drawbacks of using the semantic models in TimeXtender in combination with PowerBI. I hope this is due to my lack of understanding or design choices and hoping it can be fixed.While working OT(A)P (DEV / TST / PRD) we have found that looking at the development environment with PowerBI is too much of a hassle, too many changes, wrong data, just too much development to keep up in the semantic models and PowerBI is not flexible when it comes to name changes etc.We decided to delete the semantic models from DEV and start building the model in TST. (For early data exploration we can still build the model in PowerBI itself on the MDW). In PowerBI we use the pipelines and we can connect TST-TST and PRD-PRD. But what would be even better is connect a PowerBI DEV workspace to TST, and the PowerBI TST and PRD workspaces to the PRD endpoint so that we can test the dashboard on production data, give it the green light and there is no risk of any differenc

7284
Christian Hauggaard
Community Manager
avanrijn
Contributor
avanrijnContributor
asked in Deliver
Scheduled package fail for semantic model

Dear Sir,Our customer has an issue for scheduled semanctic models.ODX and DWH instances run succesfully when scheduled, but the semantic models are not running.The semantic model is running successfully by hand, but when the package is automated in a scheduled setting the package execution fails. Execution overview SemanticError semanticHopefully you can shine a light on this issue. Our client is running TimeXtender version 6436.1.Regards,Arthur van RijnFourpoints 

1327
avanrijn
Contributor
anders.e.jonsson
Contributor
anders.e.jonssonContributor
asked in Ingest
Microsoft Dataverse Connection

Hi, I have created and populated a small table in Dataverse using a Power App.There are no problems accessing and reading data from the table with Power BI Desktop.But I don't really understand how to use CData's connector (Microsoft Dataverse (23.0.8749.0) 64bit). Does anyone know which fields to fill in for the authentication itself? Username and password or equivalent. BRAnders

3283
Christian Hauggaard
Community Manager
K
Contributor
KarankadamContributor
asked in Prepare
Fetching information from Tables

As shown in figure, Sales Ord Is My Base Table, and second table is Sales_ORD_LN_PROD_FAM,what i want to do is, Fetch PROD_FAM_NO,SALES_ORD_LN_NO column in to Sales Ord Table,Sales_Ord_No is same column in both Table,Is there any way to do it,

713
Christian Hauggaard
Community Manager
rvgfox
Problem Solver
rvgfoxProblem Solver
asked in Prepare
Using very big tables

I have a very big table with millions of records.I’ve divided it in three mappings : aggregate, historical and current.If I need to do a full load only for the current mapping, what can I do it?

1153
Christian Hauggaard
Community Manager
P
Contributor
pontus.berglundContributor
asked in Ingest
Read latest CSV file (from S3 bucket)

Hi,I have a working connection to an S3 bucket with CSV files, using the CData CSV connector.I would like to create a solution where I read only the latest file added to the bucket.Calling the stored procedure “ListFiles” (https://cdn.cdata.com/help/RVJ/ado/pg_sp-listfiles.htm) in a query table returns a table of the files, with filename and created timestamp.Is it possible to call ListFiles in an .rsd file? If so, I think it would be possible to access the created timestamp in another .rsd file using a query slicer which can be used to get the latest file.Have anyone solved this problem, or something similar? I am using the latest version, 6512.1. 

26710
Christian Hauggaard
Community Manager
rvgfox
Problem Solver
rvgfoxProblem Solver
posted in Deliver
TimeXtender enhancements

I share with you a document and a video to show the problems I have found in TX and suggestions for improvement.In the video I’m showing how to use Tabular Editor to solve the problems. Show my video

450
rvgfox
Problem Solver
K
Contributor
KajEmergoContributor
asked in Ingest
ADF - PostGreSQL 'queryTimeout' error

We are using the Azure Data Factory - PostgreSQL 14.0.0.0 data source connector and cannot run the synchronize task. We have selected ‘All tables’ in the data source setup but get an error in ADF:“Failure happened on 'Source' side. ErrorCode=UserErrorInvalidValueInPayload,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Failed to convert the value in 'queryTimeout' property to 'System.TimeSpan' type. Please make sure the payload structure and value are correct.,Source=Microsoft.DataTransfer.DataContracts,''Type=System.ArgumentException,Message=Object of type 'System.Int64' cannot be converted to type 'System.String'.,Source=mscorlib”The error seems to be related to the ‘Command timeout’ setting in the TX portal, which we set to 1440 but ADF wants it to be a ‘System.TimeSpan’ type?When we want to use ‘Select tables’ on the ODX data source the screen runs ‘Search tables’ for a split second and then the results remain empty, no tables appear at all.The Linked Ser

1032
K
Contributor
Paul McLeod Bespoke Analytics
TimeXtender Xpert
Paul McLeod Bespoke AnalyticsTimeXtender Xpert
asked in Ingest
V20 ODX loosing Meta Data for REST data source

I have a rest interface loading via ODX in V20 into an Azure Data Lake.Recently an infrastructure change to the server made the Rest Endpoint timeout (it has an IP whitelist and the server IP was removed).This resulted in the Synchronization task determining that there were no tables available to load, even though there are multiple custom RSD files that have been generated and the CData Rest driver has been configured to Never generate Schema files. The IP has been restored to the whitelist and the Rest interface is working again (after multiple days of the ODX loading nothing). Unfortunately the Meta Data for every table has been flagged as invalid. When I run the ODX load every table comes back with an error that the table has already been used by a table with a different GUID. And If I run the synchronize task on the ODX it deletes the mapping of every table connected to the particular ODX source (40+ tables).I cannot even run a preview of the data from the Gen 2 storage through Ti

524
Paul McLeod Bespoke Analytics
TimeXtender Xpert

Badge winners

Show all badges
Terms and ConditionsCookie settings