Skip to main content
To homepage To homepage

Recently active topics

58 Topics
rvgfox
Problem Solver
rvgfoxProblem Solver
asked in Jobs & Executions
Dynamic Perspectives by schema

I’ve created a dynamic perspective based on an schema.If I try to create an execution package to execute all the tables in that perspective, it’s not possible.Is it a bug?  

242
G
Community Manager
Dean
Starter
DeanStarter
asked in Interoperability with other Platforms & Tools
SSAS tabular TimeXtender/PowerBI

Hi,I am working with TimeXtender and have an SSAS tabular on-premise on a virtual machine as the endpoint. I want to publish my Power BI dashboard to the Power BI service. However, when I attempt to publish, I receive a message indicating that the connection to the data source is broken. How can I resolve this issue? We do not have Power BI Premium licenses, hence the use of SSAS.Looking forward to your response.Best regards,Dean

203
MartinMemelink
Contributor
Christian Hauggaard
Community Manager
Christian HauggaardCommunity Manager
published in Company Announcements
Support requirements

To be eligible for technical support in TimeXtender, please ensure your version in the five latest versions available for download.For more information on how to upgrade TimeXtender Data Integration, please see this article. For more information on how to upgrade TimeXtender 20.10, please see this article. If required, reach out to your partner, in order to get assistance in upgrading or reach out to support@timextender.com.

91
R
Contributor
A
Visitor
AmrVisitor
asked in Ingest
Invalid column count Excel sheet on storage account

Suddenly all the excel sheets are not loading anymore however some of them no one touched 6 months ago.the error is:Executing table excel_sheet:failed with error:Exception Type: System.ExceptionMessage: Invalid column count             Stack Trace: at DataStorageEngine.DataLakeGen2.DataLakeGen2Transfer.<>c__DisplayClass41_5.<UploadData>b__14(DataTable dataTable, Partition partition)                          at DataStorageEngine.DataLakeGen2.DataLakeGen2Transfer.UploadData(ADLSGen2APIManager api, DataSourceModel dataSourceModel, DataLakeGen2ExecutionMethod executionMethod, Action`2 writeExecutionLog)                          at DataStorageEngine.DataLakeGen2.DataLakeGen2StorageEngine.<>c__DisplayClass35_2.<TransferDataAsync>b__7(DataLakeGen2ExecutionMethod executionMethod)                          at DataSourceEngine.Custom.CustomSourceEngine.InvokeDataSourceExecution(Action`1 action)                          at DataSourceEngine.Custom.CustomSourceEngine.RunExecu

30
A
Visitor
L
Starter
leo.noharetStarter
asked in Prepare
Help with Primary Keys and Incremental Load in Table Inserts

Hi, I am facing an issue with duplicate records when using incremental load on a table that receives data via a table insert from another table in the same data area. The incremental load selection rule is based on DW_TimeStamp, and there are three PK in the target table.The issue is that the primary key does not seem to be enforced in the target table, as I am getting duplicate rows in the table. I tested this with another table where data is inserted through a table insert (but without incremental load), and I still see duplicate values for the PK fields and despite setting the table option to "Use instance setting (error)", no error is thrown when duplicates occur.  I have tested this behavior in TDI 6935.1 and 6926.1, and the issue persists. My questions are:  How do primary keys work with table inserts? Should they prevent duplicates, or do they not function as expected when using table inserts? Can incremental load be achieved using table inserts? If so, what are the necessary

495
rory.smith
TimeXtender Xpert
P
Participant
pkaustubhaParticipant
asked in SAP
SAP HANA and SAP ECC with SQL/Oracle Database Connection with TimeXtender

Hi, Previously, we used SAP HANA (CDATA) connector to connect SAP HANA with TimeXtender. I understand from documentation that we can use Azure Data Factory - SAP Table and TimeXtender SAP Table Data Source for connecting with SAP HANA Data Sources.  My question is withADF- SAP Table, does customer need to have ADF Subscription/Licenses. Also if they want deployment target as SQL Server On Premise. How can we user the same, TimeXtender SAP Table Data Source - Can we use this without Theobald Connector, if yes, how to use this with SQL server On Premise.Let me know the steps and example at the earliest.  

61
rory.smith
TimeXtender Xpert
P
Participant
pkaustubhaParticipant
asked in SAP
SAP Public Cloud - TimeXtender Connection

Hi,I was able to connect with SAP Public and Private Cloud, SAP C4C (SAP CRM),  in the past using SAP Cloud for Customer (CDATA) connector which is no longer supported by TX. Please let me know on priority how we can connect to SAP Public and Private Cloud, C4C and other SAP Cloud Product using TDI.  Please let me know with new options available what connector I need to use and how I can connect above mentioned data sources with TDI. I have a demo with a prospect. Need help on priority. Also share the steps and example, if possible

60
P
Participant
T
Participant
thzmanParticipant
asked in Ingest
SOAP request with encryption

​Hi,I’m sorry for this somewhat lengthy post but I have a problem that I don’t really know how to solve and I’m just looking to see if anyone have run into the same issue, or maybe already solved it.We are going to fetch data from a time management system that have a SOAP API and all the information I find in the community refers to RSD files, that is not to be used anymore. I don’t know how I would solve the problem that I have even with an RSD file, but that’s somewhat beside the point here. 😊The issue is that we must take the request XML, encrypt the whole thing using AES, into a fingerprint that in turn will need to be inserted into the actual request that is then sent to the API.I have received some code in C# that does the following steps:Generates a timestamp and an MD5 hash of the request XML Generates the fingerprint XML using the timestamp and the newly created MD5 hash with the schema like in the attached picture fingerprint_schema Encrypts the fingerprint XML with AES, usi

288
T
Participant
S
Contributor
Syed YousufContributor
published in Configure Resources
Use Snowflake for Prepare instance storageTutorial

Snowflake is a cloud-based data warehouse storage technology with automatic usage-based scaling of compute and storage resources. Additionally, Snowflake offers multi-cloud compatibility, allowing for greater flexibility in data management across different platforms.Released in TimeXtender Data Integration 6143.1 Snowflake Storage is available as part of the Standard, Premium or Enterprise PackageThe following functionality is currently supported when using Snowflake storage when using the TimeXtender Data Integration 6675.1 release or later:Ingest instance using Azure Data Lake Storage with SAS authentication Simple Mode tables Incremental Load Field Transformations Field Validations Conditional Look-ups History tables Supernatural Keys Custom Views Aggregate tables Table inserts Custom table insertsInstructions Create a Snowflake Database Get Snowflake Instance Details Configure Storage for Prepare Instance  Configure SAS token for Ingest ADLS storage Connecting to Tabular, Table

21071
Alexander Khorunzhiy
Starter
B
Contributor
bjornContributor
asked in Ingest
Avoid URL encoding in the Query

Hey, I use the REST connector to consume a CSV file. In my query parameters I got one for auth key. So when I try to load the file a get an error and the reason is that parameter get encoded (% → %25) .  How can I avoid encoding in the query? /Bjørn A.  

150
B
Contributor
R
Explorer
r.miltenburgExplorer
asked in Ingest
Schema already exists error when change data soruce connection

Hi,We've updatet our Data Integration version from 6766.1 to 6963.1. Which means we had to update our outdated providers. So we followed the steps mentioned in this post Change data source provider | Community (timextender.com).This results in an error when we try to full load changed data source. It keeps giving is the error: “The schema …. already exists on the SQL storage and cannot be used” Which actually means we can’t update our providers/ data sources. We have to create new ones en have to map all our tables in de odx. Anyone else facing this problem and have a solution for this?

435
Thomas Lind
Community Manager
Thomas Hjermitslev
Community Manager
Thomas HjermitslevCommunity Manager
Data source providers (Excel) r. 2025-04-24

Today, we’ve released an updated data source provider for Excel. Note: Today’s release contains the TDI version only. 20.10 BU and 20.10 ODX versions will follow.ExcelVersion: 23.2.0.0 (TDI)Added ‘_ResourceURI’ column as an available metadata column. This column is automatically populated with the filename of the Excel file for that row. Added default file types. Changed some file management behavior to avoid locking files. Fixed a bug related to aggregation of files and sheets and infer data types.

330
Thomas Hjermitslev
Community Manager
A
Problem Solver
aftabpProblem Solver
asked in Prepare
Deploy running for over 20 minutes

This is a simple Deploy and its been running for almost 20 minutes.Whats wrong here?  

80
A
Problem Solver
P
Explorer
Pieter-JanExplorer
asked in Legacy & Upgrades
upgrade to 20.10.63

Hi,I'’ m upgrading from 20.10.52 to 20.10.63 and are waiting for a long time (over a hour)  message“please wait while the application is preparing for first use”and after a while a message“installer not reponding “ with a retry or cancel.Is this normal behaviour? 

358
P
Explorer
N
Contributor
nmoContributor
asked in Ingest
REST: replace '' with NULL

I am trying to replace the CDATA Dynamics365 adapter with the TX REST connector (8.0.0) and I am having some issues where empty values from the API is interpreted as empty strings rather than NULL and as a result creates tables with incorrect datatypesHow do i set up a way to replace these empty strings with NULL values and keep the correct data types as wellI have tried with various combination of “Search and replace" on the endpoint as well as the individual nodes in the table builder without any luck.I also have the “Empty fields as null” option enabled.  

183
Thomas Lind
Community Manager
J
Starter
jasperpStarter
asked in REST APIs
Passing a dynamic value as an additional column next to the output of the call it is used in?

I am using a Power BI endpoint (https://learn.microsoft.com/en-us/rest/api/power-bi/datasets/get-refresh-history) where I need datasetIds to get the refreshes of that dataset. I am using the TimeXtender REST data provider, in which I loop over a list of dataset ids using a dynamic value. The problem is that in the output of the Get Refresh History endpoint the dataset Id is not included.Therefore, my question is: Is it possible to pass a dynamic value used in a call as an additional column next to the output of the call? I don't see any option for this in the portal. If I were to extract the data using Power BI, I would do the call for every row in a table containing the required dataset Ids and expand the resulting column. This way, the original table column containing the dataset Ids will always be related to the dataset refreshes. Can I do the same using TimeXtender?

664
M
Starter
avanrijn
Contributor
avanrijnContributor
asked in Prepare
Direct Read option latest TX version

Dear Sir,In TX version 20 you had a configuration setting Direct Read.I cannot find this setting in the latest and the greatest version in TimeXtender.Question: Is Direct Read still available ? How can I set this up ?Thanx in advance for looking into this. The "Direct Read" option in TimeXtender is particularly useful in scenarios where you need to transfer data between different data areas within the same physical database but using different schemas. Here are some specific scenarios where you might use the Direct Read option:  Large Data Volumes:  When dealing with large tables, Direct Read can be more efficient as it allows for direct data transfer within the same database, reducing the overhead associated with external data movement tools like SSIS or ADO.NET.  Incremental Loads:  Direct Read is beneficial for incremental loads where only a subset of data needs to be transferred based on specific criteria (e.g., timestamp or modified date). This can help in optimizing performanc

272
Christian Hauggaard
Community Manager
M
Participant
MMMParticipant
asked in Ingest
Snowflake Ingest instance functionality

Hi! We are currently setting up TimeXtender with Snowflake and have a bit of an issue when it comes TimeXtender not having the capability of managing the ODX in Snowflake (internal stage).  As you know an external stage is needed via Azure Data Lake Gen2.  The issue for us is that we would like to use private endpoint when creating this data lake in Azure but that requires business critical subscription to Snowflake which is 30 percent more expensive.   Are there any plans/timeline for when TimeXtender will be capable of handling the Ingest instance in Snowflake and if so could you please give a rough estimate on when that might be available?  We need to make some decisions on our end on how to proceed and would like to know the answer before we move forward.

93
rory.smith
TimeXtender Xpert
Christian Hauggaard
Community Manager
Christian HauggaardCommunity Manager
published in TimeXtender Data Quality
Scheduling Objects (Tutorial)

Schedule Groups are used to schedule automatic executions of objects.This tutorial covers the following topics:Creating Schedule Groups Schedule Triggers One Time Trigger Repeat Every Trigger Daily Trigger Weekly Trigger Monthly Trigger Custom Trigger Adding objects to the schedule Adding objects to schedule through the property grid Schedule OverviewCreating Schedule GroupsTo create a new Schedule Group:Right-click Orchestration > Schedule Groups Choose New > Schedule Group. An empty Schedule Group has three main areas:Objects currently in the schedule Schedule Trigger Objects available for schedule.Schedule TriggersA schedule trigger is a rule that determines when the Schedule Group will execute. For example, it could execute every 5 minutes between 9 am and 17 pm, or it could execute on the first Sunday every month at 9 am.When a schedule trigger executes, it executes all included objects at the same time on the environment (Development, Test, Production) defined in Execute on

2137
rvgfox
Problem Solver
B
Explorer
Boglarka BaranyExplorer
asked in REST APIs
API Rest Pagination for Freshdesk

Hi, is there anyone who managed to get the Freshdesk pagination working? I tried different ways but it is not working for me. Let me just describe what I did so far.trying with using Query Parameters and {TX_NextPage}, I tried using that since the freshdesk url is very easy to adjust with the page number, so I added this:My URL is:Pagination should look something like this https://[domain].freshdesk.com/api/v2/tickets?page=[number]So, I added in the connection settings first the pagination rule which looks like this:and I added the endpoint later for tickets.This didn’t work, so I tried the same but adding it in the endpoint with Override pagination rules, unfortunately that didn’t work either. Any other parameters, such as pagesize, or include-stats works, perfectly fine, but the pagination simply doesn’t. So after trying this two, I tried another way. Trying using the header link from response. The query response posts the next page link in the headers, so I tried utilizing that setu

5711
Thomas Lind
Community Manager
Thomas Hjermitslev
Community Manager
Thomas HjermitslevCommunity Manager
published in Documentation and Lineage
Access instance metadata with meta collection

For reporting and troubleshooting purposes, taking a deep dive into the logs and other metadata in your instances can be useful. With the meta collection feature, you can access TimeXtender metadata in TimeXtender Data Integration.To not put unnecessary load on the underlying databases, metadata is exported to a data lake once every 24 hours. From the data lake, you can copy the data to your own Ingest instance through a standard TimeXtender data source connection. Each load to the data lake overwrites yesterday’s files, so setting up incremental load to your own Ingest instance will usually be the way to go. Enabling metadata collection for selected instancesFollow the steps below to select the instances you want to collect metadata from.In the menu, go to Data Estate > Meta collection On the Meta collection page, click Add metadata collection In the Add meta collection instances modal, select the instances you want to export metadata from under Instances. (Optional) Add a Comme

914
Thomas Lind
Community Manager
Thomas Hjermitslev
Community Manager
Thomas HjermitslevCommunity Manager
published in Data Sources
Change data source provider

You can change the data source provider of a data source connection if, for example, the provider is outdated or stopped working, or a better provider has become available.To be safe, the change provider feature will not change the provider of an existing data source connection. Instead, a copy of the data source connection will be created that uses the new provider, leaving the old connection using the old provider in place. Changing the data source provider of a data source connection.In the TDI Portal, navigate to the Data source connections page or the details page of the data source connection you want to change the provider for. Click the ⋮ context menu on the data source connection you would like to change provider for then click Change connection provider. On the Change provider for [connection] page, select the new provider. As you select the provider, the form will be updated the match the form used by the provider you selected and filled with the values from data source con

1392
Thomas Lind
Community Manager
MartinMemelink
Contributor
MartinMemelinkContributor
posted in REST APIs
REST data source multiple XSLT tables performance test

The TimeXtender REST Data Source has the ability to add an API endpoint with table flattening in multiple ways: either adding the endpoint once with multple tables or adding the same endpoint multiple times. I've done some tests to find out which is fastest.The test was done on an API with an unstructured JSON data source, with root nodes on multiple levels where the XSLT Table Builder can iterate over. This means I needed to add 4 flattened tables on the same endpoint, each with different root nodes. Version numbers were REST provider version 9.0, TDI 6935.1, with Ingest running on and Azure VM and storage on ADLS Gen 2.Two ways of setting up the same endpoint with four tablesMy hypothisis was that 1x endpoint with 4x tables would be quicker than 4x endpoints with easch 1x table, because TimeXtender would call the API once and the multiple XSLT tansformations can happen on the same result data, rather than the API being called multiple times which would add unnecessary tansfer of data

101
Thomas Lind
Community Manager
Christian Hauggaard
Community Manager
Christian HauggaardCommunity Manager
published in Deliver
Power BI Premium EndpointTutorial

Released in TimeXtender Data Integration 6024.1This article describes how to deploy and execute the Deliver instance to the Power BI Premium XMLA Read/Write Endpoint.Configure Power BI Add Power BI Premium Deliver Instance Endpoint Deploying the endpoint in TimeXtender Data Integration Configure the Power BI Data Source Credential (Optional) Authenticate using a Service Principal  Create an App Registration in Azure Allow service principals to use Power BI APIs Give your App Registration Admin Access Update Credentials in Deliver instance Configure Power BILogin to app.powerbi.com Select the workspace where the Deliver instance will be deployed to: Go to Workspace Settings Click the Premium tab Select the Premium per user or Premium per capcity License mode (this requires a Premium license) Copy the workspace connection.    Go to the admin portal Under, Premium Per User / Dataset workload settings, Set XMLA to "Read Write". Note: If you are using Fabric Capacity to host your

28925
rory.smith
TimeXtender Xpert
K
Contributor
KajEmergoContributor
asked in General
Orchestration 'Retry on Failure' setting

In TimeXtender Orchestration, you have the option to set ‘Retry on Failure’ equal to True on a package (e.g. a TimeXtender Ingest package). What does this setting do? It will probably retry the package in a process if it fails? But can you set how many retries should be carried out if it keeps on failing? Also, the ‘Retry in (seconds)’ setting is probably the amount of time Orchestration waits before it starts the retry? I have searched the Community but I cannot find any proper documentation about this, or am I missing out on some article?  

132
K
Contributor

Badge winners

  • Innovator
    oscarclevehas earned the badge Innovator
  • Certified Solutions Architect
    leo.noharethas earned the badge Certified Solutions Architect
  • Innovator
    Bernarddbhas earned the badge Innovator
  • Certified Solutions Architect
    JeroenStahas earned the badge Certified Solutions Architect
  • Ingest Expert
    nmohas earned the badge Ingest Expert
Show all badges
Terms and ConditionsCookie settings