Skip to main content
To homepage To homepage

TimeXtender Desktop Q&A

Ask questions and find answers about TimeXtender Data Integration and TimeXtender Classic desktop applications

728 Topics
K
Contributor
KajEmergoContributor
asked in Ingest
Sharepoint data source 'Authorize OAuth' not working

When configuring the CData Microsoft Sharepoint (23.0.8669) provider for extracting a Sharepoint List, we encounter a problem with the button ‘Authorize OAuth’. We are configuring the data source in ODX Server 20.10.40 and TX version is also 20.10.40.The following settings are configured:According to the CData documentation AzureAD should be used as Auth Scheme to leverage OAuth to authenticate, we also use this exact same setting and the same app registration for another data source using the Excel Online provider for which all is ok.However, when using ‘Authorize OAuth’ with the Sharepoint provided, we get the following error:What could be causing this? Changing the file or location for OAuth does not matter at all, we have also tried other versions of the provider but they all give this error. Also, changing Initiate OAuth to ‘REFRESH’ does not have an effect.

1063
Christian Hauggaard
Community Manager
E
Contributor
ebayContributor
asked in Prepare
Is it possible to extract created date for a CSV file?

HelloI need the creation date and time (createdAt) of a CSV file within the MDW table as a column. How can I access this information?Best Regards

3109
Christian Hauggaard
Community Manager
K
Contributor
KajEmergoContributor
asked in Ingest
Using open source API with download link

In order to retrieve meteorological data from The Netherlands, we want to use the Open Data API developed by the Dutch Meteorological Institute (KNMI). This website contains all relevant information on using the API.In summary, these are the steps that we want to undertake. Anyone can do this, because of the anonymous API key that is open to public:Locate the ‘Anonymous API key’, can be found on the KNMI documentation website Determine the dataset name, version and filename to establish the correct endpoint In this example we want to use the following endpoint: https://api.dataplatform.knmi.nl/open-data/v1/datasets/etmaalgegevensKNMIstations/versions/1/files/KIS___OPER_P___OBS_____L2.nc/url Execute the GET call (make sure to use Authorization header in combination with the anonymous API key The GET call returns a download URL pointing to the KNMI Amazone AWS storage which can be easily used in Postman to retrieve the data (in x-netcdf format)Would you like to try the above in Postman a

2048
K
Contributor
sierd.zuiderveld
Contributor
sierd.zuiderveldContributor
asked in Ingest
Best Azure VM size for ODX

Our ODX is hosted on a separate VM in Azure. We followed the suggestion to use the size DS2_v2, but we encountered frequent “System Out of Memory exception was thrown” errors that caused the ODX to stop. We are planning to switch to E2_ads_v5, which has twice the memory, but I am curious if anyone else has faced this issue and has any advice.

1223
M
Starter
christian.koeken
Contributor
christian.koekenContributor
asked in Deliver
The stream does not have an active operation

Dear Support,My customer is having some troubles with executing a tabular semantic model. This customer has three semantic models, Finance, Sales and Logistics. Finance and Sales are running fine, but Logistics sometimes give the error "The stream does not have an active operation!”.I solve this issue by doing a Full process on the model in SQL Management Studio. But what I want to know is what causes this error? As I said Finance and Sales are running fine, but Logistics gives this error now and then.See the file in the attachment for the error. TimeXtender version: 6346.1 

2665
Christian Hauggaard
Community Manager
R
Participant
r.miltenburgParticipant
asked in Prepare
Issue with running scheduled jobs

We have created several jobs on our ODX and several jobs on our DataWarehouse. The ODX jobs are running correctly based on schedule, but the Datawarehouse jobs never run since there is a schedule.We've also deployed and saved our project, so that should not be the problem. 

884
Christian Hauggaard
Community Manager
V
Participant
VictorParticipant
asked in Jobs & Executions
Data volume per load

Hello,Is there any posibility to know how much data was loaded through the data warehouse during a scheduled execution package? Either through TX repository, logs or through system files in the azure database?Let’s say my customer has a databasewith 500gb worth of data, but we load only certain tables (some full, some incremental) and would like to know how much data we push every scheduled load.Thank you,Victor

1254
V
Participant
rvgfox
Problem Solver
rvgfoxProblem Solver
asked in Deliver
Deploy and Execute SSL models in Tabular and/or PowerBi Premium

When designing a model, in TX we have to options:Deploy. It deploy all the model to the server without data Execute. Reads the data from the DW and fills the model in the server.After we have the model in the server, we can use external tools like Tabular Editor or Power Bi in the service to add custom measures that it’s not possible in TX, for example calculation groups (see video from @fwagner :Until here, all ok. The problem appears wen you Execute the model again from TX that deletes all the external changes.In think that it’s an issue.

1958
anders.e.jonsson
Contributor
Pontus Olausson
Contributor
Pontus OlaussonContributor
asked in Jobs & Executions
Excel Online connector sometimes fail with "Error while listing workbooks for drive"

 Hi,I am running a legacy version of TimeXtender (version 20.10.40.64), where we have an Excel Online connection set up using CData ADO.NET Provider for Microsoft Excel Online 2022 (22.0.8389.0) as data source.This data source is configured to authenticate via Azure ‘client flow’, see picture. The app registration in Azure has the following permissions:  The data source works properly most of the time. It is able to list the worksheets it finds on the SharePoint site, and can fetch data. However, scheduled execution packages sometimes fails with the following error message:[500] Could not execute the specified command: Error while listing workbooks for drive: [generalException] General exception while processing. Details: Error while listing workbooks for drive: [generalException] General exception while processing. Module: System.Data.CData.ExcelOnline fx220l.yg at fx220l.IIu.m(Boolean ) at fx220l.IIu.X(tbp`1 , Boolean ) at fx220l.IIu.YI(LoL )

2317
andrew.gebhard
TimeXtender Xpert
S
Contributor
Søren SørensenContributor
asked in Ingest
varchar(max) fields not coming through in ADLS Gen2

I have a table with a varchar(max) field (stored in Dedicated Pool, which is a data source). and it won’t come through to ADLS Gen2 (ODX, version 6284.1). I’m using the Azure Synapse provider.The longest field contains almost 4 million characters, but I’ve been unable to figure out whether this is a limitation in TX or Azure. Does anyone know?

1365
Christian Hauggaard
Community Manager
T
Participant
thzmanParticipant
asked in Prepare
SCD does not update correctly

Hi!I beg your pardon for this somewhat lengthy post, but I try to be thorough to avoid confusion. :)I have a problem with updating an SCD.We are moving an old adress history table from another system into a SCD in TX. It has gone well so far since the old system made one insert per person per day regardless of whether there was an update or not, which has made us go from about 108M rows to about 275k rows with actual changes. So far so good. :)The problem now is that have a hard time to get this moved table to update correctly from a new source. The setup looks like this at the moment: The MDW table KIR_Persons is the correct and prepared historical data from the old system where I have fixed the From- and To-dates along with the “Is Current” flag. The “break date” for the data from the old system is 2023-10-16 which is when I made the final export.The new source for the address data is the DSA table KI0VAA0POPULATIONPERSON_QT which is the result of a query table. I’m using the DSA vie

1365
T
Participant
E
Contributor
ebayContributor
asked in Prepare
Relation Diagram of project

HiIn one of my projects, I created a model by transferring the table I received from DSA to MDW using view. When I wanted to create the relation diagram of this model, I saw that it could not establish a connection with the view and DSA table. How do I ensure the connection of all tables at the end of the project? There is no problem with Data Linage.Best Regards

1126
daniel
TimeXtender Xpert
B
Starter
BisotaStarter
asked in Prepare
TimeXtender Training unable to add data warehouse

Hello to the community 😀 Currently I started the TimeXtender Training. I am at the point where I have to create the instances. Adding the ODX or SSL instance was no problem. But adding the MDW instance didn’t work out for me. The problem is that i can’t select any storage in the “Server storage type” field. It just says “No items found”. (While adding the ODX instance it preselects “Azure Data Lake” and I can just switch to SQL database”, but while adding the MDW instance it doesn’t give me these options) Does this problem occur to anyone else? Do I maybe have to change any configuration before the “add data warehouse step”? Thank you in advance. Kind regards,Tobias  

463
Thomas Lind
Community Manager
rvgfox
Problem Solver
rvgfoxProblem Solver
asked in Deliver
Measure references should not be qualified with the table name

When we create a custom measure:TX qualifies the measure with the table name and this it’s not a good practice. It it’s the oposite that I comented in: FYI: @fwagner 

1361
fwagner
Employee
L
Starter
lukas.gStarter
asked in Ingest
Cannot find files in Excel Online (Sharepoint with Delegated Permission)

We use Sharepoint for multiple data sources. Connecting the Sharepoint Lists works fine and I have a OAuth for Excel Online running as well, but my data source throws an error: Cannot find file.  I need to handle multiple files according to this documentation:https://support.timextender.com/data%2Dsources%2D112/connect%2Dto%2Dexcel%2Dfiles%2Dwith%2Dexcel%2Donline%2D628 What’s the reason for this?  My App Permissions are set accordingly: My Setup looks like this:  

2329
Christian Hauggaard
Community Manager
K
Contributor
KajEmergoContributor
asked in Prepare
Mapping set not working on renamed columns

Hi,In my DSA layer I succesfully added a mapping set for which the include rule has identifed two tables. All of the columns in my DSA table have been renamed so none of them align with the original names in the ODX. As a result, the mapping set tells me all of the columns are missing: This specific table was first added to the DSA for a single ODX table, then the columns got renamed and at a later moment I wanted to replace the mapping to a mapping set. Should the mapping set be able to cope with this? In essence, it would be just like doing it manually and using the ‘smart synchronize’ option. But the mapping set does not seem to work like that.Best regards,Kaj

836
K
Contributor
Z
Visitor
ZuzaGlogVisitor
asked in Prepare
Regular Expressions (Regex) in TimeXtender

Hello community, Is it possible to do RegEx with TimeXtender? Or use Python code somewhere in TX that supports the library re? Our business case:-  We have a database with text reviews of varying lengths, where personal information is sometimes available. We want to read the database in and anonimise the values which contain personally identifiable information. For example: "oh no, ZuzaGlog doesn't know how TimeXtender works” and we want to make it "oh no, XXXXXX doesn't know how TimeXtender works”. We currently do it in Python with the library re, and a list of possible personally identifiable information. We search through the strings with reviews using the keywords from the list, and replace hits with XXXXXX. Now we want to build this solution in TimeXtender. In what way would this be possible?

822
Thomas Lind
Community Manager
K
Visitor
kgoddardVisitor
asked in Prepare
Onetime MDW historical table map

Our client has a question about a historical table in TimeXtender. They would like to know if they can make a onetime update from SSMS to populate historical records. More details on the scenario below.Scenario:Table in question is in MDW An ID merge has been done to collapse users that have created multiple accounts into on true account. Logic is done in DSA and flows to MDW. The new merged id was inserted as a new field in the MDW table, the old id was renamed. New merged id field is null for historical records where old id is populated. This makes historical queries fail.Question: Can they run a one time stored procedure in SSMS to fill in the historical records to the new merged id field? What are the potential drawbacks of this solution?

994
Thomas Lind
Community Manager
andrew.gebhard
TimeXtender Xpert
andrew.gebhardTimeXtender Xpert
asked in Ingest
Nested API Call with case / if statement in RSD file

Hi community, I am trying to work with the LinkedIn API to retrieve details about UGC posts (i.e. engagements, clicks, etc.). This information is not part of the LinkedIn Marketing Solutions CDATA connector, so I am using the CDATA provider for REST 2022. I first made a call to the posts API to ‘Find Posts by Account’: Posts API - LinkedIn | Microsoft Learn. After that I need to pass each Post ID into the Organizational Entity Share Statistics API to ‘Retrieve Statistics for Specific UGC Posts’: Organization Share Statistics - LinkedIn | Microsoft Learn. The problem I am facing is that the Posts API returns two types of posts (which cannot be filtered in the API): shares and UcgPosts. Each of those types of posts needs a different URL format in the ‘Organizational Share Statistics’ API. So, I need a way to only pass one type of post into the second API. UCG posts are posts where the ID starts with 'urn:li:ugcPost:'The file RSD 1.txt works, until the first ID from the Posts API is a Ucg

1734
Christian Hauggaard
Community Manager
Stefán Gunnar Jóhannsson
TimeXtender Xpert
Stefán Gunnar JóhannssonTimeXtender Xpert
asked in Prepare
Not supported SQL server version

I’m testing out the new version of TimeXtender. I’ve downloaded the newest version of SQL Server that was suggested in the training material. I’ve created ODX and MDW instance, when I try to deploy a table in the MDW instance I get the following error: Not supported in current SQL version Version:Microsoft SQL Server 2022 (RTM) - 16.0.1000.6 (X64)   Oct  8 2022 05:58:25   Copyright (C) 2022 Microsoft Corporation  Developer Edition (64-bit) on Windows 10 Enterprise 10.0 <X64> (Build 22621: ) (Hypervisor) 

3598
rory.smith
TimeXtender Xpert
erik.van.mastrigt
TimeXtender Xpert
erik.van.mastrigtTimeXtender Xpert
asked in Ingest
SAP Table Data Source in ODX Server v21 - table filtering doesn't work properly

I’m struggling with the TimeXtender SAP Table Data Source version 18 in ODX Server v6429.1. In our current setup we use Table Name filtering like this: Please see the wildcards used. How does this translate to ODX Server v21? I have these three rules: The latter does not seem to work. I tried many variations (and did a sync data source consecutively), but when I click Select Tables under a transfer task, it only comes up with the tables matchin an equal-rule. Tables that should match a like-rule never show up: Using equal and wildcards doesn’t work either Any advice on how I should filter tables properly?

513
bas.hopstaken
TimeXtender Xpert
P
Contributor
pontus.berglundContributor
asked in Prepare
Conditional lookup fields (in preview) for deployment in Snowflake

In the release notes for 6429.1 it says that conditional lookup fields are available “in preview” for deployments in Snowflake. What does this mean?

431
Christian Hauggaard
Community Manager
erik.van.mastrigt
TimeXtender Xpert
erik.van.mastrigtTimeXtender Xpert
asked in Ingest
ODX Server and unicode data source fields

Hi community,I have a MariaDB data source which I connect to using ODX Server (v 6346) and the CData/ADO.net connector for MariaDB v 23.0.8565.0.The source database is set to collation utf8mb4_general_ci. I noticed by copying from ODX Server to a Data Area that some special characters are slightly different than the source/ODX. I can fix this by manually changing the data type to nvarchar instead of varchar, but that is a lot of field editing.The Override Data Type function can help as well, but as we have a wide range of field lengths, this also means a lot of override rules.Is there a way to tell ODX Server that all varchar fields should be unicode/nvarchar by default (eg. based on the source database collation)?Example from ODX Server. These fields should all be nvarchar(xx) instead of varchar(xx): Implementing this idea would work for me as well :) In TX v20 Business Units, we had this option: 

1196
erik.van.mastrigt
TimeXtender Xpert
P
Contributor
pontus.berglundContributor
asked in Prepare
Mapping set not working with custom fields

Hi,I want to use mapping set to map several ODX tables with the same table structure to a single DW table.The problem is that I also want to create additional “custom fields” in the DW table, and since these fields do not exist in any of the ODX tables, the mapping set excludes all the ODX tables and I am left with an empty DW table. Is there a work around to this? or am I perhaps doing something wrong?This is my DW table: The bolded fields with descriptions do not have mappings to them, they instead have custom transformations.I have used “convert to mapping set” to get the mapping set, and then adjusted it so both tables match the mapping set rules.As seen below, both tables are then excluded since neither have the custom fields. Is it necessary that all fields have at least one mapping to them?

624
P
Contributor
anders.e.jonsson
Contributor
anders.e.jonssonContributor
asked in Ingest
Error when creating ODX Notification on Critical Errors

Hi,We are unable to set up Notification on Critical Errors for the ODX Server. Both service and database for the ODX is on prem. The Exchange Server is deployed as a hybrid. TimeXtender version 6221.1This is the error message:  Setting up notification for the executions in the MDW’s and SSL’s is no problem. No authentication is required by the Exchange server.BRAnders

14216
anders.e.jonsson
Contributor

Badge winners

  • Certified Solutions Architect
    hay71has earned the badge Certified Solutions Architect
  • Certified Solutions Architect
    Himanshu Chhas earned the badge Certified Solutions Architect
  • Innovator
    oscarclevehas earned the badge Innovator
  • Certified Solutions Architect
    leo.noharethas earned the badge Certified Solutions Architect
  • Innovator
    Bernarddbhas earned the badge Innovator
Show all badges
Terms and ConditionsCookie settings