TimeXtender Community

Recent activity
Help others
Categories

Sourcing dashboard with (near) realtime data from TimeXtender

Hi!I am currently investigating something for a customer of ours. They just switched their Telephony system to Teams Telephone and want to use a dashboard in Power BI to show the current queue of callers. The data can be extracted from Teams Telephone by MS Graph API. This customer has a TimeXtender environment in production, so adding a new datasource (TimeXtender REST connection to the MS Graph API) will not be the hardest part.But, they want the dashboard to show (near) real-time data. Is it possible for TimeXtender to take in data, prepare it for the report and refresh the semantic layer within seconds and then start again?I am aware MS have created a plugin for Teams to show these numbers in a dashboard of their own in the application, but our customer would like to know if it is possible to create this in Power BI using TimeXtender. Kind regards, Richard

202

8 hours ago

Thomas LindCommunity Manager

Data Sources

Use OAuth 2.0 client authentication to connect to Graph API with the TimeXtender REST data sourceTutorial

It is possible to use OAuth 2.0 as the authentication method for the TimeXtender REST data source. One API that uses this is the Graph API.ContentContent Prerequisites Application setup Access Token URL Scope Initial setup Set up OAuth Authentication Main Endpoints Users Groups Teams Set up pagination Dynamic endpoints Users messages Team members PrerequisitesUsing the postman collection explained in this guide Use Postman is a good start as the method is pretty much similar. What we will do is the application method aka Client Authentication.Application setupAs mentioned above you need to use Application rights for client authentication, so the app you want to use for this must have the correct rights. The Delegated rights are easier to set as they mainly do not require Admin consent, that is not the case for most Application rights, so get these rights authenticated before starting.I got one app where I got all the application rights addedIf you want access to groups an

7379

10 hours ago

Boglarka BaranyParticipant

REST APIs

API Rest Pagination for Freshdesk

Hi, is there anyone who managed to get the Freshdesk pagination working? I tried different ways but it is not working for me. Let me just describe what I did so far.trying with using Query Parameters and {TX_NextPage}, I tried using that since the freshdesk url is very easy to adjust with the page number, so I added this:My URL is:Pagination should look something like this https://[domain].freshdesk.com/api/v2/tickets?page=[number]So, I added in the connection settings first the pagination rule which looks like this:and I added the endpoint later for tickets.This didn’t work, so I tried the same but adding it in the endpoint with Override pagination rules, unfortunately that didn’t work either. Any other parameters, such as pagesize, or include-stats works, perfectly fine, but the pagination simply doesn’t. So after trying this two, I tried another way. Trying using the header link from response. The query response posts the next page link in the headers, so I tried utilizing that setu

12014

13 hours ago

Brede FjaeraVisitor

Interoperability with other Platforms & Tools

Unable to create Microsoft Fabric Storage

Hi, I am trying to set up a new Ingest Instance with Microsoft Fabric Storage. I am following Christian Hauggaard’s guide for Integrating TimeXtender Data Integration with Microsoft Fabric, but i am stuck on step 2. Create Storage for Ingest Instance. (Link: Fabric Lakehouse Ingest Instance storage (Public Preview) | Community)The guide describes using a non-MFA user when authenticating, but i am stuck using my Azure AD user with MFA enabled. When i try to create storage in TimeXtender Data Integration i get the attached error message, and when i check the sign-in logs for my app registration in Azure there is an ‘interrupted’ sign-in attempt with error code 50076 (User needs to perform multi-factor authentication). Error message detailsIs there any way to resolve this issue with the current MFA-requirement on my user?

111

1 day ago

AmrExplorer

Ingest

Invalid column count Excel sheet on storage account

Suddenly all the excel sheets are not loading anymore however some of them no one touched 6 months ago.the error is:Executing table excel_sheet:failed with error:Exception Type: System.ExceptionMessage: Invalid column count Stack Trace: at DataStorageEngine.DataLakeGen2.DataLakeGen2Transfer.<>c__DisplayClass41_5.<UploadData>b__14(DataTable dataTable, Partition partition) at DataStorageEngine.DataLakeGen2.DataLakeGen2Transfer.UploadData(ADLSGen2APIManager api, DataSourceModel dataSourceModel, DataLakeGen2ExecutionMethod executionMethod, Action`2 writeExecutionLog) at DataStorageEngine.DataLakeGen2.DataLakeGen2StorageEngine.<>c__DisplayClass35_2.<TransferDataAsync>b__7(DataLakeGen2ExecutionMethod executionMethod) at DataSourceEngine.Custom.CustomSourceEngine.InvokeDataSourceExecution(Action`1 action) at DataSourceEngine.Custom.CustomSourceEngine.RunExecu

8010

1 day ago

Thomas HjermitslevCommunity Manager

Data Sources

Import/export connection profiles for data source connections

You can import and export data source connections to use in different accounts, save for later, or share with coworkers. Two import/export formats are supported:Connection profile (recommended): JSON-format that includes extensive information about the data source provider and settings Connection string: SQL-like format used by the ODX in TimeXtender 20.10 than contains less information. This format is not supported for all data source providers since it cannot represent all configurations.No matter the format, the value of password fields, and other sensitive fields, will always be excluded from the export. Exporting a data source connectionTo export a connection, follow the steps below.In the TDI Portal, navigate to the Data source connections page or the details page of the data source connection you want to export. Click the ⋮ context menu on the data source connection you would like to export. Click Export connection profile or Export connection string depending on the format yo

RLBProblem Solver

Hi,I'm having some issues with renaming a table. There's a an incremental table in my MDW, containing 60 million rows. I'm trying to rename the table whilst keeping all data.I've tried several combinations (deploy, deploy & execute, deploy with differential deployment unchecked, etc.). But it keeps throwing the same error during the "Deploy Direct Read Transfer" stage of the deployment. In SSMS I can see that the table was in fact renamed correctly.The error is:fact_example to fact_example_oldInvalid object name 'mdw.fact_example'.Yes, I know that's an invalid object name because you've just renamed that table...At some stage I actually managed to lose all data which is quite unfortunate.There are a few supernatural key fields, there is a clustered columnstore index, no (custom) table inserts, no relations.Any ideas what could be causing this? I've got no idea where to look.Version is 20.10.66.

141

4 days ago

rbrandsmaStarter

General

Datatypes not correctly set after adding datasource

Hi!A customer I am working for recently did an upgrade to TX Classic 20.10.66.64.After switching all data sources from ODX to Business Units not all datatypes are set correctly in TimeXtender. Especially the columns containing the datatype “time(7)”. When you check the fields in the new datasource the datatype for that field is shown as unknown, while sql recognizes the source as a “time(7)” field. We were able to resolve this with the overrule datatype option, but would like to have it investigated to check if this is desirable. TimeXtender: SSMS: Datasource: Any Source ADO.netDataprovider: SQLClient Data Provider (.Net Framework data provider)

424

4 days ago

rbrandsmaStarter

General

Error message when starting the TimeXtender services

Hi Just installed TX 20.10.66.64 on a new server for a customer and connected to the server where the txrepository is kept, all without any problems. Now I need to setup the Prod environment and therefore start the service I created for that, but this keeps showing an error message: From the application log of the server:

291

5 days ago

avanrijnContributor

Ingest

ODX TimeXtender Parquet Data Source connector (23.1.1.0 64bit)

Dear Sir,Our client is running TimeXtender 6963.1.So want a rowcount, count(*) on our tables loaded in de ODX.Our ODX is configured with ADSL (Azure Datalake Gen2 Storage).So we want to use the ODX TimeXtender Parquet Data Source connector (23.1.1.0 64bit).Is it possible to run a count(*) query to our tables when we setup this connection to our ADSL?We need to know how many records are loaded in all of our tables.We have a lot of incremental tables, so we worry of all the increment files in the lake. Do we need to configure some sort of a aggregation ?Is there documentation available how to configure this ? The connector has a lot of options, we don’t know all the details.Hope somebody has some experience with this Parquet connector.Thank you in advance for looking into this.Regards,Arthur

391

5 days ago

AmrExplorer

Ingest

Invalid column count Excel sheet on storage account

8010

1 day ago

r.miltenburgParticipant

Ingest

Schema already exists error when change data soruce connection

Hi,We've updatet our Data Integration version from 6766.1 to 6963.1. Which means we had to update our outdated providers. So we followed the steps mentioned in this post Change data source provider | Community (timextender.com).This results in an error when we try to full load changed data source. It keeps giving is the error: “The schema …. already exists on the SQL storage and cannot be used” Which actually means we can’t update our providers/ data sources. We have to create new ones en have to map all our tables in de odx. Anyone else facing this problem and have a solution for this?

1068

6 days ago

juriaan.hensbroekContributor

REST APIs

TX Rest Dynamic value Endpoint query

I'm using dynamic values function in the TX REST connector 9.1.0.0. I use id's from another endpoint to loop through in my second endpoint path. This works well when I use “From Endpoint Table” but now I want to add a filter to only get the id's with a flag “hasresponse=true”.I've read the page but I still get an error with my Endpoint query. “No such table” the error message says. I've tried several things like adding a schema. But all with the same response. Is there something wrong with my syntax?Error:

11911

7 days ago

peter.jensenTimeXtender Xpert

SAP

SAP datasphere connection

Hi,what is the best (performing) way to extract data from SAP datasphere?I read about an API connection (OData), but is this the ‘optimal’ way to do this ?https://community.sap.com/t5/technology-q-a/how-to-export-data-from-sap-datasphere-or-its-database-sap-hana-cloud-to/qaq-p/13708728https://help.sap.com/docs/SAP_DATASPHERE/43509d67b8b84e66a30851e832f66911/7a453609c8694b029493e7d87e0de60a.htmlBest Regards,Peter

210

1 month ago

aftabpProblem Solver

Ingest

Nested RSD file for XML

This is a follow-up of Using XML to ingest data, that i have managed to solve.I need some help with creating a nested statement. The first rsd which lists out all the IDs is this:<api:script xmlns:api="http://apiscript.com/ns?v1" xmlns:xs="http://www.w3.org/2001/XMLSchema">  <api:info title="contract" desc="Generated schema file." xmlns:other="http://apiscript.com/ns?v1"> <attr name="contractid" xs:type="string" readonly="false" other:xPath="/Envelope/Body/contracts/contract@contractid" /> <attr name="description" xs:type="string" readonly="false" other:xPath="/Envelope/Body/contracts/contract@description" /> </api:info> <api:set attr="DataModel" value="RELATIONAL" /> <api:set attr="URI" value="https://my.soap.endpoint/service.asmx?WSDL" /> <api:set attr="PushAttributes" value="true" /> <api:s

1138

4 months ago

annfossParticipant

Ingest

TimeXtender CSV Data Source - PathNotFound (aggregation pattern)

Hi,We are trying to connect to several CSV files stored in a local folder. While we can successfully synchronize the data source and perform a full load in the ODX, we encounter an error when attempting to add the table to our data area (DSA).The issue lies in the path to the Parquet file stored in Azure. The correct path should be:CSV_DNB/csv_*/DATA_2024_11_28__11_09_50_2219585/DATA/DATA_0000.parquet However, the path Timextender is looking for is:CSV_DNB/csv_^*/DATA_2024_11_28__11_09_50_2219585/DATA/DATA_0000.parquet It seems that Timextender is misinterpreting the automatically generated name and adds a ^ character.I also attempted to use a specific file aggregation pattern, such as;H100.*.csv(all files in folder have the prefix H100 followed by a random number). However, I encountered the same error. Is there a way to specify the name of the table generated in the ODX? It seems like the “File aggregation pattern” is the issue. Do you have any idea how to fix this? -Execute Executi

1277

5 months ago

TimeXtender Desktop Q&A

Ask questions and find answers about TimeXtender Data Integration and TimeXtender Classic desktop applications

Ingest

290 topics

Prepare

229 topics

Deliver

71 topics

Jobs & Executions

132 topics

TimeXtender Portal Q&A

Ask questions and find answers about the TimeXtender Portal

General

45 topics

Data Sources Q&A

Ask questions of about setting up data sources

General

58 topics

REST APIs

45 topics

RSD File Customization

25 topics

SAP

11 topics

Oracle

9 topics

ODBC

8 topics

General Q&A

Ask general questions

General

45 topics

Interoperability with other Platforms & Tools

13 topics

Legacy & Upgrades

68 topics

Security & Compliance

6 topics

Infrastructure & Networking

8 topics

XPilot

0 topics

Learn & Share

Share tips and best practices, show what you've created and inspire others

Success Stories

6 topics

Tips, Tricks and Best Practices

18 topics

TimeXtender Tuesdays

30 topics

Community Announcements

Everything you need to know about this community

Getting started in the community

8 topics

Company Announcements

18 topics

TimeXtender Orchestration and Data Quality Q&A

TimeXtender Orchestration and Data Quality

General

16 topics

Orchestration

0 topics

Data Quality

0 topics

TimeXtender Data Enrichment Q&A

TimeXtender Data Enrichment

General

0 topics

Community Statistics

1,672: Topics
5,735: Replies
1,076: Members

Awarded Badges widget

Himanshu Chhas earned the badge Certified Solutions Architect
oscarclevehas earned the badge Innovator
leo.noharethas earned the badge Certified Solutions Architect
Bernarddbhas earned the badge Innovator
JeroenStahas earned the badge Certified Solutions Architect

Show all badges

Leaderboard

Show full leaderboard

Ask Questions. Find Answers. Fast.

Download the latest version of TimeXtender Data Integration

Featured topics

The latest & greatest from the community

Community Statistics

Awarded Badges widget

Leaderboard

Need more help?

Sign up

Login with SSO

Login to the community

Login with SSO

Scanning file for viruses.

This file cannot be downloaded