Skip to main content
To homepage To homepage

Recently active topics

58 Topics
oscarcleve
Contributor
oscarcleveContributor
asked in Ingest
Special Character Encoding Issues with Swedish Characters in ODBC Oracle Integration

Hello,I'm facing an issue with how TimeXtender handles special Swedish characters (å, ä, ö) when querying data from an Oracle database through the ODBC data source. I have a view that contains a column with the data type (VARCHAR2) in the Oracle DB. When loading the data to TimeXtender the special characters appear as question marks (å), a (ä), and o (ö).  However, when I create a Query Table and use CAST(CF$_PLAN AS VARCHAR2(1000)) on the same column the special characters are retrieved correctly to TimXtender.   I have queried DUMP from the database to check that the column’s special characters are stored with proper UTF-8 encoded values, and they are.I have also checked the NLS settings for the Oracle database, the TX application server and the ODBC connection.Is there a way for these special characters to be retrieved correctly to TimeXtender without having to use CAST in Query Tables?I use TimeXtender Data Integration 6822.1 and TimeXtender Ingest Service 6823.1. The ODBC Driver u

102
oscarcleve
Contributor
3 hours ago
B
Contributor
BennyContributor
asked in REST APIs
REST connector cashing folder contains a data_.raw and a data_.xml. The result is no data

Hello, I want to get metadate from my Azure datalake using their Blob API. I wasn't seeing any data in the Ingest storage so I turned on cashing to file, to try to see what's happening.  There are three files in my cashing folder: Data_.raw: The return of the call, i.e. my actual data. This look excellent, except that it's a .raw file. Contents: <?xml version="1.0" encoding="utf-8"?><EnumerationResults ServiceEndpoint="https://xxxx.blob.core.windows.net/" ContainerName="datalake"> <Prefix>my_prefix</Prefix> <Blobs> <Blob> .... </Blob> </Blobs> <NextMarker/></EnumerationResults>   Data_.xml: Basically the same as the Data_.raw, but with the content of Data_.raw as the data of a value-element. The data also contains the XML header (so now the document has two headers) and the brackets have been encoded (i.e. all the `<` are now `<`).  <?xml version="1.0" encoding="utf-8"?><Table_flattening_name

152
B
Contributor
6 hours ago
A
Contributor
aftabpContributor
asked in Ingest
XML ingestion

Anyone have a suggestion about how do i use this XML to ingest data into ODX?<?xml version="1.0" encoding="utf-8"?><soap:Envelope xmlns:soap="http://www.w3.org/2003/05/soap-envelope" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xsd="http://www.w3.org/2001/XMLSchema"> <soap:Body> <ExportDocsProjectWithTendersResponse xmlns="http://publicprocurement.com"> <ExportDocsProjectWithTendersResult>{ "ProjectBodies": [ { "ExternalId": "666666", "DefaultEvaluationModel": "LowestPrice", "DocumentNumberingSchema": "Numeric", "SectionNumberingSchema": 0, "RequirementNumberingSchema": "Alphabetic", "Metadata": [ { "Name": "ProjectName", "Value": "Ingesting Data into TX" }, { "Name": "Reference", "Value": "123456" }, { "Name": "ContractType", "Value": "XML" } ], "DataFields": [ { "ExternalId": "1",

184
A
Contributor
7 hours ago
D
Contributor
DylanW.Contributor
asked in Ingest
Issues with TimeXtender_Ingest_Service_6823.1

I wanted to ask if others have experienced issues with the TimeXtender_Ingest_Service_6823.1.For the second time, I’ve encountered problems with opening the ODX, where it gets stuck during the process. When attempting to restart the Ingest service, it remains in a "stopping" state and fails to restart properly.To resolve this, I’ve had to manually force the TimeXtender_Ingest_Service_6823.1 to stop using the Command Prompt. Once the service has been forced to stop, I can restart it successfully, and afterward, the ODX opens without issue.Has anyone else encountered similar problems? If so, are there any recommendations or fixes to prevent this from occurring again?Looking forward to your insights.

373
Christian Hauggaard
Community Manager
15 hours ago
avanrijn
Contributor
avanrijnContributor
asked in General
Release 24.3 of TimeXtender Orchestration Exmon DG Client Desktop

Dear Sir,“ It’s our pleasure to announce the release 24.3 of TimeXtender Orchestration & Data Quality and TimeXtender Master Data Management, featuring exciting new updates and enhancements. “So we are just migrating to TX 6766.1 and now our customer is asking for more options to Orchestrate their TimeXtender environment.Question:Where can we download the latest and the greatest of TimeXtender Orchestration 24.3 ?We would like to setup Exmon DG Client Desktop in our customers new TimeXtender environment.Thanks in advance for looking into this.Regards,Arthur

131
Christian Hauggaard
Community Manager
15 hours ago
A
Contributor
aftabpContributor
asked in Ingest
Using XML to ingest data

Its my first SOAP ingestion.The XML looks like this <?xml version="1.0" encoding="utf-8"?><soap:Envelope xmlns:soap="http://www.w3.org/2003/05/soap-envelope" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xsd="http://www.w3.org/2001/XMLSchema"> <soap:Body> <ListPublishedFilesResponse xmlns="http://something-something.com"> <ListPublishedFilesResult> <idbdata xmlns=""> <originator> <company name="ABC Corp" url="http://www.abc.corp" /> <contact name="ABC Corp" email="post@abc.corp" /> </originator> <generation date="2024-12-09 10:43:09" dateutc="2024-12-09 09:43:09" /> <contract origin="tendsign.com" tendsigncontractid="2649113" name="Protocol" referencename="1 (ABC-01)" startdate="2018-07-01 00:00:00" startdateutc="2018-06-30 22:00:00" enddate="2025-0

14223
Thomas Lind
Community Manager
3 days ago
avanrijn
Contributor
avanrijnContributor
asked in Ingest
E-mail notifications on Ingest ODX Data Source Data Transfer Task

Dear Sir,We are looking for following.E-mail notifications when an Ingest ODX Data Source Data Transfer Task is failing to load the data from the source application/database.Is this possible in TX version 6766.1 ?Or do we need an upgrade. Regards from Venray.Arthur

211
Christian Hauggaard
Community Manager
3 days ago
X
Contributor
Xiaoqing HuContributor
asked in General
Error loading csv from Azure Blob Storage or Azure File Share

Hi everyone, We are trying to load csv file from Azure Blob Storage or Azure File Share with the guidance according to the posts below. But we are still receiving error: “Exception has been thrown by the target of an invocation.”Connect to CSV data sources | CommunityLoad CSV files from Azure Blob Storage | CommunityKindly see the connection details below. Could you help give some advice? Thank you! For Azure Blob StorageFor Azure File Share 

373
X
Contributor
4 days ago
Thomas Lind
Community Manager
Thomas LindCommunity Manager
published in Data Sources
TimeXtender CSV Data sourceTutorial

This data source can be used to connect to text or CSV files in many locations. It is also able to find files across folders and subfolders. It can then decide to merge these into one or more specified tables. If your setup requires a specific setup to work there also is various methods available to handle this.Configuration manual General notes on setting comma-separated parameters Connection settings Location Local file or folder Azure Blob Storage settings AWS S3 Bucket settings SharePoint or OneDrive settings Google Cloud Storage settings SFTP settings Path Include sub-folders Included file types File aggregation pattern: Location specific fields Culture setup Culture and client culture Delimiter Line ending Quote character Header setup Has header record Include empty headers Skip top Skip comment rows Comment start character(s) Incomplete row handling Ignore blank rows Ignore incomplete rows Trim spaces Empty fields e

3387
Thomas Lind
Community Manager
4 days ago
Christian Hauggaard
Community Manager
Christian HauggaardCommunity Manager
published in Data Sources
TimeXtender OData Data Source

The TimeXtender OData data source is based on the TimeXtender REST data source. The documentation for the TimeXtender REST data source applies here unless otherwise specified below.Metadata Discovery Select an Ingest Instance Define Authentication Settings: If applicable, define the necessary authentication settings. The metadata discovery will use the data source authentication settings. Configure Metadata Discovery: Provide a URL to the OData metadata discovery EDMX file. An example URL is: https://services.odata.org/OData/Odata.svc/$metadata and an Ingest instance are set, press the Configure button to open the Metadata discovery modal. In the modal, select the endpoints and possible expansions you want to get configurations for. Submit Configurations: After selecting your endpoints and possible expansions, press Submit to return to the data source configurations. You will now have generated endpoints based on your selection. Continue configuring the endpoints as you would

552
Thomas Lind
Community Manager
5 days ago
G
Contributor
gediminas.juskenasContributor
asked in Ingest
TimeXtender classic ODX connect to Azure SQL / Synapse storage

Hello,We are using TimeXtender classic ODX server (20.10.51) to ingest data. Some of our data sources are located in Azure in form of Azure Synapse / Azure SQL.Are there any guides on how to setup data ingestion from Azure to on-premises ODX server?I.e. what are prerequisites from Azure side (service principal / managed identity?) to connect and what connectors should be used from the ones available in ODX server?I know this is possible from cloud version of TX, but is it possible to do so from classic version? Thank you

323
Christian Hauggaard
Community Manager
6 days ago
M
Starter
mikeschipperStarter
asked in Ingest
Add Fabric LakeHouse as new source

Hi All, I try to add my Fabric LakeHouse as a new source in TimeXtender version 20.10.50.64 but I keep getting an error when I try to read objects from datasource eventhough it says connection is succesfull.Data source settingsI copy the SQL connection string from my lakehouse and put it as server name. When I do "Read object from data source” I get the following error. The weird thing is that when I try these exact same stept in SSMS I can see the table from the source with the data in it. Am I missing some steps? 

497
M
Starter
6 days ago
M
Contributor
MarcodenijsContributor
asked in Ingest
Timextender Excel data source error.

I’m trying the new timextender excel data source but I keep getting errors. I have upgraded to TimeXtender Ingest Service 6823.1 and TimeXtender Data Integration 6822.1.I am trying to load a really basic excel file. First I tried the ‘Infer data types’ option. It succesfully detected the datatypes but I still end up with an error in the last step of the metadata manager.Service request failed: The given value of type String from the data source cannot be converted to type nvarchar of the specified target column. (System.InvalidOperationException)It does not say which column is the issue.After this I tried to disable the ‘infer data types’. It shows all my source columns as text but I still end up with the same error. Lastly I tried to override the data types to varchar(max). Still the same error. Any ideas on what I am doing wrong here?  

361
Thomas Lind
Community Manager
6 days ago
R
Participant
Remy Kamphuis | VictaParticipant
asked in RSD File Customization
RSD file referencing field from ParentTablePath

Hi all,I have an API that uses nested XML to deliver the data. I have used a relational model to be able to retrieve this data in separate tables. Based on key fields that are created I am able to join the tables back together. All works fine, however, I want to reference a (different) field from my parenttable in a nested table. Currently, the output adds a field _id in my parenttable PerformanceInfoRow to be able to reference the underlying data back to the specific period. However, this _id contains an integer. Daily I will get three rows of data and daily I will thus get back the _ids 1, 2 and 3. So, in the end this will not be a unique key when retrieving more days of data. Therefore, I want to specify the Period that also is available in the parenttable, which is unique since it will not only show the date but also whether it is morning, afternoon or evening. This will be unique, but unfortunately I am not able to add this field to the underlying tables. I have tried to adjust my

285
Thomas Lind
Community Manager
6 days ago
G
Community Manager
Greg LennoxCommunity Manager
published in Prepare
Use History to implement Slowly Changing DimensionsTutorial

 This article clarifies the concepts of slowly changing dimensions and explains how to implement a History table in TimeXtender Data Integration. What is SCD? SCD Types History Fields Example Instructions Enable History Configure Fields Additional Settings Surrogate Keys What is SCD?A Slowly Changing Dimension or SCD is a complex data warehouse pattern that maintains historical data for reporting even when this data is no longer available in the source. Consider this example scenario: You report on customer shipments. Unfortunately, your data source only supports a primary address for each customer and previous versions are not available. Subsequently, a customer moves to a new location and the account manager updates the customer address in the source system. The Prepare Instance is updated, but now the historical shipping records are pointing to the row in the customer table which has the new address, instead of the original address they were shipped to. By implementing a slowl

14751
rvgfox
Problem Solver
7 days ago
A
Starter
anders.bengtssonStarter
asked in Ingest
Soap 1.2 Request from ODX - is it possible?

Hi,Have anyone succeeded with a Soap 1.2 call from ODX?We have a source that only have a Soap interface. I've done a lot of testing but so far very little success.For the moment it complains about my content-type header. Don't know why. I'm using the rest connector. Perhaps I should use a xml connector instead. If anyone could share a working example I would be more than happy. Perhaps it's not possible at all. I'm not sure. RegardsAnders Bengtsson

1223
A
Contributor
7 days ago
L
Explorer
linda.monincxExplorer
asked in Ingest
Accessing Unity Catlog (Azure Databricks) with TimeXtender (20.10.44)

Hi, I have a unity catalog in azure databricks where I want to connect to from Timextender (20.10.44), I installed the Cdata connector for Databricks (2024) and am able to connect via test connection (succesfully connected) but when i try to save TX has issues with the length of the (Protocol ?) version which is empty but also using 1 till 8 which are available in the drop down list all result in the same errorWhat do I need to do in order to get his working? Kind regards,  

4010
L
Explorer
7 days ago
P
Participant
pkaustubhaParticipant
asked in Ingest
TDI and Ingest Service Download

Hi I want to download the latest version of TDI and Ingest Service which is 6823.1. But when I use the link to download, it still gives 6822.1. Can you please share the link for the same to download.Also can someone share the link to download 6766.1 with Ingest Services.

161
Christian Hauggaard
Community Manager
7 days ago
avanrijn
Contributor
avanrijnContributor
asked in Deliver
Go to Source Object is greyed out in SSL Deliver Instances

Dear Sir,In some Deliver Instances Semantic Models we can not use the right click table option Go to Source Object. It is greyed out. So TX user A created the Deliver Instance SSL and populated it with tables.But TX user B can not use the right click table option Go to Source Object, it is greyed out.But both users have Grand Access to the Deliver Instance config in the Portal.The data lineage is working fine.What am I overlooking. Some security setting ?Somebody has an idea ?Thanks in advance. Regards,Arthur

413
G
Community Manager
10 days ago
Thomas Lind
Community Manager
Thomas LindCommunity Manager
published in Data Sources
Use OAuth 2.0 client authentication to connect to Graph API with the TimeXtender REST data sourceTutorial

It is possible to use OAuth 2.0 as the authentication method for the TimeXtender REST data source. One API that uses this is the Graph API.ContentContent Prerequisites Application setup Access Token URL Scope Initial setup Set up OAuth Authentication Main Endpoints Users Groups Teams Set up pagination Dynamic endpoints Users messages Team members PrerequisitesUsing the postman collection explained in this guide Use Postman is a good start as the method is pretty much similar. What we will do is the application method aka Client Authentication.Application setupAs mentioned above you need to use Application rights for client authentication, so the app you want to use for this must have the correct rights. The Delegated rights are easier to set as they mainly do not require Admin consent, that is not the case for most Application rights, so get these rights authenticated before starting.I got one app where I got all the application rights addedIf you want access to groups an

4431
C
Starter
10 days ago
J
Contributor
jarleContributor
asked in RSD File Customization
Nested rsd file with paging not working

I have issue with getting details from forms based on a list of formsList of forms: https://api.goformz.com/v2/formzForm details: https://api.goformz.com/v2/formz/formIdBoth nested query and pagination works seperately, but I struggle to get it work with both of them. I have tried the solution in the linked case below, but I get stuck on the same place as the user in that case:The query table is running for approximately correct time (which indicates it is reading the correct amount of data), but no data is going into the SQL-table.The query is this simple: SELECT fields,formId FROM REST.Formz_DataPerFormWHERE Nested_Id IN (SELECT formId FROM REST.formz_WithDateFilter)Is it possible to get this working?  

8711
J
Contributor
10 days ago
R
Contributor
rluytenContributor
asked in General
Error in script, how to adapt ?

Hello,When deploying a table I get error that something is wrong in the script. How do I get into that script to adapt it ? See below screenshot:Thanks in advance,Ronny

213
R
Contributor
10 days ago
A
Explorer
annfossExplorer
asked in Ingest
TimeXtender CSV Data Source - PathNotFound (aggregation pattern)

Hi,We are trying to connect to several CSV files stored in a local folder. While we can successfully synchronize the data source and perform a full load in the ODX, we encounter an error when attempting to add the table to our data area (DSA).The issue lies in the path to the Parquet file stored in Azure. The correct path should be:CSV_DNB/csv_*/DATA_2024_11_28__11_09_50_2219585/DATA/DATA_0000.parquet However, the path Timextender is looking for is:CSV_DNB/csv_^*/DATA_2024_11_28__11_09_50_2219585/DATA/DATA_0000.parquet It seems that Timextender is misinterpreting the automatically generated name and adds a ^ character.I also attempted to use a specific file aggregation pattern, such as;H100.*.csv(all files in folder have the prefix H100 followed by a random number). However, I encountered the same error. Is there a way to specify the name of the table generated in the ODX? It seems like the “File aggregation pattern” is the issue. Do you have any idea how to fix this?  -Execute Executi

747
Christian Hauggaard
Community Manager
11 days ago
R
Contributor
rluytenContributor
asked in General
Could not load file or assembly 'Microsoft.SqlServer.ConnectionInfo, Version=12.0.0.0

hello,I am upgrading to the latest TX and SQL 2022. When I want to deploy my project I get following error: Could not load file or assembly 'Microsoft.SqlServer.ConnectionInfo, Version=12.0.0.0, Culture=neutral, PublicKeyToken=89845dcd8080cc91' or one of its dependencies. The system cannot find the file specified.Location: Business Unit 'BU_CRH'.Details:Could not load file or assembly 'Microsoft.SqlServer.ConnectionInfo, Version=12.0.0.0, Culture=neutral, PublicKeyToken=89845dcd8080cc91' or one of its dependencies. The system cannot find the file specified.Module: TimeXtender.Sql.Engine.2014System.IO.FileNotFoundException   at TimeXtender.Sql.Engine.SqlEngineBase.InitializeFromSqlServer(SqlServer sqlServer)   at TimeXtender.DataManager.DataSource_Sql.GetSqlEngine(Boolean startTransaction, Boolean singleConnection)   at TimeXtender.DataManager.StepTableStructureRawDeploy.DoAbstractStep(StepSetup stepSetup) Details of the SQL:Microsoft SQL Server 2022 (RTM-CU13-GDR) (KB5040939) - 16.0.41

10612
E
Explorer
11 days ago
P
Visitor
PieterQVisitor
asked in Prepare
Join multiple timelines from DSA to dimension

Case:In the DSA I have two tables (Employee and Employee Addresses).The fist table has history in it from the source system (so no TX  history active).On the second table we have TX History active (Type II) . It is not privided by the source system. When joining the tables to a dimension, the timelines must be combined.In what way can this be achived in TX? Emp_ID RegistrationNumber ExpDate ValidFromDate ValidToDate SCD Is Current       109030 39935270430 4-7-2020 1-01-00 1-10-24 0       109030 39935270430 4-7-2029 2-10-24 31-12-99 1                                           Emp_ID ZIP City SCD From DateTime SCD To DateTime SCD Is Current       109030 1625 HV Hoorn 1-01-00 31-05-24 0       109030 1000 AB Amsterdam 1-06-24 31-12-99 1                         Result of join:                 DWH_ID Emp_ID RegistrationN

242
Christian Hauggaard
Community Manager
11 days ago

Badge winners

Show all badges
Terms and ConditionsCookie settings