To homepage To homepage

TimeXtender Desktop Q&A

Ask questions and find answers about the TimeXtender Desktop Application

415 Topics

S
Participant
satish.padarthiParticipant
asked in ODX

Limiting data pull on ODX

Trying to limit data when pulling from office365 ..Have incremental load but also need to have some 'Data Selection Rule' to get only just this week's data on initial load. Tried this, but still taking forever to load...I am assuming its too much data...Any thoughts?  

4
daniel
TimeXtender Xpert
10 months ago
jon.catt
Explorer
jon.cattExplorer
asked in Jobs & Executions

Trigger Data Source transfer tasks from Execution Packages

Would be great if within TX (or via external script) you could trigger Data Source transfer tasks as an initial Step within an Execution Package (or batch), so that once the transfer of new data is complete, the execution package runs the next dependant step?  This way, if the transfer task from the data source to the DL takes longer (more data than expected) then the execution package won't run until it completes.  There seems to be no method currently to trigger a transfer load within the execution packages - and therefore no way to make the two different scheduling tools (it's really that) align with each other intelligently.

5
Christian Hauggaard
Community Manager
10 months ago
rvgfox
Contributor
rvgfoxContributor
asked in Data Warehouse

Error in SQL Snippet

Hi, with this snippet:  I get an error in deploy: The sippet it’s correct as you can see in: 

1
Stefan
Employee
10 months ago
A
Contributor
Agnes.SoumanContributor
asked in Jobs & Executions

Error selecting External Executable package

When creating / editing an external executable I receive an error message when trying to select an SSIS package. The list of available packages won't open. In stead I get the following error message:What do I do wrong?Not sure if this is of importance but under Tools > Options > Custom editors I have referenced my version of Visual Studio.

3
S
Contributor
10 months ago
M
Contributor
Michel van DrunenContributor
asked in Data Warehouse

Error during filtering ODX Azure Data Factory-DSA

Hi,Our customer uses the new TimeXtender version with ODX (Azure Datalake). MDW (Azure SQL Database) and also uses the NAV connector. We experience issues when adding data selection rules in MDW layer on existing tables.  System.AggregateException: One or more errors occurred. ---> System.AggregateException: Pipeline execution failed ---> System.Exception: {  "errorCode": "ActionFailed",  "message": "Activity failed because an inner activity failed; Inner activity name: TIMEXTENDER COPY DATA, Error: The request failed with status code '\"BadRequest\"'.",  "failureType": "UserError",  "target": "TIMEXTENDER COPY DATA LOOP",  "details": ""}   --- End of inner exception stack trace ---   at ODX.DataFactory.DataFactoryResourceHelper.ValidatePipelineRunResult(PipelineRun pipelineRun, DataFactoryConnectionModel dataFactoryConnection)   at ODX.DataFactory.DataFactoryResourceHelper.ExecutePipeline(Dictionary`2 pipelineParameters, DataFactoryConnectionModel dataFactoryConnection, String p

1
JTreadwell
Community Manager
10 months ago
rory.smith
TimeXtender Xpert
rory.smithTimeXtender Xpert
asked in Jobs & Executions

Typo in Execution Server Configuration interface

The Execution Server Configuration tool shows “Currently assinged instances” instead of “Currently assigned instances”.

1
AvanWijnen
Employee
10 months ago
rory.smith
TimeXtender Xpert
rory.smithTimeXtender Xpert
asked in Data Warehouse

Transformations / changes not visible until forced full load

When you add tables to a DWH data area (from an Azure Data Lake backed ODX) and subsequently perform a Deploy & Execute, data is loaded normally as expected. In this example I am adding AW2014's Person.Person and Sales.SalesPerson tables. I subsequently want to add a field where I add a transformation to generate the full name for a person (Firstname + ' ’ + Lastname). When I add this field with the transformation and perform a Deploy & Execute, the field is not populated.The reason for this is probably the same reason under: https://legacysupport.timextender.com/hc/en-us/requests/25792 I would expect changes to ETL to trigger a full reload without needing to either change the Table Settings > Data Extraction > Full Load or perform a cumbersome full reload through D&E > Review tasks.Given that this issue seems generic and not only limited to Historiy tables, it is probably a good idea to solve this generally as well.

7
JTreadwell
Community Manager
10 months ago
rory.smith
TimeXtender Xpert
rory.smithTimeXtender Xpert
asked in Data Warehouse

Data Profile does not always give the correct highest/lowest occurence

When using the Data Profile function on the Person.Person table in the AdventureWorks2014 database I see strange results for the highest and lowest occurence in the LastName field: Diaz is the highest and Billstrom is the lowest. In reality Abbas is the lowest when sorting by LastName ASC where count(*) == 1 I am not entirely sure that 'Highest occurence’ is clear to everyone that is not a natvie speaker: you could also assume this should be the highest sorted value.

1
JTreadwell
Community Manager
10 months ago
M
Contributor
Michel van DrunenContributor
asked in Semantic Models

Error during deployment semantic layer azure analysis services

Hi,During deployment of the semantic model in TimeXtender 6024.1 an error occured.Finished executing instance 'SSL Test' Execution Package 'Execution Queue Default'Execution failedStart Time : 1/10/2023 12:05:34 PM End Time : 1/10/2023 12:05:36 PM on server: vm-tx-prod-01-Execute Execution Package Execution Queue Default 'Failed'    Object reference not set to an instance of an object.        Details:        Object reference not set to an instance of an object.    Module: TimeXtender.Semantic.Logic    System.NullReferenceException       at TimeXtender.Semantic.TOMEndpointDeployExecute.GetColumn(SharedSemanticLayerField field, Table parentTable, SharedSemanticLayerEndpointTOM endpointTOM, Dictionary`2 columnCache)       at TimeXtender.Semantic.TOMEndpointDeployExecute.CreateModel(SharedSemanticLayerEndpointTOM endpointModel, Boolean isDeployment, Boolean forCheckSum)       at TimeXtender.Semantic.TOMEndpointDeployExecute.Execute(SharedSemanticLayerEndpointTOM endpointModel)       at Tim

1
Christian Hauggaard
Community Manager
10 months ago
mnoordam
Contributor
mnoordamContributor
asked in ODX

Error after last upgrade ODX/TX

ODX Server is running fine, but transfer en sync jobs fail.Error occurs when I 'Select Tables'.What to do?Error in command: 'Select Tables...'.Service request failed: ODX.Model.Exceptions.DataSourceException: The custom data source is out of date and needs to be updated.at DataSourceEngine.Custom.CustomSourceEngine.IsDataSourceVersionValid(Version version)at DataSourceEngine.Custom.CustomSourceEngine.GetCustomDataSource()at DataSourceEngine.Custom.CustomSourceEngine.<GetSupportedFilterModeType>b__48_0()at DataSourceEngine.Custom.CustomSourceEngine.GetSupportedFilterModeType()Details:Service request failed: ODX.Model.Exceptions.DataSourceException: The custom data source is out of date and needs to be updated. ...Module: TimeXtender.ODX.EngineTimeXtender.ODX.Engine.ODXFaultExceptionat TimeXtender.ODX.Engine.ODXEngine.SendServiceRequest[C,T](WcfServerSettings serverSettings, ProjectInformation projectInformation, Func`3 func)at TimeXtender.ODX.Engine.DataSourceController`1.GetSuppo

3
mnoordam
Contributor
2 years ago
A
Starter
agusteStarter
asked in ODX

Cannot find the object after upgrade to 20.10.28 - "_FDS" tables

After the upgrade this error is raised for various (not all) tables when trying to execute from SQL Server source.  It includes some table names with the "_FDS" extension. I tried googling the _FDS but nothing comes up, neither in TxT documentation nor outside.  Anyone who can give me a clue on how to proceed?  Error example:"Cannot find the object "DIRPARTYTABLE_FDS" because it does not exist or you do not have permissions." I can solve this be re-deploying each table but of course that is a very sub-optimal choice :(

4
A
Starter
1 year ago
B
Contributor
brandon.spencerContributor
asked in Data Warehouse

Solutions for different schemas in a data lake?

I am new to TX and data lakes.  I have a common problem that others have commented on and would like to know if: 1) The functionality now exists, or if it does not 2) How are others getting around the issue? The issue is that I need to be able to segregate data sources in the data lake.  I am pulling in data from multiple SQL sources where the source schema and table names are the same, and I need to differentiate those tables in the data lake.  By schema would be best, but if that is not possible, I need some other ideas.  Thanks!

6
B
Contributor
1 year ago
jon.catt
Explorer
jon.cattExplorer
asked in ODX

Data Source management

Data Source selection in Project Perspective (already has been asked for in 2019) - to filter the list of hundreds of sources to those related to the specific project. Data Source "guarding" to prevent accidental modification in DEV or TEST environments, when a source is already actively used in PROD environment. Data Source disable option (in conjuction also with guarding) - various use cases.

5
fwagner
Employee
1 year ago
B
Starter
bernardo.dichiaraStarter
asked in ODX

Connection to AWS RDS instance

Hi! Does TimeXtender support retrieving data from a MySQL RDS instance in AWS? I have tried to connect but I did not manage to test the connection successfully. Thanks a lot in advance, Bernardo Di Chiara

2
B
Starter
1 year ago
A
Starter
anders.bengtssonStarter
asked in ODX

Soap 1.2 Request from ODX - is it possible?

Hi,Have anyone succeeded with a Soap 1.2 call from ODX?We have a source that only have a Soap interface. I've done a lot of testing but so far very little success.For the moment it complains about my content-type header. Don't know why. I'm using the rest connector. Perhaps I should use a xml connector instead. If anyone could share a working example I would be more than happy. Perhaps it's not possible at all. I'm not sure. RegardsAnders Bengtsson

2
Thomas Lind
Community Manager
1 year ago
D
Explorer
dsvartzmanExplorer
asked in Jobs & Executions

Slow performance ODX transfer

Hi, I'd love to get your thoughts on issue we're dealing in the past few days. We've noticed that transfer time from ODX to DSA is growing rapidly. This as significant impact on total running time of DWH and SLA towards our clientExecution log of DSA As you can see. as insert and cleansing tasks remains pretty much the same, transfer time is growing.In terms of volume, data hasn't grown significantly   Batch Id 13428 (first) - 46347863 rowsBatch Id 13481 (last)  46536187 rows (+0.4%)difference in transfer time is more apparent as you zoom in into the package execution (Gantt chart)Batch Id 13428  vs last batch (13481)There is no inconsistencies in ODX que or ODX service logs found. I've also checked it there is long running transactions (sp_who2) in both TX and DWH server but could find anything out of the ordinary   Our setup consists of ODX repository and DWH storage on same Azure Managed Instance. TX application server is (still) on-prem My burning question is: what can attribute th

5
S
Contributor
1 year ago
T
Visitor
tobias.schmockerVisitor
asked in Data Warehouse

Change Data Type in Cleansing

Hi, Let's assume I am importing from CSV file. The Data is very dirty and somehow I have stings in my int filed "ID" so the filed is interpreted as NVARCHAR(MAX). If I change data type of the field (right click > Edit Field) from string back to integer I receive a runtime error during the execution. What I was expecting was to see was corresponding entries in the _M and _L tables. Is this not part of data cleansing after all? We have this problem all over and could not find a better solution than to build custom views with TRY_CAST etc. where we lose lineage etc. What is the best way to clean up such data (keep valid rows, write errors/warnings on invalid rows)? We are talking 100+ tables so I'm looking for a highly scalable solution here not a one time work around. Thanks and BR, Tobias

2
fwagner
Employee
1 year ago
S
Starter
sanderudenStarter
asked in Jobs & Executions

ODX to Data Warehouse - SqlException - Error code 4815

After trying to import data from a REST source in the ODX I got an SQL Exception with error code 4815.After a bit of Google I ended up on this page, telling me that it had something to do with SQLBulk copy not able to match the columns in source and destination or the value of a column was larger than in the destination allowed (e.g. string with length of 200 -> nvarchar(100)).Because TimeXtender defines the columns it probably didn't have something to do with that.Because the RSD I created didn't have a column size specified, all my string type field allowed 2000 chars. Thinking that none of the string fields were going to be larger, I started changing int to double and after that all the fields to string and later even to text. None of this worked which send me back to start. After properly examining the parquet file I found 1 record that had a text field that exceeded the 2000 char limit.The next time I get this error I will do the following steps:1. Examine data type of API (Ope

6
S
Starter
1 year ago
ignacio
Contributor
ignacioContributor
asked in Data Warehouse

Create Identity column

Hi all,  I need to create an Identity column, How could I create it in TX? Thanks Ignacio

2
ignacio
Contributor
1 year ago
A
Starter
alfred.kristinssonStarter
asked in ODX

Google Cloud Platform

Hi, Is there any development on creating a connector to upload data to Google Storage Bucket or Google BigQuery?My bestAlfreð

5
Thomas Lind
Community Manager
3 years ago
R
Starter
r.rajStarter
asked in Jobs & Executions

Pass project parameters at run time

Can you pass project variable values at run time via the command line? We need to trigger the package and pass on user defined variable values that has been used in the package creation. Like a date that a user can pass whenever he intends to run a package.

2
R
Starter
3 years ago
S
Visitor
sai.mamidiVisitor
asked in Data Warehouse

SQL 'Case'

How to write 'case' in Custom SQL, please let me know with example. Here is the situation (SQL query) that I need to perform on Date table & likes to update 'IND' column where DateValue is default column in Date table selectcase when GETDATE()<=DateValue then 'N' else 'Y' end as 'IND' ,* from <table_name> order by DateValue desc

1
JTreadwell
Community Manager
3 years ago
R
Starter
r.rajStarter
asked in Jobs & Executions

TX- Oracle connector issue

The TX oracle connector drops and creates the complete table during export. Is there a way that we can control this behaviour and the table be not dropped ? This is because we need to move data from Staging Orcle to Main tables based on Triggers and if the table is dropped by TX then the trigger is of no use.

3
JTreadwell
Community Manager
3 years ago
S
Contributor
Søren SørensenContributor
asked in ODX

Synchronized data mapping from ODX Server

I'm currently migrating an Azure MI solution to ADLS Gen2 and Synapse Analytics. The migration includes remapping all DSA table ... instead of using an old ODX, DSA will now use an ADLS Gen2 on ODX Server. Mapping tables bring all data source fields across ... it would be nice to have the usual option to only synchronize existing fields as it's a lot of fields to delete when getting the entire data source table.

2
S
Contributor
3 years ago
B
Visitor
bunyamin.ozkilicVisitor
asked in ODX

Extracting from Azure Service Bus

Hi, Is it possible to extract data from an Azure Service Bus into TX?

1
A
3 years ago

Badge winners

Show all badges
Terms and ConditionsCookie settings