Skip to main content
To homepage To homepage

TimeXtender Desktop Q&A

Ask questions and find answers about TimeXtender Data Integration and TimeXtender Classic desktop applications

742 Topics
V
Visitor
vance.nicholsVisitor
asked in Deliver
OLAP ETL failure Issue

Hello! I'm trying to resolve an issue where OLAP fails to execute during ETL processing due to a canceled transaction attempting to acquire a lock.  This is occurring on a QA instance hosted on a dedicated server that doesn't have any other ETL jobs processing.  I'm seeing a pattern of failures occurring on particular days of the week.  However, the error message sent in the ETL email isn't specific to the root-cause.  Also, I've perused 3 online resources that give explanations on the causes and remedies for such an issue, as I've gained understanding thereby that this matter occurs due to insufficient "timeout" settings.  But those tactical solutions pertain to remediation via the traditional SSAS development capacity, and such do not apply to the TX DWA software  For I don't see a way within TX DWA to change the settings for CommitTimeout and ForcedCommitTimeout.  Does anyone have any insight on how to rectify this issue? Your input would be greatly appreciated.  Thanks and have a g

451
Christian Hauggaard
Community Manager
M
Starter
mikkel.hansenStarter
asked in Ingest
How to read Excel files stored in Sharepoint 365

Hi   Does anyone know hos to extract data from excel files stored in a Sharepoint 365 library?

5417
Thomas Lind
Community Manager
F
Visitor
fredrik.juelhagenVisitor
asked in Deliver
Encoding Hints in semantic layer

Is there any method for specifying encoding hints for SSAS in the semantic layer? If not, this could be useful and very easy to implement.  { "name": "Sales Amount", "dataType": "decimal", "sourceColumn": "SalesAmount", "formatString": "\\$#,0.00;(\\$#,0.00);\\$#,0.00", "sourceProviderType": "Currency", "encodingHint": "Value" }

351
Christian Hauggaard
Community Manager
S
Explorer
StefanSExplorer
asked in Jobs & Executions
Full load execution package not running

Hi all,I've recently implemented Incremental load. Pretty great.I have also built an Execution Package to run each week, where I have added all Incremental tables to the Full load tab.The Execution package sends me a Notification on Success.Both the email, as the Execution History show that the package takes 0 seconds to run. It does run and fires the notification, but nothing actually happens.I would also expect DW_TimeStamp in all Incremental tables to be equal (or at minimum, last run time of Full load).How can I troubleshoot this?Thanks!

1367
S
Explorer
sierd.zuiderveld
Contributor
sierd.zuiderveldContributor
asked in Jobs & Executions
Logs for failed retries

Hi, Currently we have execution packages set to retry upon failure, this is set as Retries = 5 , Retries per step = 3Occasionally we encounter a failure, however it seems we can then only access the logs for the most recent fail, is there a way to get the logs for all of the failures?Similarly, is there a way so get logs of a failed execution step when the full execution package succeeded after a retry?

902
Thomas Lind
Community Manager
S
Participant
satish.padarthiParticipant
asked in Ingest
Limiting data pull on ODX

Trying to limit data when pulling from office365 ..Have incremental load but also need to have some 'Data Selection Rule' to get only just this week's data on initial load. Tried this, but still taking forever to load...I am assuming its too much data...Any thoughts?  

444
daniel
TimeXtender Xpert
jon.catt
Explorer
jon.cattExplorer
asked in Jobs & Executions
Trigger Data Source transfer tasks from Execution Packages

Would be great if within TX (or via external script) you could trigger Data Source transfer tasks as an initial Step within an Execution Package (or batch), so that once the transfer of new data is complete, the execution package runs the next dependant step?  This way, if the transfer task from the data source to the DL takes longer (more data than expected) then the execution package won't run until it completes.  There seems to be no method currently to trigger a transfer load within the execution packages - and therefore no way to make the two different scheduling tools (it's really that) align with each other intelligently.

1085
Christian Hauggaard
Community Manager
rvgfox
Problem Solver
rvgfoxProblem Solver
asked in Prepare
Error in SQL Snippet

Hi, with this snippet:  I get an error in deploy: The sippet it’s correct as you can see in: 

731
Stefan
Employee
A
Contributor
Agnes.SoumanContributor
asked in Jobs & Executions
Error selecting External Executable package

When creating / editing an external executable I receive an error message when trying to select an SSIS package. The list of available packages won't open. In stead I get the following error message:What do I do wrong?Not sure if this is of importance but under Tools > Options > Custom editors I have referenced my version of Visual Studio.

933
S
Contributor
M
Contributor
Michel van DrunenContributor
asked in Prepare
Error during filtering ODX Azure Data Factory-DSA

Hi,Our customer uses the new TimeXtender version with ODX (Azure Datalake). MDW (Azure SQL Database) and also uses the NAV connector. We experience issues when adding data selection rules in MDW layer on existing tables.  System.AggregateException: One or more errors occurred. ---> System.AggregateException: Pipeline execution failed ---> System.Exception: {  "errorCode": "ActionFailed",  "message": "Activity failed because an inner activity failed; Inner activity name: TIMEXTENDER COPY DATA, Error: The request failed with status code '\"BadRequest\"'.",  "failureType": "UserError",  "target": "TIMEXTENDER COPY DATA LOOP",  "details": ""}   --- End of inner exception stack trace ---   at ODX.DataFactory.DataFactoryResourceHelper.ValidatePipelineRunResult(PipelineRun pipelineRun, DataFactoryConnectionModel dataFactoryConnection)   at ODX.DataFactory.DataFactoryResourceHelper.ExecutePipeline(Dictionary`2 pipelineParameters, DataFactoryConnectionModel dataFactoryConnection, String p

1331
JTreadwell
Employee
rory.smith
TimeXtender Xpert
rory.smithTimeXtender Xpert
asked in Jobs & Executions
Typo in Execution Server Configuration interface

The Execution Server Configuration tool shows “Currently assinged instances” instead of “Currently assigned instances”.

581
AvanWijnen
Employee
rory.smith
TimeXtender Xpert
rory.smithTimeXtender Xpert
asked in Prepare
Transformations / changes not visible until forced full load

When you add tables to a DWH data area (from an Azure Data Lake backed ODX) and subsequently perform a Deploy & Execute, data is loaded normally as expected. In this example I am adding AW2014's Person.Person and Sales.SalesPerson tables. I subsequently want to add a field where I add a transformation to generate the full name for a person (Firstname + ' ’ + Lastname). When I add this field with the transformation and perform a Deploy & Execute, the field is not populated.The reason for this is probably the same reason under: https://legacysupport.timextender.com/hc/en-us/requests/25792 I would expect changes to ETL to trigger a full reload without needing to either change the Table Settings > Data Extraction > Full Load or perform a cumbersome full reload through D&E > Review tasks.Given that this issue seems generic and not only limited to Historiy tables, it is probably a good idea to solve this generally as well.

1417
JTreadwell
Employee
rory.smith
TimeXtender Xpert
rory.smithTimeXtender Xpert
asked in Prepare
Data Profile does not always give the correct highest/lowest occurence

When using the Data Profile function on the Person.Person table in the AdventureWorks2014 database I see strange results for the highest and lowest occurence in the LastName field: Diaz is the highest and Billstrom is the lowest. In reality Abbas is the lowest when sorting by LastName ASC where count(*) == 1 I am not entirely sure that 'Highest occurence’ is clear to everyone that is not a natvie speaker: you could also assume this should be the highest sorted value.

261
JTreadwell
Employee
M
Contributor
Michel van DrunenContributor
asked in Deliver
Error during deployment semantic layer azure analysis services

Hi,During deployment of the semantic model in TimeXtender 6024.1 an error occured.Finished executing instance 'SSL Test' Execution Package 'Execution Queue Default'Execution failedStart Time : 1/10/2023 12:05:34 PM End Time : 1/10/2023 12:05:36 PM on server: vm-tx-prod-01-Execute Execution Package Execution Queue Default 'Failed'    Object reference not set to an instance of an object.        Details:        Object reference not set to an instance of an object.    Module: TimeXtender.Semantic.Logic    System.NullReferenceException       at TimeXtender.Semantic.TOMEndpointDeployExecute.GetColumn(SharedSemanticLayerField field, Table parentTable, SharedSemanticLayerEndpointTOM endpointTOM, Dictionary`2 columnCache)       at TimeXtender.Semantic.TOMEndpointDeployExecute.CreateModel(SharedSemanticLayerEndpointTOM endpointModel, Boolean isDeployment, Boolean forCheckSum)       at TimeXtender.Semantic.TOMEndpointDeployExecute.Execute(SharedSemanticLayerEndpointTOM endpointModel)       at Tim

1351
Christian Hauggaard
Community Manager
ignacio
Contributor
ignacioContributor
asked in Prepare
Create Identity column

Hi all,  I need to create an Identity column, How could I create it in TX? Thanks Ignacio

1372
ignacio
Contributor
T
Visitor
tobias.schmockerVisitor
asked in Prepare
Change Data Type in Cleansing

Hi, Let's assume I am importing from CSV file. The Data is very dirty and somehow I have stings in my int filed "ID" so the filed is interpreted as NVARCHAR(MAX). If I change data type of the field (right click > Edit Field) from string back to integer I receive a runtime error during the execution. What I was expecting was to see was corresponding entries in the _M and _L tables. Is this not part of data cleansing after all? We have this problem all over and could not find a better solution than to build custom views with TRY_CAST etc. where we lose lineage etc. What is the best way to clean up such data (keep valid rows, write errors/warnings on invalid rows)? We are talking 100+ tables so I'm looking for a highly scalable solution here not a one time work around. Thanks and BR, Tobias

1492
fwagner
Employee
S
Starter
sanderudenStarter
asked in Jobs & Executions
ODX to Data Warehouse - SqlException - Error code 4815

After trying to import data from a REST source in the ODX I got an SQL Exception with error code 4815.After a bit of Google I ended up on this page, telling me that it had something to do with SQLBulk copy not able to match the columns in source and destination or the value of a column was larger than in the destination allowed (e.g. string with length of 200 -> nvarchar(100)).Because TimeXtender defines the columns it probably didn't have something to do with that.Because the RSD I created didn't have a column size specified, all my string type field allowed 2000 chars. Thinking that none of the string fields were going to be larger, I started changing int to double and after that all the fields to string and later even to text. None of this worked which send me back to start. After properly examining the parquet file I found 1 record that had a text field that exceeded the 2000 char limit.The next time I get this error I will do the following steps:1. Examine data type of API (Ope

2666
S
Starter
D
Contributor
dsvartzmanContributor
asked in Jobs & Executions
Slow performance ODX transfer

Hi, I'd love to get your thoughts on issue we're dealing in the past few days. We've noticed that transfer time from ODX to DSA is growing rapidly. This as significant impact on total running time of DWH and SLA towards our clientExecution log of DSA As you can see. as insert and cleansing tasks remains pretty much the same, transfer time is growing.In terms of volume, data hasn't grown significantly   Batch Id 13428 (first) - 46347863 rowsBatch Id 13481 (last)  46536187 rows (+0.4%)difference in transfer time is more apparent as you zoom in into the package execution (Gantt chart)Batch Id 13428  vs last batch (13481)There is no inconsistencies in ODX que or ODX service logs found. I've also checked it there is long running transactions (sp_who2) in both TX and DWH server but could find anything out of the ordinary   Our setup consists of ODX repository and DWH storage on same Azure Managed Instance. TX application server is (still) on-prem My burning question is: what can attribute th

2605
S
Contributor
jon.catt
Explorer
jon.cattExplorer
asked in Ingest
Data Source management

Data Source selection in Project Perspective (already has been asked for in 2019) - to filter the list of hundreds of sources to those related to the specific project. Data Source "guarding" to prevent accidental modification in DEV or TEST environments, when a source is already actively used in PROD environment. Data Source disable option (in conjuction also with guarding) - various use cases.

435
fwagner
Employee
B
Starter
bernardo.dichiaraStarter
asked in Ingest
Connection to AWS RDS instance

Hi! Does TimeXtender support retrieving data from a MySQL RDS instance in AWS? I have tried to connect but I did not manage to test the connection successfully. Thanks a lot in advance, Bernardo Di Chiara

402
B
Starter
B
Contributor
brandon.spencerContributor
asked in Prepare
Solutions for different schemas in a data lake?

I am new to TX and data lakes.  I have a common problem that others have commented on and would like to know if: 1) The functionality now exists, or if it does not 2) How are others getting around the issue? The issue is that I need to be able to segregate data sources in the data lake.  I am pulling in data from multiple SQL sources where the source schema and table names are the same, and I need to differentiate those tables in the data lake.  By schema would be best, but if that is not possible, I need some other ideas.  Thanks!

1576
B
Contributor
sierd.zuiderveld
Contributor
sierd.zuiderveldContributor
asked in Jobs & Executions
How to configure Max Threads for execution package

Hi, I am a bit unclear on how to configure Max Threads for an execution package. The way I perceive it now is: if I run on 4 cores, I choose 4 Max Threads, if I run on 16 cores, I choose 16 Max Threads. i.e. N Cores -> N Max Threads. Is this the correct approach or are there other factors that need to be accounted for? 

2714
Thomas Lind
Community Manager
G
Contributor
gediminas.juskenasContributor
asked in Prepare
Converting int/char to date

Hello, I have a problem that i am struggling with. I have a table that contains field called [Period] and it stores month dates in following int format: 2201, 2202, 2203 which i need to translate to 2022-01-01, 2022-02-01, 2022-03-01 etc. to date format (always 1st day of month) The problem is i can convert the source format to date format in the view, but when i am trying to generate a table from that view, i always get an error that [Period] cannot be converted to date format. I have different options and nothing has worked as timextender always fails to convert to date format. Everything that failed on timextender, worked perfectly on MSSQL so i am not sure what is wrong. Thanks for your help

2506
fwagner
Employee
A
Starter
alexander.hauensteinStarter
asked in Prepare
Location of Errors and Warnings Messages

Dear CommunityIf I'm clicking on Report->Errors or Warnings then I see a fulll list of them. Where are those records stored? In which table can I find them ?My problem is that once forgot to check the "Error" manually, therefore I want to create a script which regularly should check if errors exists.But wo far, I couldn't the table/view/place where this Infos are stored.Any ideas? RegardsAlex 

651
JTreadwell
Employee
bas.hopstaken
TimeXtender Xpert
bas.hopstakenTimeXtender Xpert
asked in Prepare
Incremental Table insert - Is it possible?

Hi,I'm searching for a way to get a table insert incremental. I have a table (about 30 million records). This has a row for each hour of the day for 10.000 machines, so this table is getting bigger very quickly.I do a lot of transformations in this table. This resulted in a load time of over 10 hours. I've discussed this with our TimeXtender Solution Specialist and we've decided to split the table into multiple smaller tables. Now I do have 1 table (loaded incrementally from ODX), this table has a lot of lookups and simple transformations. This table is loading quickly because it's incrementally loaded.The result of this table is inserted in a new table (Raw table), using a table insert. This table is converting cumulative numbers to noncumulative, using the SQL functions LAG, OVER, PARTITION BY and ORDER BY. Because it is a table insert I have no idea how to do this incremental. I've set NonClusted Indexes (also on Raw table) on all fields used in the PARTION BY function. And enabled

4802
bas.hopstaken
TimeXtender Xpert

Badge winners

Show all badges
Terms and ConditionsCookie settings