Ask questions and find answers about TimeXtender Data Integration and TimeXtender Classic desktop applications
Recently active
Hi Does anyone know hos to extract data from excel files stored in a Sharepoint 365 library?
Is there any method for specifying encoding hints for SSAS in the semantic layer? If not, this could be useful and very easy to implement. { "name": "Sales Amount", "dataType": "decimal", "sourceColumn": "SalesAmount", "formatString": "\\$#,0.00;(\\$#,0.00);\\$#,0.00", "sourceProviderType": "Currency", "encodingHint": "Value" }
Hi all,I've recently implemented Incremental load. Pretty great.I have also built an Execution Package to run each week, where I have added all Incremental tables to the Full load tab.The Execution package sends me a Notification on Success.Both the email, as the Execution History show that the package takes 0 seconds to run. It does run and fires the notification, but nothing actually happens.I would also expect DW_TimeStamp in all Incremental tables to be equal (or at minimum, last run time of Full load).How can I troubleshoot this?Thanks!
Hi, Currently we have execution packages set to retry upon failure, this is set as Retries = 5 , Retries per step = 3Occasionally we encounter a failure, however it seems we can then only access the logs for the most recent fail, is there a way to get the logs for all of the failures?Similarly, is there a way so get logs of a failed execution step when the full execution package succeeded after a retry?
Trying to limit data when pulling from office365 ..Have incremental load but also need to have some 'Data Selection Rule' to get only just this week's data on initial load. Tried this, but still taking forever to load...I am assuming its too much data...Any thoughts?
Would be great if within TX (or via external script) you could trigger Data Source transfer tasks as an initial Step within an Execution Package (or batch), so that once the transfer of new data is complete, the execution package runs the next dependant step? This way, if the transfer task from the data source to the DL takes longer (more data than expected) then the execution package won't run until it completes. There seems to be no method currently to trigger a transfer load within the execution packages - and therefore no way to make the two different scheduling tools (it's really that) align with each other intelligently.
Hi, with this snippet: I get an error in deploy: The sippet it’s correct as you can see in:
When creating / editing an external executable I receive an error message when trying to select an SSIS package. The list of available packages won't open. In stead I get the following error message:What do I do wrong?Not sure if this is of importance but under Tools > Options > Custom editors I have referenced my version of Visual Studio.
Hi,Our customer uses the new TimeXtender version with ODX (Azure Datalake). MDW (Azure SQL Database) and also uses the NAV connector. We experience issues when adding data selection rules in MDW layer on existing tables. System.AggregateException: One or more errors occurred. ---> System.AggregateException: Pipeline execution failed ---> System.Exception: { "errorCode": "ActionFailed", "message": "Activity failed because an inner activity failed; Inner activity name: TIMEXTENDER COPY DATA, Error: The request failed with status code '\"BadRequest\"'.", "failureType": "UserError", "target": "TIMEXTENDER COPY DATA LOOP", "details": ""} --- End of inner exception stack trace --- at ODX.DataFactory.DataFactoryResourceHelper.ValidatePipelineRunResult(PipelineRun pipelineRun, DataFactoryConnectionModel dataFactoryConnection) at ODX.DataFactory.DataFactoryResourceHelper.ExecutePipeline(Dictionary`2 pipelineParameters, DataFactoryConnectionModel dataFactoryConnection, String p
The Execution Server Configuration tool shows “Currently assinged instances” instead of “Currently assigned instances”.
When you add tables to a DWH data area (from an Azure Data Lake backed ODX) and subsequently perform a Deploy & Execute, data is loaded normally as expected. In this example I am adding AW2014's Person.Person and Sales.SalesPerson tables. I subsequently want to add a field where I add a transformation to generate the full name for a person (Firstname + ' ’ + Lastname). When I add this field with the transformation and perform a Deploy & Execute, the field is not populated.The reason for this is probably the same reason under: https://legacysupport.timextender.com/hc/en-us/requests/25792 I would expect changes to ETL to trigger a full reload without needing to either change the Table Settings > Data Extraction > Full Load or perform a cumbersome full reload through D&E > Review tasks.Given that this issue seems generic and not only limited to Historiy tables, it is probably a good idea to solve this generally as well.
When using the Data Profile function on the Person.Person table in the AdventureWorks2014 database I see strange results for the highest and lowest occurence in the LastName field: Diaz is the highest and Billstrom is the lowest. In reality Abbas is the lowest when sorting by LastName ASC where count(*) == 1 I am not entirely sure that 'Highest occurence’ is clear to everyone that is not a natvie speaker: you could also assume this should be the highest sorted value.
Hi,During deployment of the semantic model in TimeXtender 6024.1 an error occured.Finished executing instance 'SSL Test' Execution Package 'Execution Queue Default'Execution failedStart Time : 1/10/2023 12:05:34 PM End Time : 1/10/2023 12:05:36 PM on server: vm-tx-prod-01-Execute Execution Package Execution Queue Default 'Failed' Object reference not set to an instance of an object. Details: Object reference not set to an instance of an object. Module: TimeXtender.Semantic.Logic System.NullReferenceException at TimeXtender.Semantic.TOMEndpointDeployExecute.GetColumn(SharedSemanticLayerField field, Table parentTable, SharedSemanticLayerEndpointTOM endpointTOM, Dictionary`2 columnCache) at TimeXtender.Semantic.TOMEndpointDeployExecute.CreateModel(SharedSemanticLayerEndpointTOM endpointModel, Boolean isDeployment, Boolean forCheckSum) at TimeXtender.Semantic.TOMEndpointDeployExecute.Execute(SharedSemanticLayerEndpointTOM endpointModel) at Tim
Hi all, I need to create an Identity column, How could I create it in TX? Thanks Ignacio
Hi, Let's assume I am importing from CSV file. The Data is very dirty and somehow I have stings in my int filed "ID" so the filed is interpreted as NVARCHAR(MAX). If I change data type of the field (right click > Edit Field) from string back to integer I receive a runtime error during the execution. What I was expecting was to see was corresponding entries in the _M and _L tables. Is this not part of data cleansing after all? We have this problem all over and could not find a better solution than to build custom views with TRY_CAST etc. where we lose lineage etc. What is the best way to clean up such data (keep valid rows, write errors/warnings on invalid rows)? We are talking 100+ tables so I'm looking for a highly scalable solution here not a one time work around. Thanks and BR, Tobias
After trying to import data from a REST source in the ODX I got an SQL Exception with error code 4815.After a bit of Google I ended up on this page, telling me that it had something to do with SQLBulk copy not able to match the columns in source and destination or the value of a column was larger than in the destination allowed (e.g. string with length of 200 -> nvarchar(100)).Because TimeXtender defines the columns it probably didn't have something to do with that.Because the RSD I created didn't have a column size specified, all my string type field allowed 2000 chars. Thinking that none of the string fields were going to be larger, I started changing int to double and after that all the fields to string and later even to text. None of this worked which send me back to start. After properly examining the parquet file I found 1 record that had a text field that exceeded the 2000 char limit.The next time I get this error I will do the following steps:1. Examine data type of API (Ope
Hi, I'd love to get your thoughts on issue we're dealing in the past few days. We've noticed that transfer time from ODX to DSA is growing rapidly. This as significant impact on total running time of DWH and SLA towards our clientExecution log of DSA As you can see. as insert and cleansing tasks remains pretty much the same, transfer time is growing.In terms of volume, data hasn't grown significantly Batch Id 13428 (first) - 46347863 rowsBatch Id 13481 (last) 46536187 rows (+0.4%)difference in transfer time is more apparent as you zoom in into the package execution (Gantt chart)Batch Id 13428 vs last batch (13481)There is no inconsistencies in ODX que or ODX service logs found. I've also checked it there is long running transactions (sp_who2) in both TX and DWH server but could find anything out of the ordinary Our setup consists of ODX repository and DWH storage on same Azure Managed Instance. TX application server is (still) on-prem My burning question is: what can attribute th
Data Source selection in Project Perspective (already has been asked for in 2019) - to filter the list of hundreds of sources to those related to the specific project. Data Source "guarding" to prevent accidental modification in DEV or TEST environments, when a source is already actively used in PROD environment. Data Source disable option (in conjuction also with guarding) - various use cases.
Hi! Does TimeXtender support retrieving data from a MySQL RDS instance in AWS? I have tried to connect but I did not manage to test the connection successfully. Thanks a lot in advance, Bernardo Di Chiara
I am new to TX and data lakes. I have a common problem that others have commented on and would like to know if: 1) The functionality now exists, or if it does not 2) How are others getting around the issue? The issue is that I need to be able to segregate data sources in the data lake. I am pulling in data from multiple SQL sources where the source schema and table names are the same, and I need to differentiate those tables in the data lake. By schema would be best, but if that is not possible, I need some other ideas. Thanks!
Hi, I am a bit unclear on how to configure Max Threads for an execution package. The way I perceive it now is: if I run on 4 cores, I choose 4 Max Threads, if I run on 16 cores, I choose 16 Max Threads. i.e. N Cores -> N Max Threads. Is this the correct approach or are there other factors that need to be accounted for?
Hello, I have a problem that i am struggling with. I have a table that contains field called [Period] and it stores month dates in following int format: 2201, 2202, 2203 which i need to translate to 2022-01-01, 2022-02-01, 2022-03-01 etc. to date format (always 1st day of month) The problem is i can convert the source format to date format in the view, but when i am trying to generate a table from that view, i always get an error that [Period] cannot be converted to date format. I have different options and nothing has worked as timextender always fails to convert to date format. Everything that failed on timextender, worked perfectly on MSSQL so i am not sure what is wrong. Thanks for your help
Dear CommunityIf I'm clicking on Report->Errors or Warnings then I see a fulll list of them. Where are those records stored? In which table can I find them ?My problem is that once forgot to check the "Error" manually, therefore I want to create a script which regularly should check if errors exists.But wo far, I couldn't the table/view/place where this Infos are stored.Any ideas? RegardsAlex
Hi,I'm searching for a way to get a table insert incremental. I have a table (about 30 million records). This has a row for each hour of the day for 10.000 machines, so this table is getting bigger very quickly.I do a lot of transformations in this table. This resulted in a load time of over 10 hours. I've discussed this with our TimeXtender Solution Specialist and we've decided to split the table into multiple smaller tables. Now I do have 1 table (loaded incrementally from ODX), this table has a lot of lookups and simple transformations. This table is loading quickly because it's incrementally loaded.The result of this table is inserted in a new table (Raw table), using a table insert. This table is converting cumulative numbers to noncumulative, using the SQL functions LAG, OVER, PARTITION BY and ORDER BY. Because it is a table insert I have no idea how to do this incremental. I've set NonClusted Indexes (also on Raw table) on all fields used in the PARTION BY function. And enabled
When we perform a transfer from the acceptance environment to the production environment, there are settings that you do not want to take with you. First the time schedule. We have an Execution package for both acceptance and production. These should run at different times. Secondly, the acceptance environment naturally refers to other TimeXtender databases than the production environment. Nevertheless, the database links are taken literally after the transfer. Third, when you accept a change in acceptance, you transfer to production. However, when you have executed these, the sources are literally copied from the acceptance. We have circumvented the latter by allowing acceptance to refer to production, but this is not always desirable. Fourth, it would be nice to be able to include project perspectives during the transfer. It would be nice if you could set the above points as settings to transfer.
Already have an account? Login
No account yet? Create an account
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.