Skip to main content
To homepage To homepage

TimeXtender Desktop Q&A

Ask questions and find answers about TimeXtender Data Integration and TimeXtender Classic desktop applications

742 Topics
B
Explorer
businessintelligenceExplorer
asked in Jobs & Executions
Sharepointlist +5000 rows

Hi I’m having problems executing a table from a Cdata source Sharepoint list that has exceeded 5000 rows. Do you have any tips for resolving this issue? Best regardsFrederik

1382
Christian Hauggaard
Community Manager
A
Contributor
alain.thireContributor
asked in Prepare
Loading transactions

I have a transaction table in odx with the following fields (simplified)Key,Value, transactiondate Example100, V100, 2023-01-01100, V100A,2023-01-31 09100, V100B,2023-01-31 10 Each day there are multiple transactions added , of course with  another transaction date.Note in the example I  have only shown the date part (not hours, minutes, seconds) What I need is a table with the latest update in DSAI created the same table. Set primary key to KEY and added an incremental selection rule on transactiondate . Added history settings to update the Value and transaction date based on the keyWhere it goes wrong is if we get in one day multiple transactions 100, V100A,2023-01-31 09100, V100B,2023-01-31 10I traced down the cleansing procedure and Tx detects that there are twice the same key. So far so good.Next it puts the ID of  the latest transcation into <table>_L  and only processes the ID’s that ar not in <table>_LThe result is that I get  100, V100A,2023-01-31 09 which is incor

54011
A
Contributor
daniel
TimeXtender Xpert
danielTimeXtender Xpert
posted in Prepare
Supernatural keys & Data Cleansing performance

Dear Community,I like to build my data estates with supernatural keys but in lager datasets the data cleansing starts to take very, very long. Do you happen to have the same issues? Is there a way to make the supernatural keys load faster? Even with incremental loading it begins to be super slow:I've ran a test on 435,397 records. This is on a Azure SQL with 10 vCores1. is a full load on the table with 7 supernatural keys.2. is a full load on the same table without the supernatural keys.1 has data cleansing of 1 second. 2 has a data cleansing of 104 seconds!Second I've done a test on the same tables but now incremental loads:1. incremental load with 7 supernatural keys2. incremental load without supernatural keys1 has a data cleansing time 1,6 seconds and 2 a data cleansing of a whopping 129 seconds!I'm not so sure I want to keep using the supernatural keys. What do you guys do? Take care= Daniel

3002
rory.smith
TimeXtender Xpert
vw-victa
Contributor
vw-victaContributor
asked in Ingest
Incorrect Job Repository: Expected 1 found 2, after downgrade

Hello,I'm working on a project (new license model) where we want to use the Azure Data Factory for Data Movement. I've installed the TX 6143.1 version but got the message “Data Factory source is out of date”. Looking at the release notes this version of TX doesn't support ADF Data Movement at the moment:“Warning: The new version does not support the data source providers that move data using Azure Data Factory (e.g. "Azure Data Factory - SQL Server (11.0.0.0) 64 bit").”I've decided to downgrade to TX version 6117 but I'm getting the message as shown below (screenshot). It looks like there is another Repository from both installations.How can I solve this and remove one of the repositories. I want to use the ADF Movement so the repository for version 6117 is needed.Thanks in advance!VinceVicta B.V.

1538
vw-victa
Contributor
sierd.zuiderveld
Contributor
sierd.zuiderveldContributor
asked in Prepare
Force Supernatural key value

Hi, I have a list that maps product_codes to product_ID's.What I would like to create is a Key Store that, when fed a product_code from the list, produces the same product_ID and when fed a new code (so not in list) produces a supernatural_key as usual. Is it possible to force the keystore to create the ID's as shown above? 

1202
Christian Hauggaard
Community Manager
S
Explorer
StefanSExplorer
asked in Jobs & Executions
ODX Dev/Prod refresh

Hi,I have the following setup in my Dev/Prod environments:ODX Shared, all on my live environment DSA / MDW separate for each environmentA daily refresh starts with ODX and on success moves to DSA. So far so good.On the ODX step, there's a Usage condition for Environment (project variable) = ‘Prod’.I added this because I don't want to start 2 refreshes of the same ODX from both Prod&Dev.However, the Dev environment goes straight into the DSA refresh because the ODX ‘starts’ and finishes instantly. Meaning the DSA only gets a few thousand rows from the still-refreshing ODX (largest table has 2000 rows where I'd expect 2million+).Is my assumption correct in using the Usage condition? How can I use the same Execution packages for Dev/Prod while still using the same ODX ?Thanks for any help!

934
S
Explorer
rvgfox
Problem Solver
rvgfoxProblem Solver
asked in Prepare
Setup Pre and Post script

The setup phases are confusing, can anyone explain where exactly they run? The Pre script runs previously to insert the records in the valid table, it’s correct in my case, but the post script that must be run after the records inset, doesn’t run.My script it’s: 

1223
Christian Hauggaard
Community Manager
Jan Stroeve
Contributor
Jan StroeveContributor
asked in Jobs & Executions
Jobs: "Hide objects that can't be added"

When adding a job I see a checkbox 'Hide objects that can't be added’.  After I uncheck this checkbox I see that my execution schedules for both the data warehouse and the semantic layer can't be added to the job. Could you please tell me what might be causing this?And in general I'd like to know when an object can't be added to a job.

821
Jan Stroeve
Contributor
sierd.zuiderveld
Contributor
sierd.zuiderveldContributor
asked in Ingest
Error validating data storage version. The version is empty

Hi, I am trying out the new TimeXtender version and just set up my environment. Now when I use a transfer task I receive the following error: System.AggregateException: One or more errors occurred. ---> System.Exception: Error validating data storage version. The version is empty   at DataStorageEngine.SQL.SQLHelper.GetDataStorageVersion(SqlCommand command)   at DataStorageEngine.SQL.SQLStorageEngine.ValidateStorage(SqlCommand command, Boolean tryTakeOwnership, Boolean throwIfInvalidOwner)   at DataStorageEngine.SQL.SQLStorageEngine.TransferData(IDataSourceEngine dataSourceEngine, ExecutionTaskModel taskModel, List`1 tableModels, Boolean forceFullLoad, SecurityExecutionModel securityExecutionModel)   at ExecutionEngine.Action.StandardAction.Execute()   at ExecutionEngine.Action.ExecutionAction.<.ctor>b__9_0()   at System.Threading.Tasks.Task.Execute()   --- End of inner exception stack trace ------> (Inner Exception #0) System.Exception: Error validating data storage versio

812
sierd.zuiderveld
Contributor
J
Starter
johannmStarter
asked in Ingest
ODX cdata XML missing attribute

I'm reading XML files from a folder using cdata XML provider. This is working fine and using incremental loading also works. The issue I'm having is that there is an attribute defined in my rsd file that is not always present in the XML files. When ODX starts reading the folder and the first file it parses doesn't have this field it skips the field for all following files. Similarly if the first file does have the attribute all the rest is parsed ok. Is this a bug or is there a setting I'm not aware of? Or maybe a definition in rds that could help?

1316
Thomas Lind
Community Manager
F
Explorer
femke.kooijExplorer
asked in Jobs & Executions
Multi Environment Tranfer refresh data source included in deploy step

It would be great if in the Multi Environment Transfer Step it would be possible to refresh the Data source as well.Currently I have to add new tables in Dev en Prod environment on a weekly basis (chaning ERP systems).It happens that a table is added in Dev, but that table is not yet avialable in Prod. So when I transfer the project and deploy I do not get a warning that the table does not exists. So after deployment, the schedule will run in morning and it will fail on the missing table.Only after a refresh of the Data source the project recognises the missing table and gives a warning. Now I have to in Dev transfer project and deploy to Prod and then open the Prod environment itself to refresh data source in order to check if all tables are available or not.

731
JTreadwell
Employee
B
Contributor
brandon.spencerContributor
asked in Prepare
Are "Over Ride Data Types" applied in order like a SQL case statement?

Does anyone know whether or not the rules you put in the over ride data types area are applied sequentially like they would be in a SQL case statement (i.e. once a field evaluates to TRUE it ignores the subsequent logic)?

501
Christian Hauggaard
Community Manager
rvgfox
Problem Solver
rvgfoxProblem Solver
asked in Prepare
How to use variables to usage conditions

I would like to run a job only if the number of records in the raw table it’s diferent of the number of records in the valid table wit a condition.How can I do it?

1094
rory.smith
TimeXtender Xpert
S
Starter
sturla.winger.svendsenStarter
asked in Ingest
Change db compatibility_level

Hi, We are running on MS SQL Server 2019, but all of the DBs created from TX  are still on compatibility level 120. Will changing the compatibility_level impact the TX solution?   br,Sturla

291
S
Contributor
D
Visitor
dylan brabecVisitor
asked in Ingest
SAP ByDesign Connection suddenly stopped working

Hi Guys,  I had an ODX connection to a SAP ByDesign instance that suddenly stopped at the end of last week and spit out the below error log. I am looking for any ideas on the direction to go. From how I am reading the error, I am assuming its originating at the ByDesign end, and I need to find a location to whitelist DiscoveryHub. (doesn't explain why it was working then suddenly not working without any other changes).   Thanks for any help.     If you need assistance, please submit this with your ticket. Service request failed: System.Reflection.TargetInvocationException: Exception has been thrown by the target of an invocation. ---> rds190C.vX: HTTP protocol error. 401 Unauthorized. ---> rds190C.vX: HTTP protocol error. 401 Unauthorized. ---> rds190C.IX: HTTP protocol error. 401 Unauthorized.at rds190C.ERZ.q(String , String , FR , ERk , String , Boolean , String )at rds190C.ERZ.o(Boolean )at rds190C.FZZ.K(WDn )at rds190C.WaZ.q(Wg , WDt )at rds190C.WaZ.A(Wg , Wan )--- End of

541
S
Contributor
E
Starter
eric.vangemertStarter
asked in Prepare
Securing sensitive data

Data in the context of GDPR or sensitive to stock markets require attention in the datawarehouse with regard to securing the data, in some cases this also to the people developing the datawarehouse. We have been looking into several options, and now plan to do a proof of concept on transparent data encryption.   Anybody experience with securing sensitive data in the datawarehouse, either with this setting or in other ways?

591
S
Contributor
R
Visitor
rajneesh.mangotraVisitor
asked in Prepare
converted to type nvarchar

Hello!!Please help to figuer out this error "The given value of type String from the data source cannot be converted to type nvarchar of the specified target column" while pulling data from source to stage.Anyone Who Can Help!!!

2184
S
Contributor
rvgfox
Problem Solver
rvgfoxProblem Solver
asked in Jobs & Executions
Records in Execution Log for DSA Jobs are wrong

I’ve a job like this:The Job’s schedule it’s: When the job finishes the execution log it’s wrong, there’re several tasks, but no one with schedule start type and without details:  

763
Christian Hauggaard
Community Manager
R
Contributor
r.depagterContributor
asked in Jobs & Executions
Execute and deploy takes entire project

Hi, When executing and deploying a project it does every single table and change, not just the changes I have made since the last deployment. In other projects, it only deploys the selected tables or changes made. But in our biggest project (deployment takes roughly 15 minutes each time) it does all or nothing.Even when in a perspective it still does every other table that exists in the entire project.Other projects don't do this and I can't seem to find the setting that changes this for the big project. Does anyone know how to set this up?Thanks!

1365
Christian Hauggaard
Community Manager
rvgfox
Problem Solver
rvgfoxProblem Solver
asked in Prepare
Error. Indexes missing

The autoindexes doesn’t created in the physical table 

342
rvgfox
Problem Solver
Jan Willem Kuper
Starter
Jan Willem KuperStarter
asked in Jobs & Executions
Error 1064: An exception occurred in the service when handling the control request.

The services of 6117.1 worked fine, but after upgrading to 6143.1, I'm not able to start the TimeXtender Execution service. Receive the error:Windows could not start the TimeXtender Execution 6143.1 service on Local ComputerError 1064: An execption occured in the service when handling the control request.In the Event log not more info then the error above.Anyone an idea what is causing this and how to solve this?

1666
Jan Willem Kuper
Starter
D
Starter
dror.svartzmanStarter
asked in Ingest
Dynamically Import tables into ODX

Hi, My source database contains over 300 tables, from which only 30 are relevant for our purposes. Instead of manually searching and checking the required tables, Is it possible to define a list of objects of interest(text)  and let TX pick it from there? Kind regards, Dror Svartzman

756
Christian Hauggaard
Community Manager
S
Participant
satish.padarthiParticipant
asked in Prepare
TRIM/RTRIM/LTRIM

Did anyone notice that these functions do not seem to work directly on a field? I always have to create a new one to use trim function on the original filed. Am I missing something?I would like to avoid the repetitive process of manually creating additional fields when I have a table which needs TRIM.

12412
Christian Hauggaard
Community Manager
M
Starter
mikkel.hansenStarter
asked in Prepare
Normalizing table containing filed in json format

Hi.I have a question for you all:I have a table for example link thisfiled_name:FormatProduct_id: IntegerDelivery_metod: varchar(50)Inventory_id: IntegerInventory_Entries: JSONInventory_entries can contain one or several entries in JSON format like this:[{"SKU":"A","Price":"100"},{"SKU":"B","Price":""00"}]Instead off one line with the json entries nested into one single field i would like to Normalize the tabel into several lines, one for each SKU.Any ideas?

992
Christian Hauggaard
Community Manager
M
Explorer
mark.beedleExplorer
asked in Deliver
Partitioning and Execution in SSAS Tabular

It would be really beneficial if functionality was added to the Semantic layer, such that SSAS Tabular partitions could be defined within the tool.Ideally, one would be able to right click on a table within the semantic model and choose partitioning, which would allow you to pick a field, like a Date field and configure it so that partitions on say Year, or Quarter, or Month, or Week would be dynamically created with each deployment of the tabular model. Additionally, it would also be great if once TX had visibility of the metadata of the partitions it has created, it would be extremely beneficial if we could then decide which partitions are executed in a given execution package.A little background for this request, we are in the middle of a major AX and data warehouse project, and we are building out quite a few SSAS tabular models to be consumed by Power BI.  Unfortunately, with the current setup of the semantic layer, we are having to consider managing tabular models outside of Time

1954
Christian Hauggaard
Community Manager

Badge winners

Show all badges
Terms and ConditionsCookie settings