Skip to main content
To homepage To homepage

Prepare

Ask questions about Prepare Instances in TimeXtender Data Integration

  • 236 Topics
  • 1,062 Replies
236 Topics
rvgfox
Problem Solver
rvgfoxProblem Solver
asked in Prepare
How to know the age of data in the ODX storage

Currently it’s not possible to create a job to concatenate the transfer task of data source (d365 f&o) to ODX and from this to DSA.I would need to get the age of the data in ODX to transfer that value to somewhere in DSAHow can I do this?

534
Christian Hauggaard
Community Manager
rory.smith
TimeXtender Xpert
rory.smithTimeXtender Xpert
asked in Prepare
Is TimeXtender compatible with SQL Server 2022?

While running trials of TimeXtender it is fairly common to run against SQL Server Developer Edition. As SQL Server 2022 has been GA since last November, this is the version people will generally be installing.Finding 2019 is fairly hard. I have noticed that the 20.10.37 ODX Server is perfectly happy, but that TimeXtender 20.10.39 gave me an “Unsupported version of SQL” error, even with databases running in SQL 2019 compatibility level. Is this supposed to be the case?Azure SQL DB is 2022 under the hood, even if SELECT @@VERSION states something else.

2504
harishkm
Community Manager
E
Contributor
ebayContributor
asked in Prepare
Connect to Excel files

I'm following the steps explained on this page https://support.timextender.com/data-sources-112/connect-to-excel-files-with-excel-online-628#Connect+with+the+Excel+Online+CData+provider, but I couldnt get it. I used Microsoft SharePoint Excel Provider.I have a 48 Excel file. I uploaded them to my company's onedrive. I then gave OAuth to Cdata. But I took this error. ‘You must specify an Excel file: Set the FILE property to an .xlsx file.’ The file url address where the excel files are located like this:https://companyname-my.sharepoint.com/:f:/g/personal/xxx_companyname_onmicrosoft_com/xxxxxxxxxxxxxxxxxxxx Now I have written this above address in the 'URL' section under 'Authentication'. Is this true? Or should I specify in the 'Folder' and 'File' sections in the 'Connection' section? Which Auth Scheme should I choose?

3497
fwagner
Employee
p.ruijter
Contributor
p.ruijterContributor
asked in Prepare
Table Inserts and Object Dependencies

I have a table with a table Insert from a view (actually multiple views) underneath it. The problem is that this table sometimes is empty because the Data Lineage is wrong. It seems that we need to have Object Dependencies for Table Inserts. 2 Questions about that:  When creating a "Table Insert" get a message that "Object Dependencies" are required? Is it enough to check the next child view (in my case) in the "Object Dependencies" if you have one table insert? Or should it be the first child table? Or should all underlying views/tables be included?

2642
Christian Hauggaard
Community Manager
daniel
TimeXtender Xpert
danielTimeXtender Xpert
asked in Prepare
Guarding Views in data warehouse

Dear all,Do any of you have a way of guarding Views in the data warehouse?I have some views which I for archiving purposes rather not delete, but this is giving me issues when I want to deploy the project as a whole.Thanks!

1042
daniel
TimeXtender Xpert
Jan Willem Kuper
Starter
Jan Willem KuperStarter
asked in Prepare
New field not available in Data Movement

In my data source a new field [geregistreerd] is added.After synchronizing the data source and a transfer, the field is available in the ODX Go to the MDWSelect the mapping of the table  The field is not available in the Data Movement  Add a new field in the MDW tableAdd a transformationThe field is available in the Data Fields   Why is it not available in the Data Movement?

1312
daniel
TimeXtender Xpert
A
Contributor
alain.thireContributor
asked in Prepare
Updating table values - history settings

I have loaded a table with some initial data  (== initial stoock). The key is quiet simple  Company, Warehouse and ItemNow I want to update the amounts every day so that it reflects the actual stock level of data dayThe initial load was done from one source , the updates come from another sources History settings  have natural jkey set , and all non lookup fields are updsated  (type 1)Nevertheless the record is not updated Any idea ‘why’ the update is not working

842
A
Contributor
anders.e.jonsson
Contributor
anders.e.jonssonContributor
asked in Prepare
Adding new schemas to a Data Area. What are the pros and cons?

Hi,It’s possible to create new schemas to set rules for access. Are there other reasons, beyond that, for creating new schemas?What are the pros and cons of extra schemas in a Data Areas in version 21 (6xxx)?All knowledge and experience in the field is gratefully receivedBRAnders

481
rory.smith
TimeXtender Xpert
K
Contributor
KajEmergoContributor
asked in Prepare
Audit trail modified GDPR-related objects

Hello,In order to be able to answer all related questions regarding GDPR, we are designing a TX solution that allows us to track all tables/columns that contains sensitive information. Most importantly, we make use of tags so we can track the columns throughout the DWH.An additional question we got is if it is possible to keep track of changes in the TimeXtender projects. In other words, who added which column (with sensitive data) to the project and when? What is the best way to keep track of these things and is there a solution in TimeXtender available that we can use to provide this information? Probably we should use the data in the TX Repository, we were curious if you have had this question before.

802
K
Contributor
rvgfox
Problem Solver
rvgfoxProblem Solver
asked in Prepare
Incremental load without primary key

I’ve some tables in my data source without primary key, but I’ve a MODIFIEDDATETIME field for all the records, that it can be used to incremental load, but TX doesn’t allow it.Some workaround? 

3384
Thomas Lind
Community Manager
rvgfox
Problem Solver
rvgfoxProblem Solver
asked in Prepare
Setup TX for multiple developers

What it’s the recomended setup in the new version to support multiple developers and multiple projects?How many ODX instances, MDW instances must we would use?

853
Thomas Lind
Community Manager
V
Participant
VictorParticipant
asked in Prepare
Incremental load with Table Inserts and Views

Hello,Current Setup: TimeXtender 20.10.31.64 and ODX 20.10.31.I need help setting up incremental load on a rather different type of data flow from the standard one, that has table inserts and views inbetween tables.The flow is as follows:Table A (has incremental load today) => View1 => TableB => Table C(MDW) once directly but also through View2.Both views are necessary so we cannot remove them.  My question is how to setup incremental load in timextender on this solution, if it is even possible. I am not sure how to do it through a view. Currently there is only an incremental load set up on Table A and then we fully load table B and C. Thank you

2663
Christian Hauggaard
Community Manager
K
Contributor
KCMTContributor
asked in Prepare
History Table not deploying anymore 'SCD Type I Hash Key' Error

After attempting to add a new column to my history table, I cannot get the table deployed and executed anymore. The new column is currently not in the table, but I also can't get it to get back to "old" historical table back without the new column. Currently have tried the following things, but so far without result:Set the project version back to an earlier version where the change wasn’t made yet; Upgrarde the PROD SQL DB Size and deploy again.It does not get beyond the Valid Table structure when deploying the historical table. When previewing I also get the following error messages:The table you are trying to preview has not been deployed yet. Deploy first.Invalid column name 'SCD Type I Hash Key'.   The table you are trying to preview has not been deployed yet. Deploy first. Invalid column name 'SCD Type I Hash Key'. Details: SQL Server: 'c5d03ed4f0ca.tr30953.westeurope1-a.worker.database.windows.net,11052'SQL Procedure: ''SQL Line Number: 1SQL Error Number: 207 Invalid column name

1398
K
Contributor
ignacio
Contributor
ignacioContributor
asked in Prepare
How to create a union Table in DSA

I have the following code y DSA:Select * from TableA union Select * from TableBunion Select * from Table CI want to replace this code with a table

2284
ignacio
Contributor
K
Contributor
KajEmergoContributor
asked in Prepare
ADF pipeline run fails with empty configuration

Hi,We are receiving some weird error messages when executing our project, which uses Azure Data Factory to copy tables from our Data Lake storage to the Azure SQL db (ODX → DWH). The error can be found in the attachments. When inspecting the pipeline run on ADF, it seems to be missing the configured activities (see second attachment). When executing the table manually from TX, the pipeline runs succesfully. Also the pipeline seems correctly configured on ADF and the pipeline run that is created when executing the table manually shows the correct activities.Any ideas as to what might be causing this? Best regards,Kaj  

40512
Christian Hauggaard
Community Manager
rvgfox
Problem Solver
rvgfoxProblem Solver
asked in Prepare
Add custom table insert feature

Can you explain how and for what it can be used?

3706
tld
Contributor
rvgfox
Problem Solver
rvgfoxProblem Solver
asked in Prepare
Revese Data Area feature

Can you provide some documentation about this?How can I use it?For what it must be used? 

822
tld
Contributor
rvgfox
Problem Solver
rvgfoxProblem Solver
posted in Prepare
Copy between instances

When you arte coping between instances, the destination insatance name doesn’t show complete. 

500
rvgfox
Problem Solver
rvgfox
Problem Solver
rvgfoxProblem Solver
posted in Prepare
TX allows to add data selection rules over calculated fields but gets an error in execute

As you can see in the screenshot, I think that this situation must be controled: 

516
rvgfox
Problem Solver
R
Starter
richardrayStarter
asked in Prepare
Troubleshooting data cleansing rules

v20.10.36.64Hi,I have a project that is loading data from the ledger table into the staging database with approx, 5m records.When manually executing the load, the ADO.NET transfer is taking 5-6 minutes, but the cleansing rules can take hours, to the point I have to terminate the load.Is there any troubleshooting I can perform on the cleansing steps? I know I have taken the easy option on joins where the data types differ, and wonder if that is now compounding the issue?Any tips or pointers greatly appreciated.Thanks,Richard

5062
R
Starter
L
Contributor
LorenzoContributor
asked in Prepare
Range lookup

Hi,I would like to do a “range lookup”. Because I can't solve it using a conditional lookup, I used a custom field transformation. My code looks like this:CASE    WHEN substring([SBIcode_cleansed], 1, 1) like '[^0-9]' THEN                    (SELECT [kvk_groep_omschrijving]                     FROM  [dsa].[SBIcode_groepering]                             where [SBIcode] = [SBIcode_cleansed]                   ) --'test1'   ELSE                   (SELECT [kvk_groep_omschrijving]                     FROM  [dsa].[SBIcode_groepering]                            where substring([SBIcode_cleansed], 1, 2) >= [min_sbi_code]                              and substring([SBIcode_cleansed], 1, 2) <= [max_sbi_code]                   )--'test2'   END It seems that a subquery is not possible because I get an error message that more than one value is retrieved using the subquery but that is not possible.Testing it in SSMS works fine. (Not using between because above seems to work faster when testing

1486
rory.smith
TimeXtender Xpert
rvgfox
Problem Solver
rvgfoxProblem Solver
posted in Prepare
Adding a new field to an existing table with data

If you add a new field with the deploy only option, to an existing table with data, there are two diferent behaviors, depending if the table has incremental rule defined or not.This is controled by this setting: By default it’s cleared for “normal” tables and setted to incremental tables.I think the behavior should always be the same or at least get a warning message

380
rvgfox
Problem Solver
rvgfox
Problem Solver
rvgfoxProblem Solver
asked in Prepare
Partition Schemas

I’ve detected that if you have the same table in DSA and MDW. let say DSA.Invoices and MDW.Invoices for example, and you define partition for that, both tables share the same partition schemas and partition functions in the SQL Server database.It’s a problem when you try to add or remove field from whatever table.

1188
rvgfox
Problem Solver
rory.smith
TimeXtender Xpert
rory.smithTimeXtender Xpert
asked in Prepare
Replace transformation with char type requires looking up the int value of a char

I discovered that when using the replace transformation with the CharType that you are required to know or look up the int value of the character you want to replace and use that as the parameter.This does not seem to be documented anywhere or be useful in any way I can think of. I assume REPLACE('abc’, char(65), 'b’) is functionally equivalent to REPLACE('abc’, 'a’, 'b’). In a Case Insensitive collation there is no difference between the two anyhow.There is also no COLLATION or binary type support, which are things that you can do with REPLACE() that might actually be useful in certain rare cases. 

1775
Christian Hauggaard
Community Manager
rvgfox
Problem Solver
rvgfoxProblem Solver
asked in Prepare
Problems with "Manage Query Tables"

I’ve a query table created to my D365 F&O data source like you can see in this screenshot: The query returns data as you can see in the query tool (it would be nice to be able to run it in the “Manage Query Tables” window too): But, If try to Synchronize ODX Objects: I get an error and there is not the table if I try to remap it:  And when I deploy and execute the table, it’s empty: Is this a bug or I’m doing something wrong?

1332
rvgfox
Problem Solver

Badge winners

Show all badges
Terms and ConditionsCookie settings