- - Knowledge base overview
Product Updates
Training
Portal
For Partners
TimeXtender Classic

Home
Community overview
TimeXtender Desktop Q&A
Prepare

Prepare

Ask questions about Prepare Instances in TimeXtender Data Integration

220 Topics
984 Replies

When you subscribe we will email you when there is a new topic in this category

220 Topics

Recently active

Most replies Most views Newest first

Roy VProblem Solver

asked in Prepare

Object reference not set to an instance of an object.

I am deploying a project to Snowflake.On a table I get the following error:Object reference not set to an instance of an object.As read in another ticket I did a ‘Save and reload' but unfortunately that did not solve the issue.It;s on deploying the data cleansing script however it does not show me the script in the deployment log, I only see the error message. Is there an easy way i can see what lookup column is causing the issue ?

538

6 days ago

rvgfoxProblem Solver

asked in Prepare

Buid dependency Graph

This is the first time that I see it: What it is?

201

11 days ago

Roy VProblem Solver

asked in Prepare

snowflake depoyment message 'skipped - uses unsupported feautures' -> apparantly key stores

I am deploying a project to Snowflake and see a lof of tables are skipped.Then we get the messages below (as an example) Apparantly the tales are skipped as key stores / supernatural keys are not supported .Is this a feature to become available on short notice as our entire datawarehouse uses these?Besides that, is there a way I can see what any other unsupported feautures we have?

325

12 days ago

Paul BridgeContributor

asked in Prepare

Issue with Data Area When Attempting to View Report / Errors

HiI have an issue whereby I get the following message when running the ‘Report / Errors’ menu option in one of my data areas. However, when I click OK I do not get any further information to help me identify the issue. Please advise what I need to do to troubleshoot this further.TimeXtender Data Integration version 6745.1Thanks

6712

19 days ago

FenchContributor

asked in Prepare

Persistent mapping error message on syncing MDW with ODX

Dear all,When synchronizing the mdw with the odx through right mouse click on the odx and selecting “Synchronize (...)”, the error messages as attached always show up. “Synchronize with Remapping (...)” only leads to complete removal of the field mappings in the subject tables.As there are other ways to sync the mdw with the odx, it’s still possible to work with the subject tables in the mdw. Nevertheless i wonder what causes the error messages and would like to eliminate them along with the risk of having to redo all work on the tables in a later stage.

584

25 days ago

anders.e.jonssonContributor

asked in Prepare

Using instance name or id in a viariable

Hi,We are migratring i customer from version 20 to 21. In version 20 they use a system variable to limit the amount of data loaded into certain DSA tables in the development environment.is there any way to accomplish this in V21 - setting a variable that only affects one instance?BRAnders

444

25 days ago

Roy VProblem Solver

asked in Prepare

Simple mode in combination with incremental load

I have a table which loads incremental in the ODXIn the datawarehouse the table is on Automatic and in simple mode.The setting to keep fields up to date is off.Will the incremental records from the ODX do inserts and updates, but update only on the fields with no transformations/lookups or will no updates be made at all when an updated existing record is retrieved from the source?As we don’t have any transformations in that part I was hoping we could skip the RAW table and that records get updated if newer versions come by.The documentation only mentions what the ‘keeping fields up to date’ does for lookup fields , transformation fields and so on, not what exactly happens when that box is not checked

403

26 days ago

aftabpContributor

asked in Prepare

Saving ANSI in DVH without proper JSON

I am working with a solution that delivers 3 end pointsThe first end-pointhttps://data.mysystem.com/86fb92b5-ae9cData from this end-point is aleady in the DVHid is the unique id for the attached document:{ "Type": "images", "fileName": "some_file_name.pdf", "id": "3de1cef70101", "mimeType": "application/pdf" }The second end-pointTo reterive the document the endpoint ishttps://data.mysystem.com/attachment/<id>This gives the output as ANSI%PDF-1.7%��1 0 obj<</Type/Catalog/Pages 2 0 R/>>endobj2 0 obj<</Type/Pages/Count 21/Kids[ 4 0 R 27 0 R 31 0 R 37 0 R 46 0 R 48 0 R 50 0 R 54 0 R 56 0 R 60 0 R 62] >>endobj3 0 obj<</MSIP_Label_7a2396b7-5846-48ff-8468-5f49f8ad722a_Enabled(true) /MSIP_Label_7a2396b7-5846-48ff-8468-5f49f8ad722a_SetDate(2022-10-05T08:45:49Z) /MSIP_Label_7a2396b7-5846-48ff-8468-5f49f8ad722a_Method(Standard) /MSIP_Label_7a2396b7-5846-48ff-8468-5f49f8ad722a_Name(Lav) /MSIP_Label_7a2396b7-5846-48ff-8468-5f49f8ad722a_SiteId(e6795081-6391-44

131

28 days ago

darrirafnStarter

asked in Prepare

Data Cleansing Rules hangs / times out

Hi there. I‘m having trouble with a three tables in my project. What they have in common is that they are tables that I created specifically (that is not with a mapping to ODX) and populate with a Custom Table Insert.The problem seems very similar to this one: Data Clensing results in time out | Community (timextender.com)For example, I deployed and executed one of my tables yesterday evening (not a large one, about 20.000 rows). And these are the results: I’m not sure what the problem is but the tables are able to finish execution if the Custom Table Insert is set to valid, however then all my lookup fields (and fixed value fields) are null. If it’s set to raw, then the execution of the data cleansing rules seems to go on forever. In relation to the answers to the other question from @Bernarddb, then yes Operator for the lookup fields is normally always none for me (but I also don’t get exactly the same error): Some of the settings might be wrong perhaps: - Tables are not guarded on d

403

1 month ago

woutersmikeExplorer

asked in Prepare

Add transformation on a field not visible when table is opened in new window

HelloDon’t know if this is a bug or a deliberate choice, but when you want to add a transformation on a field in a table that was opened in ‘new window (CTRL+W shortcut), then the section for Field Transformation is not available.I have included a picture.When your table is in the DSA/MDW node and you do right-mouse click, then you can choose Field Transformation.When your table is in a separate window, then this particular option is missing

303

1 month ago

o.beckeStarter

asked in Prepare

History table not inserting new records to valid table from raw table

Dear Support,I have encountered a strange phenomenon with the history settings and need urgent support.Situation:Records which were once flag as new records from the ERP system show up as SCD Is Current is 0. These orders were canceled in the ERP as a next step and flagged correctly in the history raw table table as a type II change (which is correct). However, they do not get inserted into the valid table as new record. Today we realized even more records are missing in the valid table. TX Version: 20.10.40.64.Please advise on how to proceed. This is causing us major issues in our month end closing reporting. It used to be fine and we only experienced it this week. Thank you.Oscar

485

1 month ago

r.miltenburgStarter

asked in Prepare

Unable to add job for Data Warehouse and Semantic model

Hi guys,Somehow I am unable to create a job for my semantic models or my datawarehouse/ data area. I can’t select the model when I’m trying to add a new job.

743

1 month ago

Roy VProblem Solver

asked in Prepare

Error deploying historic table to Snowflake

Good morningI am deploying a specific table with history (mostly type2) to Snowflake.However in the generated script the semicolumn is not placed correctly (after the ; some additional ‘and’ clauses are added). This results in an error creating the data cleansing procedure. I added the script in the attachment.Can you please have a look.

313

1 month ago

aftabpContributor

asked in Prepare

Data Clensing results in time out

This problem arrived after the issue with SNK is resolved. I am not sure if the two cases are related in any way but that was the last change made in TX.I am trying to figure out why data clensing is taking so much time. It ultimately ends in time out:Error during Data Processing for Table: DSA.FACT_TABLE_A at: DSAExecution Timeout Expired. The timeout period elapsed prior to completion of the operation or the server is not responding.Operation cancelled by user.Warning: Null value is eliminated by an aggregate or other SET operation.The wait operation timed outStored Procedure: [DSA].[usp_FACTABLE_Clean]Parameters:@version = 2177Line number: 0Details:SQL Server: 'TEST-SQL-SERVER'SQL Error Number: -2The total number of rows in ODX are 9 664 965. It shouldn’t take more than a few minutes to transfer and data clens !

11116

1 month ago

JogchumSiRContributor

asked in Prepare

Columns with source data type money behaving incorrect

Hi All, Hopefully you can help me with this one. We have a source table from our POS systems containing sales transactions. There are a few value columns we transfer that are stored as a money data type and we see some weird things happening with the values of the columns. Differences of 0.01 up to 0.0001 are appearing from nowhere in the transfer from ODX to DWH and i don't know how this i happening.The columns that have money data type are called ‘Bedrag', ’Korting’ and ‘NettoBedrag’ Take transaction 52. In the source the values are like this: After transfer with ODX, i looked in the parquet file using ParquetViewer and that looks like this: Still the same, nothing wrong here.I imported the table without any modifications in TimeXtender and it looks like this: After a transfer the data looks like this: If you look closely we lost 0.0001 on the first record ‘NettoBedrag’. Also wel lost 0.0001 on the Bedrag of the second record.I've tried a few things to mitigate this. Different numeri

9214

1 month ago

DushyantStarter

asked in Prepare

How to add Query table for Mysql data source

Hi Team,We have a data provider for which we need to connect to MySQL. We want to incrementally bring data from the source, but the problem is that all the columns in the table are of the string data type. This prevents us from setting any incremental logic on the date column, which is currently stored as a VARCHAR(8). I tried casting the column to a date format, which works in the query tool, but when I try to add the query table, the option is disabled. I am using Mysql 5.1 client data source.Could you please suggest how I can achieve this?

438

1 month ago

alozVisitor

asked in Prepare

CTE (Common Table Expression)

Is it possble to create a table based on CTE in timextender, or how would you do it?

765

1 month ago

dpjatContributor

asked in Prepare

404 Path can't be found

Hi everyone, back again with another issue. We have now setup our ODX with storage account as storage layer. refreshing it sometimes breaks though. I'm getting 404 error, path can't be found. This happens with transfer all option. When I run the set of tables one by one, everything seems to be fine. I saw 1 more post like this for oracle, where the connector got updated. We're using an older version so I suppose can update the cdata connector and try again. However: the weird thing is that this also happens with ODX to DSA. Any clue how this is possible? Path does not exist, but I can find it in the storage account.

8311

1 month ago

jermaine.cotinoExplorer

asked in Prepare

Unable to use custom data selection rule on ODX table in a DSA mapping

Dear all, We have tx instaled on Azure and on premise. The version we are using is 20.10.52.64. how is it possible that on the onpremise we can use the custom data selection rule and on Azure this screen is not appearing in the DSA?The issue we are facing is that we want to limit that data we want to load in the odx when the raw table is being executed. Therefore we want to set a customized data selection tule on the mappings.Why this option is not in Azure but it is there on the on premise?We want to load / keep all data in the odx server and make a data selection rule in the DSA..Imagine we are migrating from on premise and we want to show only 15 months of data instead of 10 years. Only if the customer is asking for it we will load it. This is working on the on premise perfectly.Now that we are migrating from on premise to azure we are missing the most used data selection rule. And the advised work around

524

1 month ago

jermaine.cotinoExplorer

asked in Prepare

DSA mapping is not showing the source names of the odx in the field mappings

See the screenshot. in the mapping you can see all odx sources with the correct name (ODX(BEBOO1): bronze.blueyonder_wms.DSCMST. However when I go the the field mapping The name for each source is now called local host????For trouble shooting purposes when missing a mapping. It will create a work around for us, because we have to click on the table to see all mappings on the right side then you have to go on be by one. why the name have changed on a the field mapping? possible to have a fix for this?

424

1 month ago

MaarsenStarter

asked in Prepare

The best way for keys

Hi all, I'm looking at making the right keys in our database model. I've been reading some topics on the forum but haven't found a shared opinion on the best practice. Super natural keys Advantage: Easy to use. Disadvantage Huge performance impact. According to some topics reloads can increase in time from 3 till 30 minutes. Their are relations in reloading the tables in the correct sequence. TX will calculate this sequence, however their is an increased change of circle references. Hashed Keys Advantage: Easy to use. Should be faster than SNK. It doesn't need a look up to the keystore. Disadvantage: Change on duplication of keyus is limited to a minimum Source: https://stackoverflow.com/questions/297960/hash-collision-what-are-the-chances Look up DW_Id from different tables Advantage: Able to make all joins on last layer. Easy to use. BIGINT in keys, is better than VARCHARS in keys. Disadvantage: It will cost the simple mode in transfering data from data area X

6911

1 month ago

truttafiskerExplorer

asked in Prepare

Trying to add a new custom field based on an already exsisting value

Hi again I have a table with the following values: I want to add the [No] from the first line (101) to all the other lines .. therefor I thought of making a SQL like this the following. I Why is it my nested Select doesn’t work ??or are there a smarter way than what I thought of doing ?

437

2 months ago

aftabpContributor

asked in Prepare

The selected deployemnt does not contain all needed objects

I often get this pop-up when i Execute a table or a view. It could be either a new table/view or an existing.I get it in DSA and MDW. Dont remember getting it in ODXWhy do i get it?What happens when i click on Yes? What happens when i click on No?

131

2 months ago

truttafiskerExplorer

asked in Prepare

Many-to-many relation or distinct data selection

Hi alleI’m all new to timextender so please bare with me .. I have 2 tables which I have to join but there are duplicate values in both tables .. in one of the tables it’s ok if I somehow made an distinct data selection to it .. but I don’t know how .. I also looked into making a bridge table, but that wouldn’t at first hand solve my problem .. Do anyone have a sugestion on how I could/should make a relationship between these to tables or how I could make a data selection rule that somehow made an “group by” or “distinct” selection ?

568

2 months ago

avanrijnContributor

asked in Prepare

Release DWH from DEV to PROD

Dear Sir,Our client is trying to promote/release their DataWareHouse from DEV to PROD.They are using the Environments page (https://app.timextender.com/data-estate/environments) in the Portal and after a minute or so this Error pops up:“failed with the error 'SQL errored whilst updating target tables”See Word attachment for screenshot details.Client is using TimeXtender version 6675.2Their is no detailed information for this error, so can you please give us a hint where to look for, to solve this. We double checked all database connectivity for DWH and ODX.No luck so far.Please assist. Regards,Arthur

464

3 months ago

Page 1 / 9

Badge winners

KCMThas earned the badge Innovator
dennishanssenhas earned the badge Certified Solutions Architect
Roy Vhas earned the badge Prepare Expert
rvgfoxhas earned the badge Deliver Expert
rvgfoxhas earned the badge Prepare Expert

Show all badges

Terms and Conditions Cookie settings

Sign up

Already have an account? Login

Login with SSO

SSO login

Username *

E-mail address *

Full Name

(Private)

Only you and moderators can see this information

TX Partner / Customer *

Company

(Private)

Only you and moderators can see this information

Password *

I accept the terms & conditions

loginBox.register.email_repeat

Login to the community

No account yet? Create an account

Login with SSO

SSO login

Username or Email

Password

Remember me

Forgot password?

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.