To homepage To homepage

Data Warehouse

Ask questions about TimeXtender Data Warehouse Instances

  • 182 Topics
  • 742 Replies

182 Topics

boyclaesen
Contributor
boyclaesenContributor
asked in Data Warehouse

TimeXtender Execution stopped running

Hello, For two weeks my clients Power Bi report was refreshed daily without issues. Last week this changed after the TimeXtender Execution server stopped running. I ran the TimeXtender ODX Server Configuration on the desktop and started the TimeXtender execution server again. The next days the execution jobs where triggered again but I would like to know why TimeXtender Execution stopped running in the first place.  How could this have happened?     

1
rory.smith
TimeXtender Xpert
3 months ago
P
Visitor
PhantipaVisitor
asked in Data Warehouse

Where can I find a full example both json response data file and RSD file for "Enum and page method" ? Or anyone can give me an example?

I’ve read the artical Enum and page method but we still have a question how the json response and the RSD file should be.It would be great if anyone provide a full example (json response data and the RSD) so that we can fully test.Thanks for advance!

1
Thomas Lind
Community Manager
3 months ago
V
Contributor
vw-victaContributor
asked in Data Warehouse

Data Movement Azure Data Factory - (ForEach Loop) Slow performance

Hello,we're using Timextender with ADF for the data movement between our Data Lake storage and SQL Database. Running the execute from TimeXtender of rerun it within ADF the performance is poor (slow!).Our setup at the moment, regarding to the specs within the topic "Create a Demo Template Project TX SaaS”. We wanted to start basic and then tweak the settings for better performance. Executing the first SQL DatabaseService tier: General Purpose Compute tier: Serverless Hardware:    Standard (Gen5), Min/Max vCores 10 and 30GB Min/Max Memory Auto-pause delay: 1 hourIntegration Runtime - type AzureComputer Size: smallWe tried using a different Computer Size on the IR and also changed the SQL DB Tier for more DTU. No performance improvement after changing.Looking at one of the jobs we are transferring 2048 rows from our Data Lake to our Azure SQL.The Queue is taking most of the time. We did some research on the support page of TimeXtender (No topics) and also at the Microsoft community. Ther

3
andrew.gebhard
Participant
4 months ago
rory.smith
TimeXtender Xpert
rory.smithTimeXtender Xpert
asked in Data Warehouse

Should multiple SQL statements be possible in the query tool?

In v20 and before you can define multiple statements in a query tool window. This can be handy when doing comparisons or dealing with wide tables. v20 statement 1 v20 statement 2 In v21 the second statement is simply ignored for SQL DWH instances and results in an error in Snowflake:v21 SQLv21 Snowflake ; separating statements Was this taken out of v21 or should this actually work like in v20?

1
Thomas Lind
Community Manager
4 months ago
C
Starter
CarloCDOStarter
asked in Data Warehouse

Removing SQL-Logins

Hi all,I recently created a bunch of SQL logins in TimeXtender to use in our Database Roles we set. After I did that I found out I made a mistake and I removed those SQL logins from the database. However, when I try to edit a database role and try to Add a login, I still see the SQL logins I removed.To make sure there is nog caching or something involved I waited a few days before checking if they were still there.Does someone have a solution to remove those logins from the list? I don't want to create new names for my SQL logins just to avoid having the same name as the previous one. Although, if that is the only option I am willing to accept that as well. Kind regards,Carlo

2
C
Starter
4 months ago
sierd.zuiderveld
Contributor
sierd.zuiderveldContributor
asked in Data Warehouse

DW_SourceCode as natural key

Hi all, We ran into an issue with history settings in combination with the DW_SourceCode. We need the DW_SourceCode in our primary key as there is overlap in the sources and this ensures uniqueness.  In the history settings we cannot choose the DW_SourceCode to be the natural key: Without this, history does seem to work, but when we enable Create new record when a deleted record reappears in the source We obtain the error Error during Data Processing for Table: Maintenance.Verkoopinfo at: MaintenanceThe column name 'DW_SourceCode' is specified more than once in the SET clause or column list of an INSERT. A column cannot be assigned more than one value in the same clause. Modify the clause to make sure that a column is updated only once. If this statement updates or inserts columns into a view, column aliasing can conceal the duplication in your code.I've looked into the stored procedure that produces this error and this snippet produces the error: -- History: handle deleted records IN

10
sierd.zuiderveld
Contributor
4 months ago
E
Contributor
ebayContributor
asked in Data Warehouse

Is it possible to extract created date for a CSV file?

HelloI need the creation date and time (createdAt) of a CSV file within the MDW table as a column. How can I access this information?Best Regards

9
Christian Hauggaard
Community Manager
4 months ago
R
Starter
r.miltenburgStarter
asked in Data Warehouse

Issue with running scheduled jobs

We have created several jobs on our ODX and several jobs on our DataWarehouse. The ODX jobs are running correctly based on schedule, but the Datawarehouse jobs never run since there is a schedule.We've also deployed and saved our project, so that should not be the problem. 

4
Christian Hauggaard
Community Manager
4 months ago
T
Explorer
thzmanExplorer
asked in Data Warehouse

SCD does not update correctly

Hi!I beg your pardon for this somewhat lengthy post, but I try to be thorough to avoid confusion. :)I have a problem with updating an SCD.We are moving an old adress history table from another system into a SCD in TX. It has gone well so far since the old system made one insert per person per day regardless of whether there was an update or not, which has made us go from about 108M rows to about 275k rows with actual changes. So far so good. :)The problem now is that have a hard time to get this moved table to update correctly from a new source. The setup looks like this at the moment: The MDW table KIR_Persons is the correct and prepared historical data from the old system where I have fixed the From- and To-dates along with the “Is Current” flag. The “break date” for the data from the old system is 2023-10-16 which is when I made the final export.The new source for the address data is the DSA table KI0VAA0POPULATIONPERSON_QT which is the result of a query table. I’m using the DSA vie

5
T
Explorer
5 months ago
E
Contributor
ebayContributor
asked in Data Warehouse

Relation Diagram of project

HiIn one of my projects, I created a model by transferring the table I received from DSA to MDW using view. When I wanted to create the relation diagram of this model, I saw that it could not establish a connection with the view and DSA table. How do I ensure the connection of all tables at the end of the project? There is no problem with Data Linage.Best Regards

6
daniel
TimeXtender Xpert
5 months ago
B
Starter
BisotaStarter
asked in Data Warehouse

TimeXtender Training unable to add data warehouse

Hello to the community 😀 Currently I started the TimeXtender Training. I am at the point where I have to create the instances. Adding the ODX or SSL instance was no problem. But adding the MDW instance didn’t work out for me. The problem is that i can’t select any storage in the “Server storage type” field. It just says “No items found”. (While adding the ODX instance it preselects “Azure Data Lake” and I can just switch to SQL database”, but while adding the MDW instance it doesn’t give me these options) Does this problem occur to anyone else? Do I maybe have to change any configuration before the “add data warehouse step”? Thank you in advance. Kind regards,Tobias  

3
Thomas Lind
Community Manager
5 months ago
K
Contributor
KajEmergoContributor
asked in Data Warehouse

Mapping set not working on renamed columns

Hi,In my DSA layer I succesfully added a mapping set for which the include rule has identifed two tables. All of the columns in my DSA table have been renamed so none of them align with the original names in the ODX. As a result, the mapping set tells me all of the columns are missing: This specific table was first added to the DSA for a single ODX table, then the columns got renamed and at a later moment I wanted to replace the mapping to a mapping set. Should the mapping set be able to cope with this? In essence, it would be just like doing it manually and using the ‘smart synchronize’ option. But the mapping set does not seem to work like that.Best regards,Kaj

6
K
Contributor
5 months ago
Z
Visitor
ZuzaGlogVisitor
asked in Data Warehouse

Regular Expressions (Regex) in TimeXtender

Hello community, Is it possible to do RegEx with TimeXtender? Or use Python code somewhere in TX that supports the library re? Our business case:-  We have a database with text reviews of varying lengths, where personal information is sometimes available. We want to read the database in and anonimise the values which contain personally identifiable information. For example: "oh no, ZuzaGlog doesn't know how TimeXtender works” and we want to make it "oh no, XXXXXX doesn't know how TimeXtender works”. We currently do it in Python with the library re, and a list of possible personally identifiable information. We search through the strings with reviews using the keywords from the list, and replace hits with XXXXXX. Now we want to build this solution in TimeXtender. In what way would this be possible?

2
Thomas Lind
Community Manager
5 months ago
K
Visitor
kgoddardVisitor
asked in Data Warehouse

Onetime MDW historical table map

Our client has a question about a historical table in TimeXtender. They would like to know if they can make a onetime update from SSMS to populate historical records. More details on the scenario below.Scenario:Table in question is in MDW An ID merge has been done to collapse users that have created multiple accounts into on true account. Logic is done in DSA and flows to MDW. The new merged id was inserted as a new field in the MDW table, the old id was renamed. New merged id field is null for historical records where old id is populated. This makes historical queries fail.Question: Can they run a one time stored procedure in SSMS to fill in the historical records to the new merged id field? What are the potential drawbacks of this solution?

4
Thomas Lind
Community Manager
5 months ago
Stefán Gunnar Jóhannsson
TimeXtender Xpert
Stefán Gunnar JóhannssonTimeXtender Xpert
asked in Data Warehouse

Not supported SQL server version

I’m testing out the new version of TimeXtender. I’ve downloaded the newest version of SQL Server that was suggested in the training material. I’ve created ODX and MDW instance, when I try to deploy a table in the MDW instance I get the following error: Not supported in current SQL version Version:Microsoft SQL Server 2022 (RTM) - 16.0.1000.6 (X64)   Oct  8 2022 05:58:25   Copyright (C) 2022 Microsoft Corporation  Developer Edition (64-bit) on Windows 10 Enterprise 10.0 <X64> (Build 22621: ) (Hypervisor) 

8
rory.smith
TimeXtender Xpert
5 months ago
P
Contributor
pontus.berglundContributor
asked in Data Warehouse

Conditional lookup fields (in preview) for deployment in Snowflake

In the release notes for 6429.1 it says that conditional lookup fields are available “in preview” for deployments in Snowflake. What does this mean?

1
Christian Hauggaard
Community Manager
5 months ago
P
Contributor
pontus.berglundContributor
asked in Data Warehouse

Mapping set not working with custom fields

Hi,I want to use mapping set to map several ODX tables with the same table structure to a single DW table.The problem is that I also want to create additional “custom fields” in the DW table, and since these fields do not exist in any of the ODX tables, the mapping set excludes all the ODX tables and I am left with an empty DW table. Is there a work around to this? or am I perhaps doing something wrong?This is my DW table: The bolded fields with descriptions do not have mappings to them, they instead have custom transformations.I have used “convert to mapping set” to get the mapping set, and then adjusted it so both tables match the mapping set rules.As seen below, both tables are then excluded since neither have the custom fields. Is it necessary that all fields have at least one mapping to them?

4
P
Contributor
5 months ago
rvgfox
Problem Solver
rvgfoxProblem Solver
asked in Data Warehouse

Full outer join between two tables

I’ve two tables, A and B, and I want a full outter join to obtain a table C like in the image:In T-SQL it would be:SELECT  COALESCE(A.Id, B.Id) AS Id       ,A.ValueA AS ValueA       ,B.ValueB AS ValueBFROM TableA AS A    FULL OUTTER JOIN TableB AS BON A.Id=B.Id Is it the only way to use a custom view?

6
Thomas Lind
Community Manager
5 months ago
anders.e.jonsson
Contributor
anders.e.jonssonContributor
asked in Data Warehouse

Error i command Deploy. After upgrading to 6429

Hello,We just upgraded our sandbox to release 6429.We created environments, and Copied from Dev to Test without problems in the portal. Both MDW and SSL. SSL was mapped to the correct MDW.But after we copied from Test to Prod this error came when we tried to deploye Data Area DSA in MDW Prod. Error details in attached text file.BRAnders

2
Thomas Lind
Community Manager
5 months ago
sierd.zuiderveld
Contributor
sierd.zuiderveldContributor
asked in Data Warehouse

Raw field can still be mapped to next table?

Hi, I believe this is a bug but perhaps intentional. When a field in the DSA is set to ‘Raw’ , you can still map it to the MDW. When you do this the field is not mapped (as it is impossible), however the table does become dirty (red). Then, when you refresh the instance, the field is actually added in the MDW, but not mapped. I attached a GIF that shows this.  

2
Christian Hauggaard
Community Manager
5 months ago
R
Starter
r.miltenburgStarter
asked in Data Warehouse

Unable to add job for Data Warehouse and Semantic model

Hi guys,Somehow I am unable to create a job for my semantic models or my datawarehouse/ data area. I can’t select the model when I’m trying to add a new job.  

2
Christian Hauggaard
Community Manager
6 months ago
R
Starter
r.miltenburgStarter
asked in Data Warehouse

Sync between ODX and Datawarehouse

Hi, I am syncing my data between ODX (csv files) and my DSA_Clean data area (Data waehouse). No i’m constantly getting an error that 1 of my previous inserted rows doesn’t exist anymore. I’ve tried to sync all my possible steps, so ODX, Source, Data are, but I keep getting the error and I don’t know hpw to resolve this problem.I tried several steps:1 Add the table as new table in my datawarehouse area, but still same error.2 Remove and add column again 

4
R
Starter
6 months ago
Roy V
Contributor
Roy VContributor
asked in Data Warehouse

Incremental load based on history table with soft deletes

I have table A with history enabled, all columns SCD type 2 except the PK and a record is marked as deleted when deleted in the source (with a seperate record).In the next data area / data warehouse (DSA) i want to create an incremental table B based on table A, but I do not want to have deleted records from A in table B.When follwing the incremental rule wizzard the incremental selection rule can be set based on the incrementaltimestamp but deletes can not be handled because table A has no deletes (is thomstone =1).How to solve this the easiest? I can only think of taking along the Isthombstone field to table B and delete the records in a post script but this should be possible musch easier I would say.Suggestions? 

13
peter.jensen
TimeXtender Xpert
6 months ago
G
Starter
gisliheiStarter
asked in Data Warehouse

Load large fact table incrementally takes "long" time.

Is it normal when loading fact table incrementally with new data, that it can take up to one hour?Are there any tips to have this incremental load to perform better?Moving records from staging table to fact tablefact table is 140 million records, new load is around 500 thousand records with new timestamp here is the execution log overview  the table is not that complex.17 fields are moved over, from staging to fact table1 field is from keystore3 fields are have custom value script table settings are..  we are running TX, version.  6346.1Azure database, running with 6 cpu 

1
daniel
TimeXtender Xpert
7 months ago
P
Contributor
pontus.berglundContributor
posted in Data Warehouse

Best practice when using Supernatural keys

Hi,I have seen clients use Supernatural key fields to create keys between the fact and dimension tables, usually when the logical key is a combination of fields. I have seen these two methods used:The Supernatural field key is created in both the fact and dim table, using the same key store The Supernatural key is created in the dim table, then mapped to the fact table with a conditional lookupIs there a difference in performance here? Is there a best practice to advocate for? 

22
Thomas Lind
Community Manager
7 months ago

Badge winners

Show all badges
Terms and ConditionsCookie settings