Prepare

Hi, I'm searching for a way to get a table insert incremental. I have a table (about 30 million records). This has a row for each hour of the day for 10.000 machines, so this table is getting bigger very quickly. I do a lot of transformations in this table. This resulted in a load time of over 10 hours. I've discussed this with our TimeXtender Solution Specialist and we've decided to split the table into multiple smaller tables. Now I do have 1 table (loaded incrementally from ODX), this table has a lot of lookups and simple transformations. This table is loading quickly because it's incrementally loaded. The result of this table is inserted in a new table (Raw table), using a table insert. This table is converting cumulative numbers to noncumulative, using the SQL functions LAG, OVER, PARTITION BY and ORDER BY. Because it is a table insert I have no idea how to do this incremental. I've set NonClusted Indexes (also on Raw table) on all fields used in the PARTION BY function. And enabl

Hi all, I'll try to find out how to get rows in the _L table when I use a field validation. For field validation I can decide if I get a warning or an error information. But I only get a message in the _M like this: How can I get the rows that don't match the field validation criterion to get an entry in the _L table?

Hi all, I have not been able to find any similar posts. My problem is that I stumble over an execution error when trying to map two different sources with identical columns, except one, that only exist in one source. I except data from one of the sources into the column and expect Null from the other on the lines originating from the other. But however Timextender throws error "Invalid column name 'XXXXX' " on the column at execution. Have tried full deploy. Only if I remove the XXXXX column it will execute. Any ideas?

When I have two tables, how can i make a left outer join between 2 tables. Or do i always need to use a custom view for this situation. Table 1 = Adressid = 1id = 2 Table 2 = Relationpersonid = 1personid = 2 Table 3 id = 1, personid = 1, personid = 2id 2 , null

Is there an option to set a default value for a simple table such that we can fill it with some value without doing any transformations. It then also should be possible to add fields for simple tables, but that you can only fill it with a default value. It would also be helpful in the DSA.

I am busy with de TimeXtender Learn (TimeXtender Optimization) en there is an exercise : Right click DSA node and choose Automate > Add Suggested Constraints. De instruction is on TX 20.5.6.64, we work with 20.10.23.64. I can't find this function. Is that correct ?

I am unable to use the Add related records on a table. I get the error message "There is no relation between table-A and the table table-B". I have added a condition where the key in both tables should be equal. I have also tried creating a relation between the two tables in both directions but no luck. There is no mention in the docs that it is needed to add a relation before adding related records. I am getting a Warning that the source table is executed after the destination table. What am I doing wrong?

Is there a way to use IS NOT NULL as one of the join conditions on a lookup? I want to get the TOP (1) record where a field is not null, ordered by date. Currently I have to edit the _Clean stored procedure as custom code to add it, which is obviously not the best way to do things. Thanks

When you set up primary key behaviour to 'error' you elegantly force all valid data to be unique combinations of your selected primary keys. But, how do you control what individual dataset is regarded as valid and what is discarded as error ? Is there a way to let the primary key violation error handling know, which record you consider the valid one ? (e.g. based on min/max values in non-primary key data fields)

Hello, So I am loading historical data into tables in TX created of Excel files. One file for property data, one file for casualty data. After some time the file format changes and they combine these two separate files into one file and add new fields. Can I create a new data source to load the new file but still use the original worksheet tab names such that the data will still load into the existing tables? Thanks in advance. P.S. I am using Discovery Hub 17.12.13.64

I have been running into a problem where my execution package keeps failing due to a deadlock between an index rebuild and a select statement on sys.tables. TimeXtender is running both process' and one eventually gets killed and fails the entire job. in subsequent executions it has always failed on an index rebuild, but not the same index. Has anyone run into this issue or have any solutions? here's the query. SELECT SCHEMA_NAME(tbl.schema_id) AS [Schema], tbl.name AS [Name], tbl.object_id AS [ID], CAST( case when tbl.is_ms_shipped = 1 then 1 when ( select major_id from sys.extended_properties where major_id = tbl.object_id and minor_id = 0 and class = 1 and name = N'microsoft_database_tools_support') is not null then 1 else 0 end AS bit) AS [IsSystemObject] FROM sys.tables AS tbl ORDER BY [Schema] ASC,[Name] ASC

I have a table with fields defined (call it Table B), but no mapping. I am inserting into this by using Table Insert (from Table A). Think Table A -> inserted into -> Table B. In the picture below Table A is Projects from D365 at the bottom of the picture. Table B is everything else in the image. DataAreaId is a field defined on Table B and is populated successfully from the table insert. I would like to have a field, Field C, that simply does a custom transformation which places the value of DataAreaID into Field C. While the Table B is fully deployed and executed, I am finding that Field C is unpopulated. In fact all fields in the image that take values not from the Table Insert directly are unpopulated meaning I also can't assign constants. So, all of the DimensionDisplayValue - xxxx fields in the picture are empty after executing. I have also noticed to my surprise that the raw table is empty. Not sure if this is by design or if something on Table B can be reconfigure to allow this

Hi, I have a large FACT-tables in my DWH (copy from a view in stage). I have tried to add partitions. I didn't help that much, so I removed it again.But since I removed it, the table can't be deployed. I get the below error. I can re-add the partition, but still the same error: An error occurred during drop partition function. See exception details for the failing object An error occurred during drop user defined function. See exception details for the failing object: Drop failed for PartitionFunction 'FactSalesOrder_History_PartitionFunction'. An exception occurred while executing a Transact-SQL statement or batch. Partition function 'FactSalesOrder_History_PartitionFunction' is being used by one or more partition schemes. Details: SQL Server: '.' SQL Procedure: '' SQL Line Number: 2 SQL Error Number: 7706 I'm not sure how to find and drop what-ever TX is complaining about.Tried this:DROP PARTITION FUNCTION FactSalesOrder_History_PartitionFunction and then get this:Partition function

I am using the Field Validation to test our ETL. Using this as source data: And these rules in the DSA: And this query to check for errors: I get the following result: The _L table is linking to the records in the _R table that were removed when they failed the validation step on FIRST_NAME. Also the Warning level notification is not present in the table. As it stands the _L, _R, and _M tables as joined above are showing incorrect or at least confusing information. Am I using them as they were intended to be used, and has anyone done anything to get around this? Thanks, Mark

Is it possible to create a clustered column-store index in TimeXtender 20.103.64?

How does "Table classification" in Table Settings affect a table ?Can't find any information in the user guide or google. For which cases "Dimension- /Fact Table (normal + large) are use full ? Many thanks for your help. Cheers Alex

How do I tell TimeXtender to use a clustered columnstore index for my fact table in Azure Synapse?

How can I execute a stored procedure once a load of a table is done. I know it should be possible. I just don't know where I should configure it

Hi, I have to do something like this in TX: If productno > 0 then 'Product A' else lookup in table productnames I cannot figure out how to do this in TX. Hope someone can help. Best regards Michael Vaisgaard

How to write 'case' in Custom SQL, please let me know with example. Here is the situation (SQL query) that I need to perform on Date table & likes to update 'IND' column where DateValue is default column in Date table selectcase when GETDATE()<=DateValue then 'N' else 'Y' end as 'IND' ,* from <table_name> order by DateValue desc

Example scenario: Table DimProject has 2 mappings, each from a different source: Mapping 1 = SourceA.Project Mapping 2 = SourceB.Project Now both systems will have the same project number with different meanings. My question is how do I make a transformation that returns 'A' + [project number] in mapping 1 and 'B' + [project number] in mapping 2. The solution needs be rely on explicitly meaningful conditions, no implicit conditions that drive people crazy trying to decipher what they are for somewhere in the future. Any ideas?

How can a parent-child hierarchy be historicized using parent DW_Ids?

Hi, i've setup a MDW layer with proper relations between tables. At this point I wanted to create a relation diagriam to visualise to my client the relation between his entities. my tool of choice was SQL Management Studio. Only then i've realised that TimeXtender only create DW_Id as physical primary key and the relations between tables are managed internally Is there a way in TimeXtender to visualize the relations between the tables? I've already put my vote here

Hi, I am trying to build a transformation process in TX based on the following SQL code. ------------------------------------------ SELECT distinct[BusinessEntityID] ,B.MonthKey,[StartDate],[EndDate] ,[DepartmentName] FROM [TX_DSA].[dbo].[EmployeeDepartmentHistory] Ajoin dbo.Calendar B ON B.Date >= A.StartDatewhere b.DateValue >= a.StartDate AND (a.EndDate is null or a.EndDate <= b.DateValue) ---------------------------------------------------- I want intentionally to expand the grain of table A. I tried different Joins and conditional lookups but I just can't reproduce the output. How would you solve this? Thanks in advance grJose

I am joining 2 tables T1 and T2 based on a condition T1.A = T2.B T1.A have values like 'wNFq' and T2.B have values like 'WNFQ', 'wnfQ', 'WnFq', 'wNFq' For a regular join a particular row of 'wNFq' from T1 gets joined with all values: 'WNFQ', 'wnfQ','WnFq' and 'wNFq' of T2 My intention is to join only 'wNFq' from T1 to 'wNFq'. I achieved the same using custom SQL insert and using the below COLLATE function to join based on case sensitive sequencing using: T1.A COLLATE Latin1_General_CS_AS_KS_WS = T2.B COLLATE Latin_1_General_CS_AS_KS_WS Wandering if there is a different way to achieve this avoiding custom SQL. Appreciate any help on the same.