TimeXtender Desktop Q&A

We are facing a performance issue while fetching the data from D365 F&O using CData provider. While fetching a data entity with around 700K records, It was taking around 1:20 mins, now when we execute it, its running for 10+ hours with no response. While executing we noticed a SQL session with bulk insert command from TimeXtender with suspended state. and on the D365 database there are multiple session of batch process to fetch the data based on partition number. Since we are witnessed multiple sessions keeps executing, we would like to understand how the batch size is defined. And how we can customize the batch. Or any other way to set the connection properties which pull’s the data faster.Query for Ref :FROM Table_XXXXXXX T2 WHERE ((((((T2.PARTITION=5637144576) AND ((T2.PARTITION#2=5637144576) OR (T2.PARTITION#2 IS NULL))) AND (T2.PARTITION#3=5637144576)) AND (T2.PARTITION#4=5637144576)) AND (T2.PARTITION#5=5637144576)) AND (T2.PARTITION#6=5637144576)) )T1 WHERE ((T1.rowNumber&gt

I’m importing a table which is supposed to have an integer primary key, but the data is messy and we find things like “6TEST3” or “CREDIT3” in this field. I want to read the table and use this field as an integer, however can’t convert it because of those rows. Is there a way to remove a row if I can’t convert a field value to integer?

In v20.10.43, I’ve come across a bunch of auto-generated views with a _BCV suffix.Are they used for merged (incremental?) loading in the next layer, or what’s the purpose of these views?Why do they need to be redeployed whenever I do a managed deployment?And why does the SQL Clean Up Wizard delete them when they’re being used?(I haven’t tested if this could happen in a v6284.1 MDW)

Hi TimeXtender, We’re seeing the following scenario: We have a execution package ‘A’ that is set up with an usage condition and a next package ‘B’ in the post execution steps.Now, when we manually execute package ‘A’ through the user interface and the usage condition resolves false, the display message appears with this information, package 'A’ won't start as expected and, importantly, the next package 'B’, from the 'Run Package’ setting, won't start as well.However, when the same execution package 'A’ is triggered through the scheduler, we see that even though package 'A’ won't start, because the usage condition returns false, the next package 'B’ in this case does start executing. Is this something you are familiar with or are able to reproduce? Extra information is that package 'B’ doesn't have an usage condition applied and we're running TX 20.10.43.64. Best regards,Luuk Bouman

HelloI am wondering, how can I connect to Zip File? I searched and asked Xpilot and then I get this answer: To connect a Zip file in TimeXtender, you can use the "File" data source type. But I couldnt find File datasource. Has the name changed or is there another method?Best Regards

Hi,To my knowledge it is not possible to setup alerts for errors or warnings on validation rules.However, I read the following on the TimeXtender Sales Hub:"Set up automated alerts to notify you when data quality rules are violated, data quality issues are detected, or executions fail to complete.” (https://coda.io/d/TimeXtender-Sales-Hub_d3yl25w6y3Y/Data-Quality_sueAz#_luZ9c).Does someone know if this is possible, and if so, how? If not this would be a nice idea though! Kind regards,Devin

Hi,I normally use Custom transformation (CASE statements) when I need to populate a field based on multiple conditions, in this case multiple “OR” conditions (Logical disjunction) . It was brought to my attention not to use CASE statements in Custom transformations. So I have below an example using a fixed value transformation but I want to add two conditions to populate only when it is ‘FL’ or ‘OL’. When I add these conditions the conditions are on separate lines but still TX makes an “AND” logic of it so instead of (like ‘FL%’ or like ‘OL%’) it translate it to (like ‘FL%’ & like ‘OL%’). How can I get the “OR” instead of “AND”?   

We are facing an issue with one of our clients in which we built out a UAT environment to promote proper development but have come across an issue where we have a fully built TX Semantic Layer on the production environment, but we do not have it built out for the TX UAT environment. The reason behind this was because the test Qlik Sense environment was not available initially, and we could not successfully execute packages on the TX uat environment, so we decided to work without it on TX uat. Now that we have an operational test Qlik Sense environment, we want to export the semantic layer from TX production to TX uat environment. Is there a way for us to do this in TimeXtender? We are trying to avoid large amount of manual work to build this out on the TX uat environment and we dont want to export project from Prod to UAT as that will override all our work in UAT environment. Prod TX Semantic LayerUAT TX Semantic Layer  

Hello,I have a history enabled table with a lookup field. The lookup field is marked as type I (update record). However, the record is only updated with the new values in the table from which the lookup field is retrieved, if the record is available in the raw variant of the history table. If the record has been updated in the mean time, the lookup field is never triggered to be updated.Is there a way to have the lookup fields be updated in a history enable table without the record being present in the raw table?I have currently created a work around by not truncating the raw table, but this causes an unnecessary increase in the size of the raw table and produces many primary key violation errors.Looking forward to your answer!

I was interested in this link.Data directly from Data lake to MDW (without ODX) | Community (timextender.com) I am not able to access this link which was posted in the below of the message.  https://support.timextender.com/timextender-product-focus-group-123/virtual-odx-capability-to-read-directly-from-existing-data-lake-container-no-second-copy-614 Please advice,  

Hello.I have a scheduled execution package which takes data from ODX, transforms data in DSA database and loads final tables to MDW. This execution package basically runs a perspective containing this process.I need to setup following logic:If data in any source table (ODX) of this execution package is empty (i.e. at least 1 empty table) Do not execute the package If data in all source tables (ODX) of this execution package contain any data (i.e. all tables non-empty) Execute the package Is there any way how i can setup this? Maybe even create additional “control” execution package? The version of TX i am running is 20.10.34.64 Thank you!

Hi all,I have a client that has a datalake with parquet files in an Azure Storage Account Blob container (Datalake Gen2). This datalake has not been created by ODX server, but has been created by Synapse (scripted, delta lake parquet files). Since we want to load multiple tables from multiple folders we use the CData Parquet connector v2023 (TX 20.10.41). The issue we have is that we can’t find the right settings for the connector to recognize that the folder we’re connecting to contains multiple tables and that the parquet files are in a subfolder of the table folder. For the connection we use a Shared Access Signature and the connection is working:The name of the container is ‘development’ which we configure in the Base URL. In the URI we point to the folder of the bronze layer, the system and the database: The database folder contains a folder for each table. In each table folder some tables have a a partition folder followed by the actual parquet file. Since the connector needs to

Hi all!We have created an external executable to run a python script, basically looking like this: cd F:\Data\Start-Process python GetData.pyexitNext we have added this to an execution package. If we run the package it will open a prompt and run the python script no problem.However if we add the package to a job and schedule or manually run that job nothing happens. How can we get this to work?cheers,Maarten

I need to make a field transformation such that if the field value starts with “DOK”, then I want to replace the value with “1001”. I tried to set up this custom field transformation using something along the lines of CASE WHEN …, but didn’t manage to get this to work. How would I write this code in TX?

We have a historic table and we use Dw_id as an unique indentifier. But when we update the record the DW_Id will stay the same, so we have duplicate values in the table on that field then. the original DW_id field is changing but the transformantion field isn’t.  Because we work with custom data aswell that we want to have there own value we work with the custom transformation. I will  provide some screens from the issue:   Can you provide me a way so the field eenheidssleutel will be unique over time and is equal to the DW_ID now and in the past of the historic table. 

I have below the API request for Power Shell. Now I want to set it up in TX.  How to set up (Basic) Authentication for a request with a token retrieve?    # Force the use of SSL [System.Net.ServicePointManager]::SecurityProtocol = [System.Net.SecurityProtocolType]::Tls12 ####################### # SETTINGS                                                                       # ####################### # REST API SETTINGS # $API_key = "HIDDEN" $API_username = "HIDDEN" $API_password = "HIDDEN" $API_company = "HIDDEN" $API_URL_Login = "https://secure.xxxxxxxxxxxxx.eu/ta/rest/v1/login" ####################### # LOGIN AND RETRIEVE TOKEN FOR UKG Ready                                         # #######################          Write-Host "### Retrieving token"            $headers_login = @{   'Content-Type' = 'application/json';         'Accept' = 'application/json';         'API-Key' = $API_key;      }     Write-Host "- Headers prepared"         $request_login = '{"credentials": {"username": "'

Hi, I've been trying to add new excel file from a new sharepoint group from the same company link to the same ODX server by using CData connector. Is there any setting to add both sharepoint links or make it visible? Now, I can only see the link with group1.sharepoint page examples;https://company.sharepoint.com/sites/group1https://company.sharepoint.com/sites/group2Best!

Anyone know in what TX repo table I can find the field and value for “Guard on deployement” and “Guard on execution?I know where the setting is in the UI, but need to look up the value in the repo db.

Hi can you add a diagram or something like that to understand when and where that scripts are executed? 

v20.10.35.64A while ago I was looking for a solution on how to conditionally fill down/flash fill values with certain criteria. Unfortunately the answers in this ticket didn't do the trick for me, as I kept getting NULL values with all solutions I've tried. How can I conditionally fill down/flash fill NULL values with previous values based on certain criteria? | Community (timextender.com)Now I seem to get it working with a Self Lookup view and a Lookup Field (Top first-non value). However, I have to repeat this process for almost 10 columns. The loading of this table went from 06:00 to 30:00 minutes. The lookup field looks as follows. What it does is:Look if column Route Bron is empty, If Route Bron is not empty, just show Route Bron. If Route Bron is empty, lookup the TOP first non empty Route Bron Value with the same Source, Project, Cardcode where project is not empty and not 999999 Is there a way how I can optimize this process? Thanks in advance!

Hi,I'm using the CData ADO.NET Provider for OData 2022 (22.0.8322.0) to extract Topdesk data.Due to performance reasons Topdesk made some changes in their feed. Resulting in that, since 19th june 2023, 2 larger tables (IncidentDurationBlocks and IncidentSnapshots) cannot longer be extracted without filtering on a date to make the dataset smaller.How can I add a filter for only one table in my extract?Can I create an OData RSD file?I get this error when I try to extract:System.Data.CData.OData.ODataException (0x80004005): [500] Could not execute the specified command: Unexpected response status code: 503.  ---> rds220I.IC: Unexpected response status code: 503

In fact tables we are using subrogate keys from the dimension tables using supernatural keys.The relationship between the fact table and the dimension table it’s using the bussines key and getting the subrogate key from the dimension table into fact table. But some times it doesn’t exists, and I’m using -1 to put that value.What it’s the best way to include the unknow member (-1) in the dimension table?

When we creating a numeric field in a MDW table, TX suggets use a numeric(38,6) for the data type.When the field it’s translated to the semantic model it’s detected in TX:But in the model:And one of the best practice rules says “Do not use floating point data types”.How can I follow this rule?   

Hi,we have a customer running incremental loads multiple times a day in the ODX Server (using Data Lake Gen2).  We’re reaching the 10.000th incremental run.I’m wondering how the ODX server will handle that 10.000th increment (since the naming of the parquet files allows a number up to 9999).BR.Peter

Hi community, The CDATA Provider for LinkedIn 2022 contains a bug/error which causes it to call an invalid API URI for the connector’s table ‘OrganizationFollowerCount’. The appropriate URI for this table according to Organization Network Size - LinkedIn | Microsoft Learn is:https://api.linkedin.com/v2/networkSizes/urn:li:organization:1234567?edgeType=CompanyFollowedByMemberHowever, CDATA is calling the following:2023-06-12T11:31:21.793+02:00 2 [5|Q-Id] [HTTP|Req: 3] GET https://api.linkedin.com/rest/networkSizes/1234567?edgeType=CompanyFollowedByMemberWhich results in the following error message:2023-06-12T11:31:22.172+02:00    3    [5|Q-Id]    [HTTP|Res: 3] {"message":"Key parameter value '1234567' is invalid","status":400}2023-06-12T11:31:22.172+02:00    2    [5|Q-Id]    [HTTP|Res: 3] HTTP/1.1 400 Bad Request, 66 Bytes Transferred2023-06-12T11:31:22.194+02:00    1    [5|Q-Id]    [EXEC|Messag] Executed query: [SELECT [FirstDegreeSize], 0 AS [odx_batch_number] FROM [LinkedIn].[Organiz