TimeXtender Desktop Q&A

Hi community,  I have to design the following issue, every day, I have a new CVS file in the Azure storage account. These file’s name change with a new day, for exampleFormaExtract.net_new_commission_2023-03-01.csvFormaExtract.net_new_commission_2023-03-02.csvFormaExtract.net_new_commission_2023-03-03.csvHow I could create an automatic process to load a new file to the table in DSA? Now I will do it manually adding every day a new file an process the data.ODX DSA Another requirement is to create a new column SourceMainTable in the DSA table with the file’s name. RegardsIgnacio

We have a Dynamics 365 Finance and Operations system, where we have the Data-lake export running (for over 1 year). THe setup is similar to Josephs sketch solution for the following question:Dynamics 365 F&O Data Lake as a TX source | Community (timextender.com)We have it running quite stable on one of our boxes, but are struggling with stability on a pre-production box.The goal is to use Azure AD Integrated Authentication, and the user running the scheduler has been given access to the Serverless SQL Database (tested in SSMS)First we experienced some missing prerequisites when using Azure AD auth:Execute ODX d365fo_dl.ACOJournalTable_BR ADO.NET Transfer:Error:Failed      -Execute ODX d365fo_dl.ACOJournalTable_BR ADO.NET Transfer 'Failed'          Unable to load adalsql.dll (Authentication=ActiveDirectoryIntegrated). Error code: 0x2. For more information, see http://go.microsoft.com/fwlink/?LinkID=513072                    Details:                    SQL Server: 'import-d365fo-data

Dear Reader,Dynamic Row Level Security (DRLS) can be implemented by defining a table that contains 1. values for the column to be secured; 2. defining the users email-addresses.With this specific case, two DRLS columns are defined.This is shown as depicted in the first picture below:The first column (_Retailer_Key).The second column to be secured is also dynamically defined (_CountryAccess_Key):This works, however suppose I have 4 retailer country combinationsCountry Retailer UK YourOwn NL YourOwn UK Theirs GE Unsere  And the _CountryAccess_Key that was defined by DRLS was “UK” and the Retailer was YourOwn, then the Result is that the rows with the red font is returned. This is just (_CountryAccess_Key OR _Retailer_Key). However that’s not the result required. The result should be (_CountryAccess_Key AND _Retailer_Key) as depicted below.Now the result only returns one row (depicted in the red font) Country Retailer UK YourOwn NL YourOwn UK Theirs GE Unsere

Dear all,Do any of you have a way of guarding Views in the data warehouse?I have some views which I for archiving purposes rather not delete, but this is giving me issues when I want to deploy the project as a whole.Thanks!

In my data source a new field [geregistreerd] is added.After synchronizing the data source and a transfer, the field is available in the ODX Go to the MDWSelect the mapping of the table  The field is not available in the Data Movement  Add a new field in the MDW tableAdd a transformationThe field is available in the Data Fields   Why is it not available in the Data Movement?

I'm trying to setup ODX critical error notification. I've used the same settings as the regular TX notifications, but the test email never arrives. I do notice that in the ODX I do not have the option to enable SSL/TLS, which is needed. I'm using smtp.office365.com.

I have loaded a table with some initial data  (== initial stoock). The key is quiet simple  Company, Warehouse and ItemNow I want to update the amounts every day so that it reflects the actual stock level of data dayThe initial load was done from one source , the updates come from another sources History settings  have natural jkey set , and all non lookup fields are updsated  (type 1)Nevertheless the record is not updated Any idea ‘why’ the update is not working

Hi,I have created a semantic model in our development environment with a global database,In development the model is named Sales DEV and in production it is named Sales.When I make changes to the model and do a multiple environment transfer, the data in the production model is deleted and the users cannot use the model before I have executed the model in the production environment.I expected a creation of a offline model, which could be executed at a later time. Instead our users cannot access data in a period of time, which is unacceptable to our business.How can I avoid this, so our users do not experience down time on the production model? Kind regards,Rasmus Høholt

Is it possible to use CSV endpoint to Blob storage?How can I setup it?

Hi,It’s possible to create new schemas to set rules for access. Are there other reasons, beyond that, for creating new schemas?What are the pros and cons of extra schemas in a Data Areas in version 21 (6xxx)?All knowledge and experience in the field is gratefully receivedBRAnders

Hello,In order to be able to answer all related questions regarding GDPR, we are designing a TX solution that allows us to track all tables/columns that contains sensitive information. Most importantly, we make use of tags so we can track the columns throughout the DWH.An additional question we got is if it is possible to keep track of changes in the TimeXtender projects. In other words, who added which column (with sensitive data) to the project and when? What is the best way to keep track of these things and is there a solution in TimeXtender available that we can use to provide this information? Probably we should use the data in the TX Repository, we were curious if you have had this question before.

I’ve some tables in my data source without primary key, but I’ve a MODIFIEDDATETIME field for all the records, that it can be used to incremental load, but TX doesn’t allow it.Some workaround? 

We using multiple semantic layers, and adding more in the future. All semantic layers will probably need a calendar dimension and some other dimensions are also shared between layers. Is there any 10x  method to copying between semantic layers, as it seems quite ineffective to setup:sort bysummarize bycategoryn-times on the same table

What it’s the recomended setup in the new version to support multiple developers and multiple projects?How many ODX instances, MDW instances must we would use?

TX: 6143.1 I have a TimeXtender SQL Data Source version 17.0.0.0 that I am trying to upgrade to 17.0.0.1. When I do Manage Data Sources in the ODX Server from the TimeXtender application it tells me there is an update available. When I apply this it tells me to ‘Edit the datasource’ to update the connection string. There does not seem to be an obvious way to do this. The User Portal also does not seem to have a way to update this.What is the process I should apply?

Hello,Current Setup: TimeXtender 20.10.31.64 and ODX 20.10.31.I need help setting up incremental load on a rather different type of data flow from the standard one, that has table inserts and views inbetween tables.The flow is as follows:Table A (has incremental load today) => View1 => TableB => Table C(MDW) once directly but also through View2.Both views are necessary so we cannot remove them.  My question is how to setup incremental load in timextender on this solution, if it is even possible. I am not sure how to do it through a view. Currently there is only an incremental load set up on Table A and then we fully load table B and C. Thank you

Hi,I am using the ODX server to get data from the SQL server database.After executing the transfer task, I am getting the below error.Any idea how to solve this?“System.Data.SqlClient.SqlException (0x80131904): The datediff function resulted in an overflow. The number of dateparts separating two date/time instances is too large. Try to use datediff with a less precise datepart.System.Data.SqlClient.SqlException (0x80131904): The datediff function resulted in an overflow. The number of dateparts separating two date/time instances is too large. Try to use datediff with a less precise datepart.”

Hi Support,We are using an ADO Data Source connection to load data in the ODX into Azure.From there we map the ODX table to the next layer in TimeXtender.This seemed to work.But now we changed the source table with added and removed columns.We sync and transfer it in the ODX and when we use preview in the ODX we are seeing the new table as expected. But when we map it in TimeXtender again to the next layer, the changes are not added. It instead maps to what is used to be. It mappes fields to columns that no longer exist, and it does not map the new added columns.We tried clearing the files in Azure to start fresh but it still mappes to the older version that no longer exist. Why would it still mapp to the old table that no longer exist in the source and no longer exist in Azure?Why would it not mapp to the new table thats in Azure now?Is there some metadata in TimeXender that first has to be cleaned before changes can be mapped?Kind regards,Tamim 

After attempting to add a new column to my history table, I cannot get the table deployed and executed anymore. The new column is currently not in the table, but I also can't get it to get back to "old" historical table back without the new column. Currently have tried the following things, but so far without result:Set the project version back to an earlier version where the change wasn’t made yet; Upgrarde the PROD SQL DB Size and deploy again.It does not get beyond the Valid Table structure when deploying the historical table. When previewing I also get the following error messages:The table you are trying to preview has not been deployed yet. Deploy first.Invalid column name 'SCD Type I Hash Key'.   The table you are trying to preview has not been deployed yet. Deploy first. Invalid column name 'SCD Type I Hash Key'. Details: SQL Server: 'c5d03ed4f0ca.tr30953.westeurope1-a.worker.database.windows.net,11052'SQL Procedure: ''SQL Line Number: 1SQL Error Number: 207 Invalid column name

We are planning to use  Export to Azure Data Lake feature in D365 F&OMy question it’s:How can connect to the Data Lake from TX?Or, we can connect to Synapse Analytics?How can we make the data source setup in TX?

I have the following code y DSA:Select * from TableA union Select * from TableBunion Select * from Table CI want to replace this code with a table

We have a SFTP source on which CSV files are stored and which can be authenticated to with a ‘public key’. When using the CData SFTP-connector in ODX Server, we are able to connect with the following settings: The most important setting here is the SSH Auth mode, where we specify that we are using PublicKey authentication. Since I am not familiar with this type of connector, I would not now how to retrieve the data from the CSV files (the only table we get from the source now is the ‘Root’ table that contains the FileNames that can be found in the folder).I would rather use the CData CSV-connector, but that leaves me with a problem when testing the connection: I cannot specify that I want to use the PublicKey authentication mode. That is, it is specified under ‘SSH Auth Mode’ but it is not possible to select under ‘Auth Scheme’: As a result, we keep getting the same error on testing the connection (see attached file). I have tried setting the Auth Scheme to ‘None’, ‘Auto’, ‘SFTP’ or ‘B

Hi,We are receiving some weird error messages when executing our project, which uses Azure Data Factory to copy tables from our Data Lake storage to the Azure SQL db (ODX → DWH). The error can be found in the attachments. When inspecting the pipeline run on ADF, it seems to be missing the configured activities (see second attachment). When executing the table manually from TX, the pipeline runs succesfully. Also the pipeline seems correctly configured on ADF and the pipeline run that is created when executing the table manually shows the correct activities.Any ideas as to what might be causing this? Best regards,Kaj  

I’ve three excel files in a SharePoint folder:Budget Forecast Price ListWhat it’s the best option to get the files into a TXA DSA?Can you provide me with detailed instructions? 

We are seeing a situation where the next scheduled execution of a package does not start and the event is logged that this is because the previous execution is still running. However, when we closely look at finish times for these executions, the actual finish time is on average 8 minutes before the start of the next execution. I've been told that there can be a delay of a couple of minutes between the task itself actually finishing and the moment the process that executed the task is ended as well. However, 8 minutes and sometimes even up to 13 minutes seems too long.Anybody any ideas on why this occurs and what could be done about it? We're currently running TX version 20.10.25.