Ask questions and find answers about TimeXtender Data Integration and TimeXtender Classic desktop applications
Recently active
Hi,I have a working connection to an S3 bucket with CSV files, using the CData CSV connector.I would like to create a solution where I read only the latest file added to the bucket.Calling the stored procedure “ListFiles” (https://cdn.cdata.com/help/RVJ/ado/pg_sp-listfiles.htm) in a query table returns a table of the files, with filename and created timestamp.Is it possible to call ListFiles in an .rsd file? If so, I think it would be possible to access the created timestamp in another .rsd file using a query slicer which can be used to get the latest file.Have anyone solved this problem, or something similar? I am using the latest version, 6512.1.
I share with you a document and a video to show the problems I have found in TX and suggestions for improvement.In the video I’m showing how to use Tabular Editor to solve the problems. Show my video
We are using the Azure Data Factory - PostgreSQL 14.0.0.0 data source connector and cannot run the synchronize task. We have selected ‘All tables’ in the data source setup but get an error in ADF:“Failure happened on 'Source' side. ErrorCode=UserErrorInvalidValueInPayload,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Failed to convert the value in 'queryTimeout' property to 'System.TimeSpan' type. Please make sure the payload structure and value are correct.,Source=Microsoft.DataTransfer.DataContracts,''Type=System.ArgumentException,Message=Object of type 'System.Int64' cannot be converted to type 'System.String'.,Source=mscorlib”The error seems to be related to the ‘Command timeout’ setting in the TX portal, which we set to 1440 but ADF wants it to be a ‘System.TimeSpan’ type?When we want to use ‘Select tables’ on the ODX data source the screen runs ‘Search tables’ for a split second and then the results remain empty, no tables appear at all.The Linked Ser
I have a rest interface loading via ODX in V20 into an Azure Data Lake.Recently an infrastructure change to the server made the Rest Endpoint timeout (it has an IP whitelist and the server IP was removed).This resulted in the Synchronization task determining that there were no tables available to load, even though there are multiple custom RSD files that have been generated and the CData Rest driver has been configured to Never generate Schema files. The IP has been restored to the whitelist and the Rest interface is working again (after multiple days of the ODX loading nothing). Unfortunately the Meta Data for every table has been flagged as invalid. When I run the ODX load every table comes back with an error that the table has already been used by a table with a different GUID. And If I run the synchronize task on the ODX it deletes the mapping of every table connected to the particular ODX source (40+ tables).I cannot even run a preview of the data from the Gen 2 storage through Ti
Hello,Our ODX gets stuck whenever we make a request to it (be it synch, transfer, or viewing a log). Then we see the error message in attachment and usually we see a second ODX all of the sudden. Any idea what may be causing it?
I have set-up an Execution job that builds a table based on a view. The view generation is in DSA. The tables in the view have saperate Execution package that runs (before this job) without failing.Because of the limitations on how often the data can be extracted with API-endpoints in DSA_ tables, the following Execution job failed previously.I wanted to exclude the tables that are already updated so i have defined the tables that i dont want to run. Is this the right way to do it?
Is there a way to get the timetamp of when a table was transferred from source to ODX Server? Like the DW_Timestamp. The only system field i can find is odx_batch_number.
The daily build of a data warehouse started for an Execution package but never finished. I am unable to see any cause of this job stopping in the TX logs or Event Viewer (Unknown_Running.png) of the server. Is there somewhere else I can check to determine the cause of the build to cancel while running for no reason?Since there was no direction to resolve this issue, we left the build to try to run again today and are now receiving an error that says the job is currently executing (Warning.png). How do I clear this stuck job in TX?
CREATE VIEW [Demo].[INVC_T] AS SELECT R.[ACCT_DT], R.[SPLIT_FROM_INVC_NO], R.[REMIT_TO_ADDR_NO], R.[USER_INVC_NO], R.[UPDT_PERS_NO], R.[UPDT_DT_TIME], R.[TOTALS_UPDT_DT_TIME], R.[SHIP_TO_ADDR_NO], R.[SEG_NO], R.[RECUR_INVC_NO], R.[PRINT_INVC_STATUS], R.[PMT_TERMS_CD], R.[JE_NO], R.[INVC_TYPE_CD], R.[INVC_STATUS_CD], R.[INVC_SRC_CD], R.[INVC_NO], R.[INVC_DUE_DT], CAST( ([INVC_DT]) >= DATEADD(week, -10, GETDATE()) AS datetime) AS [INVC_DT], R.[INSUR_AMT], R.[FRGHT_AMT], R.[CUST_TYPE_CD], R.[CURR_RATE], R.[CURR_CD], R.[CLOSE_DT], R.[BILL_TO_CUST_NO], R.[ACCT_YR], R.[ACCT_PER], R.[PMT_METH_CD], R.[CREDIT_CARD_FLAG], [DW_Id], [DW_Batch], [DW_SourceCode], [DW_TimeStamp], [DW_ODXBatchNumber], [DW_ODXBatchId] FROM [Demo].[INVC_R]
Is there a way to remove tables from ODX storage that have been deleted in the desktop, similar to the SQL Database cleanup tool available in the DW? My use case is when SQL Storage is used for the ODX.The “Remove unused object” option does not drop tables it seems. The Storage Management Task is good of course, but we can’t use it for deleted data sources.Let’s say I have transferred a large table hundreds of times into my ODX and then deleted the data source. Can I remove them without having to drop the tables manually in SSMS?Best,Pontus
We are just started to use ODX server as a source for our countries that are migrated to Business Central in Azure. On our DEV environment i want to limit the data to only get entries after a certain date. Normally i would use a data selection rule on Posting Date Greater or Equal 2021-01-01When i want to do that on ODX server as a data source i get:Conversion failed when converting date and/or time from character string.I have tried every date notation i can think of but i always get this same error.Anyone any idea on how to filter dates from the ODX Server?
Hi community,I’ve a question about the ‘PK’ table that is created in the ODX when you enabled the ‘Handle primary key updates’ and ‘Handle primary key deletes’.I’ve noticed the ODX database (SQL Database) is growing rapidly in disk space after enable an incremental load schedule to reload data every 5 minutes. When I used the default SQL ‘Disk usage by top tables’ I noticed the PK tables are the biggest in terms of disk space.My PK table of the GL Entry table contains 4.5 billion rows! And is 95 GB. While my DATA table contains only 118 million records.When I query the PK table and filter the primay key in this table on 1 value. This value is saved 75 times in this table. For every odx_batch_number (odx_batchnumber 0 – 74). Is this normal? I think it is a bit strange that my PK tables are the biggest tables in the ODX in terms of disk space.Even when I run the storage management task. It doesn’t clean the PK table’s. It always contains the primary key for every odx batch load.The cust
Hi,I’m trying to load an Excel file from a OneLake. As OneLake is a rebranded version of Data Lake Gen2, my assumption is that it should be possible to use existing CData features to load data.I have a working setup where we use CData’s Excel provider (version 23.0.8585.0) to load an Excel sheet from a Data Lake Gen2 I explicitly configured the connection type as ADLS Gen2. Actually I was hoping that this configuration would work after changing the [Azure Storage Account] and [URI] to the OneLake parameters, but unfortunately that doesn’t work Error message: Looking into the logs, I see that CData tries to connect to *.dfs.core.windows.net. However, the uri of OneLake is *.onelake.dfs.fabric.microsoft.com. Manually entering the abfss:// uri did not work here Is it correct that CData is not yet compatible with OneLake, even though techniques under the hood are similar? Documentation on https://cdn.cdata.com/help/RXJ/ado/default.htm does not mention it (yet).Did anyone manage to load da
We have observed an inconsistency in the field order when adding a new table from the ODX to the DSA. Depending on whether we use the "Add New Table" or the "Add New Table with Field Selection" option, the fields are either randomly arranged or aligned with the source database.When we use “Add New Table” we notice that all fields are somewhat randomly arranged. When we use “Add New Table with Field Selection” and then check all the boxes the order is exactly as in the source database (as expected). How come that there is a difference? Is this on purpose? Thanks (TimeXtender 6346.1)
I Have Invoice date column in my table, i want to export data of last 10 weeks, what are ways to do it in timextender
Hello,We’re getting the following error when executing a table in DSA.ODX object synchronization detects no changes, and our ODX source is synched as well.I’m guessing the ORDER is an order by… Any idea what causes it? Thanks
Dear sir,In TX version 20 you can easily go back in time to an earlier version of your TX project.I am looking for going back in time to an earlier version of the MDW/SSL layer in TX version 21.I am running version TimeXtender 6143.1.Is this possible in the latest 6143.1 TX version ?Regards,Arthur
Hi, Please can you suggest on the following : Export to Data Lake is depreciated by Microsoft in Oct 2024 this year. So, what is the best alternate solution to extract the data from ERP FO solution for reporting? How to extract data from Field Service & CE ERP solution? OData connector is not good option as it is very slow & I cannot build incremental load on this.
Below is error message when trying to create custom view, how can i sove it@Christian Hauggaard
Hi, I created a field StorageReportIndicator in a table to rank the records in the table. This rank is a SQL window function RANK which combines table fields initially loaded from the data source (StorageUnit and ReferenceDateTime below) and lookup fields via table joins (DSA.Datum table, fields WeekKey and DayOfWeek). Goal is to have a rank to determine the first record of each week for each storageUnit. The outcome afer execution is that all records have rank 1 which is incorrect. I verified this with the same SQL statement in Management Studio.Could it be that this window function does not have the right result since the lookup is done after the rank is calculated? Note, the table is not historical and incremental. Anyone with experience with this case and is there a proper solution?
As shown in Figure Syncronize Task is sucessfully completed, but Transfer Task gets an below error “System.Data.SqlTypes.SqlTypeException: SqlDateTime overflow. Must be between 1/1/1753 12:00:00 AM and 12/31/9999 11:59:59 ”PM even though my date range starts from 2002 and ends at 2023.Even though after suggestion by @Christian Hauggaard i have made changes in setting of Date Conversition and selected MS SQL Min/Max option, but once i change the setting then i gets the below error for same process,“System.Data.SqlClient.SqlException (0x80131904): Execution Timeout Expired. The timeout period elapsed prior to completion of the operation or the server is not responding. ---> System.ComponentModel.Win32Exception (0x80004005): The wait operation timed out”(This error is geeting for those tables who has Date Column, and date column has such data (for example 03/01/2022 6:42 PM ) )What are steps to solve above error?
Hi all, I have an data source that gets daily refreshed in the ODX. With some tables, I have encountered the following error. Does anyone knows how I can resolve this? Thanks in advance!
While Running Transfering Task im getting error “Transfer Data from Data Sourse with Incremental Load”after appling incremenatl Load, again im getting Same error.
Hello, For two weeks my clients Power Bi report was refreshed daily without issues. Last week this changed after the TimeXtender Execution server stopped running. I ran the TimeXtender ODX Server Configuration on the desktop and started the TimeXtender execution server again. The next days the execution jobs where triggered again but I would like to know why TimeXtender Execution stopped running in the first place. How could this have happened?
This it’s the Snippet with the descriptions in the parameters: When I use the snippet, the description it’s missing:
Already have an account? Login
No account yet? Create an account
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.