Ask questions and find answers about TimeXtender Data Integration and TimeXtender Classic desktop applications
Recently active
Hi can you add a diagram or something like that to understand when and where that scripts are executed?
v20.10.35.64A while ago I was looking for a solution on how to conditionally fill down/flash fill values with certain criteria. Unfortunately the answers in this ticket didn't do the trick for me, as I kept getting NULL values with all solutions I've tried. How can I conditionally fill down/flash fill NULL values with previous values based on certain criteria? | Community (timextender.com)Now I seem to get it working with a Self Lookup view and a Lookup Field (Top first-non value). However, I have to repeat this process for almost 10 columns. The loading of this table went from 06:00 to 30:00 minutes. The lookup field looks as follows. What it does is:Look if column Route Bron is empty, If Route Bron is not empty, just show Route Bron. If Route Bron is empty, lookup the TOP first non empty Route Bron Value with the same Source, Project, Cardcode where project is not empty and not 999999 Is there a way how I can optimize this process? Thanks in advance!
Hi,I'm using the CData ADO.NET Provider for OData 2022 (22.0.8322.0) to extract Topdesk data.Due to performance reasons Topdesk made some changes in their feed. Resulting in that, since 19th june 2023, 2 larger tables (IncidentDurationBlocks and IncidentSnapshots) cannot longer be extracted without filtering on a date to make the dataset smaller.How can I add a filter for only one table in my extract?Can I create an OData RSD file?I get this error when I try to extract:System.Data.CData.OData.ODataException (0x80004005): [500] Could not execute the specified command: Unexpected response status code: 503. ---> rds220I.IC: Unexpected response status code: 503
In fact tables we are using subrogate keys from the dimension tables using supernatural keys.The relationship between the fact table and the dimension table it’s using the bussines key and getting the subrogate key from the dimension table into fact table. But some times it doesn’t exists, and I’m using -1 to put that value.What it’s the best way to include the unknow member (-1) in the dimension table?
When we creating a numeric field in a MDW table, TX suggets use a numeric(38,6) for the data type.When the field it’s translated to the semantic model it’s detected in TX:But in the model:And one of the best practice rules says “Do not use floating point data types”.How can I follow this rule?
Hi,we have a customer running incremental loads multiple times a day in the ODX Server (using Data Lake Gen2). We’re reaching the 10.000th incremental run.I’m wondering how the ODX server will handle that 10.000th increment (since the naming of the parquet files allows a number up to 9999).BR.Peter
Hi community, The CDATA Provider for LinkedIn 2022 contains a bug/error which causes it to call an invalid API URI for the connector’s table ‘OrganizationFollowerCount’. The appropriate URI for this table according to Organization Network Size - LinkedIn | Microsoft Learn is:https://api.linkedin.com/v2/networkSizes/urn:li:organization:1234567?edgeType=CompanyFollowedByMemberHowever, CDATA is calling the following:2023-06-12T11:31:21.793+02:00 2 [5|Q-Id] [HTTP|Req: 3] GET https://api.linkedin.com/rest/networkSizes/1234567?edgeType=CompanyFollowedByMemberWhich results in the following error message:2023-06-12T11:31:22.172+02:00 3 [5|Q-Id] [HTTP|Res: 3] {"message":"Key parameter value '1234567' is invalid","status":400}2023-06-12T11:31:22.172+02:00 2 [5|Q-Id] [HTTP|Res: 3] HTTP/1.1 400 Bad Request, 66 Bytes Transferred2023-06-12T11:31:22.194+02:00 1 [5|Q-Id] [EXEC|Messag] Executed query: [SELECT [FirstDegreeSize], 0 AS [odx_batch_number] FROM [LinkedIn].[Organiz
In Custom data insert i have one field which is varbinary(8000) data type. When i try to insert a column i get an error: The given value of type String from the data source cannot be converted to type varbinary of the specified target column.Failed to convert parameter value from a String to a Byte[].Invalid cast from 'System.String' to 'System.Byte[]'.Details:Invalid cast from 'System.String' to 'System.Byte[]'.Module: mscorlibSystem.InvalidCastExceptionat System.Convert.DefaultToType(IConvertible value, Type targetType, IFormatProvider provider)at System.Data.SqlClient.SqlParameter.CoerceValue(Object value, MetaType destinationType, Boolean& coercedToDataFeed, Boolean& typeChanged, Boolean allowStreaming)Failed to convert parameter value from a String to a Byte[].Module: System.DataSystem.InvalidCastExceptionat System.Data.SqlClient.SqlParameter.CoerceValue(Object value, MetaType destinationType, Boolean& coercedToDataFeed, Boolean& typeChanged, Boolean allowStreaming
I have deleted a schedule on a execution task but it still executes. There is no schedule and no execution plan.How to solve this?
Hi community,A customer is using a specific role that is allowed to select data from specific views in SQL. When one of these views are deployed, the Object Security Setup isn't deployed. The Database Role/Security Settings needs to be redeployed manually.Is it possible to automatically deploy the Object Security Setup, if the a view/table is deployed that is using security settings?
Hi all,We’re trying to troubleshoot some thorny networking issues, and I need to know more about how ADO.net data transfer works behind the scenes - specifically for old-school business unit SQL Server data sources, if that makes a difference. I know for sure is that data is read from the data source and written into the destination table in the staging database, but I’m fuzzier on what happens between the two places. To start off with, I have two key questions: We’re using a tool server to run TimeXtender, and a different server to host SQL Server and the TimeXtender databases. Is data routed through the that tool server when it is read via the ADO.net package? I assume that it is, but we need to know for sure. The other question I have is what happens after the data is pulled from the data source? Is it pulled into memory somewhere? If so, where? The source server, the tool server, the destination data server, or some combination of the three? Is the data ever written to disk anywher
I see this advanced menu option in all the tables but I don’t know how can it be used.
Hi,I am working on a column that evaluates a date against GetDate() and returns a 1 or 0. The table can be loaded incrementally. I assumed that if I turned on "Keep field values up-to-date", this column would always be recalculated at loadtime, but it seems that this is not true.Is there a way to make these two work together or do I have to give up on incremental loading?Thanks
Good DayI have twice completed a differential deployment of a TimeXtender project and a Valid Table that is not listed in the review tasks is still being re-created on deployment.Is there functionality setup in TimeXtender that would re-deploy a table on deployment if it was listed as a deployed object dependency?Kerry
Good DayI have 2 TimeXtender Projects and in Project A I have an Execution Package that once completed, runs an External Executable to start an Execution Package in Project B.In Project B, I have an Execution Package that is defined to not allow any other concurrent packages, including the one called from Project A, when it is running.I am finding that this settings is being ignored if the Execution Package for Project B is being called form Project A.Has anyone come across cross-project Concurrent Package settings being ignored and how to overcome this?Kerry
Hi team, In the business units and data warehouses, deletions in an incremental table are identified by system field IsTombstone = 1. You can use this field in a data selection rule to filter out deletions between the business unit and DSA. This field is not present in ODX Server tables with incremental and delete handling enabled. Is there a way to identify records that have been deleted from incremental tables in ODX Server? And if not, what is the purpose of enabling deletion handling in ODX Server? Kind regards,Andrew - E-mergo
I have made a new app registration in Azure for TimeXtender. Provide the rights exactlly as the old app registration but the secret is expired.Error in TX : AADSTS7000222: The provided client secret keys for app 'OLD_APP_ID' are expired.I filled in the datasource and global enviorment the NEW_APP_ID but the error still is there. Restarted the ODX server, removed the pipelines but still same issue. How can i force that it will use the new application ID becaused I changed it on the places it is used. (Also with the new secret ofcourse)
As you can see in the image the data are confusing because the marked records are in spanish local time and the running is in UTC.
Hi! I am experiencing an issue with ADO.NET transfer times on incrementally loaded tables where the ADO.NET transfer takes the same amount of time regardless of the amount of new rows coming into the table. A full load of the table containing about 45 million rows takes about 25 minutes, on the next incremental load the load time is still the same with ADO.NET taking up around 24 of these minutes. Our current data flow is as follows: SQL server → TimeXtender → Azure elastic pool (this is where all of our TimeXtender databases resides) Full load - 45 million rows Incremental load - 11 thousand new rows in the _R table The amount of new rows coming in to the table Has anyone experienced a similar issue? My best guess is that the problem resides in the azure elastic pool where the ado.net transfer is being throttled. Even if I have 0 rows in the _R table the ADO.NET transfer time is the same. Thank you!
Hi community, I’m using version V6221.1. I’d like to filter all tables in the data source on column ‘dataAreaId’. I try to set this up using the following settings: Do I really need to set this filter on every table I load from this data source? Or is this a bug?
Hey,I face this issue quite frequently and have not found out how to solve it yet so I’m hoping someone on here can tell me how to do this.I have a REST data source in which I make a selection of columns. I drag that table into the DSA layer, rename some columns and voila, I have my table. Now I found out that I need some additional columns from the data source so I go into my ODX and in the table selection I include those columns as well. The transfer is succesful and I have my data with additional columns. Now here comes my problem.I want to sync my table with the data source and add those additional columns to my existing table. When I right-click-drag the table into the DSA layer I can sync, smart sync and sync only with existing fields. The first options adds all columns to the bottom of my table (including the ones I already have). The other two options only sync the columns that I already have…Hope that someone can help me out as I face this more often in development.
hi,each time we do a deployment from DEV-PROD, the Txt scheduler is not working anymore. We use an older version of Txt (20.10.6.64) but still, the scheduler uses a wake up step that will d&e 1 table (retries=3, retries per step=3 and retry delay in min=5). If the step is successful, the next step will be executed. But since we deployed from DEV-PROD the scheduler is not starting anymore. Have removed the Wakeup step and created a new Wakeup have reboot the PROD machine (azure) but still no result. Can you pls tell me what needs to be done, it is urgent,thanks!!Mrt
I am using ODX version 6143.1. When loading a table from a source system, incremental load on a datetime column (with an offset of 7 days) works fine. But when I set up the incremental load rule with Detect deletes and Detect updates selected, the first incremental load (which is the initial load) runs successful, but a second load (which should be the increment) gives me a 404 HTTP error:Response status code does not indicate success: 404 (The specified path does not exist.). Edit: problem only arises when setting the Delete detection option. When I remove this checkbox, the 404 error disappears (so the Detect primary key updates option does work correct).
Hi, Is it possible to setup retry steps for ODX transfer tasks in the >6024.1 version of TimeXtender? If yes, where? If not, please add this as an idea. Greets,Devin
I am facing a problem when creating a job in the new TX version. I have two instances called ‘Ontwikkel’ (dev) and ‘Productie’ (production).I have copied my dev instance to production and now I want to set up a job to execute the production instance and several SSL's in production.I have created an execution package with all the MDW tables that need to be executed and this package was copied to the production instance. I also have several SSL's that point to the production instance as source.Now, when I add a new job (on the production environment), all looks well. I add the package and the SSL's and schedule the job:After that, then I re-open the Job and suddenly all selected execution objects have changed to the DEV (ONTW) version of the same objects: Am I doing something wrong or is this a (pretty nasty) bug?
Already have an account? Login
No account yet? Create an account
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.