Ingest

Hi,A csv table with the first approx. 23,000 rows containing only integers in the first column, doesn’t fully populate in the ODX because in row 23,000-somewhere this field contains text:“Error obtaining value ‘E04012’ for column ‘ArtikelNR’. Failed to convert to data type: ‘int’.”The data type has been set to override from ‘int’ to ‘Text’ = ‘varchar(max)’.TX version 6718.1. Thanks in advance for any suggestions.

HiI have set up ‘notifications on critical errors’ in ODX and can test successfully by clicking the [Test Notification] button. However, when I attempt to fail an ODX job on purpose to test it works (by purposefully using incorrect credentials to connect to the data source) the ODX job fails but I do not receive an email.If I receive a test notification email by clicking the [Test Notification] can I assume the mail server is correctly configured?Or is it that a set of incorrect credentials for the data source is NOT considered ‘critical’?Or could it be something else?ODX: 6675.2TX: 6698.1

Hi everyone, Trying to environment transfer but getting below error. Any idea's? 

Hello TX Team, I just updated the data source version in the portal. After the update the data of one of the sources was gone. Even though I can sync and get data.  If I test the connection in the portal I get this error: Exception has been thrown by the target of an invocation.In the desktop I am seeing a test table and not the tables from the blob. I am running the latest TX Version: 6698.1 and the latest ODX version: 6675.2 Two data sources are connected to the ODX (both csv files from a blob storage) Can someone please help or advise on the issue? Each time I update something in TX my flow breaks.  Thank you in advance. Kind Regards, Boy

Dear Sir,When I open my TX Client (6698.1) I have an error when opening my ODX instance.Even started from scratch a few times. New environment, new instance ODX and DWH.Going back to my TX client, try to open my just new created ODX instance and then I have this message: The expected instance id does not match the active instance id.…We can not use TimeXtender in our FourPoints tenant to assit our clients, please help.Error details:Service request failed: The expected instance id bd8b16fe-91e6-4142-bcdb-414d37613dd9 does not match the active instance id c1989d3e-4ed6-4f48-a8a4-4d880a2b257a (ODX.Model.Exceptions.ProjectIdException)Details:Service request failed: The expected instance id bd8b16fe-91e6-4142-bcdb-414d37613dd9 does not match the active instance id c1989d3e-4ed6-4f48-a8a4-4d880a2b257a (ODX.Model.Exceptions.ProjectIdException)Module: TimeXtender.ODX.EngineTimeXtender.ODX.Engine.ODXFaultException   at TimeXtender.ODX.Engine.ODXEngine.SendServiceRequest[C](WcfServerSettings ser

Hi,I have a postgresql cd connector which works well with SSL set to false, we activated a self signed SSL certificate on the database server side, but connecting with tx setting ssl to true is not workingthe owner of the database mentioned i should accept the certificate but from TX there is no prompt to accept the SSL certificate, how do I need to proceed? Do we need to install anything on our end (tx server), it should not as it is a self signed certificate. Thanks your help!Linda Monincx

Dear Sir,We are migrating TimeXtender to the latest and the greatest Our client is using the old school Business Units for there ODX Data Sources.Development data sources are different then Production data sources.So our client wants to have the same ODX setup in their new version of TimeXtender (6675.2).So I need to setup 2 ODX servers for this right ? One for DEV and one for PROD.If that is true, I need two Window servers to install two ODX servers. One for DEV and one for PROD.Question:Or can I install/run two ODX servers on just one Window server ?Client is going to use TimeXtender ODX Server 6675.2Hope this makes any sense. Regards,Arthur

Hello,We recently updated our TX and ODX to version 6675.2. Things were working fine until yesterday. Now whenever we open the ODX inside TX, the whole program freezes (image 1). It does not seem to be related to our VM. I have tried giving myself and the ODX service account more permissions on the C:\ProgramData\TimeXtender (sub)folders but that did not help.The only fix so far seems to be restarting the TimeXtender_ODX_Service_6675.2 in Windows Services. This is also not always without issue (image 2).   

We have 30 companies with each their own BC installation. So right now we have 30 data source connection. I created one data source connection with all the table and fields that we need. After that i cloned that one. I created all the mapping sets, so for now i have the right setup for all the companies. But now comes the problem. What if i want to added a new table and columns to all the companies. Do i need to do that on all the 30 companies? When i want to clone them again i get the message that the name already exists. Is there any way to do this easily without having to delete everything again and clone each time.

Because of another unrelated issue, I have discovered that the service account does not have acces to a certain folder where my source files are in. However, if I go to edit data source → Test Connection. It says it is connected successfully. If I go to the query tool to check my source, I get an error. Acces denied. And if run the sync/transfer tasks, I get a warning saying:The view [CSV].[AggregatedFiles] has no columns.The view is ignored And if I run this source in a job, from an Execution. I get no error/warning at all. How is this supposed to work?  

Does anyone have any experience with or a tutorial for extracting Salesforce data with TX SAAS? I'm trying to connect to Salesforce, getting a succesful connection message but when I synchronize the datasource, the sync task is successful but no table is shown: 

I am banging my head against the wall for this one for some while now. I would appriciate some help.Here is the RSD-file<api:script xmlns:api="http://apiscript.com/ns?v1" xmlns:xs="http://www.w3.org/2001/XMLSchema"> <!-- See Column Definitions to specify column behavior and use XPaths to extract column values from JSON. --> <api:info title="data" desc="Generated schema file." xmlns:other="http://apiscript.com/ns?v1"> <!-- You can modify the name, type, and column size here. --> <attr name="bildeLinke" xs:type="string" readonly="false" other:xPath="/json/data/bildeLinke" /> <attr name="bygning" xs:type="string" readonly="false" other:xPath="/json/data/bygning" /> <attr name="bygningsId" xs:type="string" readonly="false" other:xPath="/json/data/bygningsId" /> <attr name="del"

Hello,TimeXtender: 20.10.31.64ODX:  20.10.31We have a case where a customer has to move from SQL database to a OneLake Parquet as the data extraction from one of their systems. We need to find a way to get this data into TimeXtender.I could find that there is the possibility for one lake parquet connector, but it seems tied to the new version of TX as I can’t find that connector in our version of tx/odx. Is there any possibility for us to do it another way while on our version? Thank you,Victor 

Hi, I'm using the TimeXtender REST Data Source (5.0) in combination with dynamic values.The API endpoint needs a filter (Period) in order to work. As you can see in the last screenshot the dynamic value query refers to a table in TX.This table contains all the yearmonth combinations of 2023: 202301, 202302, 202303 etc. When the datasource is executed in Timextender desktop it only returns the following months: 202301, 202302, 202306, 202312.It seems like the filter does not recognize all the yearmonth combinations or skips most of the months. Has anyone had the same issue or experience with this configuration?In the screenshots you can see the curent pagination and parameter configuration.I’m also using table flattening but that doesn’t seem to make a difference. Thank you. Kind regards, Joris de Leeuw 

Good morning Team,The database [ODX_COL_PROD] has 2.0 TB of data, and we need tu purge it.Can someone give or send me informacion/documentation about the purge data task.Thanks for your help.Ignacio 

We are trying to follow the setup guidelines so that we can get to grips with TimeXtender leveraging Fabric. We are having issues at the very beginning in trying to assign our App Registration ID to the Fabric Workspace. It just wont show as an option in the list when trying to grant membership access to the Fabric Workspace. If we specifically type in the name of the App Registration ID then we get an error below the dialog indicating that we “can’t use invalid or duplicate emails”. We are obviously missing something, anyone have any ideas?

Hi,In version 20, we have a setup with two environments, a dev and a prod, that ingests data via a business unit. We are limiting the data ingested into dev by using the “Environment name” project variable together with a date filter, much like what is described here:https://legacysupport.timextender.com/hc/en-us/articles/360032668012-Creating-Dynamic-Data-Selection-Rules-using-Project-VariablesWhat is the equivalent of doing this in the latest version of TimeXtender? The client’s setup has one ODX and two DW instances (dev and prod). Their need is to limit the amount of data ingested into the Dev DW instance. Is this possible with the features available in version 6436.1?Best,Pontus Berglund

Hi all,I’m using the CData Connector for Parquet files and take files from a SFTP server. The files always contain the data from the last day (with some overlap).I made the following setup:Primary key Incremental Load with updates The first load is always ok, but then there is no new folder in the DataLake created? What I’m doing wrong?ThanksMichael

Hi community,I have this strange thing I cannot explain. I have a data connection that has been working properly for months. Since the beginning of May the transfer task results in a time out error, where after 1 hour the command time out is reached. I have tried everything to resolve this error; nothing is working. I tried with one really small table and 1 thread (of course setting the time out to a few minutes 😉); same error. The strange thing is; I have cloned this exact data connection and tested the transfer task running this exact similar table over 1 thread. This works without any problems. I have also added several other tables, also without any problems I fetch the rows of all tables within a few seconds. Does anybody have ANY idea what might cause this extremely weird behaviour? 

Hello,My transaction journal tables unfortunately don't have a useful update/modified datetime column, only a posting date or similar. I'm looking to incrementally load these tables, since they are my biggest tables. I can do this partially based on the Posting Date column which won't change after creation, however I have some columns, e.g. BalanceDue which will mutate once an Invoice has been (partially) paid. Hence, I also can't use an offset incremental loading rule for posting date, since I won't catch these changes.Anyone got an idea to still minimize loading times on these tables?

Hello,I started seeing this error message multiple times a day in the event viewer.Does anyone know what may be causing it? Synchronize executions failed:System.Data.SqlClient.SqlException (0x80131904): Violation of PRIMARY KEY constraint 'PK_ODX.ExecutionLogs'. Cannot insert duplicate key in object 'ODX.ExecutionLogs'.(...) Thanks 

The people before me defined certain variables in TX. One of these is [vDatabase] which is futher used in a stored procedure in ODX:Select....FROM INFORMATION_SCHEMA.COLUMNS WHERE TABLE_CATALOG = '[vDatabase]' AND RIGHT(TABLE_NAME,2) NOT IN ('_L','_M','_T', '_R', '_B') AND TABLE_SCHEMA NOT IN ('dbo','view', 'XLS') AND COLUMN_NAME IN ('modifyDate','last_update','Registrert_Dato') END The variable is also used in SQL snippets in ODX, DSA and MDW:DECLARE @sql NVARCHAR(MAX)SELECT @sql = COALESCE(@sql + ' UNION ALL', '') + ...... FROM %s'+ CHAR(10) , TABLE_SCHEMA, TABLE_CATALOG, TABLE_SCHEMA, TABLE_NAME, TABLE_SCHEMA + '.' + TABLE_NAME, COLUMN_NAME, COLUMN_NAME, COLUMN_NAME, COLUMN_NAME, COLUMN_NAME, COLUMN_NAME, TABLE_SCHEMA + '.' + '[' + TABLE_NAME + ']' )FROM INFORMATION_SCHEMA.COLUMNS WHERETABLE_CATALOG = '[vDatabase]' AND RIGHT(TABLE_NAME,2) NOT IN ('_L','_M','_T', '_B') AND TABLE_SCHEMA NOT IN ('dbo','view', 'XLS')EXEC(@sql)Howev

Hi,I have set up a Storage Management Task with only the Rollup option ticked, and filled in the right ADF credentials. One of my source tables has been selected for this task.TX says the runs are successful and they finish in a fraction of a second, but nothing happens in the storage account. The version folders contain the full load file + all the incremental files, as before. I have tried with many different settings for min and max rollup file size. I have not specified “folder (optional)”. I have tried with and without specifying integration runtime.No pipeline run seems to show up in ADF after triggering the task.

I have a REST datasource that uses pagination with URL paramater page. Fairly simple.The next page (if there is one) is returned not as a header but as an element in the json result:  So, to enable paging I have to set up something like this: And:I have two questions on this: I get an error on the XPath Value saying ‘Expression must evaluate to a node-set.’ . How do I determine the correct XPath to the json element? And my second question is how do I make sure the complete URL is replaced instead of only the /api/… part?

hi, i have a exclude columns made like“ exclude if schema <all” and table <all> and column contains “ plusg”  for 1 table i want a specific include likeinclude if schema <all> and table equals “plusgmoc” and column equals “plusgtest” it seems that the column isn’t added, i have done a sync and a new transfer. I look in the generated parquet file and can’t find the column.Is this expecten behaviour? how to solve?