TimeXtender Desktop Q&A

Is there a way to use IS NOT NULL as one of the join conditions on a lookup? I want to get the TOP (1) record where a field is not null, ordered by date. Currently I have to edit the _Clean stored procedure as custom code to add it, which is obviously not the best way to do things. Thanks

I have a package with an active schedule and now and then the package is, for some unknown reason, not executed.  Scheduler Service was running at the time of the preferred execution time. How do I resolve the cause of this issue?  

Goodmorning,currently I am trying to extract data from a REST API. However the JSON response is structured oddly. In the image below you can see a sample, the numerical values (704, 1406, 1517) whcih represent userID's, aData represents a JSON Object.I am able to extract the aData data. However I am not able to get the corresponding numeric values, since they are not a key:value pair. I suspect I am doing something wrong with my JSONPath and/or xpath. Below is party of my RSD file (except the methods):<api:info title="data" desc="Generated schema file." xmlns:other="http://apiscript.com/ns?v1"> <!-- You can modify the name, type, and column size here. --> <attr name="_id"xs:type="integer"readonly="false" key="true"other:xPath="/_id"/> <attr name="ID"xs:type="string"readonly="false"other:xPath(".")/> <attr name="aData"xs:type="string"readonly="false"other:xPath="/*"/> <input name="fromdate"xs:type="string"default=""/> </api:info&gt

ODX Server is running fine, but transfer en sync jobs fail.Error occurs when I 'Select Tables'.What to do?Error in command: 'Select Tables...'.Service request failed: ODX.Model.Exceptions.DataSourceException: The custom data source is out of date and needs to be updated.at DataSourceEngine.Custom.CustomSourceEngine.IsDataSourceVersionValid(Version version)at DataSourceEngine.Custom.CustomSourceEngine.GetCustomDataSource()at DataSourceEngine.Custom.CustomSourceEngine.<GetSupportedFilterModeType>b__48_0()at DataSourceEngine.Custom.CustomSourceEngine.GetSupportedFilterModeType()Details:Service request failed: ODX.Model.Exceptions.DataSourceException: The custom data source is out of date and needs to be updated. ...Module: TimeXtender.ODX.EngineTimeXtender.ODX.Engine.ODXFaultExceptionat TimeXtender.ODX.Engine.ODXEngine.SendServiceRequest[C,T](WcfServerSettings serverSettings, ProjectInformation projectInformation, Func`3 func)at TimeXtender.ODX.Engine.DataSourceController`1.GetSuppo

When you set up primary key behaviour to 'error' you elegantly force all valid data to be unique combinations of your selected primary keys. But, how do you control what individual dataset is regarded as valid and what is discarded as error ? Is there a way to let the primary key violation error handling know, which record you consider the valid one ?  (e.g. based on min/max values in non-primary key data fields)

When I recently moved our production environment to a new server and was working on deploying the entire data warehouse in TimeXtender I had some difficulties. First I did a complete (full?) and managed deploy which seemed to be successful. When I then tried to run a few execution packages one of them said it was missing a view. Then I did a differential managed deploy and it listed a lot of objects not already deployed!! OK, so I ran that which seemed to succeed as well. Tried the execution package that failed again but with the same result. Third time I did a differential deploy but this time after the deploy was done I noticed that the scrollbar in the results dialog was not all the way up! There at the top an error message was hiding. I had guard on deploy on some tables which was highlighted and hence covering up the error message. The actual error was that a view was not able to deploy because of a user defined function was missing. This UDF is defined in TimeXtender so why does

Hi I am trying retrieve data through an API using XMLI am getting the following error. The API requires I use a wildcard  to retrieve all values. My XML works if I use Postman / Swagger to test.Error obtaining value for column 'ProductList.Product.ProductCode': Error parsing long value [ * ].Details:Error parsing long value [ * ].Module: System.Data.CData.XMLdvo200m.hqat dvo200m.Uw.qM(String )at dvo200m.Uw.u(String , Int32 , Int32 , Boolean )at dvo200m.fZ.Na(String , Int32 , Int32 )at dvo200m.ZG.H(Int32 , Int32 , Int32 )Error obtaining value for column 'ProductList.Product.ProductCode': Error parsing long value [ * ].Module: System.Data.CData.XMLdvo200m.hqat dvo200m.ZG.H(Int32 , Int32 , Int32 )at dvo200m.ZG.GetValue(Int32 , Int32 )at CData.Sql.ResultSetBase.GetValue(Int32 colIndex, Int32 dataType)at dvo200m.Zv.L(Int32 , Int32 , Int32 )Error obtaining value for column 'ProductList.Product.ProductCode': Error parsing long value [ * ].Module: System.Data.CData.XMLdvo200m.hqat dvo200m.Zv.L

Hello,So I am loading historical data into tables in TX created of Excel files. One file for property data, one file for casualty data. After some time the file format changes and they combine these two separate files into one file and add new fields.Can I create a new data source to load the new file but still use the original worksheet tab names such that the data will still load into the existing tables?Thanks in advance.P.S. I am using Discovery Hub 17.12.13.64

Good Morning, We have recently upgraded TimeXtender to version 20.10.15.64. Both in QA and PROD servers. We have TX ETL jobs that extract data from Oracle database server to both server every night. They run at different times. However, the PROD ETL job takes longer to extract data. QA ETL job takes quicker. 1. QA TX on average takes 3hours to extract data from PROD oracle. 2. PROD TX on average takes 5 hours or more to extract the same information from PROD Oracle. Sometimes this take longer than this. 3.PROD TX sometimes hangs the whole night. 4. PROD TX has higher specs than QA. 5. We have checked the Performance Indicators  on PROD server while PROD TX is running. The CPU, Memory and other indicators seems well. 6. We trying to figure out why performance on PROD is slow during the data extraction from Oracle. We have checked all necessary indicators to and we still don't have answers. Is there anything that you can advice us to check so we can understand why PROD is slower than QA

Essentially, I am currently creating csv files from extracts of many TimeXtender tables.  Let suppose the data in a table is a column which identifies each row by country and the table contains many rows for each country, then I would need to create a file for each ISO country that existed in the table. I know how to do this by hand, but am wondering if there is a clever way of automating this in TX without having to build an SSIS package?Thank,Greg

I am able to deploy the semantic model but when I execute it I get the following error message: The current operation was cancelled because another operation in the transaction failed. Details: The current operation was cancelled because another operation in the transaction failed.System.Exception Not much do work with Im sorry to say but this is what I get. This is the TXDictionary project and it has worked before i moved it to a new server. The rest of the project executes fine (ODX, DSA and MDW).

Hello,I'm relatively new to TX.I'm getting the following warning when trying to load tables from an external source:The table folder 'Y' is used by another table with the id xxxx.How do I fix this?

I have been running into a problem where my execution package keeps failing due to a deadlock between an index rebuild and a select statement on sys.tables. TimeXtender is running both process' and one eventually gets killed and fails the entire job. in subsequent executions it has always failed on an index rebuild, but not the same index. Has anyone run into this issue or have any solutions? here's the query.SELECTSCHEMA_NAME(tbl.schema_id) AS [Schema],tbl.name AS [Name],tbl.object_id AS [ID],CAST(case    when tbl.is_ms_shipped = 1 then 1    when (        select            major_id        from            sys.extended_properties        where            major_id = tbl.object_id and            minor_id = 0 and            class = 1 and            name = N'microsoft_database_tools_support')        is not null then 1    else 0end                      AS bit) AS [IsSystemObject]FROMsys.tables AS tblORDER BY[Schema] ASC,[Name] ASC 

Is it not possible to create a semantic model with no endpoint? For me, the beauty of the semantic models is that I can quickly create views for 'data marts' where I can do data selection rules without having to write a single line of code.  In previous versions of TX I could use the Qlik (Deprecated) semantic model for this because it didn't need an endpoint in order to deploy the views. But the newest version(s) of TX does not support this. So what if I'm moving entire corporation's data visualizations to Qlik SaaS (basically Qlik Sense in the cloud)? Can I no longer use semantic models? 

I'm making a TimeXtender Dictionary using Azure (Azure SQL DB's & Azure Analysis Services). When deploying & executing the project I got an error for the StepExecutionTime table:Invalid object name 'MDW_etl.StepExecutionTime_I'. Details: SQL Server: 'bffa063c7c84.tr366.westeurope1-a.worker.database.windows.net,11009'SQL Procedure: 'MDW_etl.usp_CrDM_MDW_etl_StepExecutionTime_DSA_DSA_etl_StepExecutionTime'SQL Line Number: 16SQL Error Number: 208 Invalid object name 'MDW_etl.StepExecutionTime_I'.Module: .Net SqlClient Data ProviderSystem.Data.SqlClient.SqlExceptionat System.Data.SqlClient.SqlConnection.OnError(SqlException exception, Boolean breakConnection, Action`1 wrapCloseInAction)at System.Data.SqlClient.TdsParser.ThrowExceptionAndWarning(TdsParserStateObject stateObj, Boolean callerHasConnectionLock, Boolean asyncClose)at System.Data.SqlClient.TdsParser.TryRun(RunBehavior runBehavior, SqlCommand cmdHandler, SqlDataReader dataStream, BulkCopySimpleResultSet bulkCopyHandler, T

I have a table with fields defined (call it Table B), but no mapping.  I am inserting into this by using Table Insert (from Table A).  Think Table A -> inserted into -> Table B.  In the picture below Table A is Projects from D365 at the bottom of the picture.  Table B is everything else in the image.   DataAreaId is a field defined on Table B and is populated successfully from the table insert.  I would like to have a field, Field C, that simply does a custom transformation which places the value of DataAreaID into Field C.  While the Table B is fully deployed and executed, I am finding that Field C is unpopulated.  In fact all fields in the image that take values not from the Table Insert directly are unpopulated meaning I also can't assign constants.    So, all of the DimensionDisplayValue - xxxx fields in the picture are empty after executing.  I have also noticed to my surprise that the raw table is empty.  Not sure if this is by design or if something on Table B can be recon

Hi,  I was wondering if the CData data provider supports Bearer Authentication. The API request I'm trying to make is to a small 3rd party Application. Regards, Emil H

hi  am trying to update my CData Datasource providers (Update available) but when i click on the update button, this is what i get: Unable to update the provider.The provider is currently locked by the application. Details: Unable to update the provider. ...Module: timeXtenderSystem.Exceptionat TimeXtender.DataManager.CDataComponentInstallHelper.UninstallComponent(DataSourceComponentModel dataSourceComponentModel, Boolean isUpdate)at TimeXtender.DataManager.ManageCDataDataSourceProvidersCommand.UninstallProvider(Form parentWindow, CDataComponentModelWrapper componentModelWrapper, Boolean isUpdate) Time: 2020-12-09 09:00:29UTC: 2020-12-09 08:00:29Title: CloudDWH - TimeXtender 20.10.6.64Application: 20.10.6.64Repository: 20.10.6.64 (in Azure)SQL Server: Microsoft SQL Azure (RTM) - 12.0.2000.8 Oct 1 2020 18:48:35 Copyright (C) 2019 Microsoft Corporation Any idea what is causing this and what to do to make it work? thanks! M

Currently we are facing a problem with memory resources when we're trying to do a data export. When writing a huge file, 4 gb, the memory allocated to this TX process takes up more resources than  we would like (> 22gb of RAM). Is there any possibility for breaking up the data export in partions, such that the process takes up less RAM? I would think there would be some kind of option like the data batch cleansing in the table settings, but I can't seem to find it anywhere.   Within the data export we use the TimeXtender File Export 2.0.0.0 provider. 

Currently, we are rendering an error when we want to do a Transfer task for with the ODX server. We are trying to read an PxPlus data source via an ODBC driver, TimeXtender correctly shows all available tables and columns, and synchronizing also seems to work fine. However, when we try to transfer the data the following error is returned:The source does allow any schema's, and it seems that TimeXtender nevertheless tries to envoke a query with a schema (I think the error is returned because of the []. before the tablename). We have tried some things in the Query formatting and Character Replacement, but we can't get it to work properly. TimeXtender version: 20.10.1.64ODX Server version 20.10.1

Hi, I have a large FACT-tables in my DWH (copy from a view in stage). I have tried to add partitions. I didn't help that much, so I removed it again.But since I removed it, the table can't be deployed. I get the below error. I can re-add the partition, but still the same error: An error occurred during drop partition function. See exception details for the failing objectAn error occurred during drop user defined function. See exception details for the failing object: Drop failed for PartitionFunction 'FactSalesOrder_History_PartitionFunction'.An exception occurred while executing a Transact-SQL statement or batch.Partition function 'FactSalesOrder_History_PartitionFunction' is being used by one or more partition schemes. Details: SQL Server: '.'SQL Procedure: ''SQL Line Number: 2SQL Error Number: 7706 I'm not sure how to find and drop what-ever TX is complaining about.Tried this:DROP PARTITION FUNCTION FactSalesOrder_History_PartitionFunction and then get this:Partition function 'FactS

I am using the Field Validation to test our ETL. Using this as source data:And these rules in the DSA:And this query to check for errors:I get the following result:The _L table is linking to the records in the _R table that were removed when they failed the validation step on FIRST_NAME. Also the Warning level notification is not present in the table.As it stands the _L, _R, and _M tables as joined above are showing incorrect or at least confusing information. Am I using them as they were intended to be used, and has anyone done anything to get around this?Thanks,Mark

Is it possible to create a clustered column-store index in TimeXtender 20.103.64?

Hi!Can you clearify that if I run a full load ( on a source based incremental table), it doesn't update the _I table with the current max value? In our scenario, I run a full load very early in the morning and then run incremental loads during the day. But I have seen that the first incremental load of the day takes a very long time to run which I suspect is due to there being a lot of changes since the last incremental load, i.e. the full load's transfer is ignored by the incremental load?So the first incremental load, more or less, transfers the same data that the full load did?Version 19.11.7.64RegardsNiclas

I have enabled simple mode on a project with 1 data source and 1 Business Unit. I have also updated the settings for all tables to support simple mode:When i try to deploy the project i get the error:Could not load file or assembly 'Microsoft.SqlServer.BatchParser.dll' or one of its dependencies. The specified module could not be found.Location: Business Unit 'ABC'.Details:Could not load file or assembly 'Microsoft.SqlServer.BatchParser.dll' or one of its dependencies. The specified module could not be found.Module: mscorlibSystem.IO.FileNotFoundExceptionat System.Reflection.RuntimeAssembly.GetType(RuntimeAssembly assembly, String name, Boolean throwOnError, Boolean ignoreCase, ObjectHandleOnStack type)at System.Reflection.RuntimeAssembly.GetType(String name, Boolean throwOnError, Boolean ignoreCase)at Microsoft.SqlServer.Management.Common.ServerConnection.GetStatements(String query, ExecutionTypes executionType, Int32& statementsToReverse)at Microsoft.SqlServer.Management.Common.S