To homepage To homepage

Unanswered questions

13 Topics

K
Contributor
KajEmergoContributor
asked in Data Warehouse

ODX -> DWH data movement with ADF does not use assigned runtime

Hi,We have been using ADF for transferring data from our ODX storage account to Azure SQL database for a long time but now our manual and scheduled reloads get stuck in ADF.It looks as if TX does not pass the runtime to ADF. This is required because our storage account is behind a private endpoint so we need to use an IR that resolves in our VNet in Azure.Do you have any idea why the runtime does not appear on the pipeline? As you can see there is no runtime assigned to this run:  Normally the runtime appears in ADF:  We are on TX 20.10.45 by the way.Would love to hear from you!

0
K
Contributor
8 hours ago
wouter.goslinga
TimeXtender Xpert
wouter.goslingaTimeXtender Xpert
asked in Data Warehouse

Lookup fields not selectable when adding data selection rule

I am loading a fact table from a staging table, both are regular data warehouse tables. When I create a data selection rule on the mapping table, I'm unable to select the conditional lookup fields or the system fields from the source table:  TX Version is 6590.1. In legacy TX, it is possible to select the conditional lookup fields and system fields for creating selection rules: We have implemented a workaround where we create an extra field in the DSA table that has a transformation that fills it with the value of the conditional lookup field. In turn, this extra field does show up in the selection rule fields because it is a regular field. But this is not a very nice or future-proof solution.Is this an intentional change and if so, can you explain why? Or perhaps this is a bug in TX SAAS?

3
rvgfox
Problem Solver
14 hours ago
Paul McLeod Bespoke Analytics
TimeXtender Xpert
Paul McLeod Bespoke AnalyticsTimeXtender Xpert
asked in General

Azure Data Factory - SQL Server (14.0.0.0) was not found

Hi I am trying to use ADF to connect to a on-premise SQL Database with some very large tables for transfer.I selected the Azure Data Factory - SQL Server (14.0.0.0) as the source and created the datasource.When I tried to Synchronize the ODX source in TX desktop (6521.1) I got the error message that the assembly for the provider is not installed.I cannot change the provider without creating a new data source (product enhancement request!), Do I need to upgrade the TX Desktop to get access to the drivers? Or is it some other install that I need to do? I cant find any documentation on this.

1
rory.smith
TimeXtender Xpert
16 hours ago
wouter.goslinga
TimeXtender Xpert
wouter.goslingaTimeXtender Xpert
asked in Data Warehouse

Table does not load from ODX to DSA

Hi,I have a very regular table that is loaded from a SQL Datasource. The table has a little over 3 million records and the following definition:  Nothing out of the ordinary as you can see. The table is loaded with the ODX with an incremental selection rule on te mut_dt column. The ODX load works fine; loading the table full or incremental is no problem and the data is stored in the container as expected within 1 or 2 minutes.However, when I drag the table to the DSA data area and load it there, something strange happens. Loading the table to the DSA hangs after 900.000 records are inserted into the raw table. We have tried waiting for several hours, but it just hangs there and nothing happens. Other tables from the same source load fine to the DSA.Data source version is TimeXtender SQL Source v 19.1.1.0 (but load from source to ODX works fine)ODX and TX version is 6590.1 .

15
rory.smith
TimeXtender Xpert
1 day ago
S
Contributor
sigsolContributor
asked in ODX

Paging with cursor in TimeXtender REST API 6.1

Hello,We are currently utilizing the new TimeXtender REST API 6.1 and leveraging its built-in paging feature to connect to an external REST API. We're not using an RSD configuration for this setup.I've encountered a challenge with pagination, specifically with the use of a parameter named "Cursor." This parameter is critical for the pagination logic in the API we're connecting to. Each row in the data returned by the API has a unique Cursor value, but for pagination purposes, only the first Cursor value from the current page should be used in the subsequent POST request to fetch the next page.Here’s how we've set up the Cursor parameter:Name: cursor Type: XPath Value: /TX_Autogenerated_Root/TX_Autogenerated_Element/data/arTransactions/edges/cursorThe issue arises because I need to ensure that only the first Cursor value from each fetched page is used in the pagination post body for the next request. I'm unsure how to configure TimeXtender to utilize only the first Cursor value for this

8
Thomas Lind
Community Manager
1 day ago
kerry_bespoke
Contributor
kerry_bespokeContributor
asked in Legacy & Upgrades

Fail External Tasks if Step Fails

I have setup an Execution Package and am running a number of Perspectives in the order they need to build in the project. I then call 2 External Steps, which are Execution Packages in other TX Projects in the same environment. I am having an issue where when a step fails in the project, the build then continues onto the External steps whereas I would like the entire package to fail. I thought this would be accomplished by selecting the FailPackage action on Failure Handling but it is not working. Do I need to set this up a different way to get this to work?(I have hidden sensitive data in my screenshot) 

9
Thomas Lind
Community Manager
3 days ago
G
Starter
gisliheiStarter
asked in Jobs & Executions

Not able to pick execution job when creating a job

When choosing a execution job, just a single execution job, it’s grayed out and I’m not able to choose it.it’s deployed and the execution jobs works, when I run it manually.I’m running Timextender version 6590.1

1
G
Starter
4 days ago
S
Contributor
spenningContributor
asked in ODX

Referencing a content of local file in RSD / avoiding credentials in the portal?

Hi, I was wondering if it is possible to reference to the content of local file on the ODX server from within a RSD file. Such as Get-Content with Powershell.  We have some RSD files for some of the api’s call that we are making. We are in the process of including these RSD's in our own source control system in order to keep track of the changes that we do with the RSD files. One of the api's is quite unstable and sometimes needs tweeking in the rsd file. (Source control on the RSD file's / powershell scripts files could be another topic to be honest).Anyway, we have to include an API key in the script that we would not like to have saved in the source control. Therefore, an option to reference a file in which we can store the API key would be great.  I know that you can also include authentication in the portal, but we are looking to maybe avoid putting credentials as much as possible in the portal. The portal also creates a OAUTH map if you use OAUTH in the portal. But I don't know h

2
S
Contributor
4 days ago
rogier.helmus
Contributor
rogier.helmusContributor
asked in ODX

TX not responding when opening ODX task log (v20.10.45)

Hi all,I have v20.10.45 running in Azure with ODX server running for a client. We have about 15 ODX datasources. The synch/loads run daily and the server has been up for about 9 months, so no extraordinary amount of logging I think. The issue that I’m having is that it’s not possible anymore to check the execution logs of  some ODX task runs. The popup doesn’t appear and TX goes into a “Not Responding” state. Any click in the client will crash the application. This happens when I have no TX project opened, only the Manage tab for ODX server (see screenshot).I’ve upscaled the VM from DS2v2 (2 core, 8GB) to D4S_v3 (4 core, 16GB), but this doesn’t change it. Restarting ODX server also doesn’t help.The issue is not with all tasks. Tasks for which all recent executions are successful will show the logging. Checking the event logging at ODX server level will crash and tasks with a lot of recent failures also crash. Edit 1: A connection that has this logging issue is a connection using the CD

6
Christian Hauggaard
Community Manager
8 days ago
E
Contributor
ekw9Contributor
asked in Data Warehouse

Partitioning on Transformed Fields

Current advice on partitioning on a non-date field calls for creating a partitioning “bucket” using field transformations. While attempting to follow the instructions outlined here I encountered a problem. Partitioning works by creating a calculated field in the valid table that has the capacity to handle NULL values if the partition template is so configured. However, that same field, along with the calculated default value, is also present in the Raw table. This means that when anyone following TimeXtender’s guidance for non-date transformations executes the table, that execution will fail with the error “Cannot insert the value NULL into column ‘DW_PartitionKey’”Is this a bug, or does the documentation for creating partitions need to be updated? 

3
Christian Hauggaard
Community Manager
10 days ago
S
Contributor
sigsolContributor
asked in ODX

ODX Rollup task does nothing

Hi,I have set up a Storage Management Task with only the Rollup option ticked, and filled in the right ADF credentials. One of my source tables has been selected for this task.TX says the runs are successful and they finish in a fraction of a second, but nothing happens in the storage account. The version folders contain the full load file + all the incremental files, as before. I have tried with many different settings for min and max rollup file size. I have not specified “folder (optional)”. I have tried with and without specifying integration runtime.No pipeline run seems to show up in ADF after triggering the task.

8
Thomas Lind
Community Manager
1 month ago
A
Contributor
aftabpContributor
asked in ODX

Getting BLOOB file into DVH

I need some guidence saving contents ofan endpoint as BLOOB. I can see that the version we use doesnot have an option for BLOOB but may be Text or Binary with maximum length can give me what i need.So I have this RSD that i created <api:script xmlns:api="http://apiscript.com/ns?v1" xmlns:xs="http://www.w3.org/2001/XMLSchema"> <!-- See Column Definitions to specify column behavior and use XPaths to extract column values from JSON. --> <api:info title="GetAllStops" desc="Generated schema file." xmlns:other="http://apiscript.com/ns?v1"> <!-- You can modify the name, type, and column size here. --> <attr name="kortnavn" xs:type="string" readonly="false" other:xPath="/json/kortnavn" /> <attr name="tittel" xs:type="string" readonly="false" other:xPath="/json/tittel" /> <attr name="virksomhet" xs:type="string" readonly="false" other:xPath="/jso

8
Thomas Lind
Community Manager
1 month ago
R
Explorer
RobertUExplorer
asked in Data Warehouse

Error using data selection rule in DSA with data source ODX server

We are just started to use ODX server as a source for our countries that are migrated to Business Central in Azure. On our DEV environment i want to limit the data to only get entries after a certain date. Normally i would use a data selection rule on Posting Date Greater or Equal 2021-01-01When i want to do that on ODX server as a data source i get:Conversion failed when converting date and/or time from character string.I have tried every date notation i can think of but i always get this same error.Anyone any idea on how to filter dates from the ODX Server?

33
Thomas Lind
Community Manager
3 months ago

Badge winners

  • Certified Solutions Architect
    Karankadamhas earned the badge Certified Solutions Architect
  • TimeXtender Xpert
    Muddihas earned the badge TimeXtender Xpert
  • Innovator
    andrew.gebhardhas earned the badge Innovator
  • Certified Solutions Architect
    mello.bogaartshas earned the badge Certified Solutions Architect
  • Innovator
    ekw9has earned the badge Innovator
Show all badges
Terms and ConditionsCookie settings