Skip to main content
To homepage To homepage
Solved

Unable to use custom data selection rule on ODX table in a DSA mapping

J
Explorer

Dear all,

 

We have tx instaled on Azure and on premise. The version we are using is 20.10.52.64.

 

how is it possible that on the onpremise we can use the custom data selection rule and on Azure this screen is not appearing in the DSA?

The issue we are facing is that we want to limit that data we want to load in the odx when the raw table is being executed. Therefore we want to set a customized data selection tule on the mappings.

Why this option is not in Azure but it is there on the on premise?

We want to load / keep all data in the odx server and make a data selection rule in the DSA..

Imagine we are migrating from on premise and we want to show only 15 months of data instead of  10 years. Only if the customer is asking for it we will load it.  This is working on the on premise perfectly.

Now that we are migrating from on premise to azure we are missing the most used data selection rule. And the advised work around

 

Best answer by Thomas Lind

Hi @jermaine.cotino 

As Andrew alludes to it is because you point at the ODX and it is not possible to do custom queries against a parquet file.

It is a deliberate choice. I think there is a feature suggestion for the change of this somewhere. Perhaps if you use SQL as the ODX store or something like that.

View original
Did this topic help you find an answer to your question?

4 replies

Thomas Lind
Community Manager
Forum|alt.badge.img+5
  • Thomas Lind
  • Community Manager
  • 1017 replies
  • August 27, 2024

Hi @jermaine.cotino 

Can you show the same image where it doesn’t allow for you to use it?

It is not possible to make custom conditions on all tables facing the ODX, but all other places it is possible.

This is my project with ODX.

DSA pointing at my ODX.

MDW pointing at DSA.

 

Here I got another project that do not use the ODX, but uses the BU staging database instead.

 

I also got a project where the database used is stored in Azure, it also works here.

I do use Direct Read between Bu, DSA and MDW so they can share the same database for better performance.

J
Explorer

Hi Thomas

See the below screenshot.

 

 

andrew.gebhard
TimeXtender Xpert
Forum|alt.badge.img+2
  • andrew.gebhard
  • TimeXtender Xpert
  • 64 replies
  • August 28, 2024

Hi @jermaine.cotino,

Between ODX Server and data warehouse layers, it is not possible to add a custom data selection rule. You can use the ‘filter rows’ function on the data source in the ODX Server to limit the records ingested into your ODX, or you can add a separate raw data layer, similar to a business unit, between your ODX and DSA. 

Between data warehouse layers, you can apply custom data selection rules. 

While I'm not sure as to the reason the option is not available, I imagine it has to do with issues querying parquet files in a data lake using custom SQL.

Kind regards,

Andrew

Thomas Lind
Community Manager
Forum|alt.badge.img+5
  • Thomas Lind
  • Community Manager
  • 1017 replies
  • Answer
  • August 28, 2024

Hi @jermaine.cotino 

As Andrew alludes to it is because you point at the ODX and it is not possible to do custom queries against a parquet file.

It is a deliberate choice. I think there is a feature suggestion for the change of this somewhere. Perhaps if you use SQL as the ODX store or something like that.

Reply


Most helpful members this week

Terms and ConditionsCookie settings

Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings