Build better products with our product team
The current design in TX v21 doesn’t allow more than one job to run at a time per execution service. In many environments, either with multiple instances or with data sources that require frequent updates this is quite a limitation as jobs will constantly be added to a queue with the waiting state. There shouldn’t necessarily be a need to have multiple VM’s with a separate execution engine just be able to run jobs simultaneously.When using exMon for orchestration and as a tool for business user to run executions on-demand it can also give the user a false pretence that the job has started when it is actually waiting in queue. If it has to wait too long the exMon package will get a timeout failure when there is no failure. The package will eventually start and finish successfully but the user will not know about it.This limit also makes the current concurrency options for the execution packages quite useless.
Hi team, An issue that I am running into relatively often is that a job fails to fail or complete, staying in the ‘running’ state indefinitely. Sometimes cloud services can experience transient issues, which may cause these anomalies. More importantly, however, there is no way to clear the queue, stop existing jobs, or force a job to restart when it's already running. Furthermore, there is no timeout on jobs, so they can continue to run forever.Example: this job has been in the running state for about 30 hours. It runs a number of Ingest Transfer and Cleanup tasks:Job MonitorIn the ODX Execution Queue I can see that there are no ODX tasks waiting or running, so I cannot cancel anything from there: Ingest Instance Execution QueueStarting the job manually or via eXmon does not work, I get the message failed to run message from eXmon: “The TimeXtender job 'ODX - OneLake and FTP - Transfer + Cleanup' is already running”. If this was a prepare or deliver job, it would now be blocking the other prepare or delivery jobs from running. -- The only way to reset the jobs is by stopping the ODX Service and restarting it. This causes all ODX tasks (also outbound) to fail instantly, which is far from ideal in an environment where data is constantly being loaded, and lengthy reloads may be running outside of work hours. It's also difficult to explain to a client that they may need to do this periodically to keep their environment running. We should have more control over the how jobs run, fail, and cancel. Jobs waiting or running in the queue should be able to be removed without restarting a service and a large unplanned impact to the platform. Kind regards,Andrew
HelloI see two tickets for it not being possible to have multiple jobs running at the same time. The answer was that it is not posibble within one execution service (only for ssl now).With more and more organisations moving to more real time analysis, timextender is the ideal tool to have multiple job schedules during the day (even with extract data on demand to have it combined with data ingestion). But then you are limited, that for one instance, it can only have one job running and other jobs have to wait. I just don’t understand how that matches with the filosofy of the tool?I hope that based on the related tickets a solution to this issue is one of high priority.The wo tickets: If not high on the priority list can you please let me know how we can solve this in the meantime (of course without using the development or acceptance execution service for production jobs).For example : one job runs each hour and one each two hours. When the 2-hour job is running the job which needs to run each hour will not run while the two hour job is busy (and runs for an hour and a half). I don’t want a technical limit on these times, it needs to be based on the business needs.
In custom table inserts, views, custom transformations and custom measures (in deliver instances) we create parameters that point to fields or tables, to create dependencies, lineage and catch column or table renaming.Currently, we have to drag and drop these parameters every time. It would be very nice if the editor had a ‘detect parameters’ button that automatically creates parameters based on the code written.
In the 6xxx release when you synchronize your Prepare instance with an Ingest instance there are two things that may happen:TimeXtender automatically handles changes, no input is required. TimeXtender cannot automatically deal with the changes and user input is required to tell TimeXtender how mappings should be set up.In both cases, there are significant improvements to be made (or deficiencies handled). I will list my issues and suggestions for each in the following sections:Changes can be handled automaticallyIt is usually great that TimeXtender handles things for you, but there is currently no way of seeing the changes that were applied. In the 20.10.x BU setup, a source synch would show you what changes were applied. In my opinion what should be available is the following:a synchronize which can be auto-resolved should show the proposed (additions, removals, mutations) changes. It only applies them if the user agrees it should be possible to review the current mapping state in its totality the interface showing all mappings should be sortableChanges cannot be handled automaticallyWhen TimeXtender cannot handle changes, it shows a dialogue with all mappings (one line per table, followed by all field mappings). You need to scroll through a potentially huge list of mappings to find any that are problematic. This dialogue will not accept empty (None) mappings and give you a warning. What we need here is the following:the interface showing all mappings should be sortable (to quickly sort on tables with errors) it should be possible to collapse and expand tables (start with everything collapsed) so that fields can be hidden for a shorter list it should be possible to select None as a mapping. If a field is removed from source, there is no reason why None is not a valid mapping to DWH. It is fine to mark the field visually, but if I want a field without a mapping that is not always an error it should be possible to filter the interface so I can focus on the problems only instead of needing to scroll through thousands of mappings with pgdn to try and find one problematic mapping it should be possible to review the current mapping state in its totalityI am not sure how mapping sets are currently visualised (if they are at all), but those rules should be reachable from the general mapping interface.
I would like to have the option to aggregate strings in the TimeXtender Aggregate functionality as can be done in SQL via a STRING_AGG() function. I’m currently doing this with views.
Hello,it would be great if you could do anonymization and the like in Timextender's REST Connection.You can do that in Cdata's REST connection.BRAnders
In the legacy version of TX, it was possible to check one or more semantic models in a project perspective. If the perspective is dynamic, it would then automatically select all tables required for that semantic model in the perspective.In the new TX version, semantic models are separate instances and can therefore not be selected in the data warehouse Perspectives. So now we have to select all tables manually and maintain the selection if tables are added to a semantic model.It would be very helpful if we are able to select a semantic model in a data warehouse perspective.
TDI UI Improvement idea - Make sure Data Selection Rule and Field Validation are disabled when incremental load is applied to a table.
How many times you ended up dragging table to the wrong table or did something else stupid you regret about? simple 'Undo' (ctrl+z) could save the (rest of your) day
Hi,This is related to post:The suggested solution is to use 'Review Tasks’ to deploy the changed table/View together with security. But than you have to deselect ALL other tables and views you do not want to deploy/execute. This is not a workable solution when you have hundreds of tables you need to deselect each time you need to deploy a table with security. It is also not directly clear for developers which tables are used in security rules. This would mean that every time you change a table or a view you have to do a differential deployment on data warehouse level.Please make sure that table/view security is automatically deployed when a table and/or view is changed. Make sure that users don't have to manually add security to the production environment each time after a environment transfer.
Hello,wouldn't it be good with a best practice analyzer for Prepare and Deliver instances.A BPA can start on a modest scale and develop over time. There will certainly be suggestions on what needs to be checked in the Community.The same applies to the functionality. You can start with a report that lists possible areas for improvement, with suggestions for action.The next step could be for Timextender to provide an interactive proposal where the proposals for measures are listed with checkboxes so that you can choose which ones you want Timextender to implement.If a BPA is to be implemented in the portal or application, I leave it open.BRAnders
Hi, Is it possible to create your own Exmon Process Map Templates?If so, how to save them as a template. Regards,Devin
Add feature to enable table partitioning in SSAS tabular models.
At the moment. It is is possible to install/update data source connectors to the newest version. While in some cases, the new version of the connector is not compatible with the installed version of TimeXtender. This means you have to install a older version of a data source connector, or you need to update TimeXtender Data Integration to the newest version.It would be way easier if only the data source connectors were shown in the portal that are compatible with in installed TimeXtender Data Integration version. Or at least, a pop up/warning is visible that is showing the compatible versions for the selected connector.
In the new version from yesterday 02/04/24 we haven’t enought space to see the SSL instances:It would be nice to be able to create something like Power Bi Pipelines to define the sequence DEV->PROD for each group of instances because it would be more clear and more safe:
Add option to copy/clone instances in the Portal. Just like the clone option for Data Sources that can be used in the portal.
Currently, when you open the Environments page in the portal, the Semantic Models are shown per two items with scroll buttons. We have customers with around 20 semantic models, so you need to click around a lot to go to the model you need. Also, when you click it to copy it to another instance, the UI switches back to the first two items so you have to click your way back again to the next one.It would be nice if the portal shows more Semantic Models at once, perhaps around 10. There is space enough. Even better would be if you can choose the amount of models shown.
As mentioned in this post :It is currently necessary to manually map all tables whenever a new promotion of a Prepare instance is done. This makes the use of multiple environments for DTAP tedious and unnecessary a lot of work. With each new release the amount of fields/tables could grow, leading to more overhead work for mapping. Since only 1 ODX could run per server isn't it a simple solution to just get a pop-up which asks if we would like to use the same Ingest instance or choose one? It can then automatically remap based on the new Ingest instance. Whenever a table or fields name doesn't match it could give us the same remapping table in which we can manually correct these or take other actions.Please look into this, since I cannot see how the current process should work as it does.
Hi team, Currently I am working in a project with 60+ instances, across three environment folders. There are certain actions in TimeXtender Data Integration that trigger all of the folders to open. This is frustrating, as it makes it easy to open an instance from a different folder in the list by mistake. Closing an instance, for example, causes all folders to expand. Kind regards,Andrew
I love this feature, as it can also be used to quickly incorporate datawarehouses made when TimeXtender was not used yet. I gather that it was created because the Export/ Import feature from version 20.10 is no longer (or not yet?) available.However, when taking a database, created with TimeXtender, it unfortunately simply also takes in the raw tables, Log and Message tables (as the gif in your article clearly shows). This means actually that you need to clean up a lot of “ingested” tables from the solution and remove all the system fields, like DWID, because the deploy just doesn’t work otherwise. If it wouldn’t take too much work, it would be great to have an option to Choose a Schema to import. If best practices are followed, then only the Valid schema should be enough.. and it would allow to import a Staging area only, or a Final area only have a check box to remove any fields which would conflict .. and thus not scripting any of the system fields which TimeXtender will add again.Until this is made, I’ll work on with a custom solution because I believe this feature offers the opportunity to refrain from re-inventing the wheel over and over again, but to inject template sets of tables and views to gain even more time.
Hi community,Often, multiple versions of the same measure are made with only slight differences. Being able to clone a measure, including its parameters, would speed up this process and is relevant for all endpoints.Kind regards,Andrew
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.