Skip to main content
To homepage To homepage

Jobs & Executions

Ask questions about Jobs & Executions within TimeXtender

  • 117 Topics
  • 524 Replies
117 Topics
M
Explorer
MvestExplorer
asked in Jobs & Executions
Backend table for the ODX Execution Log

Hello,In Timextender there is a report called ODX Execution Log (see image). I was wondering in which tables the underlying data is stored.My company has a dashboard / chat bot that we use to check on our nightly DWH executions. For this we use the tables ExecutionPackageLogs, ExecutionPackageLogDetails, Projects, etc.I want to expand these reports with data regarding the ODX Transfer Tasks. I checked most of the tables in the metadata database (e.g. ScheduleJobs, ScheduleJobLogs) but I was not able to find it.  

921
rory.smith
TimeXtender Xpert
7 months ago
K
Contributor
KCMTContributor
asked in Jobs & Executions
Azure SQL Database Log Backup Storage Size grows enormously resulting in high costs

Recently we identified that our Azure SQL Database Backup Costs for our TimeXtender environment are very high, almost even higher then the regular storage costs itself. We now try to minimize these Backup Costs. We already minimized the Backup Retention policies:Now, when analysing some Backup data in the Azure Portal we found that the Log Backup Storage Size is growing the the multiple TeraBytes, even though our PROD database uses around 28GB.  Does anybody know how we can further analyse and minimize these backup costs and data? I found the following regarding the transaction log, but I can't seem to dive in the transaction log/size per table or execution for example. --------------------------------------------------------------------------------------------------------------------In Azure SQL Database, transaction logs record changes made to the database to ensure data durability and provide for features like point-in-time restore and disaster recovery. Various operations within Az

3245
Christian Hauggaard
Community Manager
7 months ago
p.ruijter
Contributor
p.ruijterContributor
asked in Jobs & Executions
Start Execution Package on an other location

I want to start an Execution Package at another server. I have attached the PS1 script. This script is working on the TimeXtender server. But not on our Qlik server. We use the same credentials. Also the credentials have access to the timextender.exe and the shares mentioned in the script on our Qlik server.I think the parameters package name and project name are not recognized when starting the script on an other server. Can you help me out to start an execution package on an other location then the timextender server? 

937
p.ruijter
Contributor
7 months ago
S
Contributor
spenningContributor
asked in Jobs & Executions
Opening "Manage Schedule" option for a job automatically trigger jobs to run

Hi, We are running Timextender 6536.1 with execution server 6536.1 on on-premise sql server 2019.We seems to be having some strange behaviour with the “Manage schedule” option in with editing a job. Whenever we open the schedule it seems to trigger the job itself. I don't know if others experienced the same. I also don't know if it is related to Timextender 6536.1 since we had to do a lot of updates and configuration changes to the server lately due to a tempdb problem. Below I added a screenshot of the option, it applies to any job not only the odx one I'm highlighting.   

904
S
Contributor
8 months ago
S
Contributor
Søren SørensenContributor
asked in Jobs & Executions
Externally triggered load/execution

One of my clients has a file data source that arrives at unpredictable times of the day. Has anyone found a good way to external-trigger-load such data source when it arrives? E.g. Webhooks, Logic Apps, ...The question is for 20.10.43, but I’m equally interested in hearing if there are solutions for v6284.1 as we’ll be moving in that direction.Thanks!

1983
E
Contributor
8 months ago
devin.tiemens
TimeXtender Xpert
devin.tiemensTimeXtender Xpert
posted in Jobs & Executions
Jobs/ tasks UTC v.s. Daylight saving time

 Hi everybody, Probably unnecessary but for the ones living/working in Europe I just wanted to inform that daylight saving time will change to winter time this weekend. This means that for those who have an ODX server or the “new” version (6XXX) of TimeXtender, the scheduled tasks/jobs will take place one hour earlier than currently set.This also brought me to the question how we could automate this? Any thoughts about this? Maybe an option in TimeXtender to use local time instead of UTC?Kind regards,Devin

2216
ruben.ruhulessin
Starter
8 months ago
sierd.zuiderveld
Contributor
sierd.zuiderveldContributor
asked in Jobs & Executions
Execution package nests itself?

Hi all, We experience a weird issue where our execution package seems to run itself? This happens for a total of 3 times in the execution. Then, when it succeeds it'll kick off the next package where it will happen again. This just started to occur in the past week, before everything worked normally.  Has anyone else experienced this? This is the setup of the package.  Any help would be appreciated. 

1083
Christian Hauggaard
Community Manager
8 months ago
S
Contributor
Søren SørensenContributor
asked in Jobs & Executions
%Instance% parameter in the notification subject

The %Status% and %ExecutionPackage% work nicely in the subject line of notifications but I can’t make the %Instance% parameter work.Does anyone have a fix for this?(aside from creating instance-specific jobs/notifications and type the instance name in the subject line)

732
Thomas Lind
Community Manager
9 months ago
A
Explorer
AndrewSExplorer
asked in Jobs & Executions
Changing transformation in History table

Hi Folks,I have a painful process that involves uploading csv files into my ODX on ad-hoc basis. In the DSA, i use transformations to pull the existing fields apart into various new fields. This table has history enabled to track when key values change. I then push to the MDW, minus some of the ugly data and using SCD To and From dates to track changing dimensions.A new set of entries with some extra parenthesis broke my job. I have a new set of case statements to deploy to the DSA history table, but as I went to deploy it, I panicked. The normal deploy and execute for a table without history will clear existing data and reload from scratch. Does the same happen with a history table?This table would be a nightmare to rebuild.TX version 19.11.7.64

1334
Thomas Lind
Community Manager
9 months ago
A
Contributor
aftabpContributor
asked in Jobs & Executions
Exclude tables from an Execution package

I have set-up an Execution job that builds a table based on a view. The view generation is in DSA. The tables in the view have saperate Execution package that runs (before this job) without failing.Because of the limitations on how often the data can be extracted with API-endpoints in DSA_ tables, the following Execution job failed previously.I wanted to exclude the tables that are already updated so i have defined the tables that i dont want to run. Is this the right way to do it?    

804
Thomas Lind
Community Manager
9 months ago
kerry_bespoke
Contributor
kerry_bespokeContributor
asked in Jobs & Executions
Execution Package Unknown/Running and never Finished

The daily build of a data warehouse started for an Execution package but never finished. I am unable to see any cause of this job stopping in the TX logs or Event Viewer (Unknown_Running.png) of the server. Is there somewhere else I can check to determine the cause of the build to cancel while running for no reason?Since there was no direction to resolve this issue, we left the build to try to run again today and are now receiving an error that says the job is currently executing (Warning.png). How do I clear this stuck job in TX? 

2343
kerry_bespoke
Contributor
9 months ago
sten.lomme
Participant
sten.lommeParticipant
asked in Jobs & Executions
CData BigQuery connector not executing when run as part of execution package

We are having issues running source objects when source is CData BigQuery connector.Execution of objects run fine when executed individually with Deploy and Execute. When the objects are added to an execution package, the execution package runs fine when executed manually. But when the package is run on a schedule, the package just “hangs” and never finish the job. This prevents next running packages from executing, until we kill the process.When we look at the running processes on the machine, it seems like the Timextender package is running as a process. But if we look at the ongoing execution processes in SQL Server, nothing is running.The Event Viewer reports issues with “The application-specific permission settings do not grant Local Activation permission for the COM Server application” at the same time the process started.How can we fix this issue and ensure BigQuery objects can run as part of an execution package?

981
Thomas Lind
Community Manager
11 months ago
V
Participant
VictorParticipant
asked in Jobs & Executions
Data volume per load

Hello,Is there any posibility to know how much data was loaded through the data warehouse during a scheduled execution package? Either through TX repository, logs or through system files in the azure database?Let’s say my customer has a databasewith 500gb worth of data, but we load only certain tables (some full, some incremental) and would like to know how much data we push every scheduled load.Thank you,Victor

1004
V
Participant
11 months ago
Pontus Olausson
Participant
Pontus OlaussonParticipant
asked in Jobs & Executions
Excel Online connector sometimes fail with "Error while listing workbooks for drive"

 Hi,I am running a legacy version of TimeXtender (version 20.10.40.64), where we have an Excel Online connection set up using CData ADO.NET Provider for Microsoft Excel Online 2022 (22.0.8389.0) as data source.This data source is configured to authenticate via Azure ‘client flow’, see picture. The app registration in Azure has the following permissions:  The data source works properly most of the time. It is able to list the worksheets it finds on the SharePoint site, and can fetch data. However, scheduled execution packages sometimes fails with the following error message:[500] Could not execute the specified command: Error while listing workbooks for drive: [generalException] General exception while processing. Details: Error while listing workbooks for drive: [generalException] General exception while processing. Module: System.Data.CData.ExcelOnline fx220l.yg at fx220l.IIu.m(Boolean ) at fx220l.IIu.X(tbp`1 , Boolean ) at fx220l.IIu.YI(LoL )

2017
andrew.gebhard
Contributor
1 year ago
sierd.zuiderveld
Contributor
sierd.zuiderveldContributor
asked in Jobs & Executions
Execution has been skipped for execution package, but why?

Hey, Usually when an execution package fails to start it is due to another already running, then in the event viewer we get a message like this: Here, we see that the issue is due to another package. Now I have noticed that we occasionally also get messages like this one: Difference being that it does not show which ‘other’ package is causing this issue.  Is this a common occurrence?

1372
sierd.zuiderveld
Contributor
1 year ago
M
Employee
mmaxellEmployee
asked in Jobs & Executions
HubSpot task

Hi guys, I cannot get the companies and deals table to execute in the ODX phase. The error I get: Executing table [HubSpot].[Companies]:failed with error:System.Data.SqlClient.SqlException (0x80131904): Execution Timeout Expired.  The timeout period elapsed prior to completion of the operation or the server is not responding. ---> System.ComponentModel.Win32Exception (0x80004005): The wait operation timed out Has anyone else seen this before? 

601
Thomas Lind
Community Manager
1 year ago
MartinMemelink
Contributor
MartinMemelinkContributor
asked in Jobs & Executions
Execution succesful but notification e-mail

Hi all, at a client we have encountered a curious situation with execution e-mail notifications, hopefully you will be able to help us figure it out.There are 5 scheduled execution packages for BU's that run every morning. Since two days we are getting e-mail notifications saying these have failed, but when we look in in TimeXtender they in fact have executed successfully.Each BU execution throws a different connection error message:ERROR [HY000] [MySQL][ODBC 8.0(w) Driver]Can't connect to MySQL server on 'XXXXXX' (10060) Unable to connect to any of the specified MySQL hosts. The remote server returned an error: (400) Bad Request. [500] Could not execute the specified command: HTTP protocol error. 500 Internal Server Error. ERROR [08001] could not connect to server: Connection refused (0x0000274D/10061) I will take the top one as an example to show you how it looks. Attached is the full fail notification e-mail.This package includes has the following settings: This is what the executi

26411
MartinMemelink
Contributor
1 year ago
E
Contributor
ebayContributor
asked in Jobs & Executions
Incorrect job repository version. Expected 2.0.0.0 found 3.0.0.0

Hello Today I get this error, wenn I want to add new Job. We didn’t change the version and use TimeXtender 6143.1.  We updated all of data sources but doesn’t change. Firstly, I want to understand why I am receiving this error. If I encounter this message in the future, I want to comprehend what I should do. There is a similar topic, but since there is no version change, I want to reopen it. Xpilot recommends that we should use the new version. Is it correct?

936
E
Contributor
1 year ago
K
Starter
KashifStarter
posted in Jobs & Executions
Incremental Data Load Issue

Hi Support, We first raised this problem/bug back in Feb 2022. It seems that the incremental rules are not working correctly. The client Xandor had removed these incremental rules from their Live system some time ago but re-introduced them this month, and have failed. The problem seems to be related to using multiple incremental rules e.g. 'MODIFIEDDATETIME > (Last Max Value) - 3600 seconds & TRANSDATE > (Last Max Value) - 15,552,000 seconds.  Please see attached document for further information on this. The client is currently on version 20.10.30.64 and have TX configured to use SSiS for data transfers.  Do you know if there is a solution to this issue please? Thanks,Kashif 

1385
Christian Hauggaard
Community Manager
1 year ago
M
Explorer
MvestExplorer
asked in Jobs & Executions
Max Threads when daisy chaining execution packages

Hello!I want to experiment a little and check if changing my Max Threads setting can improve execution times. I have one big package which includes multiple other packages as Steps.If I change the Max Threads setting in the main package, do the packages from the included steps inherit this setting, or do I have to manually change the setting for each included step?Side question; I have plenty of data for execution times at 4 threads. My plan is to do three runs at 3, 5 and maybe even 6 threads and compare the averages. Is that a good setup? Thanks.

1406
M
Explorer
1 year ago
Acumen
Visitor
AcumenVisitor
asked in Jobs & Executions
Upgrading Multiple Environments

Is it absolutely necessary to perform a transfer between environments after an upgrade?Dev, QA and Prod are all sitting on their own server. I have upgraded all 3 to the latest TimeXtender version and all Deployed and executed perfectly. Would I still have to do the “Multiple environment Transfer” or is this not necessary?Upgrade Dev - Deploy, Execute, & Validate all is working.  Upgrade Test - Deploy, Execute, & Validate all is working. Transfer Dev -> Test - Deploy, Execute, & Validate Test to ensure all is working. Upgrade Prod - Deploy, Execute, & Validate all is working. Transfer Test -> Prod - Deploy, Execute, & Validate Prod to ensure all is working

981
Thomas Lind
Community Manager
1 year ago
J
Starter
joelpetterssonStarter
asked in Jobs & Executions
Job logs lacks detailed information

Hi,We are currently trying to figure out the new gen of Timextender, and I’m finding the setup with jobs a bit lacking. Perhaps I’ve just missed something, but here are a few things that bug me. As far as I can understand, the way to go when scheduling in the DW is to set up your execution packages in the execution tab. Then we need to set up a Job that schedules the execution packages. In my trials I intentionally set up a package to fail, and first of all the monitoring view of jobs do not show any information about the error: Jobs monitoringIf I go into the execution log, I can see an error message that essentially just says that the job didn’t succeed.Execution log for test job​​​​​For debugging that means I have to check the contents of the job (that potentially could have multiple execution packages in it) and then head over to the execution tab to check the log for the package, where I see all the details.Execution log in execution tabI would think it was nice to be able to reac

1593
Christian Hauggaard
Community Manager
1 year ago
D
Explorer
David PrietoExplorer
posted in Jobs & Executions
How to solve this issue: Package executes itself

I’m facing this issue:This package is scheduled to run every half an hour. On rare occacions the package executes itself as shown on the picture to the left (blue rectangle) and the execution log shows both executions as successful. We would like to know any insight to help us solve this issue.  Some things to consider:At the customer’s request the package is being run from the Task Scheduler.  The execution log does not show any errors as shown in the image above (green rectangle) This is how the retries are setup: The task scheduler showed this warning: We got this email throwing an error. However, the "network-related error” is nowhere to be found since according to the execution log it ran successfully:   

16310
D
Explorer
1 year ago
L
Participant
luuk.boumanParticipant
asked in Jobs & Executions
Difference in post execution step behavior for execution packages with a usage condition

Hi TimeXtender, We’re seeing the following scenario: We have a execution package ‘A’ that is set up with an usage condition and a next package ‘B’ in the post execution steps.Now, when we manually execute package ‘A’ through the user interface and the usage condition resolves false, the display message appears with this information, package 'A’ won't start as expected and, importantly, the next package 'B’, from the 'Run Package’ setting, won't start as well.However, when the same execution package 'A’ is triggered through the scheduler, we see that even though package 'A’ won't start, because the usage condition returns false, the next package 'B’ in this case does start executing. Is this something you are familiar with or are able to reproduce? Extra information is that package 'B’ doesn't have an usage condition applied and we're running TX 20.10.43.64. Best regards,Luuk Bouman

1356
L
Participant
1 year ago
G
Contributor
gediminas.juskenasContributor
asked in Jobs & Executions
Execution package when data in source table is not empty

Hello.I have a scheduled execution package which takes data from ODX, transforms data in DSA database and loads final tables to MDW. This execution package basically runs a perspective containing this process.I need to setup following logic:If data in any source table (ODX) of this execution package is empty (i.e. at least 1 empty table) Do not execute the package If data in all source tables (ODX) of this execution package contain any data (i.e. all tables non-empty) Execute the package Is there any way how i can setup this? Maybe even create additional “control” execution package? The version of TX i am running is 20.10.34.64 Thank you!

1091
rogier.helmus
Problem Solver
1 year ago

Badge winners

  • Certified Solutions Architect
    pkaustubhahas earned the badge Certified Solutions Architect
  • Ingest Expert
    avanrijnhas earned the badge Ingest Expert
  • Deliver Expert
    danielhas earned the badge Deliver Expert
  • Jobs & Executions Expert
    p.ruijterhas earned the badge Jobs & Executions Expert
  • Certified Solutions Architect
    lstegmeierhas earned the badge Certified Solutions Architect
Show all badges
Terms and ConditionsCookie settings