To homepage To homepage

Jobs & Executions

Ask questions about Jobs & Executions within TimeXtender

  • 101 Topics
  • 402 Replies

101 Topics

G
Starter
gisliheiStarter
asked in Jobs & Executions

Not able to pick execution job when creating a job

When choosing a execution job, just a single execution job, it’s grayed out and I’m not able to choose it.it’s deployed and the execution jobs works, when I run it manually.I’m running Timextender version 6590.1

1
G
Starter
3 days ago
A
Contributor
aftabpContributor
asked in Jobs & Executions

A project with this name aleady exists

I have set up two completly new enviorments in AZURE.Project name is same in both (i also have tried to append _PROD in Production) Why is this an issue? How do i come around this? 

13
H
Starter
9 days ago
B
Starter
BennyStarter
asked in Jobs & Executions

Execution Job cannot find package

Hello, I added an execution package to my production instance. I want to add it to a certain job, but that job cannot find my package. In fact, it finds all packages except for the one I just added. How can this be?  

3
B
Starter
13 days ago
M
Starter
MvestStarter
asked in Jobs & Executions

Backend table for the ODX Execution Log

Hello,In Timextender there is a report called ODX Execution Log (see image). I was wondering in which tables the underlying data is stored.My company has a dashboard / chat bot that we use to check on our nightly DWH executions. For this we use the tables ExecutionPackageLogs, ExecutionPackageLogDetails, Projects, etc.I want to expand these reports with data regarding the ODX Transfer Tasks. I checked most of the tables in the metadata database (e.g. ScheduleJobs, ScheduleJobLogs) but I was not able to find it.  

1
rory.smith
TimeXtender Xpert
14 days ago
V
Participant
VictorParticipant
asked in Jobs & Executions

Decreasing ODX transfer time

Hello,TimeXtender 20.10.31.64ODX: 20.10.31We are currently running a database on hyperscale with 12vcores and premium memory optimized hardware. ODX is a data lake.We are running execution packages on 4 threads and we want to reduce our odx transfer times as that is out biggest impact right now.This is an example of a load. I am seeing long ODX transfer times for very small tables that I cant find the cause of or explain.We have alot of small tables (see example below) that is taking 1-3 minutes, while some tables doing data cleansing on 1million + rows is doing it in the same amount of time. See this small table that is 400 rows, no transformations and only 10 columns. I can see we are peaking log io at 100% during certain periods.However, that seems to be during the later parts of the loads and not during odx transfer in the start. Is there any thing that can cause this or possibility to improve it?Thank you,Victor​​​​​

7
Christian Hauggaard
Community Manager
21 days ago
K
Contributor
KCMTContributor
asked in Jobs & Executions

Azure SQL Database Log Backup Storage Size grows enormously resulting in high costs

Recently we identified that our Azure SQL Database Backup Costs for our TimeXtender environment are very high, almost even higher then the regular storage costs itself. We now try to minimize these Backup Costs. We already minimized the Backup Retention policies:Now, when analysing some Backup data in the Azure Portal we found that the Log Backup Storage Size is growing the the multiple TeraBytes, even though our PROD database uses around 28GB.  Does anybody know how we can further analyse and minimize these backup costs and data? I found the following regarding the transaction log, but I can't seem to dive in the transaction log/size per table or execution for example. --------------------------------------------------------------------------------------------------------------------In Azure SQL Database, transaction logs record changes made to the database to ensure data durability and provide for features like point-in-time restore and disaster recovery. Various operations within Az

5
Christian Hauggaard
Community Manager
30 days ago
p.ruijter
Contributor
p.ruijterContributor
asked in Jobs & Executions

Start Execution Package on an other location

I want to start an Execution Package at another server. I have attached the PS1 script. This script is working on the TimeXtender server. But not on our Qlik server. We use the same credentials. Also the credentials have access to the timextender.exe and the shares mentioned in the script on our Qlik server.I think the parameters package name and project name are not recognized when starting the script on an other server. Can you help me out to start an execution package on an other location then the timextender server? 

7
p.ruijter
Contributor
1 month ago
S
Contributor
spenningContributor
asked in Jobs & Executions

Opening "Manage Schedule" option for a job automatically trigger jobs to run

Hi, We are running Timextender 6536.1 with execution server 6536.1 on on-premise sql server 2019.We seems to be having some strange behaviour with the “Manage schedule” option in with editing a job. Whenever we open the schedule it seems to trigger the job itself. I don't know if others experienced the same. I also don't know if it is related to Timextender 6536.1 since we had to do a lot of updates and configuration changes to the server lately due to a tempdb problem. Below I added a screenshot of the option, it applies to any job not only the odx one I'm highlighting.   

4
S
Contributor
1 month ago
S
Contributor
Søren SørensenContributor
asked in Jobs & Executions

Externally triggered load/execution

One of my clients has a file data source that arrives at unpredictable times of the day. Has anyone found a good way to external-trigger-load such data source when it arrives? E.g. Webhooks, Logic Apps, ...The question is for 20.10.43, but I’m equally interested in hearing if there are solutions for v6284.1 as we’ll be moving in that direction.Thanks!

3
E
Contributor
1 month ago
devin.tiemens
TimeXtender Xpert
devin.tiemensTimeXtender Xpert
posted in Jobs & Executions

Jobs/ tasks UTC v.s. Daylight saving time

 Hi everybody, Probably unnecessary but for the ones living/working in Europe I just wanted to inform that daylight saving time will change to winter time this weekend. This means that for those who have an ODX server or the “new” version (6XXX) of TimeXtender, the scheduled tasks/jobs will take place one hour earlier than currently set.This also brought me to the question how we could automate this? Any thoughts about this? Maybe an option in TimeXtender to use local time instead of UTC?Kind regards,Devin

6
ruben.ruhulessin
Starter
1 month ago
sierd.zuiderveld
Contributor
sierd.zuiderveldContributor
asked in Jobs & Executions

Execution package nests itself?

Hi all, We experience a weird issue where our execution package seems to run itself? This happens for a total of 3 times in the execution. Then, when it succeeds it'll kick off the next package where it will happen again. This just started to occur in the past week, before everything worked normally.  Has anyone else experienced this? This is the setup of the package.  Any help would be appreciated. 

3
Christian Hauggaard
Community Manager
2 months ago
rory.smith
TimeXtender Xpert
rory.smithTimeXtender Xpert
asked in Jobs & Executions

Job stuck on Active

I have a job that reloads a DWH instance that seems to be stuck on ‘Active’. This job is months old and may have been killed by a VM being shut down automatically.  This job blocks executions with a ‘Job already queued’ error.Is there any way to remove this from the queue?  

15
Thomas Lind
Community Manager
2 months ago
S
Contributor
Søren SørensenContributor
asked in Jobs & Executions

%Instance% parameter in the notification subject

The %Status% and %ExecutionPackage% work nicely in the subject line of notifications but I can’t make the %Instance% parameter work.Does anyone have a fix for this?(aside from creating instance-specific jobs/notifications and type the instance name in the subject line)

2
Thomas Lind
Community Manager
2 months ago
A
Explorer
AndrewSExplorer
asked in Jobs & Executions

Changing transformation in History table

Hi Folks,I have a painful process that involves uploading csv files into my ODX on ad-hoc basis. In the DSA, i use transformations to pull the existing fields apart into various new fields. This table has history enabled to track when key values change. I then push to the MDW, minus some of the ugly data and using SCD To and From dates to track changing dimensions.A new set of entries with some extra parenthesis broke my job. I have a new set of case statements to deploy to the DSA history table, but as I went to deploy it, I panicked. The normal deploy and execute for a table without history will clear existing data and reload from scratch. Does the same happen with a history table?This table would be a nightmare to rebuild.TX version 19.11.7.64

4
Thomas Lind
Community Manager
2 months ago
A
Contributor
aftabpContributor
asked in Jobs & Executions

Exclude tables from an Execution package

I have set-up an Execution job that builds a table based on a view. The view generation is in DSA. The tables in the view have saperate Execution package that runs (before this job) without failing.Because of the limitations on how often the data can be extracted with API-endpoints in DSA_ tables, the following Execution job failed previously.I wanted to exclude the tables that are already updated so i have defined the tables that i dont want to run. Is this the right way to do it?    

4
Thomas Lind
Community Manager
2 months ago
kerry_bespoke
Contributor
kerry_bespokeContributor
asked in Jobs & Executions

Execution Package Unknown/Running and never Finished

The daily build of a data warehouse started for an Execution package but never finished. I am unable to see any cause of this job stopping in the TX logs or Event Viewer (Unknown_Running.png) of the server. Is there somewhere else I can check to determine the cause of the build to cancel while running for no reason?Since there was no direction to resolve this issue, we left the build to try to run again today and are now receiving an error that says the job is currently executing (Warning.png). How do I clear this stuck job in TX? 

3
kerry_bespoke
Contributor
2 months ago
sten.lomme
Participant
sten.lommeParticipant
asked in Jobs & Executions

CData BigQuery connector not executing when run as part of execution package

We are having issues running source objects when source is CData BigQuery connector.Execution of objects run fine when executed individually with Deploy and Execute. When the objects are added to an execution package, the execution package runs fine when executed manually. But when the package is run on a schedule, the package just “hangs” and never finish the job. This prevents next running packages from executing, until we kill the process.When we look at the running processes on the machine, it seems like the Timextender package is running as a process. But if we look at the ongoing execution processes in SQL Server, nothing is running.The Event Viewer reports issues with “The application-specific permission settings do not grant Local Activation permission for the COM Server application” at the same time the process started.How can we fix this issue and ensure BigQuery objects can run as part of an execution package?

1
Thomas Lind
Community Manager
4 months ago
V
Participant
VictorParticipant
asked in Jobs & Executions

Data volume per load

Hello,Is there any posibility to know how much data was loaded through the data warehouse during a scheduled execution package? Either through TX repository, logs or through system files in the azure database?Let’s say my customer has a databasewith 500gb worth of data, but we load only certain tables (some full, some incremental) and would like to know how much data we push every scheduled load.Thank you,Victor

4
V
Participant
5 months ago
Pontus Olausson
Visitor
Pontus OlaussonVisitor
asked in Jobs & Executions

Excel Online connector sometimes fail with "Error while listing workbooks for drive"

 Hi,I am running a legacy version of TimeXtender (version 20.10.40.64), where we have an Excel Online connection set up using CData ADO.NET Provider for Microsoft Excel Online 2022 (22.0.8389.0) as data source.This data source is configured to authenticate via Azure ‘client flow’, see picture. The app registration in Azure has the following permissions:  The data source works properly most of the time. It is able to list the worksheets it finds on the SharePoint site, and can fetch data. However, scheduled execution packages sometimes fails with the following error message:[500] Could not execute the specified command: Error while listing workbooks for drive: [generalException] General exception while processing. Details: Error while listing workbooks for drive: [generalException] General exception while processing. Module: System.Data.CData.ExcelOnline fx220l.yg at fx220l.IIu.m(Boolean ) at fx220l.IIu.X(tbp`1 , Boolean ) at fx220l.IIu.YI(LoL )

7
andrew.gebhard
Participant
5 months ago
sierd.zuiderveld
Contributor
sierd.zuiderveldContributor
asked in Jobs & Executions

Execution has been skipped for execution package, but why?

Hey, Usually when an execution package fails to start it is due to another already running, then in the event viewer we get a message like this: Here, we see that the issue is due to another package. Now I have noticed that we occasionally also get messages like this one: Difference being that it does not show which ‘other’ package is causing this issue.  Is this a common occurrence?

2
sierd.zuiderveld
Contributor
6 months ago
M
Employee
mmaxellEmployee
asked in Jobs & Executions

HubSpot task

Hi guys, I cannot get the companies and deals table to execute in the ODX phase. The error I get: Executing table [HubSpot].[Companies]:failed with error:System.Data.SqlClient.SqlException (0x80131904): Execution Timeout Expired.  The timeout period elapsed prior to completion of the operation or the server is not responding. ---> System.ComponentModel.Win32Exception (0x80004005): The wait operation timed out Has anyone else seen this before? 

1
Thomas Lind
Community Manager
6 months ago
MartinMemelink
Contributor
MartinMemelinkContributor
asked in Jobs & Executions

Execution succesful but notification e-mail

Hi all, at a client we have encountered a curious situation with execution e-mail notifications, hopefully you will be able to help us figure it out.There are 5 scheduled execution packages for BU's that run every morning. Since two days we are getting e-mail notifications saying these have failed, but when we look in in TimeXtender they in fact have executed successfully.Each BU execution throws a different connection error message:ERROR [HY000] [MySQL][ODBC 8.0(w) Driver]Can't connect to MySQL server on 'XXXXXX' (10060) Unable to connect to any of the specified MySQL hosts. The remote server returned an error: (400) Bad Request. [500] Could not execute the specified command: HTTP protocol error. 500 Internal Server Error. ERROR [08001] could not connect to server: Connection refused (0x0000274D/10061) I will take the top one as an example to show you how it looks. Attached is the full fail notification e-mail.This package includes has the following settings: This is what the executi

11
MartinMemelink
Contributor
6 months ago
E
Contributor
ebayContributor
asked in Jobs & Executions

Incorrect job repository version. Expected 2.0.0.0 found 3.0.0.0

Hello Today I get this error, wenn I want to add new Job. We didn’t change the version and use TimeXtender 6143.1.  We updated all of data sources but doesn’t change. Firstly, I want to understand why I am receiving this error. If I encounter this message in the future, I want to comprehend what I should do. There is a similar topic, but since there is no version change, I want to reopen it. Xpilot recommends that we should use the new version. Is it correct?

6
E
Contributor
7 months ago
B
Explorer
businessintelligenceExplorer
asked in Jobs & Executions

Error loading project - Item with same key has already been added

Hi,I get this error while loading the latest version of a project.I also tried to load an ealier version of the project, but was not allowed to save it as the latest - getting the same error.What should I do? - Gabrielle

3
B
Explorer
8 months ago
K
Starter
KashifStarter
posted in Jobs & Executions

Incremental Data Load Issue

Hi Support, We first raised this problem/bug back in Feb 2022. It seems that the incremental rules are not working correctly. The client Xandor had removed these incremental rules from their Live system some time ago but re-introduced them this month, and have failed. The problem seems to be related to using multiple incremental rules e.g. 'MODIFIEDDATETIME > (Last Max Value) - 3600 seconds & TRANSDATE > (Last Max Value) - 15,552,000 seconds.  Please see attached document for further information on this. The client is currently on version 20.10.30.64 and have TX configured to use SSiS for data transfers.  Do you know if there is a solution to this issue please? Thanks,Kashif 

5
Christian Hauggaard
Community Manager
8 months ago

Badge winners

  • Certified Solutions Architect
    Karankadamhas earned the badge Certified Solutions Architect
  • TimeXtender Xpert
    Muddihas earned the badge TimeXtender Xpert
  • Innovator
    andrew.gebhardhas earned the badge Innovator
  • Certified Solutions Architect
    mello.bogaartshas earned the badge Certified Solutions Architect
  • Innovator
    ekw9has earned the badge Innovator
Show all badges
Terms and ConditionsCookie settings