Recently active topics

This article describes how to add a CSV Endpoint to a Deliver instance. If you want to use data from the Deliver instance in an endpoint that is not natively supported by TimeXtender Data Integration, you can use the CSV endpoint to create files that can be read by almost everything under the sun. When you execute the endpoint, a file is created for each table in the model. Only regular fields are supported, not measures or custom fields.In the TimeXtender Portal navigate to Data Estate > Instances, click Add Instance> Add Deliver instance. Select CSV Endpoint from the Add endpoints list, then click Add an endpoint. Fill out the following fields in the form.In the Directory box, enter the path to the folder where the files should be placed In the File extension box, enter the file extension you want to use (usually "txt" or "csv") In the Encoding list, click on the encoding you want to use. In the Field names in first row, click No if you do not want the field names to be output

I believe I have read the documentation, in case I missed something. My bad. Im trying to load csv files from the root of a S3 bucket. The 'test connection’ in the portal turns green but when trying to synchronize in timextender it tells me I have to enter a value for ‘path’.I have tried these so far: /.mybucketname/inbound/s3://mybucketname/inbound/But timextender keeps throwing errors saying the directory does not exist. I can succesfully connect to it and download the csv's via Python so Im quite sure the setup is correct.  Does anyone know what to fill in for ‘path’?

A JSON response looks like this [{"ref": 123456,"dim_1": "A","dim_2": "B","peroid": 202601},{"ref": 5E+20242959,"dim_1": "A","dim_2": "B","period": 202602}]The second ref (5E+20242959) is a problem - its neither STRING nor an INT.Ref is defined as NVARCHAR in BU, but as you can see the value is not between “”.I have tried the following approaches under, still i get the same errorInput string '5E+20242959' is not a valid number. Path '[56935]['ref.53e92a42-b13c-4062-87b4-6bd5a89547b1.1992753']', line 1, position 36741783.How do i solve this?Here are the approaches i have tried:Omitting Ref in Table FlattningIn table flattning, i have left it out. I have the other three values, but still landing returns an error:Defining the value as NULL in table flattningField transformationCondition on column ref in BUI have defined the following condition on the column, still i get the same errorCASE WHEN [ref] LIKE '5E+%' THEN NULL ELSE [ref]ENDScript ActionsI have created a script th

I run into this error while loadning csv-files from our s3 bucket.The issue is that the number of fields differs from time to time. We would like to ignore that and read these fields if they exists and otherwise not.Is there a way to do this or is this just an exception in CsvHelper-lib that isnt accessible for me to configure? The error:Executing table [csv].[VOF_UTF_Planeradebesok__aggregated]:failed with error:CsvHelper.MissingFieldException: Field with name 'Planerat besök - konfidentiellt' does not exist. You can ignore missing fields by setting MissingFieldFound to null.IReader state:   ColumnCount: 21   CurrentIndex: -1   HeaderRecord:["Användare - ID2","Användare - personnummer","Användare - profession","Avbruten/inställd","Brukare - ID2","Brukare - personnummer","Planerad resurs - namn","Planerat besök - dubbelbemanning","Planerat besök - ej utfört (anledning)","Planerat besök - sluttid","Planerat besök - starttid","Planerat besök - typ av brukare","Planerat besök - utfört","P

I have a large table with about 50 columns. There is column called projectNumber. This column, i am unable to override.This column is varchar. However in TX with Enhanced Drivers it shows Int32.I have overridden it to Text It even says so in Data type overrides on the DataSource I have even tried adding and removing it in Table builder  

Orchestration & Data Quality can run your Timextender Data Integration (TDI) work on a schedule: your Ingest, Prepare and Deliver tasks, in the order you choose, against the instance you choose for each environment. Every run is recorded, and you can have someone notified when one fails.There are three steps:Connect Orchestration to TDI with a data provider. Map your TDI instances to Orchestration's three environments — this is environment-aware sync, and it is what lets one set of packages serve all your environments. Schedule the work, choosing the environment each schedule runs in.This page walks through all three, in order. You do this once per data provider.Already running TDI packages in Orchestration?Instance mapping was introduced in 26.2. If your TDI data provider was created before 26.2, start with Migrate from per-environment TDI packages. It explains what changes, what keeps working in the meantime, and what to retire. Following this page alone would leave you with two

Instance mapping was introduced in 26.2. If your Timextender Data Integration (TDI) data provider was created before 26.2, Orchestration holds one copy of every package for every environment it lives in.Your schedules keep running. But Sync with TDI is switched off on that data provider, so it can no longer pick up changes from TDI — and the environment setting on your schedules does not do what it appears to do. This page explains why, what still works in the meantime, and how to move across.For the destination, see Orchestrating TDI. Why this changed Syncing a TDI data provider used to create a separate package, object group, process and process map for every environment a package existed in. Five TDI packages across four instances produced twenty package entries:A customer with 18 packages across three environments got 54 entries for 18 real pipelines.The duplication was not just clutter. Each duplicated object stayed permanently tied to the instance it was synced from, so the envir

 This article has been replaced by Orchestrating TDI and Migrate from per-environment TDI packages

Since TX Enhanced Connector doesnot allow parameters with the same name, how do i resolve the issue with:https://baseURL/cars?exportField=model&exportField=Year&exportField=Manufacturer?I have tried to solve it like this:But then in logs, i see that my URL is:https://bseURL/cars?exportField=Model&Year=exportFields=Year&Manufacturer=exportFields=ManufacturerWhich is obviously not correct.It shouldnt be: &Year=exportFields=Year&Manufacturer=exportFieldsManufacturerbut &exportFields=Year&exportFields=Manufacturer

Hi,I have two Execution Package chains ("Run Packages...") configured as follows:Chain 1:1a) Revenue 1b) Revenue Trigger 1c) Morning 1d) Morning TriggerChain 2:2a) Store 2b) Store TriggerThe requirement is that 2a) Store and 2b) Store Trigger must not run concurrently with 1c) Morning or 1d) Morning Trigger.I have configured this restriction in the Concurrent Packages section under Edit Execution Package. However, the restriction does not currently seem to be enforced as expected.Could this be because 1a) Revenue and 1b) Revenue Trigger are allowed to run concurrently with 2a) Store and 2b) Store Trigger?In other words, when Execution Packages are part of a chain, do the concurrency restrictions need to be configured for every package in the chain? Or should the restriction between 1c/1d and 2a/2b be sufficient to prevent those specific packages from running at the same time?

We have a client with a Rest Datasource that does not use URL parameters. Instead they use the post body to pass a series of filters and conditions.We are using this post body to implement Incremental loading from the datasource. It seems to be working correctly in so far as the rest source is definitely loading incrementally.However the Ingest instance does not seem to recognize the tables in the Gen 2 Storage as incremental.We have defined the incremental several times, deleted the entire folder in the Azure Gen2 storage. Still the same result.if we drag the table over to a data area the source in the Ingest instance is not flagged with an “i” indicating that it is incremental.Is this because we are passing the incremental variable through the post body and not as a query parameter?if this is the case is there a work around?The issue we are facing is that we cannot do any downstream incremental loads as TX complains that the source table in the ingets instance is not incremental. Not

So i think i must be missing something or maybe even forgetten.My dataflow: I have a Data source connection (dsc) ingesting csv-files from a S3 bucket with an aggregation pattern since the files have the date in the filename to make sure we dont overwrite any files. Each row in each file has a column with the date. So all rows in the file has the same date. The ingestion has a data type override to override all columns to nvarchar(max) since we cant trust the data source. The data is then transfered to a to a table in a data area as is.  Next step is with a view for validation and a simple table insert move data to a table with data types we want to work with.This last table is a History table. Not that we use any scd we simply want to update the data and use the scd-columns to be able to know first seen/last seen stuff. Problem/question:Since this last table is a history table, its vital that rows are inserted in the correct order (date order i wrote about in step 1) to not update row

Hi,We are consolidating our ingestion setup from one ingest instance per environment to a single shared ingest instance for both DEV and PRD environments.Current situation:ODX DEV → DSA_DEV → SSL_DEVODX PRD → DSA_PRD → SSL_PRDTarget situation: ↗ DSA_DEV → SSL_DEVODX PRD ↘ DSA_PRD → SSL_PRDThe DEV VM is able to communicate with the PRD VM, where the shared ODX instance is hosted.Could you please advise on the next steps required to implement this change?  

I'm using (legacy) TimeXtender version 20.10.82 with ODX.I messed up something in the .RSD file for a CData REST data source and subsequently fixed my mistake. But still, somehow, this has broken all tables in that data source. Executing the DSA tells me "Table not found in the data source" while the tables are clearly still there.I tried executing the synchonize task in the ODX and even deleted the .parquet files and fully loaded everything again. No luck. After "Synchonize objects" in my TimeXtender project all DSA tables lose their mappings to the ODX tables.TimeXtender probably tries to find the ODX tables but their id's have changed or whatever. Is there a way to fix this without remapping all my DSA tables?I'm 100% certain I've seen this behaviour before but on a smaller scale with less impact.

Hi,i have a gen2 storage account with a blob container with multiple parquet files. when i do a sync with odx it’s succesfull, the transfer gives me for 4 files the message “ is used by another table”. all other files in the same map go ok. have tried to recreate the blob container, and recreate the parquet files again, same results.Exact message:The table folder 'parquet_taak_status' is used by another table with the id 9a510177-a130-4bcc-aaaa-5abefd42c1b9 how to solve / find the other table that is referenced to? thanks!  

In this article you will learn about the Azure Cloud Optimizer package type, how to create one in TimeXtender Data Orchestration and run it.When using cloud resources, such as Azure virtual machines, Azure SQL databases or Fabric Capacities, leaving them idle at high resource usage levels, or running at all, when they are not truly needed can quickly become very expensive. The Azure Cloud Optimizer package type for TimeXtender Data Orchestration allows you to create packages that can switch Azure Virtual Machines on or off, and reboot them should that be required, scale Azure SQL databases up or down, between purchasing models, tiers and the different available capacities or pause, resume or scale Fabric Capacities. These packages can be run before and after other processes, making sure those processes that need powerful virtual machines running that nothing else uses, utilize Fabric Capacities that are not always at the same level of use, or that require databases to process much more

In my TX Connection, i have created a Data Cource. Under that i have an Endpoint. Initially i have called it CASES. I have used it for a few days and now i have changed it to SEN_CASES.However in BU, it still appears as CASES.I have a cuple of senarios like that where i need to change the name. In CData it was easy, yoiu change the name of the RSD-file and the endpoint name chages, but how do i do it here. I dont want to delete the 20 or so endpoints and create then again.

When adding a conditional lookup in table A from table B an index is created in table B.This is expected behaviour when the Index generation setting is set to “Automatic”.However, if the lookup operator is set to “None”, no index is created in table B, eventhough index generation is set to automatic.Additionally, if a lookup is at first created with operator “Max” (or any other) an index is created, but if the operator is later changed to “None” the index is automatically removed. This seems like a bug. Is anyone else able to replicate this?I have tested this on version 7026.1

TimeXtender Exact Online Data SourceAccess and ingest data from Exact Online REST APIs using the TimeXtender Exact Online data source.TimeXtender Exact Online Data Source Authentication Setup Create an APP in Exact Set up the Authorization request to retrieve the code value to use to generate the tokens Use the code value to generate the initial tokens Find the division value Endpoints Query parameters Table flattening Other AuthenticationExact Online REST APIs use OAuth Refresh Token flow for authentication. This requires the user to perform initial steps before it is possible to set up the authentication in TimeXtender Exact Online data source. When you have generated a client ID, client secret, and the initial access token and refresh token, you can fill in the corresponding fields for authentication.NOTE: the initial access token timestamp needs to be converted to UTC time-zone and then to UNIX timestamp seconds.To find these values you need to go through a three-

We want to compare production data after the promote of changes to a saved snapshot of data using TX OD&Q.I can see in your documentation the description of “Saved Comparatives” as below:Saved ComparativeSaved Comparative are used to compare data to a previously saved snapshot of that data. This can be convenient when the source data doesn’t have an audit trail of changes. Examples of Saved Comparative queries are:Monitor changes in access privileges. Monitor customer discount changes. However I can see no way to setup Saved Comparatives or How to build them into a comparative test. Can you please let me know if what I want o achieve is possibel and how I can implement it if it does work please. 

Hello,I have created a .csv endpoint based on a view in my MDW. I’m able to successfully execute the endpoint manually or through the execution package, where the .csv gets created as expected.However, I can’t seem to add the package to a job, and can’t get it to work through Exmon/Orchestration.In Exmon, my StocklistCSV package can be found. However, when I run it in Exmon, it doesn’t do anything and doesn’t show in the execution log. If I add the package in a process, it won’t run and time-out after 10 minutes.Do you have any idea how I can schedule to execution of the CSV endpoint so it creates the file based on a schedule?