Skip to main content
SUBMITTED

Add Ingest instance storage clean up tool

Related products:TimeXtender Data Integration
  • January 24, 2024
  • 2 replies
  • 73 views

Forum|alt.badge.img+2

Please consider adding the feature to remove tables from Ingest instance storage that have been deleted in the desktop, similar to how the “SQL Database cleanup tool” works for the DW.

Let’s take the use case of when SQL Storage is used for the Ingest instance.

The “Remove unused object” option does not drop tables.

The “Storage Management Task” is good of course, but we can’t use it for deleted data sources.

Let’s say I have transferred a large table hundreds of times into my Ingest instance and then deleted the data source. Currently I can’t drop them from TimeXtender Data Integration and the workaround is that I drop the tables manually in SSMS.

The feature could work in similar ways for other Ingest instance storages. For example with ADLS Gen2 the feature could delete the files from storage etc.

Best,

Pontus Berglund 

2 replies

Thomas Lind
Community Manager
Forum|alt.badge.img+5
  • Community Manager
  • January 24, 2024

Hi @pontus.berglund 

It could also help with tables that have gone from the source and returned on a later date.

This will make it give a warning when you do the transfer.


Forum|alt.badge.img+2

One thing to add to this. At least when using SQL Server storage for the Ingest instance, the short name of the data source is added as a prefix the schemas created. If a data source is created and then deleted, and then a new data source is created with the same short name, an error occurs because the schema is already “claimed”. A clean up tool that cleans up the schemas would be great to have as well.

I don’t know how this plays out with an ADLS Gen2 Ingest instance. If anyone knows, please let me know.