Skip to main content
Tutorial

Storage Cleanup Tool

  • March 24, 2023
  • 0 replies
  • 2363 views

Forum|alt.badge.img+3

To prevent accidental data loss, deleting a table in TimeXtender Data Integration does not delete the physical table in the Prepare instance storage. The downside is that tables deleted in TimeXtender Data Integration still take up space in the Prepare instance storage.

The Storage Cleanup Tool enables you to identify objects left behind by TimeXtender Data Integration and delete - drop - them to free up space.

Warning: When you drop an object with the Storage Cleanup Tool, it is permanently deleted. Use caution when running this tool.

The tool supports two types of Prepare storage:

  • SQL Database - identifies and drops unused tables, views, procedures, and functions from your SQL database.
  • Fabric Lakehouse - identifies and drops unused tables (both the delta parquet data and the associated notebook) from your Lakehouse storage.

SQL Database

Note that database schemas are not deleted from the database. You will need to drop those manually in SQL Server after deleting them in TimeXtender Data Integration.

To clean up a SQL-based Prepare instance data area:

  1. Right-click a Data Area, click Advanced, and click Storage Cleanup Tool.
  2. TimeXtender Data Integration reads the objects from the database and opens the Storage Cleanup Tool window.
  3. The window lists objects in the database that are no longer - or never were - part of the currently opened instance.
  4. (Optional) Right-click a table, view, procedure, or function and click Script to display the SQL script behind the object.
  5. Right-click a table, view, procedure, or function and click Drop to drop the object from the database.
    • If the item has no subordinate items, click Yes when asked to confirm.
    • If the item has subordinate items, a window opens with a list of objects that will be dropped. Clear the selection for any items you want to keep, then click Drop.

    Note: TimeXtender Data Integration automatically clears the selection for any incrementally loaded tables to prevent accidental data loss. You will be asked to confirm if you want to drop an incrementally loaded table.

  6. When you have dropped all the objects you want to remove, close the window.

Fabric Lakehouse

To clean up a Fabric Lakehouse Prepare instance data area:

  1. Right-click a Data Area, click Advanced, and click Storage Cleanup Tool.
  2. TimeXtender Data Integration scans the Lakehouse and opens the Storage Cleanup Tool window. Review the identified objects, which are organized into the following categories:
    • Deleted tables - Tables that have been deleted from the data warehouse. Each entry is grouped with its corresponding notebook and any associated system tables, so you can see all related objects at a glance before deciding to drop them.
    • Independent objects - Tables found in the Lakehouse that do not have a notebook associated with them. These may be TimeXtender objects whose notebook was removed separately.
    • Orphan tables - Tables found in the Lakehouse that were not created by TimeXtender. These are listed for visibility, but exercise caution - they may belong to other workloads.
    • Orphan notebooks - TimeXtender notebooks that belong to the Lakehouse but do not match any existing table. These are safe candidates for removal if you are certain they are no longer needed.
  3. (Optional) Click an object to view its table definition or the notebook script contents. This is for reference only and does not represent the live scripts used to create the objects.
  4. Drop objects in either of the following ways:
    • Drop individual objects - right-click a specific object and click Drop.
    • Drop by group - right-click a group (e.g., a deleted table with all its associated objects) and click Drop to remove the entire group at once.
    Confirm when prompted.
  5. When you have dropped all the objects you want to remove, close the window.