Skip to main content
Question

Invalid column count Excel sheet on storage account


  • Starter
  • 4 replies

Suddenly all the excel sheets are not loading anymore however some of them no one touched 6 months ago.

the error is:

Executing table excel_sheet:
failed with error:
Exception Type: System.Exception
Message: Invalid column count
             Stack Trace: at DataStorageEngine.DataLakeGen2.DataLakeGen2Transfer.<>c__DisplayClass41_5.<UploadData>b__14(DataTable dataTable, Partition partition)
                          at DataStorageEngine.DataLakeGen2.DataLakeGen2Transfer.UploadData(ADLSGen2APIManager api, DataSourceModel dataSourceModel, DataLakeGen2ExecutionMethod executionMethod, Action`2 writeExecutionLog)
                          at DataStorageEngine.DataLakeGen2.DataLakeGen2StorageEngine.<>c__DisplayClass35_2.<TransferDataAsync>b__7(DataLakeGen2ExecutionMethod executionMethod)
                          at DataSourceEngine.Custom.CustomSourceEngine.InvokeDataSourceExecution(Action`1 action)
                          at DataSourceEngine.Custom.CustomSourceEngine.RunExecution[M](DataExecutionDestination dataExecutionMethod, Action`1 action)
                          at DataStorageEngine.DataLakeGen2.DataLakeGen2StorageEngine.<>c__DisplayClass35_2.<TransferDataAsync>b__5(Action`2 waitUntil)

8 replies

Thomas Lind
Community Manager
Forum|alt.badge.img+5
  • Community Manager
  • 1059 replies
  • April 28, 2025

Hi ​@Amr 

What version are you on?

Both the data source version and TDI.

Can you run the import metadata task and see what the result is.


  • Author
  • Starter
  • 4 replies
  • April 28, 2025

Hi ​@Thomas Lind ,

I have TimeXtender Data Integration version 6935.1
I already ran import and it completed successfully.
Also, In the Metadata manager, I can see the tables and the columns that I'm expecting


Thomas Lind
Community Manager
Forum|alt.badge.img+5
  • Community Manager
  • 1059 replies
  • April 28, 2025

Hi ​@Amr 

Is your Excel data source version 9.1.0.0


  • Author
  • Starter
  • 4 replies
  • April 28, 2025

Hi ​@Thomas Lind ,

I don't know what is 9.1.0.0
but what I can see is

ProviderName 

Provider Version

TimeXtender Excel Data Source

23.2.0.0


Thomas Lind
Community Manager
Forum|alt.badge.img+5
  • Community Manager
  • 1059 replies
  • April 28, 2025

Yes, that is the one I forgot the numbering isn’t the same across all data sources. You upgraded to this version from an earlier one and afterwards you ran the import metadata task to see that it got a new field called _ResourceURI?

 


  • Author
  • Starter
  • 4 replies
  • April 28, 2025

Exactly this is what I can see:
 

 


  • Author
  • Starter
  • 4 replies
  • April 29, 2025

Hi,
This is causing a serious problem to our production if you can support ASAP.
 


Thomas Lind
Community Manager
Forum|alt.badge.img+5
  • Community Manager
  • 1059 replies
  • April 29, 2025

Hi ​@Amr 

If you experience errors, we generally suggest that you add the issue here

https://legacysupport.timextender.com/hc/en-us/requests/new

Or send an email to support@timextender.com. In these locations we have easier ways to involve the developers and are able to assign a priority level.

Besides that I did create an internal case for this issue and the developers have been working on it since that.

The issue was found to be a bug and will be fixed very soon.

In the mean time I got this suggestion from the developer.

The person is using a data lake. So to fix the issue and not wait for a new data source fix, he can synchronize the data source and make sure to select all columns. There is a bug where if you don’t select all columns, you will get invalid column count. 

In the image you sent you seem to have selected all columns and I suppose you ran the Synchronize Metadata a few times and saw no more additions.

You likely need to synchronize the Ingest service from the Prepare instance and then select the _ResourceURI field in there to avoid the error.


Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings