Hi all,
I am currently working with a client who is using TimeXtender version 6766.1 in an Azure environment. We are trying to ingest data from a source that generates JSON files stored in a hierarchical folder structure organized by date and hour. The folder structure is as follows:
subject/version/date=YYYY-MM-DD/hr=HH/*.json
- Example Path:
dev/Call/1.2/date=2024-10-30/hr=14/*.json
Within each hr=HH
(hour) folder, there may be one or more JSON files. Similarly, each date=YYYY-MM-DD
(date) folder may contain multiple hour subfolders, though it's rare for all 24 hour subfolders to be present.
I have successfully configured the data source connector in TimeXtender to read all JSON files from a specific hour folder, as shown in the example above. However, our goal is to configure TimeXtender to ingest all JSON files across all date and hour subfolders under the main path:
dev/Call/1.2/
When I attempt to use wildcards to achieve this—such as:
dev/Call/1.2/*/*/*.json
I encounter an error stating:
Error 404: Path not found
My questions are:
- Is it possible to configure TimeXtender to recursively ingest JSON files from all subfolders using wildcards or via another method?
- If so, could you please provide guidance on how to set up the data source connector to accomplish this?
- If this functionality is not supported, would you recommend implementing an Azure Function or another solution to consolidate all JSON files into a single folder for TimeXtender to access?
Your assistance in resolving this issue would be greatly appreciated.
Thanks in advance for your support.
Best regards,
Rob van den Brink