TimeXtender Rest data source with CSV response

Hi,

if you are on the TDI release and have an updated TimeXtender REST connector you can specify the Data Format, one of the options there is CSV. See the documentation at the Data Format heading: 

• TimeXtender REST data source Tutorial

Hi ​@rory.smith. Thank you! However, I can’t get this setting to work. When I execute the “import metadata” I get “completed successfully” but no source tables. When I cache to path I get the same XML file as above.

Hi,

I guess the option is meant for the format of the entire response- in your case it has CSV inside JSON. I guess that would require some XLST or similar.

Hi ​@rory.smith. I don’t think I have a CSV inside a JSON. This is my output in postman. 

<?xml version="1.0" encoding="UTF-8"?> <Name_of_table>     <value> "name_of_column1","name_of_column2","name_of_column3","000: name_of_column4," "G name,with comma","2000M01","Volumindeks, kalenderjustert",. "G name,with comma","2000M02","Volumindeks, kalenderjustert",. "G name,with comma","2000M04","Volumindeks, kalenderjustert",3.2 "G name,with comma","2000M05","Volumindeks, kalenderjustert",50.2... </value> </Name_of_table>

Your initial post indicates otherwise. I think Postman unwraps the JSON automatically, if you look at the real packets coming back (Console in Postman), you will likely see the CSV data is enclosed in a JSON structure.

Hmm, I am pretty sure the output is on CSV format (I checked the console in postman). this is what TimeXtender give me when I don’t chooce the data format.

<?xml version="1.0" encoding="UTF-8"?>
<Name_of_table>
    <value> "name_of_column1","name_of_column2","name_of_column3","000: name_of_column4," "G name,with comma","2000M01","Volumindeks, kalenderjustert",. "G name,with comma","2000M02","Volumindeks, kalenderjustert",. "G name,with comma","2000M04","Volumindeks, kalenderjustert",3.2 "G name,with comma","2000M05","Volumindeks, kalenderjustert",50.2...  </value>
</Name_of_table>

It is an open source API: 

https://data.ssb.no/api/v0/no/table/07129

body: {"query":[{"code":"ContentsCode","selection":{"filter":"item","values":["VolumInVirkedag"]}}],"response":{"format":"csv2"}} 

Thank you, ​@Thomas Lind. Everything is working perfectly now.

For anyone facing similar issues, we resolved it by upgrading TimeXtender to ensure compatibility with the new version of the REST provider (9.0.0.0), which allows specifying the data format (CSV).

However, I don’t think this will be a further issue in TimeXtender Data Integration 6926.1 due to this improvement? ​@Thomas Lind 

When you upgrade to the new release, the Ingest service and data sources must be upgraded at the same time (i.e. you cannot upgrade the ingest service without upgrading data sources or vice versa).