hi there
I need a little advise form you guys ..
In the near future I need a new datasource but I’m not quite sure what the best approach is ..
I’m going to have 600 inidivudal xml files which all contains different product data .. these will be updated daily or at minmum weekly.
What would be the smartest way to import all these files into 1 table ?
Should I make a parser or should I do something else ?
Solved
Importing new data .. what to do ?
Best answer by Thomas Lind
The values of fields can be different, it is just the names of the tags or whatever it is called that needs to be the same.
In any case I would first just try to connect to just the folder and see what happens. If it gives errors due to them being too different you can limit it by adding parts of names.
You can also use RSD files if you want to connect to many different kinds of files in the same data source.
+5Is the files set up with the same “fields” and data types or are all different?
XML files will automatically be merged together if they all have the same setup but are stored in the same folder. If not you will have to add asterisks in the URI to limit the amount of files.
For example this URI
abfss://sharedfiles/XML/4th/*2014-GL33_Exp.XML
Will give only the one file from here.
But if I changed it to abfss://sharedfiles/XML/4th/ it would be both files as they do share the same setup but contain data from different periods.
Thomas Lind wrote:
Is the files set up with the same “fields” and data types or are all different?
XML files will automatically be merged together if they all have the same setup but are stored in the same folder. If not you will have to add asterisks in the URI to limit the amount of files.
For example this URI
abfss://sharedfiles/XML/4th/*2014-GL33_Exp.XML
Will give only the one file from here.
But if I changed it to abfss://sharedfiles/XML/4th/ it would be both files as they do share the same setup but contain data from different periods.
Hi Thomas
I’m pretty sure that the individual files/product lines can contain different values .. and there aren’t null values for those parameters that doesn’t have any values ..
+5The values of fields can be different, it is just the names of the tags or whatever it is called that needs to be the same.
In any case I would first just try to connect to just the folder and see what happens. If it gives errors due to them being too different you can limit it by adding parts of names.
You can also use RSD files if you want to connect to many different kinds of files in the same data source.
Thomas Lind wrote:
The values of fields can be different, it is just the names of the tags or whatever it is called that needs to be the same.
In any case I would first just try to connect to just the folder and see what happens. If it gives errors due to them being too different you can limit it by adding parts of names.
You can also use RSD files if you want to connect to many different kinds of files in the same data source.
aaah, now I think I understand .. I will look into it .. thanks in advance ..
+5If you do have a solution that works for you, please share it here so others with similar issues can see how you did it.
Reply
Rich Text Editor, editor1
Editor toolbars
Press ALT 0 for help
Most helpful members this week
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.
