Skip to main content
To homepage To homepage
Solved

Cdata adapter - CSV File 10(GB)

R
Starter

We are trying to get a csv file of 10 gb into TimeXtender but it takes very long for TimeXtender to get this loaded and sometimes we are getting an error (system out of memory). Is there a solution or something else we can try to get big csv files into TimeXtener or can we change the CSV file to get it loaded into TimeXtender? We are now using the Cdata adapter and already used the multiple/single file adapter.

 

Thanks for the response!

Best answer by JTreadwell

You may also want to try this: 

https://legacysupport.timextender.com/hc/en-us/articles/360022596691-How-to-configure-segmented-table-executions-Chunking-

View original
    Did this topic help you find an answer to your question?

    3 replies

    JTreadwell
    Employee
    Forum|alt.badge.img+5
    • JTreadwell
    • Employee
    • 179 replies
    • July 16, 2020

    Hi Rob... A few things to try. 

    1. Make sure SQL Server db is set to Simple Recovery Mode
    2. Decrease the batch Size on the Staging Db
       

       
    3. Also you can set Batch Data Cleansing in Table Settings.
       

       

    -Joseph Treadwell
    R
    Starter
    • r.brummans
    • Author
    • Starter
    • 2 replies
    • July 16, 2020

    Tried all options but unfortunately no solution.... thanks for the quick response!

    JTreadwell
    Employee
    Forum|alt.badge.img+5
    • JTreadwell
    • Employee
    • 179 replies
    • Answer
    • July 17, 2020

    You may also want to try this: 

    https://legacysupport.timextender.com/hc/en-us/articles/360022596691-How-to-configure-segmented-table-executions-Chunking-

    -Joseph Treadwell

    Reply


    Most helpful members this week

    Terms and ConditionsCookie settings

    Cookie policy

    We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

     
    Cookie settings