Importing large csv - Trading Software

Importing large csv

Trading Software
2010-06-07 08:33:32

Hi,

I have tried to import a large csv file (230 mb). This seems to freeze my computer. I believe the import process use too much ram (~ 1GB?).

The solution I found was to split the big file into smaller chunks, which works fine, except that I have to import each one manually.

Is there a way to import multiple individual files automatically, or via script?
*Note that adding all the files to the 'import list' will cause the same freezing issue as having one big file. *

cheers.

QuantShare
2010-06-08 13:59:53

Best Answer

Hi,

We have made a change in the code and you should be able to import a 200mb file now.
The change will be available in the next release

Trading Software
2010-06-09 05:49:41

Cool!

The same problem also occurs with a large number of small files. Will the change also fix this?

cheers.

QuantShare
2010-06-09 06:53:47

Yes, it will

Get more messages

No more messages

Back


Trading Items Large Block Ratio Indicator Portfolio Statistics to CSV File Large price and volume gain after consolidation Ratio of Small Cap to Large Cap Stocks MICEX Index - Market Data	How-to Lessons How to import trading data from CSV files How to export trading data to a CSV file How to quickly select stocks based on the last value of a databas... How to import trades into a portfolio How to plot the relative performance of several stocks/indices
Related Forum Threads Custom Date Format When Importing Data from CSV How to import Bid, Ask and Trade ticks from CSV file? importing sectors and industries update a new symbol from a csv file Column Headers on Scanner CSV Export	Blog Posts Transaction Costs Export Trading Orders from a Portfolio to a File Create Profitable Trading Strategies with Exchange Traded Funds (... German Stock Exchanges: 5 free ways to download historical EOD/In... 6 ways to download free intraday and tick data for the U.S. stock...