Click here to Login

Trading Software Trading objects Features How-to Blog Search


                                                   Importing large csv

  0

0
tdtran
2010-06-07 08:33:32


Hi,

I have tried to import a large csv file (230 mb). This seems to freeze my computer. I believe the import process use too much ram (~ 1GB?).

The solution I found was to split the big file into smaller chunks, which works fine, except that I have to import each one manually.

Is there a way to import multiple individual files automatically, or via script?
*Note that adding all the files to the 'import list' will cause the same freezing issue as having one big file. *

cheers.



QuantShare
2010-06-08 13:59:53

  0

Best Answer
Hi,

We have made a change in the code and you should be able to import a 200mb file now.
The change will be available in the next release



tdtran
2010-06-09 05:49:41

  0

Cool!

The same problem also occurs with a large number of small files. Will the change also fix this?

cheers.



QuantShare
2010-06-09 06:53:47

  0

Yes, it will


No more messages
0




Reply:

No html code. URLs turn into links automatically.

Type in the trading objects you want to include: - Add Objects
To add a trading object in your message, type in the object name, select it and then click on "Add Objects"










QuantShare

Trading Items
Large price and volume gain after consolidation
Ratio of Small Cap to Large Cap Stocks
MICEX Index - Market Data
Kaufman's Efficiency Ratio (Fractal Efficiency)
Wilshire Indices - Wilshire 5000 Index

How-to Lessons
How to export trading data to a CSV file
How to import trading data from CSV files
How to quickly select stocks based on the last value of a databas...
How to import trades into a portfolio
How to create a composite index/indicator

Related Forum Threads
Export to CSV the whole database including symbols
update a new symbol from a csv file
Importing portfolio from a comma delimted file
Multi thread and large memory
Importing data

Blog Posts
10 ways to download historical stock quotes data for free
Trading Forex with the commitments of traders report
6 techniques to improve the performance of your stock trading str...
Trading System: Buy stocks with the highest Sharpe ratio
How to Create a List of Ticker Symbols









QuantShare
Product
QuantShare
Features
Create an account
Affiliate Program
Support
Contact Us
Trading Forum
How-to Lessons
Manual
Company
About Us
Privacy
Terms of Use

Copyright © 2012 QuantShare.com
Social Media
Follow us on Facebook
Twitter Follow us on Twitter
Google+
Follow us on Google+
RSS Trading Items