Click here to Login




How to debug a downloader

Updated on 2012-05-12





This article will show how to debug and update a download item. For information about how to create a download item from scratch, you can read the QuantShare documentation file.

Steps:

- Select "Download" then "Download Manager"
- Select the download item you would like to debug then click on "Update" (top menu)

The "Download Steps" displays the different steps that should be performed to get data.

Columns:

- URL: You can see there the URL used to retrieve data. URLs can be generated dynamically by clicking on "Settings" then "Create a URL-Script". More info here: Download Trading Data using the URL-Script
- Fields: Defines the URL parameters that will be updated dynamically (Example: symbol, date...)
- Content Type: The type of the content returned by the URL
- Parser: Settings that define how to parse the content returned by the URL




- To debug the download item, simply click on "Parser". The default URL will be used to get sample data.
- In the next form, you can see the URL used by the parser. You can copy it and paste it in your browser to see the actual content.

Note however that sometimes, pasting the URL in the browser does not return the expected result. This is because, in some cases, the download item defines some other fields (such as headers, which can be updated in "Settings -> Request Headers") that are sent along with the URL to get the appropriate data.

- Click on "Next" to see the parser settings. There you can see the different columns, the separator, the data format...
- Click on "Next" again to see how the first parsing process is accomplished
- Click on "Next" to complete the parsing process
- Click on "Show Output" to see what kind of data will be added to your database (Quotes, Tick, Intraday or Custom database) if you run the downloader.








no comments (Log in)

Back







QuantShare
Product
QuantShare
Features
Create an account
Affiliate Program
Support
Contact Us
Trading Forum
How-to Lessons
Manual
Company
About Us
Privacy
Terms of Use

Copyright © 2012 QuantShare.com
Social Media
Follow us on Facebook
Twitter Follow us on Twitter
Google+
Follow us on Google+
RSS Trading Items