Data | Data Tool

Modified on 2020/03/28 09:44 by Eugene — Categorized as: Knowledge Base, Misc, Providers

What it is

This tool integrates with Data Manager, allowing to perform certain operations on entire DataSets which would otherwise take certain effort:


Compatibility

Supported are static data providers that rely on Wealth-Lab to maintain their data in the local storage of .WL files. Only their DataSets will appear in the DataSets tree on the left and allow themselves to be processed.


Quotes pane

Image

From this handy list you can take a quick peek at the market dynamics of the selected DataSet. The pane displays a table with the DateTime + OHLCV data for all symbols of the highlighted DataSet. For convenience, the table includes absolute and percentage change from the previous bar for each instrument as well as if the symbol has hit a 52-week high/low today. The data is displayed with respect to the number of default decimal places specified in Wealth-Lab's Preferences dialog.

By default, the table is sorted in descending order on the Bars.Count column to instantly show symbols with zero bars. It's possible to sort it in either ascending or descending order by repeatedly clicking on any column.

Below the Quotes pane, there are four tabs which group the actions you can perform on DataSets using the Data Tool:


Datasource Truncation

Image

The following data truncation options apply to all symbols of highlighted DataSet:


Dead symbol removal

Image

To clear highlighted DataSet from dead (inactive) symbols with 0 (zero) bars, click "Remove inactive". To additionally remove any symbols that stopped trading before some date, pick a date and enable the checkbox before clicking on "Remove inactive".

Image

Note: Before making changes, close all Strategy windows using the DataSet you're removing inactive symbols from.

Data validity checker

Image

To quickly verify a DataSet's integrity, click "Check data integrity" from the "Data checker" tab. The following errors are detected in historical data:


Synthetic bars are inserted by some data vendors for days on which no trades took place (e.g. stock halt). The Data Tool can detect the following types of these bars:
  1. OHLC are all the same as the previous Close and the Volume is 0
  2. OHLC are the same as the previous bar's OHLC and the Volume is 0

Due to the fact that some conditions like weekend bars are perfectly correct in some international markets, some options can be turned on or off.

Clean bad data

Image

As bad bars may produce inaccurate backtesting results, the Data Tool can perform various data cleanup tasks like:


The "Clean data" button makes possible to clean up for symbols of the selected DataSet. If symbols are selected, the button changes to "Clean selected" and acts accordingly. (To apply to all DataSet symbols, click outside or change DataSet.)



Right click menu

Context menu features

Context menu features


The right click menu serves two purposes:


Limitations