Chapter 4: Loading TAQ Data

Setting the environment variables

Setting up the RAP environment

set_rap_env_pl.sh sets environment variables for the shell. You must edit the placeholders in this file with the correct path information, then run this script to set the environmental variables.

Variable name	Description
RAP_HOME	Base directory for RAP. All other paths should be relative to this directory.
RAP_DATA	Input directory for loading files into ASE. Monitored by the loading process.
RAP_STAT	Used for placing tickler file to stop the load process.
RAP_IN	General input directory. Files are linked to the $RAP_DATA, $IQ_DIR, and $RAP_ARCH directories for loading. Monitored by loading process.
RAP_ARCH	Archive directory. The loading process compares files between this directory and the $RAP_IN directory to determine whether to link files to other input directories for loading.
IQ_DIR	Input directory for loading files into IQ. Monitored by loading process.
LOAD_IQ_SCRIPT_DIR	Directory where sql scripts used by the dbisql utility during IQ loading are stored.
TICKLER_FILE	Name of the tickler file that stops the loading script.
MAX_PTN_QUOTE	Maximum number of partitions for the STOCK_QUOTE table.
MAX_PTN_TRADE	Maximum number of partitions for the STOCK_TRADE table.
ASE_SERVER	Name of the ASE server.
ASE_INTERFACE	Path to the ASE interfaces file.
ASE_UID	The ASE user ID.
ASE_PWD	The ASE user password.
ASE_DB_QUOTE	ASE database name for storing STOCK_QUOTE table data.
ASE_DB_TRADE	ASE database name for storing STOCK_TRADE table data.
IQ_ENGINE	Name of the IQ server.
IQ_UID	The IQ user ID.
IQ_PWD	The IQ user password.
IQ_DB_QUOTE	IQ database name for storing STOCK_QUOTE table data.
IQ_DB_TRADE	IQ database name for storing STOCK_TRADE table data (should be the same as IQ_DB_QUOTE.)

Setting up the utilities environment

Before starting the load process, you must set up the environment for the bcp and dbisql utilities, if you have not already done so.

To set up the environment for the bcp utility used by ASE, run the SYBASE.sh script, which is located in the ASE installation directory.

To set up the environment for the dbisql utility used by IQ, run the ASIQ-12_6.sh script, which is located in the directory /ASIQ-12_6 in the IQ installation directory.

View this book as PDF