Spider: Installation

Spider is a complete application, built on top of the Keel Meta-Framework which is in turn built on top of Avalon. Familiarity with either of these IOC frameworks should make installing & configuring Spider much easier, but if you haven't had the opportunity to work with either, this step by step should put you on the right path.

Download

Download the source distribution with runtime environment here: Spider 0.1.0 distribution. Unzip this archive into the directory where you would like Spider installed.

Setup Environment

Create an environment variable SPIDER_HOME pointing to your chosen installation directory (ex: SPIDER_HOME=/home/jdoe/tse-spider ). Alternatively, hardcode this variable value in the startup script in (./bin/spider.sh or ./bin/spider.bat). Refer to the scripts themselves for more details.

Build

From SPIDER_HOME, execute two maven tasks:

• maven copy-dependencies - copies runtime libraries into SPIDER_HOME/lib
• maven jar - builds Spider source and places jar into SPIDER_HOME/lib

Spider's dependencies are detailed in the maven project descriptor (project.xml). If maven is unable to download any of the required dependencies, you will need to obtain them manually. This is sometimes the case for libraries that can not be freely redistributed, and are not included in your JDK. Manually installed jars should be placed in the maven repository, and SPIDER_HOME/lib.

Install JMS Support (Optional)

If you would like to use Spider in Daemon/Client mode, you need to install JMS support. Daemon/Client mode will allow a single instance of Spider to run as a Daemon (Server) communicating with multiple clients via JMS. This is ideal for integration with other systems like Nagios where we want to repeatedly query Spider without incurring the overhead of a full system startup.

Download openjms-0.7.5.zip and unzip it in the SPIDER_HOME/jms directory.

Configure JDBC Support (Optional)

By default, Spider uses the HSQL Database Engine, which will allow it to persist data locally (for its own use) in the ./db directory. If you would like to leverage another JDBC enabled RDMBS, you need to modify the ./config/jdbc-system.xconf file with the appropriate JDBC properties.

Configure Spider Tasks

You next need to define the tasks you would like Spider to perform in the ./config/tasks.xml file. Spider's flexible nature makes the tasks.xsd almost meaningless...tasks.xml does not validate against it. The best way to define your own tasks is to use the examples or take a look at the RuleSets used within your installation.

As a side, the tasks.xml file is actively monitored by the Avalon/Excalibur monitor service, and any changes to it will be actively parsed/digested by Spider.

Launch Application

• View Spider's runtime options by executing: ./bin/spider.sh -?
• Optionally launch Spider's JMS server (for JMS Daemon/Client mode) with: ./bin/startjms.sh
• Launch Spider with your chosen options!