Data mining

The step-by-step procedures

The step by step procedure to get Reconstructed Data Objects from the new Managed Data Server is:
1. Log in as user bramreco on rmds03.rhic.bnl.gov.
2. Change to the script directory mdc1/scripts.
3. Create (or edit) a job specification file (see unsink_rdo.in) that describes the files you want to transfer. The job specification file has the same format as for data sinking.
4. Run the unsink_rdo.pl script.
The step by step procedure for running the data mining program is:
1. Log in as yourself on rcas17.s30.bnl.local.
2. Run the mine_all.pl script in /brahms/u/alv/brat_apps.
The simple data mining program Bminor.cxx in /brahms/u/alv/brat_apps keeps the events with reconstructed tracks.
The Reconstructed Data Object files are read from the /disk0/brahms/rdo directory.
The Physics Data Set files are written to the /disk0/brahms/phds directory.
The step by step procedure for sinking Physics Data Sets into the new MDS is:
1. not ready :-(.

The RDO unsinking script

The RDO unsinking script is invoked like this:

   unsink_rdo.pl [switches] [--]  file

where the switches and arguments are:

    -d       detailed output for debugging
    -p       toggle PFTP for transfer (default is ON)
    -t       toggle throttled transfer (default is ON at 1MB/s)
    file     name of job specification file

A poor man's throttle has been implemented to avoid filling the disk cache on the new Managed Data Server. The script transfers a file unthrottled by (P)FTP and then sleeps until the average rate is reached.

The files are transferred by the scripts dst_get.pl or dst_get_pftp.pl written by Tom Throwe.

Alv Kjetil Holme

Created 30 September 1998