How to Run the Offline Data Validation System
Last Updated on Tuesday, August 19, 2014 at 15:50:38
Table
of Contents
How to Start Offline Data Validation
How to Use Offline Data Validation
How to End Offline Data Validation
How to Login to Online(2) Machine
How to Logout from Offline Machine
Creating Job Submission Window
Creating Transfer histograms to Web
Window
Creating Database Update Window
Creating Browser Control Window
Creating Run Log Window
Transfering Histograms to Web
How to View Histograms using the
Browser
How to View Histograms using the Web
Using CRS Status Window
Frequently Asked Questions
Contacting Offline Group
What is Offline Data Validation?
Its purpose is to allow, fast validation of data quality. To check writen data retrevable from HPSS, readable and processable.
How to Start Offline Data Validation
1) Sit down in front of online(2) machine (labelled "Online Two")
2) Check you are logged in. If not goto section "How to login to online(2) machine".
3) Create Job Submission window. See section "Creating Job Submission Window ".
4) Create Transfer Histos to Web window. See section "Creating Transfer Histos to Web Window"
5) Create Database Update Window. See section "Creating Database Update Window"
6) Create Browser Control Window. See section "Creating Browser Control Window"
7) Create Run Log window. See section "Creating Run Log Window"
How to Use Offline Data Validation
First you must process the data, via following proceedure.
1) Ensure run you want to look at is at HPSS. (i.e. has it been sent from DAQ; check by looking in /data/0...6 areas
on phobosx). If not send it there (See DAQ instructions how to do this).
2) In "Job Submission window"(blue one): cd ~/engrun/submit/mkjf <ENTER>
3) Type: root <ENTER>
4) A root window(fire) should appear and disapper, and in the blue window you should see:
*******************************************************
* WELCOME to ROOT *
* Version .... *
* You are welcome to visit our web site *
********************************************************
CINT/ROOT C/C++ Interpreter Version ....
Type ? for help. Commands must be C++ statement.
Enclose multiple statements between {}.
root[0]
5) If you don't see this, type: .q <ENTER> and start at (3) again until you do.
6) At prompt (root[0]) type: .x submit_data_validation.C(<Run Number>) <ENTER>
7) You should see:
Information about filenames...
CRS_submit.pl PhoHit<Run Number>s000.jf
Job "Phohit<RunNumber>s000.jf" qeued with JOB_ID #######
phobreco@rcf:~/engrun/submit/mkjf >
If however, you see: Error: No symbol cout in current scope:FILE...
Then type: .q <ENTER> and start at (3) again until you do.
8) In addition a window entitled "CRS Farm Status for PHOBOS" should pop up.
This window tells you about the status of the job you just submitted. See Using CRS Status Window.
9) When the job is finished (If hit lower refresh button, and no job with <Run Number> you selected is shown). Exit "CRS Farm Status for PHOBOS" window by hitting the Exit button.
10) To make the resulting histograms web viewable. Goto section "Transfering histograms to web".
11) To view histograms on web, goto section "How to view histograms on Web".
12) To view histograms via browser, goto "How to view the histograms using the browser"
How to End Offline Data Validation
1) Leave windows as is for next data validation process.
How to Login to Online(2) Machine
The username is "shift". The password is the normal PHOBOS password.
1) At the login prompt (phonl2 login:) type: shift <ENTER>
2) Enter the PHOBOS password
3) At the passphrase prompt (Enter passphrase:>) Enter the PHOBOS password again.
4) At the shift prompt ([shift@phonl2 ~]$]) type: startx <ENTER>
5) You should now see a X-windows environment, with a window with the shift prompt ([shift@phonl2 ~]$)in it.
How to Logout from Online(2) Machine
1) Ensure exitted window entitled "CRS Farm Status for PHOBOS".
2) In all windows type: exit <ENTER>
until all windows exited.
3) On background, click left-hand button. Menu will appear, select "Stop: Exit Fvvm", and additionally select "Yes, Really Quit"
4) At prompt [shift@phonl2 ~]$ type: exit <ENTER>
5) You have now logged out.
1) Open an xterm or use an existing window. The following prompt will appear: [shift@phonl2 ~]$
2) Open the Job Submission Window (blue window). At prompt type: subwin <ENTER>
3) A blue window entitled "Job Submission" should appear. In this window connect to rcf (Rhic Computing Facility) by typing at the prompt ([shift@phonl2~]): ssh phobreco@rcf.rhic.bnl.gov <ENTER>
4) You should see a Government Warning (The Surgeon General advises RCF is dangerous to your mental health!) and be left with a prompt: phobreco@rcf:~>
5) At the prompt type: cd engrun/submit/mkjf <ENTER>
6) The prompt should be: phobreco@rcf:~engrun/submit/mkjf>
7) You have now successfully made the window.
Creating Transfer histograms to Web Window
1) Open an xterm or use an existing window(black background+white text). The following prompt will appear: [shift@phonl2 ~]$
2) Create the Transfer histograms to Web window. At prompt type: tranwin <ENTER>
3) At prompt ([shift@phonl2 ~]$) type in red window: ssh phobreco@rsgi05.rhic.bnl.gov <ENTER>
4) At prompt (phobreco@rsgi05: ~>) type: cd engrun/submit/mkjf <ENTER>
5) Iconize this window (it will be down on bar at bottom of the page) and use it when you need to transfer histograms to the web. (To iconize window click left mouse button on left most of 3 boxes at top right of window)
1) Open an xterm or use an existing window(black background+white text). The following prompt will appear: [shift@phonl2 ~]$
2) Create the Database Update window (orange). At prompt type: dbwin <ENTER>
3) At prompt ([shift@phonl2 ~]$) type in orange window: ssh phonl1.chm.bnl.gov <ENTER>
4) At prompt (shift@phonl1.chm.bnl.gov's password:) enter the PHOBOS password.
4) At prompt [shift@phonl1 ~]) type: cd datavalidation <ENTER>
5) Iconize this window (it will be down on bar at bottom of the page) and use it after you have transfered histograms to the web so you can view them on the web. (To iconize window click left mouse button on left most of 3 boxes at top right of window)
Creating Browser Control Window
1) Open an xterm or use an existing window. The following prompt will appear: [shift@phonl2 ~]$
2) Open the Browser Control Window (green window). At prompt type: browsewin <ENTER>
3) A green window entitled "Browser Control Window" should appear. In this window connect to rcf (Rhic Computing Facility)
by typing at the prompt ([shift@phonl2~]): ssh phobreco@rcf.rhic.bnl.gov <ENTER>
4) You should see a Government Warning (The Surgeon General advises RCF is dangerous to your mental health!) and be left with a prompt: phobreco@rcf::~>
5) At prompt (phobreco@rcf~>) type: ssh rlnx03 <ENTER>
6) You should see a Government Warning (The Surgeon General advises RCF is dangerous to your mental health!) and be left with a prompt: phobreco@rlnx03:~>
7) At the prompt type: cd engrun/macros <ENTER>
8) The prompt should be: phobreco@rcf:~/engrun/macros
9) At prompt (phobreco@rcf~engrun/macros) type : source ~/nigel/setphat <ENTER>
10) Iconize the window(it will be down on bar at bottom of page) and use when want to browse histogram.(To iconize window click left mouse button on left most of 3 boxes at top right of window)
1) Open an xterm or use an existing window(black background+white text). The following prompt will appear: [shift@phonl2 ~]$
2) Create the Run Log Window. At prompt type: netwin <ENTER>
3) In the new window, you will see the PHOBOS home page (via netscape). Goto the runlog page.
4) Iconize this window, and use it to find relevant run number information when necessary. (To iconize window click left mouse button on left most of 3 boxes at top right of window)
1) In "Transfer Histos to Web" (red) window at prompt (phobreco@rsgi05:~/engrun/submit/mkjf >) type:
shipgif.pl <Run Number> <ENTER>
2) At the prompt (phobos@nighthawk.chm.bnl.gov's password) type: <PHOBOS password> <ENTER>
3) At the prompt (phobos@nighthawk.chm.bnl.gov's password) type: <PHOBOS password> <ENTER>
4) You should see the postscript files being transfered.
5) At the prompt (phobos@nighthawk.chm.bnl.gov's password) type: <PHOBOS password> <ENTER>
6) When finished you will see prompt: phobreco@rsgi05:
~/engrun/submit/mkjf>
Now you need to inform the database that this run should be added to the list of runs to
be viewed.
7) In "Database Update" (orange) window at prompt ([shift@phonl1 ~/datavalidation]$) type:
phat "db_valid.C(<RunNumber>)" <ENTER>
8) You should see
**********************************************************************************
Data Base now knows that run number, <Run Number>, has been inspected by data
validation proceedure.
Now you should be able to view data validation histograms on Web!
***********************************************************************************
NULL
If you don't following instruction given.
9) At prompt (root[0]:) type: .q
10) Iconize this window (it will be down on bar at bottom of the page) for future use. (To iconize window click left mouse button on left most of 3 boxes at top right of window)
1) Goto Runlog Web Page (http://www.bnl.gov/phobos/Detectors/ASP/DAQ/run_logbook.asp). There should be a blue icon
in the "Details" column. Click on it, then chose the histograms you want to see.
How to View Histograms using the Browser
1) In the Browser Control Window (green) at prompt type: cd ~/engrun/macros
2) At prompt (phobreco@rnlx03~engrun/macros) type: phat <ENTER>
3) At prompt (root[0]) type: .x browse.C(<Run Number>) <ENTER>
4) A browser will appear, and now you can view the histograms.
5) To exit, use menu.
This window informs you about the status of your submitted job on the reconstruction farm.
It is divided into two sections. The top section informs you about the number of nodes available and the number of jobs running on each node. The bottom section tells you information about the submitted jobs (this more relevant for you). These windows do not automatically refresh, hence to see the latest information , please hit the "Refresh Button" (once for each section). The bottom window is sectioned :
SubjobID : Specfic job identication (typically ~ job_########_0)
Status : Tells you status of your
submitted job.
Typical
sequence: constructing->queued->transfering in->executing->transfering
out->cleaning node
(Rough
meaning: Constructing ~ Putting your job together on local machine(i.e.
getting relevant files etc organised)
:
Transfering In ~Shipping the files and executable to the node(processor) on the farm
:
Executing ~ Running the job/macro
:
Transfering Out ~ Job finished, moving all files back out of farm to accessible locations
:
Cleaning Node ~ Reset state of node(processor) so ready for next job)
Node : Tells you what processor you are running this job on (typical rcrs####)
JobFile : Tells you what job file you submitted. This has the run number in it, so you can see which is your job.(typical ~PhoHit<Run Number>s000.jf)
When your job is finished, the job with your run number will no longer appear on the bottom window. Then you can transfer histograms to web.
The current onsite coordinator for online monitoring can now be beeped. Our beeper number is 7605. To reach us:
1) Dial x3456 and wait for the beep
2) Dial x7605 and wait for the beep
3) Dial in your number
For leaving suggestions, send email to the online group by doing the following:
Write comments in suggestions book beside "Online Two" computer.
Authors of Documentation:
Nigel George