Data Validation

There are two desktops on phucsia to be used for Data Validation:

1. This is the Data Monitor Desktop. It is used to monitor the status of DV jobs, data tracking and checking for runs that need to be validated.

For documentation concerning these tasks, go to Running Data Validation.

2. This is the Data Validation Desktop. It is used to validate data, by running the DVGui.

For documentation on how to validate data, go to Validating Data.

• Checklist Instructions

Checking for runs that need to be validated

Look at the "Runs to be validated" window on phucsia.

If there are any runs to validate (red and yellow window) as shown below, follow the instructions on Validating Data.

If there are no runs to validate, you will see the green window instead.

Checking for runs that should be ready to be validated but are not.

Look at the "Runs to be investigated for data tracking problems".

If there are any runs to investigate (red and yellow window as above), do the following:

1. Go to request form, and enter the run number and run type "ALLBEAM".
2. You should see for each sequence in the run, three green boxes and one grey (this means they are waiting to be validated, and the processing is finished)
         If on 90%(or 1 out of <10 sequences) of the sequences you see three green boxes, then mark the other sequences with status "2". To do this goto request change dv form, enter the run number, and chose the change status option. You will be presented with the list of sequences for this run, showing each sequences' dv quality (should all be N/A as not yet validated) and each sequences status (should all be 0). Click on the status value for the specific sequences and change it to "2".
         If most of the sequences have not yet finished processing, then mark the entire run with status "2" on the request form, and send an email to the dv team, stating what you saw and the run number with the problem. (Carla)
         If a number of jobs have not finished, that does not match the above criteria, email the DV team.

else do nothing if the window looks like.

Checking for DV/CS jobs stuck on "constructed" status.

Look at the bottom half of the "CRS Farm Status for Phobos" on phucsia. If you don't see it, follow the instructions included on the Running Data Validation page.

Refresh the window, and the look for jobs with Status = constructed. If there are any, count the number, n, and then submit a Trouble Ticket (following this link) to RCF, saying "We have n jobs stuck on constructed status.". The "problem type" is "Linux Farms".

If you have already submitted a Trouble Ticket during this shift, and n has not increased, you don't need to submit another.