Hi Selemon there is in fact a script that can remove duplicate files, ie. remove all but the latest file. This (these) scriots were written precisely because it was cumbersome to delete individual files with different versions. The are in two versions and should be done with care CheckDuplicateData.rb -d <type> -p <p> -b <firstrun> -e <lastrun> will give you a list of duplicate files. The you can run CheckAndCreateScript.rb <same arguments> which create a list of remove command that will delete the previous files. These can be copied and pasted to be executed, and put into a scripts that can be run. I udated the documentation that is in BRAT see brat/doc/filecatalog Dataproduction.tex. Hoep this helps. ---------------------------------------------------------------- Flemming Videbaek Physics Department Brookhaven National Laboratory e-mail: videbaek@bnl.gov phone: 631-344-4106 ----- Original Message ----- From: "Bekele, Selemon" <bekeleku@ku.edu> To: "flemming videbaek" <videbaek@bnl.gov> Sent: Monday, August 15, 2005 1:35 PM Subject: RE: [Brahms-dev-l] Making gtr files Hi Flemming, I looked into analysis note 52 and tried to delete some files. It works but the note has to be updated to ( # stands for the appropriate number) bramreco@rcasXXXX:~> rmdata.rb --beginRunNo # --productionNo=# --dataType gtr --versionNo # instead of bramreco@rcasXXX:~> rmdata.rb --beginRunNo # --inputProductionNo=# --dataType gtr --versionNumber # Is there any way one can access the latest version number of a given run in a perl script? My database experience is meagre but it would be nice if I could read the latest version number of a run from the database and use some kind of loop to delete old versions except the latest. Looking at version numbers on the web is fine but it is time consuming when a lot of runs are involved. Thanks, -----Original Message----- From: flemming videbaek [mailto:videbaek@rcf.rhic.bnl.gov] Sent: Sat 8/13/2005 5:08 AM To: Bekele, Selemon; brahms-dev-l@lists.bnl.gov Subject: Re: [Brahms-dev-l] Making gtr files Hi Selemon, Actually the rmdata.rb script will fix the database and remove histograms etc.. If you are in doubt how to use this, please take a look in the analysis note 52 and 53 that describes the organization. It seems reasonable up to date. flemming ---------------------------------------------------------------- Flemming Videbaek Physics Department Brookhaven National Laboratory e-mail: videbaek@bnl.gov phone: 631-344-4106 ----- Original Message ----- From: "Hironori Ito" <hito@rcf.rhic.bnl.gov> To: "Bekele, Selemon" <bekeleku@ku.edu>; <brahms-dev-l@lists.bnl.gov> Sent: Friday, August 12, 2005 5:15 PM Subject: Re: [Brahms-dev-l] Making gtr files > Hello. To remove your files, you must use rmdata.rb program (in > bramreco) to remove files from our data disks and to change our database > entries. Since you already remove files manually, the database must be > fixed. I will fix the database when I get back (There is a script to > fix the database.). As for data disks use, we have to be careful > about the use and delete the duplicate files. For anybody doing > calibrations, please use /home disks in rcas machine. Data disks should > be only used for official data files. Condor allows a user to use local > data. And, using rootd, a user can access local files remotely. > Therefor, either way, a user does not need to use data disks for > personal files. I guess we should start delete those files if the data > disks are full. > > Hiro > > > Bekele, Selemon wrote: > > >Hi Hiro, > > > > hope you are doing fine. How was QM05? I tried to make some gtr files and put them on /brahms/data18. > >some of my jobs finished OK, some others did not due to insufficient disk space. I then removed all the files > >I made using the rm command. But web interface to the datalocation still shows that they exist. I am not sure > > if there was a script to delete files from disks and update the database at the same time. How could I corect > > the info in the data base for data18? > > I hoped people would delete files they do not need so that I generate new gtr files to proceed with the slewing > >calibration for the FS. I want to put gtr files from 20 runs each on data01,02,05,06,07,11,12,13,15, and 17 for > >the time being and later move them to /home/ directories on some of the rcas machines. Do you think that works? > > > >Thanks, > > > >Selemon, > > > > > >-----Original Message----- > >From: Hironori Ito [mailto:hito@rcf.rhic.bnl.gov] > >Sent: Wed 7/27/2005 4:29 PM > >To: Bekele, Selemon > >Subject: Re: [Brahms-dev-l] Making gtr files > > > >Hello. You must logon to the gateway machine as you. Then, you need to > >log on to rcas as bramreco. > > > > > >Hiro > > > > > >Bekele, Selemon wrote: > > > > > > > >>Hi Hiro, > >> > >> It seems that I need to log onto the gatway machines as user "bramreco" and ssh to one of the rcas machines. Doing so I could not run the script > >> > >> updateScripts.sh > >> > >>which means I cannot get the ruby script > >> > >> masterGlobalTracking.rb > >> > >>to run. Also I cannot get X11 connection when I log in as "bramreco" which is not the case if I log in using my user name. May be only specific persons are allowd to edit the scripts. Doing xhost + and setting the display environment does not seem to work. Any idea what I need to do? > >> > >>Thanks, > >> > >>Selemon, > >> > >> > >> > >> > > > > > > > > > > > > > _______________________________________________ > Brahms-dev-l mailing list > Brahms-dev-l@lists.bnl.gov > http://lists.bnl.gov/mailman/listinfo/brahms-dev-l > _______________________________________________ Brahms-dev-l mailing list Brahms-dev-l@lists.bnl.gov http://lists.bnl.gov/mailman/listinfo/brahms-dev-lReceived on Mon Aug 15 14:32:51 2005
This archive was generated by hypermail 2.1.8 : Mon Aug 15 2005 - 14:33:02 EDT