Configuration of the disk Array

Configuration of the AVI-S100 controller: 1

Connecting and testing SCSI devices to the USPII 26

6/5/2002 Problem: I do not see all my targets and LUNs. 44

040728. Recovering from damaged /etc/vfstab. 46

Booting usp from cdrom.. 78

Mounting file system on Solaris hosts. 222

How to Test Disk Performance. 231

6/5/02 SCSI Info for usp. 234

SCSI Info for phobosx. 335

SCSI Info for vmesparc. 337

1/1/1 Problem: Performance degradation of the local disks at phobosx. 339

6/5/02 Tuning the disk performance. 343

Changing maxphys to 8 MB and ufs:ufs_WRITE to 0 gives 49 MB/s: 400

using forcedirectio in mount gives worse performance, 23.5 MB/s in test_fpdp. 420

6/5/02 # newfs -f 8192 -i 2097152 /dev/dsk/c1t1d3s0 gives the same result 439

6/5/02 test with event size = 4 MB, forcedirectio. 457

7/23/02 Partitioning of the DAQ disk array. 467

4/16/2004 6:20 PM... 481

10/3/2002 2:46 PM... 504

Optimizing disk. 599

Trying maximum nbpi = 20971. 661

It seems that the best setting is : 691

Reading on phobosx: 701

Reading on usp. 721

10/7/2002 4:55. Raw writing. 759

Conclusion 10/07/02. 769

10/8/2002 11:05. Notes about multi-host disk IO.. 776

Summary: Rewriting the file changes the file allocation. 782

1/27/2003 9:51. Problem: Degradation of the writing performance on phobosx. 783

Solution: 852

1/29/2003 10:31. Slow reading of the data/0 from phobosx. 856

Configuration of the AVI-S100 controller:

Logical Drives

LG ID       LV RAID     Size(MB)  Status   O #LN #SB  #FL NAME

P0 69FE5700 NA RAID0    69464     GOOD     S  4  -    0   LD0

P1 5916267C NA RAID0    69464     GOOD     S  4  -    0   LD1

Host LUNs

 ³ vÉÍÍÍÍÍÍÍÍÍ Host Channel ÍÍÍÍÍÍÍÍÍÍ»   ³

 ³ vº CHL 0 ID 1 (Primary Controller) º   ³

 ³ vº CHL 0 ID 2 (Primary Controller) º   ³

 ³ vº CHL 1 ID 1 (Primary Controller) º   ³

 ³ sº CHL 1 ID 2 (Primary Controller) º   ³

ºLUN³LV/LD³DRV³Partition³ Size(MB) ³ RAIDº

CHL 0 ID 1:

º  0³   LD³  0³        0³     69464³RAID0º

CHL 0 ID 2:

º  0³   LD³  1³        0³     69464³RAID0º

CHL 1 ID 1:

º  0³   LD³  0³        0³     69464³RAID0º

CHL 1 ID 2:

º  0³   LD³  1³        0³     69464³RAID0

view and edit SCSI drives:

 ÚÄÄÄÄÄÉÍÍÍÍÑÍÍÍÑÍÍÍÑÍÍÍÍÍÍÍÍÑÍÍÍÍÍÑÍÍÍÍÍÍÑÍÍÍÍÍÍÍÍÑÍÍÍÍÍÍÍÍÍÍÍÍÍÍÍÍÍÍÍÍÍÍÍÍ»

 ³ QuicºSlot³Chl³ ID³Size(MB)³Speed³LG_DRV³ Status ³Vendor and Product ID   º

 ³ viewÇÄÄÄÄÅÄÄÄÅÄÄÄÅÄÄÄÄÄÄÄÄÅÄÄÄÄÄÅÄÄÄÄÄÄÅÄÄÄÄÄÄÄÄÅÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄ¶

 ³ viewº    ³  2³  0³   17366³ 40MB³     0³ ON-LINE³SEAGATE ST118273WC      º

 ³ viewÇÄÄÄÄÅÄÄÄÅÄÄÄÅÄÄÄÄÄÄÄÄÅÄÄÄÄÄÅÄÄÄÄÄÄÅÄÄÄÄÄÄÄÄÅÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄ¶

 ³ viewº    ³  2³  1³   17366³ 40MB³     0³ ON-LINE³SEAGATE ST118273WC      º

 ³ viewÇÄÄÄÄÅÄÄÄÅÄÄÄÅÄÄÄÄÄÄÄÄÅÄÄÄÄÄÅÄÄÄÄÄÄÅÄÄÄÄÄÄÄÄÅÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄ¶

 ³ viewº    ³  2³  2³   17366³ 40MB³     0³ ON-LINE³SEAGATE ST118273WC      º

 ³ viewÇÄÄÄÄÅÄÄÄÅÄÄÄÅÄÄÄÄÄÄÄÄÅÄÄÄÄÄÅÄÄÄÄÄÄÅÄÄÄÄÄÄÄÄÅÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄ¶

 ³ systº    ³  2³  3³   17366³ 40MB³     0³ ON-LINE³SEAGATE ST118273WC      º

 ³ viewÇÄÄÄÄÅÄÄÄÅÄÄÄÅÄÄÄÄÄÄÄÄÅÄÄÄÄÄÅÄÄÄÄÄÄÅÄÄÄÄÄÄÄÄÅÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄ¶

 ³ viewº    ³  3³  4³   17366³ 40MB³     1³ ON-LINE³SEAGATE ST118273WC      º

 ÀÄÄÄÄÄÇÄÄÄÄÅÄÄÄÅÄÄÄÅÄÄÄÄÄÄÄÄÅÄÄÄÄÄÅÄÄÄÄÄÄÅÄÄÄÄÄÄÄÄÅÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄ¶

       º    ³  3³  5³   17366³ 40MB³     1³ ON-LINE³SEAGATE ST118273WC      º

       ÇÄÄÄÄÅÄÄÄÅÄÄÄÅÄÄÄÄÄÄÄÄÅÄÄÄÄÄÅÄÄÄÄÄÄÅÄÄÄÄÄÄÄÄÅÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄ¶

       º    ³  3³  6³   17366³ 40MB³     1³ ON-LINE³SEAGATE ST118273WC      º

       ÇÄÄÄÄÅÄÄÄÅÄÄÄÅÄÄÄÄÄÄÄÄÅÄÄÄÄÄÅÄÄÄÄÄÄÅÄÄÄÄÄÄÄÄÅÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄ¶

       º    ³  3³  8³   17366³ 40MB³     1³ ON-LINE³SEAGATE ST118273WC      º

       ÈÍÍÍÍÏÍÍÍÏÍÍÍÏÍÍÍÍÍÍÍÍÏÍÍÍÍÍÏÍÍÍÍÍÍÏÍÍÍÍÍÍÍÍÏÍÍÍÍÍÍÍÍÍÍÍÍÍÍÍÍÍÍÍÍÍÍÍÍ¼

view and edit SCSI channels:

 ³ vÉÍÍÍÍÑÍÍÍÍÍÑÍÍÍÑÍÍÍÑÍÍÍÍÍÍÍÍÍÑÍÍÍÍÍÍÑÍÑÍÍÍÍÑÍÍÍÍÍÍÍÍÍÑÍÍÍÍÍÍ»

 ³ vºChl ³Mode ³PID³SID³DefSynClk³DefWid³S³Term³CurSynClk³CurWidº

 ³ sÇÄÄÄÄÅÄÄÄÄÄÅÄÄÄÅÄÄÄÅÄÄÄÄÄÄÄÄÄÅÄÄÄÄÄÄÅÄÅÄÄÄÄÅÄÄÄÄÄÄÄÄÄÅÄÄÄÄÄÄ¶

 ³ vº0   ³Host ³  *³ NA³ 40.0MHz ³ Wide ³S³  On³ 10.0MHz ³ Wide º

 ³ vÇÄÄÄÄÅÄÄÄÄÄÅÄÄÄÅÄÄÄÅÄÄÄÄÄÄÄÄÄÅÄÄÄÄÄÄÅÄÅÄÄÄÄÅÄÄÄÄÄÄÄÄÄÅÄÄÄÄÄÄ¶

 ÀÄÄº1   ³Host ³  *³ NA³ 40.0MHz ³ Wide ³S³  On³ 20.0MHz ³ Wide º

    ÇÄÄÄÄÅÄÄÄÄÄÅÄÄÄÅÄÄÄÅÄÄÄÄÄÄÄÄÄÅÄÄÄÄÄÄÅÄÅÄÄÄÄÅÄÄÄÄÄÄÄÄÄÅÄÄÄÄÄÄ¶

    º2   ³Drive³  7³ NA³ 40.0MHz ³ Wide ³S³  On³ 20.0MHz ³ Wide º

    ÇÄÄÄÄÅÄÄÄÄÄÅÄÄÄÅÄÄÄÅÄÄÄÄÄÄÄÄÄÅÄÄÄÄÄÄÅÄÅÄÄÄÄÅÄÄÄÄÄÄÄÄÄÅÄÄÄÄÄÄ¶

    º3   ³Drive³  7³ NA³ 40.0MHz ³ Wide ³S³  On³ 20.0MHz ³ Wide º

    ÈÍÍÍÍÏÍÍÍÍÍÏÍÍÍÏÍÍÍÏÍÍÍÍÍÍÍÍÍÏÍÍÍÍÍÍÏÍÏÍÍÍÍÏÍÍÍÍÍÍÍÍÍÏÍÍÍÍÍÍ¼

Caching Parameters:

 ³ vº HÚÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄ¿³

 ÀÄÄº D³ Write-Back Cache Enabled        ³

    º D³ Optimization for Sequential I/O ³

Host-side SCSI parameters:

  view Maximum Queued I/O Count -  256

  view LUNs per Host SCSI ID - 8

  view Max Number of Concurrent Host-LUN Connection - Def(4)

  view Number of Tags Reserved for each Host-LUN Connection - Def(32)

  view Peripheral Device Type Parameters

  vÉÍÍ Host Cylinder/Head/Sector Mapping Configuration

Drive-side SCSI parameters:

 ³ Quic³ SCSI Motor Spin-Up Disabled                                    ³

 ³ view³ SCSI Reset at Power-Up Enabled                                 ³

 ³ view³ Disk Access Delay Time - 15 seconds                            ³

 ³ view³ SCSI I/O Timeout -Default( 7 seconds )                         ³

 ³ view³ Maximum Tag Count - 32                                         ³

 ³ view³ Periodic Drive Check Time -  Disable                           ³

 ³ view³ Periodic SAF-TE and SES Device Check Time -  Disabled          ³

 ³ vÉÍÍ³ Periodic Auto-Detect Failure Drive Swap Check Time - Disabled  ³

 ³ sº C³ Drive Predictable Failure Mode(SMART) -Disable                 ³

View system information:

 ³ vº CPU Type           ³PPC603e    º    ³

 ³ vº Total Cache Size   ³64MB SDRAM º    ³

 ÀÄÄº Firmware Version   ³3.12T      º  ÄÄÙ

    º Bootrecord Version ³1.13B      º

    º FW Upgradability   ³Rev. A     º

    º Serial Number      ³3182170    º

    º Battery Backup     ³Off        º

    º Base Board Rev. ID ³0          º

    º Base Board ID      ³33         º

IMPORTANT !

To be seen from the Solaris hosts the logical drives should be at separate SCSI channels, this is done by adding host channels in "view and edit Host luns" menu. After changing being made in this menu, the power should be recycled on crate with USPII and on the disk array (not necessary on phobosx). The crate should be switched on after the disk array. Improper sequence may result in missing drives on USPII: they will be seen using open boot command 'ok>probe-scsi-all' and in /var/adm/messages but will be not reported using Solaris command 'format'.

Connecting and testing SCSI devices to the USPII

ok probe-scsi-all

/pci@1f,0/pci@1,1/scsi@2,1

/pci@1f,0/pci@1,1/scsi@2

Target 1

Target 2

In the example above everything is bad.

Executing last command: probe-scsi-all

/pci@1f,0/pci@1,1/scsi@2,1

Target 0

Unit 0 Disk SEAGATE ST34573WC 6244

/pci@1f,0/pci@1,1/scsi@2

Target 1

Target 2

Now it is better. We see a disk connected to the SCSI B slot.

6/5/2002 Problem: I do not see all my targets and LUNs.

You must have all targets and LUNs in the sd.conf for Solaris to recognize them. The sd.conf is found in the /kernel/drv. By default you will have targets 0-6 and 7-15 with one LUN under each target. Here is an example of how each line should look:

name="sd"
class="scsi"
target=N
lun=0

where N is the target number. The first step is to obtain the target ID (or loop ID) from the array vendor. Enter this number into sd.conf with the appropriate number of LUNs. RAIDs are usually configured as one target with multiple LUNs, and a JBOD (Just a Bunch Of Disks) is typically configured with multiple targets (the number of disks in the JBOD equals the number of available targets). There should be one LUN under each target.

A reconfiguration boot is required after editing the sd.conf file before the device is recognized by Solaris.

Link was down when the driver attached to the adapter. In this case verify that you have a proper link (you will receive link down errors if you do not). Type in the Solaris command drvconfig. This command goes out and looks for new devices attached to the JNI adapters (remember that the targets and LUNs must be configured in the sd.conf before trying this command). After the drvconfig command, you will receive a new prompt. At this prompt, type in the command disks and press Enter. Verify the presence of the new targets by typing the format command.

Disk problems can also affect device recognition.

040728. Recovering from damaged /etc/vfstab

Problem:

In the /etc/vfstab the line which mounts / was mistakenly commented.

As a result the disk can be booted only as read-only

/ on /pci@1f,0/pci@1/scsi@1,1/disk@0,0:a read/write/setuid/dev=800078 on Wed Dec 31 19:00:00 1969

/dev/fd on fd read/write/setuid/dev=3f00000 on Thu Jul 29 12:22:34 2004

/etc/mnttab on mnttab read/write/setuid/dev=3fc0000 on Thu Jul 29 12:22:34 2004

/var/run on swap read/write/setuid/dev=1 on Thu Jul 29 12:22:34 2004

# more /etc/vfstab

#device device mount FS fsck mount mount

##to mount to fsck point type pass at boot options

##/dev/dsk/c1d0s2 /dev/rdsk/c1d0s2 /usr ufs 1 yes -

fd - /dev/fd fd - no -

#/proc - /proc proc - no -

/dev/dsk/c0t0d0s1 - - swap - no -

#/dev/dsk/c0t0d0s0 /dev/rdsk/c0t0d0s0 / ufs 1 yes -

/dev/dsk/c0t0d0s7 /dev/rdsk/c0t0d0s7 /export/home ufs 2 yes -

swap - /tmp tmpfs - yes -

phobosx:/data/7 - /mnt/phobosx nfs - yes rw,noac /dev/dsk/c1t1d0s0 /d

ev/rdsk/c1t1d0s0 /data/0 ufs - yes forcedirectio

/dev/dsk/c1t1d1s0 /dev/rdsk/c1t1d1s0 /data/1 ufs - yes forcedirectio

/dev/dsk/c1t1d2s0 /dev/rdsk/c1t1d2s0 /data/2 ufs - yes forcedirectio

/dev/dsk/c1t1d3s0 /dev/rdsk/c1t1d3s0 /data/3 ufs - yes forcedirectio

#old system patition of the vmesparc

#/dev/dsk/c1t1d0s0 /dev/rdsk/c1t1d0s0 /mnt/oldvmesparc ufs - yes ro

/dev/dsk/c0t1d0s0 /dev/rdsk/c0t1d0s0 /d1 ufs 2 no -

/dev/dsk/c0t1d0s7 /dev/rdsk/c0t1d0s7 /d1_home ufs 2 no -

To recover, I will try to boot from cdrom and edit this file from there

Booting usp from cdrom

Connect cdrom to the left scsi port on usp.

To be sure if everything is OK with scsi connection

ok boot /pci@1f,0/pci@1/scsi@1/disk@4,0:f

Resetting ...

Setting memory timing for 501 MHz CPU

Setting memory timings for >= HB1.2

MCR0 = 56a0bd04

MCR1 = c0804000

MCR2 = f10000e

MCR3 = 6

VME controller is not System Controller

screen not found.

keyboard not found.

Keyboard not present. Using ttya for input and output.

VME controller is not System Controller

Themis 2e (UltraSPARC-IIe 500MHz), No Keyboard

OpenBoot 3.10.0 PS2Kbd Rev 1.1 , 256 MB memory installed, Serial #629145.

Ethernet address 0:0:0:0:0:42, Host ID: 80099999.

Executing last command: boot /pci@1f,0/pci@1/scsi@1/disk@4,0:f

Boot device: /pci@1f,0/pci@1/scsi@1/disk@4,0:f File and args: kernel/unix

SunOS Release 5.8 Version Generic_108528-11 32-bit

WARNING: /pci@1f,0/pci@1/scsi@1 (glm0):

Disconnected command timeout for Target 4.0

WARNING: /pci@1f,0/pci@1/scsi@1 (glm0):

Unexpected DMA state: ACTIVE. dstat=81<DMA-FIFO-empty,illegal-instruction>

WARNING: /pci@1f,0/pci@1/scsi@1/sd@4,0 (sd4):

SCSI transport failed: reason 'reset': retrying command

WARNING: /pci@1f,0/pci@1/scsi@1/sd@4,0 (sd4):

SCSI transport failed: reason 'timeout': retrying command

WARNING: /pci@1f,0/pci@1/scsi@1/sd@4,0 (sd4):

SCSI transport failed: reason 'reset': retrying command

Note. These warning are due a to possible bad cable connection

Configuring /dev and /devices

Using RPC Bootparams for network configuration information.

Solaris Web Start 3.0 installer

The Solaris Installer can be run in English, or any of the following languages:

1) English 6) Japanese

2) German 7) Korean

3) Spanish 8) Swedish

4) French 9) Simplified_Chinese

5) Italian 10) Traditional_Chinese

Select the language you want to use to run the installer: 1

English has been selected as the language in which to perform the install.

Starting the Web Start 3.0 Solaris installer

Solaris installer is searching the system's hard disks for a

location to place the Solaris installer software.

Your system appears to be upgradeable.

Do you want to do a Initial Install or Upgrade?

1) Initial Install

2) Upgrade

Please Enter 1 or 2 > 2

Since swap slices are usually erased at each reboot,

the Solaris Installer would prefer to place the Solaris install image

on a slice labeled swap.

The Installer would like to use the disk slice c1t0d0s1, labeled as swap.

WARNING: All information will be lost.

an the Solaris Installer use this slice? [y,n,?] y

The Solaris installer will use disk slice, /dev/dsk/c1t0d0s1.

After files are copied, the system will automatically reboot, and

installation will continue.

Please Wait...

Copying mini-root to local disk.WARNING: /pci@1f,0/pci@1/scsi@1 (glm0):

Connected command timeout for Target 4.0

WARNING: /pci@1f,0/pci@1/scsi@1/sd@4,0 (sd4):

SCSI transport failed: reason 'reset': retrying command

WARNING: /pci@1f,0/pci@1/scsi@1/sd@4,0 (sd4):

SCSI transport failed: reason 'timeout': retrying command

WARNING: /pci@1f,0/pci@1/scsi@1/sd@4,0 (sd4):

SCSI transport failed: reason 'incomplete': retrying command

WARNING: /pci@1f,0/pci@1/scsi@1/sd@4,0 (sd4):

SCSI transport failed: reason 'reset': retrying command

WARNING: /pci@1f,0/pci@1/scsi@1/sd@4,0 (sd4):

SCSI transport failed: reason 'incomplete': retrying command

WARNING: /pci@1f,0/pci@1/scsi@1/sd@4,0 (sd4):

SCSI transport failed: reason 'reset': retrying command

WARNING: /pci@1f,0/pci@1/scsi@1/sd@4,0 (sd4):

SCSI transport failed: reason 'incomplete': retrying command

WARNING: /pci@1f,0/pci@1/scsi@1/sd@4,0 (sd4):

disk not responding to selection

WARNING: /pci@1f,0/pci@1/scsi@1/sd@4,0 (sd4):

disk not responding to selection

WARNING: /pci@1f,0/pci@1/scsi@1/sd@4,0 (sd4):

disk not responding to selection

error: zipfile read error

# |

That’s bad…

Lets see where can we go from here:

Lets mount disk on /tmp/a

# mkdir /tmp/a

#mount /dev/dsk/c1t0d0s0 /tmp/a

note that it is c1t0d0s0 not c0t0d0s0 as one can think

Now we can vi the /etc/vfstab. For vi to work we must change the default TERM setting from sun to something more convenient:

setenv TERM VT100

vi vfstab

#device device mount FS fsck mount mount

#to mount to fsck point type pass at boot options

/proc - /proc proc - no -

/dev/dsk/c0t0d0s1 - - swap - no -

/dev/dsk/c0t0d0s0 /dev/rdsk/c0t0d0s0 / ufs 1 no -

/dev/dsk/c0t0d0s7 /dev/rdsk/c0t0d0s7 /export/home ufs - yes -

swap - /tmp tmpfs - yes -

phobosx:/data/7 - /mnt/phobosx nfs - yes -

And voila! It works

Mounting file system on Solaris hosts

The vmesparc mounts the read/write file systems. The phobosx mounts read only file systems, otherwise there will be problems file system integrity. There is a drawback here: for phobosx should unmount and mount the shared again to be able to see the changes made by vmesparc on that disk. The following are lines required in the /etc/vfstab files:

on vmesparc:

/dev/dsk/c0t1d0s4       /dev/rdsk/c0t1d0s4      /data/0 ufs -   yes     -

/dev/dsk/c0t2d0s4       /dev/rdsk/c0t2d0s4      /data/1 ufs -   yes     -

on phobosx:

/dev/dsk/c0t1d0s4 /dev/rdsk/c0t1d0s4        /data/0 ufs      -        yes         ro,onerror=umount,toosoon=1y,nosuid

/dev/dsk/c0t2d0s4 /dev/rdsk/c0t2d0s4        /data/1  ufs      -        yes         ro,onerror=umount,toosoon=1y,nosuid

How to Test Disk Performance

/usr/local/bin/scsiinfo-4.7-sunos5.8-32bit –cp
This should give on phobosx:
fas0: type 0 (FAS366) speed 40MHz
fas0: sd0,0 tgt 0 lun 0:
Synchronous(20.000MB/sec) Clean TaggedQueuing Wide
Non-removable Disk: SEAGATE ST34371W SUN4.2G 7462 [SLT]
fas0: sd1,0 tgt 1 lun 0:
Synchronous(20.000MB/sec) Clean TaggedQueuing Wide
Non-removable Disk: AVI-S100 AVIstor AVI-S100 0312 [ST]
fas0: sd2,0 tgt 2 lun 0:
Synchronous(20.000MB/sec) Clean TaggedQueuing Wide
Non-removable Disk: AVI-S100 AVIstor AVI-S100 0312 [ST]
fas0: sd6,0 tgt 6 lun 0:
Synchronous(5.715MB/sec) Noisy NoTaggedQueuing Narrow
<<< SCSI probe failed: device is busy >>>
fas0: sdf,0 tgt 15 lun 0:
Synchronous(20.000MB/sec) Clean TaggedQueuing Wide
Non-removable Disk: SEAGATE ST318436LC 0010 [SLT]

6/5/02. This should give on usp:
glm0: type 11 (unknown) speed 160MHz
glm0: sd1,0 tgt 1 lun 0:
   Synchronous(80.000MB/sec) Clean TaggedQueuing Wide
   Non-removable Disk: AVI-S100 AVIstor AVI-S100 0312          [ST]
glm0: sd1,1 tgt 1 lun 1:
   Synchronous(80.000MB/sec) Clean TaggedQueuing Wide
   Non-removable Disk: AVI-S100 AVIstor AVI-S100 0312          [ST]
glm0: sd1,2 tgt 1 lun 2:
   Synchronous(80.000MB/sec) Clean TaggedQueuing Wide
   Non-removable Disk: AVI-S100 AVIstor AVI-S100 0312          [ST]
glm0: sd1,3 tgt 1 lun 3:
   Synchronous(80.000MB/sec) Clean TaggedQueuing Wide
   Non-removable Disk: AVI-S100 AVIstor AVI-S100 0312          [ST]
glm1: type 11 (unknown) speed 160MHz
glm1: sd0,0 tgt 0 lun 0:
   Synchronous(40.000MB/sec) Clean TaggedQueuing Wide
   Non-removable Disk: SEAGATE ST118273WC       6244          [SLT]

6/5/02 SCSI Info for usp

/usr/local/bin/scsiinfo-4.7-sunos5.8-32bit -r all

glm0: sd1,0 tgt 1 lun 0:

   Synchronous(80.000MB/sec) Clean TaggedQueuing Wide

Vendor:                      AVI-S100

Model:                       AVIstor AVI-S100

Revision:                    0312

Serial:                       3182170

Device Type:                 Disk

Data Transfer Width(s):      16, 8

Supported Features:          SYNC_SCSI TAG_QUEUE

Formatted Capacity:          286748672 sectors (143.4 GB)

Sector size:                 512 bytes

Physical Cylinders:          17570

Heads:                       64

Sectors per track (Avg.):    255

Tracks per zone:             1

Alternate Sectors per zone:  1

Alternate Tracks per volume: 14

Rotational speed:            5411 rpm

Cache:                       Read-Only

----------------------------

glm0: sd1,1 tgt 1 lun 1:

   Synchronous(80.000MB/sec) Clean TaggedQueuing Wide

Vendor:                      AVI-S100

Model:                       AVIstor AVI-S100

Revision:                    0312

Serial:                       3182170

Device Type:                 Disk

Data Transfer Width(s):      16, 8

Supported Features:          SYNC_SCSI TAG_QUEUE

Formatted Capacity:          286748672 sectors (143.4 GB)

Sector size:                 512 bytes

Physical Cylinders:          17570

Heads:                       64

Sectors per track (Avg.):    255

Tracks per zone:             1

Alternate Sectors per zone:  1

Alternate Tracks per volume: 14

Rotational speed:            5411 rpm

Cache:                       Read-Only

----------------------------

glm0: sd1,2 tgt 1 lun 2:

   Synchronous(80.000MB/sec) Clean TaggedQueuing Wide

Vendor:                      AVI-S100

Model:                       AVIstor AVI-S100

Revision:                    0312

Serial:                       3182170

Device Type:                 Disk

Data Transfer Width(s):      16, 8

Supported Features:          SYNC_SCSI TAG_QUEUE

Formatted Capacity:          286748672 sectors (143.4 GB)

Sector size:                 512 bytes

Physical Cylinders:          17570

Heads:                       64

Sectors per track (Avg.):    255

Tracks per zone:             1

Alternate Sectors per zone:  1

Alternate Tracks per volume: 14

Rotational speed:            5411 rpm

Cache:                       Read-Only

----------------------------

glm0: sd1,3 tgt 1 lun 3:

   Synchronous(80.000MB/sec) Clean TaggedQueuing Wide

Vendor:                      AVI-S100

Model:                       AVIstor AVI-S100

Revision:                    0312

Serial:                       3182170

Device Type:                 Disk

Data Transfer Width(s):      16, 8

Supported Features:          SYNC_SCSI TAG_QUEUE

Formatted Capacity:          286748672 sectors (143.4 GB)

Sector size:                 512 bytes

Physical Cylinders:          17570

Heads:                       64

Sectors per track (Avg.):    255

Tracks per zone:             1

Alternate Sectors per zone:  1

Alternate Tracks per volume: 14

Rotational speed:            5411 rpm

Cache:                       Read-Only

----------------------------

glm1: sd0,0 tgt 0 lun 0:

   Synchronous(40.000MB/sec) Clean TaggedQueuing Wide

Vendor:                      SEAGATE

Model:                       ST118273WC

Revision:                    6244

Serial:                      LP610174

Device Type:                 Disk

Data Transfer Width(s):      16, 8

Supported Features:          SYNC_SCSI LINK_CMD TAG_QUEUE

Formatted Capacity:          35566480 sectors (17.8 GB)

Sector size:                 512 bytes

Physical Cylinders:          7501

Heads:                       20

Sectors per track (Avg.):    237

Tracks per zone:             13440

Alternate Sectors per zone:  0

Alternate Tracks per volume: 0

Rotational speed:            7177 rpm

Cache:                       Read-Write

SCSI Info for phobosx

Become root, then:
/usr/local/bin/scsiinfo -r all
/usr/local/bin/scsiinfo: WARNING: compiled for SunOS 5.7; this is SunOS 5.8. Results may be incorrect.
fas0: sd0,0 tgt 0 lun 0:
Synchronous(11.430MB/sec) Noisy TaggedQueuing Wide
This should be: Synchronous(20.000MB/sec) Clean TaggedQueuing Wide
Vendor: SEAGATE
Model: ST34371W SUN4.2G
Revision: 7462
Serial: 9807W59768
Device Type: Disk
Data Transfer Width(s): 16, 8
Supported Features: SYNC_SCSI LINK_CMD TAG_QUEUE
Formatted Capacity: 8385121 sectors (4.2 GB)
Sector size: 512 bytes
Physical Cylinders: 3882
Heads: 16
Sectors per track (Avg.): 135
Tracks per zone: 60
Alternate Sectors per zone: 118
Alternate Tracks per volume: 0
Rotational speed: 7228 rpm
Cache: Read-Only
----------------------------
fas0: sd1,0 tgt 1 lun 0:
Asynchronous Clean TaggedQueuing Wide
This should be: Synchronous(20.000MB/sec) Clean TaggedQueuing Wide
Vendor: AVI-S100
Model: AVIstor AVI-S100
Revision: 0312
Serial: 3182170
Device Type: Disk
Data Transfer Width(s): 16, 8
Supported Features: SYNC_SCSI TAG_QUEUE
Formatted Capacity: 142262272 sectors (71.1 GB)
Sector size: 512 bytes
Physical Cylinders: 34732
Heads: 64
Sectors per track (Avg.): 64
Tracks per zone: 1
Alternate Sectors per zone: 1
Alternate Tracks per volume: 14
Rotational speed: 5411 rpm
Cache: Read-Only
----------------------------
fas0: sd2,0 tgt 2 lun 0:
Asynchronous Clean TaggedQueuing Wide
This should be: Synchronous(20.000MB/sec) Clean TaggedQueuing Wide
Vendor: AVI-S100
Model: AVIstor AVI-S100
Revision: 0312
Serial: 3182170
Device Type: Disk
Data Transfer Width(s): 16, 8
Supported Features: SYNC_SCSI TAG_QUEUE
Formatted Capacity: 142262272 sectors (71.1 GB)
Sector size: 512 bytes
Physical Cylinders: 34732
Heads: 64
Sectors per track (Avg.): 64
Tracks per zone: 1
Alternate Sectors per zone: 1
Alternate Tracks per volume: 14
Rotational speed: 5411 rpm
Cache: Read-Only
----------------------------
fas0: sd6,0 tgt 6 lun 0:
Synchronous(10.000MB/sec) Clean NoTaggedQueuing Narrow
/devices/sbus@3,0/SUNW,fas@3,8800000/sd@6,0:c,raw: Device busy
/usr/local/bin/scsiinfo: Cannot open device.
----------------------------
fas0: sdf,0 tgt 15 lun 0:
Synchronous(11.430MB/sec) Noisy TaggedQueuing Wide
This should be: Synchronous(20.000MB/sec) Clean TaggedQueuing Wide
Vendor: SEAGATE
Model: ST318436LC
Revision: 0010
Serial: 3BM0GXBE
Device Type: Disk
Data Transfer Width(s): 16, 8
Supported Features: SYNC_SCSI LINK_CMD TAG_QUEUE
Formatted Capacity: 35885168 sectors (17.9 GB)
Sector size: 512 bytes
Physical Cylinders: 14384
Heads: 6
Sectors per track (Avg.): 417
Tracks per zone: 5370
Alternate Sectors per zone: 0
Alternate Tracks per volume: 0
Rotational speed: 7173 rpm
Cache: Read-Write
----------------------------
fas0: st4,0 tgt 4 lun 0:
Synchronous(20.000MB/sec) Clean NoTaggedQueuing Wide
Vendor: QUANTUM
Model: DLT7000
Revision: 2150
Serial: qP
Device Type: Tape
Data Transfer Width(s): 16, 8
Supported Features: SYNC_SCSI LINK_CMD TAG_QUEUE
Maximum block length: 16777214 bytes
Minimum block length: 2 bytes
----------------------------
fas0: st5,0 tgt 5 lun 0:
Synchronous(10.000MB/sec) Clean NoTaggedQueuing Narrow
Vendor: HP
Model: C1537A
Revision: L706
Serial: 62
Device Type: Tape
Data Transfer Width(s): 8
Supported Features: SYNC_SCSI LINK_CMD TAG_QUEUE
Maximum block length: 16777215 bytes
Minimum block length: 1 bytes

SCSI Info for vmesparc

Become root, then:
/usr/local/bin/scsiinfo -r all
glm1: sd0,0 tgt 0 lun 0:
Synchronous(40.000MB/sec) Clean TaggedQueuing Wide
Vendor: SEAGATE
Model: ST34573WC
Revision: 6244
Serial: LN643887
Device Type: Disk
Data Transfer Width(s): 16, 8
Supported Features: SYNC_SCSI LINK_CMD TAG_QUEUE
Formatted Capacity: 8888924 sectors (4.4 GB)
Sector size: 512 bytes
Physical Cylinders: 7501
Heads: 5
Sectors per track (Avg.): 237
Tracks per zone: 3360
Alternate Sectors per zone: 0
Alternate Tracks per volume: 0
Rotational speed: 7177 rpm
Cache: Read-Write
----------------------------
glm1: sd1,0 tgt 1 lun 0:
Asynchronous Clean TaggedQueuing Wide
Vendor: AVI-S100
Model: AVIstor AVI-S100
Revision: 0312
Serial: 3182170
Device Type: Disk
Data Transfer Width(s): 16, 8
Supported Features: SYNC_SCSI LINK_CMD TAG_QUEUE
Formatted Capacity: 142262272 sectors (71.1 GB)
Sector size: 512 bytes
Physical Cylinders: 34732
Heads: 64
Sectors per track (Avg.): 64
Tracks per zone: 1
Alternate Sectors per zone: 1
Alternate Tracks per volume: 14
Rotational speed: 5411 rpm
Cache: Read-Only
----------------------------
glm1: sd2,0 tgt 2 lun 0:
Asynchronous Clean TaggedQueuing Wide
Vendor: AVI-S100
Model: AVIstor AVI-S100
Revision: 0312
Serial: 3182170
Device Type: Disk
Data Transfer Width(s): 16, 8
Supported Features: SYNC_SCSI LINK_CMD TAG_QUEUE
Formatted Capacity: 142262272 sectors (71.1 GB)
Sector size: 512 bytes
Physical Cylinders: 34732
Heads: 64
Sectors per track (Avg.): 64
Tracks per zone: 1
Alternate Sectors per zone: 1
Alternate Tracks per volume: 14
Rotational speed: 5411 rpm
Cache: Read-Only
----------------------------
glm1: sd6,0 tgt 6 lun 0:
Synchronous(5.813MB/sec) Clean NoTaggedQueuing Narrow
/devices/pci@1f,0/pci@1,1/scsi@2,1/sd@6,0:c,raw: Device busy
/usr/local/bin/scsiinfo: Cannot open device.

1/1/1 Problem: Performance degradation of the local disks at phobosx

After several days the same command shows worse performance for both SEAGATE disks:

/usr/local/bin/scsiinfo: WARNING: compiled for SunOS 5.7; this is SunOS 5.8. Results may be incorrect.
fas0: type 0 (FAS366) speed 40MHz
fas0: sd0,0 tgt 0 lun 0:
Synchronous(11.430MB/sec) Noisy TaggedQueuing Wide
Non-removable Disk: SEAGATE ST34371W SUN4.2G 7462 [SLT]
fas0: sd1,0 tgt 1 lun 0:
Synchronous(20.000MB/sec) Clean TaggedQueuing Wide
Non-removable Disk: AVI-S100 AVIstor AVI-S100 0312 [ST]
fas0: sd2,0 tgt 2 lun 0:
Synchronous(20.000MB/sec) Clean TaggedQueuing Wide
Non-removable Disk: AVI-S100 AVIstor AVI-S100 0312 [ST]
fas0: sd6,0 tgt 6 lun 0:
Synchronous(10.000MB/sec) Clean NoTaggedQueuing Narrow
<<< SCSI probe failed: device is busy >>>
fas0: sdf,0 tgt 15 lun 0:
Synchronous(11.430MB/sec) Noisy TaggedQueuing Wide
Non-removable Disk: SEAGATE ST318436LC 0010 [SLT]

Start reading test
/data/7/share/tools/benchmarks/reading_test 0

to check if it works
iostat -l 5 5 10

one should see sd1 ~18 MB
the CPU usage using Process Manager for bonnie = ~5%

6/5/02 Tuning the disk performance

ufs usage: mkfs [-F FSType] [-V] [-m] [-o options] special size(sectors) \

[nsect ntrack bsize fragsize cpg free rps nbpi opt apc gap nrpos maxcontig]

on usp:

newfs -vN c1t1d3s0

mkfs -F ufs -o N /dev/rdsk/c1t1d3s0 286693440 255 64 8192 1024 229 1 90 8192 t 0 -1 8 128

/dev/rdsk/c1t1d3s0:     286693440 sectors in 17567 cylinders of 64 tracks, 255 sectors

        139987.0MB in 2928 cyl groups (6 c/g, 47.81MB/g, 5824 i/g)

super-block backups (for fsck -F ufs -o b=#) at:

 32, 98208, 196384, 294560, 392736, 490912, 589088, 687264, 785440, 883616,

 981792, 1079968, 1178144, 1276320, 1374496, 1472672, 1570848, 1669024,

 1767200, 1865376, 1963552, 2061728, 2159904, 2258080, 2356256, 2454432,

 2552608, 2650784, 2748960, 2847136, 2945312, 3043488, 3141664, 3239840,

 size      = 286693440

 nsect     = 255

 ntrack    = 64

 bsize     = 8192

 fragsize  = 1024

*cpg       = 229

*free      = 1

 rps       = 90

 nbpi      = 8192

*opt       = t

 apc       = 0

*gap       = -1

 nrpos     = 8

*maxcontig = 128

* means the parameter is tunable using tunefs

more optimal setting

 size      = 286693440

 nsect     = 255

 ntrack    = 64

 bsize     = 8192

 fragsize  = 8192

*cpg       = 229

*free      = 1

 rps       = 90

 nbpi      = 1073741824

*opt       = t

 apc       = 0

*gap       = ?

 nrpos     = 8

*maxcontig = 128

6/5/02

~/perf/Bonnias -s 1000 -w -d /data/3

File '/data/3/Bonnie.898', size: 1048576000

Reporting...              -------Sequential Output-------- ---Sequential Input-- --Random--

              -Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --Seeks---

Machine    MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU  /sec %CPU

         1000     0 100.0 44053 62.7     0 100.0    0 100.0     0 100.0   0.0 100.0

iostat –xMc showed w/s 58, Mw/s=44.2 actv = 1.1 svc_t=18.1 %w=0, %b=94, sy=61 wt=16 id=23

Changing maxphys to 8 MB and ufs:ufs_WRITE to 0 gives 49 MB/s:

See http://docs.sun.com/db/doc/806-7009/6jftnqsj1?a=view

After changing /etc/system:

set maxphys=0x00800000

set ufs:ufs_WRITES=0

~/perf/Bonnias -s 1000 -w -d /data/3

File '/data/3/Bonnie.283', size: 1048576000

Writing intelligently...done

Reporting... -------Sequential Output-------- ---Sequential Input-- --Random--

-Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --Seeks---

Machine MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU /sec %CPU

1000 0 100.0 50233 72.4 0 100.0 0 100.0 0 100.0 0.0 100.0

iostat –xMc showed w/s 61, Mw/s=49, actv=3.3, svc_t=52.3, %b=98, sy=73, wt=25 ,d =2

test_fpdp :

trans = 26 MB/s, w/s=34, Mw/s=26, %b=95, sy=97 wt =2, id =0;

potential limit is rate/sy = 27 MB/s

using forcedirectio in mount gives worse performance, 23.5 MB/s in test_fpdp

~/perf/Bonnias -s 1000 -w -d /data/3

File '/data/3/Bonnie.309', size: 1048576000

Writing intelligently...done

Reporting...              -------Sequential Output-------- ---Sequential Input-- --Random--

              -Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --Seeks---

Machine    MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU  /sec %CPU

         1000     0 100.0 44665  3.8     0 100.0    0 100.0     0 100.0   0.0 100.0

test_fpdp = 23.5 MB/s

w/s = 271, Mw/s=23.2, svc_t = 5, %b=53, sy=47, wt=52, id =1

but potentially the limit is rate/sy = 50 MB/s

Probably it will have less wt if the event size is bigger.

Test_fpdp without disk = 43.75 MB/s sy=77, id=23

Test_fpdp, no DISK, NO_GET_DATA = 54.6 MB/s, sy=39, id=60

Test_fpdp, DISK, NO_GET_DATA = 29.4 MB/s, sy=33, wt=66 id=1

6/5/02 # newfs -f 8192 -i 2097152 /dev/dsk/c1t1d3s0 gives the same result

newfs: construct a new file system /dev/rdsk/c1t1d3s0: (y/n)? y

/dev/rdsk/c1t1d3s0: 286693440 sectors in 17567 cylinders of 64 tracks, 255 sectors

139987.0MB in 326 cyl groups (54 c/g, 430.31MB/g, 256 i/g)

super-block backups (for fsck -F ufs -o b=#) at:

32, 881568, 1763104, 2644640, 3526176, 4407712, 5289248, 6170784, 7052320,

7933856, 8815392, 9696928, 10578464, 11460000, 12341536, 13223072, 14104608,

after that: almost the same result:

~/perf/Bonnias -s 1000 -w -d /data/3

File '/data/3/Bonnie.385', size: 1048576000

Writing intelligently...done

Reporting... -------Sequential Output-------- ---Sequential Input-- --Random--

-Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --Seeks---

Machine MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU /sec %CPU

1000 0 100.0 44230 3.8 0 100.0 0 100.0 0 100.0 0.0 100.0

test_fpdp = 23.5 MB/s, w/s=244, Mw/s=23.3, %b=53, sy=48, wt=51

6/5/02 test with event size = 4 MB, forcedirectio

test_fpdp 26 MB/s, w/s=34.3, Mw/s=26.1, svc_t=43.7 %b=51, sy=50 wt=50 id=0

no big difference only 10% faster.

test_fpdp with NO_GET_DATA: Mw/s =33.3 MB/s, svc_t=50.6, %b=74, sy=28,wt=72

But Bonias shows better:

Reporting... -------Sequential Output-------- ---Sequential Input-- --Random--

-Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --Seeks---

Machine MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU /sec %CPU

1000 0 100.0 50656 4.6 0 100.0 0 100.0 0 100.0 0.0 100.0

7/23/02 Partitioning of the DAQ disk array

Current partition table (mysys):

Total disk cylinders available: 7499 + 2 (reserved cylinders)

Part Tag Flag Cylinders Size Blocks

0 root wm 222 - 775 1.25GB (554/0/0) 2625960

1 swap wu 0 - 221 513.81MB (222/0/0) 1052280

2 backup wm 0 - 7498 16.95GB (7499/0/0) 35545260

3 unassigned wm 0 0 (0/0/0) 0

4 unassigned wm 0 0 (0/0/0) 0

5 unassigned wm 0 0 (0/0/0) 0

6 unassigned wm 0 0 (0/0/0) 0

7 home wm 776 - 7498 15.20GB (6723/0/0) 31867020

4/16/2004 6:20 PM

1. c1t1d0 <AVI-2*70 cyl 17568 alt 2 hd 64 sec 255>

Part Tag Flag Cylinders Size Blocks

0 root wm 0 - 17566 136.71GB (17567/0/0) 286693440

1 unassigned wu 0 0 (0/0/0) 0

2 backup wu 0 - 17567 136.71GB (17568/0/0) 286709760

3 unassigned wm 0 0 (0/0/0) 0

4 unassigned wm 0 0 (0/0/0) 0

5 unassigned wm 0 0 (0/0/0) 0

6 unassigned wm 0 0 (0/0/0) 0

7 unassigned wm 0 0 (0/0/0) 0

2. c1t1d1 <AVI-2*70 cyl 17568 alt 2 hd 64 sec 255>

Part Tag Flag Cylinders Size Blocks

0 root wm 0 - 17566 136.71GB (17567/0/0) 286693440

1 unassigned wu 0 0 (0/0/0) 0

2 backup wu 0 - 17567 136.71GB (17568/0/0) 286709760

3 unassigned wm 0 0 (0/0/0) 0

4 unassigned wm 0 0 (0/0/0) 0

5 unassigned wm 0 0 (0/0/0) 0

6 unassigned wm 0 0 (0/0/0) 0

7 unassigned wm 0 0 (0/0/0) 0

10/3/2002 2:46 PM

AVAILABLE DISK SELECTIONS:

0. c0t0d0 <SEAGATE-ST118273WC-6244 cyl 7499 alt 2 hd 20 sec 237>

/pci@1f,0/pci@1/scsi@1,1/sd@0,0

1. c0t3d0 <SEAGATE-ST118273WC-5764 cyl 7499 alt 2 hd 20 sec 237>

/pci@1f,0/pci@1/scsi@1,1/sd@3,0

2. c1t1d0 <AVI-2*70 cyl 17568 alt 2 hd 64 sec 255>

/pci@1f,0/pci@1/scsi@1/sd@1,0

3. c1t1d1 <AVI-2*70 cyl 17568 alt 2 hd 64 sec 255>

/pci@1f,0/pci@1/scsi@1/sd@1,1

4. c1t1d2 <AVI-2*70 cyl 17568 alt 2 hd 64 sec 255>

/pci@1f,0/pci@1/scsi@1/sd@1,2

5. c1t1d3 <AVI-2*70 cyl 17568 alt 2 hd 64 sec 255>

/pci@1f,0/pci@1/scsi@1/sd@1,3

data/0:

Part Tag Flag Cylinders Size Blocks

0 root wm 0 - 20 167.34MB (21/0/0) 342720

1 swap wu 21 - 58 302.81MB (38/0/0) 620160

2 backup wm 0 - 17567 136.71GB (17568/0/0) 286709760

3 unassigned wm 0 0 (0/0/0) 0

4 unassigned wm 0 0 (0/0/0) 0

5 unassigned wm 0 0 (0/0/0) 0

6 usr wm 59 - 164 844.69MB (106/0/0) 1729920

7 home wm 165 - 17567 135.43GB (17403/0/0) 284016960

data/1

Part Tag Flag Cylinders Size Blocks

0 root wm 0 - 17566 136.71GB (17567/0/0) 286693440

1 unassigned wu 0 0 (0/0/0) 0

2 backup wu 0 - 17567 136.71GB (17568/0/0) 286709760

3 unassigned wm 0 0 (0/0/0) 0

4 unassigned wm 0 0 (0/0/0) 0

5 unassigned wm 0 0 (0/0/0) 0

6 unassigned wm 0 0 (0/0/0) 0

7 unassigned wm 0 0 (0/0/0) 0

/data/2

Part Tag Flag Cylinders Size Blocks

0 root wm 0 - 17566 136.71GB (17567/0/0) 286693440

1 unassigned wu 0 0 (0/0/0) 0

2 backup wu 0 - 17567 136.71GB (17568/0/0) 286709760

3 unassigned wm 0 0 (0/0/0) 0

4 unassigned wm 0 0 (0/0/0) 0

5 unassigned wm 0 0 (0/0/0) 0

6 unassigned wm 0 0 (0/0/0) 0

7 unassigned wm 0 0 (0/0/0) 0

/data/3:

Part Tag Flag Cylinders Size Blocks

0 root wm 0 - 17566 136.71GB (17567/0/0) 286693440

1 unassigned wu 0 0 (0/0/0) 0

2 backup wu 0 - 17567 136.71GB (17568/0/0) 286709760

3 unassigned wm 0 0 (0/0/0) 0

4 unassigned wm 0 0 (0/0/0) 0

5 unassigned wm 0 0 (0/0/0) 0

6 unassigned wm 0 0 (0/0/0) 0

7 unassigned wm 0 0 (0/0/0) 0

c0t0d0:

Part Tag Flag Cylinders Size Blocks

0 root wm 222 - 775 1.25GB (554/0/0) 2625960

1 swap wu 0 - 221 513.81MB (222/0/0) 1052280

2 backup wm 0 - 7498 16.95GB (7499/0/0) 35545260

3 unassigned wm 0 0 (0/0/0) 0

4 unassigned wm 0 0 (0/0/0) 0

5 unassigned wm 0 0 (0/0/0) 0

6 unassigned wm 0 0 (0/0/0) 0

7 home wm 776 - 7498 15.20GB (6723/0/0) 31867020

c0t3d0:

Part Tag Flag Cylinders Size Blocks

0 root wm 0 - 55 129.61MB (56/0/0) 265440

1 swap wu 56 - 111 129.61MB (56/0/0) 265440

2 backup wu 0 - 7498 16.95GB (7499/0/0) 35545260

3 unassigned wm 0 0 (0/0/0) 0

4 unassigned wm 0 0 (0/0/0) 0

5 unassigned wm 0 0 (0/0/0) 0

6 usr wm 112 - 7498 16.70GB (7387/0/0) 35014380

7 unassigned wm 0 0 (0/0/0) 0

mount:

/ on /dev/dsk/c0t0d0s0 read/write/setuid/intr/largefiles/onerror=panic/dev=800078 on Wed Oct 2 10:10:57 2002

/proc on /proc read/write/setuid/dev=3e40000 on Wed Oct 2 10:10:57 2002

/dev/fd on fd read/write/setuid/dev=3f00000 on Wed Oct 2 10:10:58 2002

/etc/mnttab on mnttab read/write/setuid/dev=4000000 on Wed Oct 2 10:10:59 2002

/var/run on swap read/write/setuid/dev=1 on Wed Oct 2 10:10:59 2002

/tmp on swap read/write/setuid/dev=2 on Wed Oct 2 10:11:03 2002

/data/0 on /dev/dsk/c1t1d0s7 read/write/setuid/intr/forcedirectio/largefiles/onerror=panic/dev=80000f on Wed Oct 2 10:11:03 2002

/data/1 on /dev/dsk/c1t1d1s0 read/write/setuid/intr/forcedirectio/largefiles/onerror=panic/dev=8000f0 on Wed Oct 2 10:11:03 2002

/export/home on /dev/dsk/c0t0d0s7 read/write/setuid/intr/largefiles/onerror=panic/dev=80007f on Wed Oct 2 10:11:03 2002

/data/2 on /dev/dsk/c1t1d2s0 read/write/setuid/intr/forcedirectio/largefiles/onerror=panic/dev=8000f8 on Wed Oct 2 10:11:03 2002

/data/3 on /dev/dsk/c1t1d3s0 read/write/setuid/intr/forcedirectio/largefiles/onerror=panic/dev=800100 on Wed Oct 2 10:11:03 2002

/mnt/oldvmesparc on /dev/dsk/c1t1d0s0 read only/setuid/intr/largefiles/onerror=panic/dev=800008 on Wed Oct 2 10:11:03 2002

/mnt/phobosx on phobosx:/data/7 remote/read only/setuid/dev=4080001 on Wed Oct 2 10:11:07 2002

Optimizing disk

Prerequisite:

~sukhanov/perf/Bonnias -s 1000 -w -d /data/3

File '/data/3/Bonnie.610', size: 1048576000

Writing intelligently...done

Reporting... -------Sequential Output-------- ---Sequential Input-- --Random--

-Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --Seeks---

Machine MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU /sec %CPU

1000 0 100.0 40207 4.8 0 100.0 0 100.0 0 100.0 0.0 100.0

Sounds too slow, by the way the scsiinfo shows normal:

# /usr/local/bin/scsiinfo-4.7-sunos5.8-32bit -cp

glm0: type 11 (unknown) speed 160MHz

glm0: sd1,0 tgt 1 lun 0:

Synchronous(80.000MB/sec) Clean TaggedQueuing Wide

Non-removable Disk: AVI-S100 AVIstor AVI-S100 0312 [ST]

glm0: sd1,1 tgt 1 lun 1:

Synchronous(80.000MB/sec) Clean TaggedQueuing Wide

Non-removable Disk: AVI-S100 AVIstor AVI-S100 0312 [ST]

glm0: sd1,2 tgt 1 lun 2:

Synchronous(80.000MB/sec) Clean TaggedQueuing Wide

Non-removable Disk: AVI-S100 AVIstor AVI-S100 0312 [ST]

glm0: sd1,3 tgt 1 lun 3:

Synchronous(80.000MB/sec) Clean TaggedQueuing Wide

Non-removable Disk: AVI-S100 AVIstor AVI-S100 0312 [ST]

glm1: type 11 (unknown) speed 160MHz

glm1: sd0,0 tgt 0 lun 0:

Synchronous(40.000MB/sec) Clean TaggedQueuing Wide

Non-removable Disk: SEAGATE ST118273WC 6244 [SLT]

glm1: sd3,0 tgt 3 lun 0:

Synchronous(40.000MB/sec) Clean TaggedQueuing Wide

Non-removable Disk: SEAGATE ST118273WC 5764 [SLT]

Suggestions. Change file system

mkfs -F ufs -o N /dev/rdsk/c1t1d1s2 286709760 255 64 8192 1024 229 1 90 8192 t 0 -1 8 128

mkfs -F ufs -o N /dev/rdsk/c1t1d1s2 286709760 255 64 8192 8192 229 1 90 2097152 s 0 -1 8 128

First effect: deleting files

After rm –rf /data/3

# ~sukhanov/perf/Bonnias -s 1000 -w -d /data/3

File '/data/3/Bonnie.620', size: 1048576000

Writing intelligently...done

Reporting... -------Sequential Output-------- ---Sequential Input-- --Random--

-Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --Seeks---

Machine MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU /sec %CPU

1000 0 100.0 49641 4.5 0 100.0 0 100.0 0 100.0 0.0 100.0

iostat shows: us sy wt id = 0 4 96 0, svc_t %w %b = 15.7 0 94

After disk cleaning the performance increased from 40 to 49 MB/s

After # newfs -f 8192 c1t1d3s2

newfs: /dev/rdsk/c1t1d3s2 last mounted as /data/3

newfs: construct a new file system /dev/rdsk/c1t1d3s2: (y/n)? y

/dev/rdsk/c1t1d3s2: 286709760 sectors in 17568 cylinders of 64 tracks, 255 sectors

139995.0MB in 837 cyl groups (21 c/g, 167.34MB/g, 21120 i/g)

super-block backups (for fsck -F ufs -o b=#) at:

32, 343008, 685984, 1028960, 1371936, 1714912, 2057888, 2400864, 2743840,

3086816, 3429792, 3772768, 4115744, 4458720, 4801696, 5144672, 5487648,

Machine MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU /sec %CPU

1000 0 100.0 44462 5.6 0 100.0 0 100.0 0 100.0 0.0 100.0

Trying maximum nbpi = 20971

# newfs -f 8192 -i 2097152 c1t1d3s2

newfs: /dev/rdsk/c1t1d3s2 last mounted as /data/3

newfs: construct a new file system /dev/rdsk/c1t1d3s2: (y/n)? y

/dev/rdsk/c1t1d3s2: 286709760 sectors in 17568 cylinders of 64 tracks, 255 sectors

139995.0MB in 326 cyl groups (54 c/g, 430.31MB/g, 256 i/g)

super-block backups (for fsck -F ufs -o b=#) at:

32, 881568, 1763104, 2644640, 3526176, 4407712, 5289248, 6170784, 7052320,

Machine MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU /sec %CPU

1000 0 100.0 44200 3.0 0 100.0 0 100.0 0 100.0 0.0 100.0

and again after disk cleaning it gives:

Machine MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU /sec %CPU

1000 0 100.0 51089 6.1 0 100.0 0 100.0 0 100.0 0.0 100.0

Checking default newfs setting

The same effect, after remounting 44297 MB/s with 4% cpu

After rm –rf /data/3 51115 MB/s at 2.4 % CPU

newfs: /dev/rdsk/c1t1d3s2 last mounted as /data/3

newfs: construct a new file system /dev/rdsk/c1t1d3s2: (y/n)? y

mkfs -F ufs /dev/rdsk/c1t1d3s2 286709760 255 64 8192 8192 229 1 90 2097152 t 0 -1 8 128

/dev/rdsk/c1t1d3s2: 286709760 sectors in 17568 cylinders of 64 tracks, 255 sectors

139995.0MB in 326 cyl groups (54 c/g, 430.31MB/g, 256 i/g)

super-block backups (for fsck -F ufs -o b=#) at:

32, 881568, 1763104, 2644640, 3526176, 4407712, 5289248, 6170784, 7052320,

Machine MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU /sec %CPU

1000 0 100.0 49352 6.1 0 100.0 0 100.0 0 100.0 0.0 100.0

It seems that the best setting is :

# newfs -f 8192 -i 2097152 -v c1t1d2s2

newfs: /dev/rdsk/c1t1d2s2 last mounted as /data/2

newfs: construct a new file system /dev/rdsk/c1t1d2s2: (y/n)? y

mkfs -F ufs /dev/rdsk/c1t1d2s2 286709760 255 64 8192 8192 229 1 90 2097152 t 0 -1 8 128

/dev/rdsk/c1t1d2s2: 286709760 sectors in 17568 cylinders of 64 tracks, 255 sectors

139995.0MB in 326 cyl groups (54 c/g, 430.31MB/g, 256 i/g)

super-block backups (for fsck -F ufs -o b=#) at:

32, 881568, 1763104, 2644640, 3526176, 4407712, 5289248, 6170784, 7052320,

Reading on phobosx:

find /data/2 -exec /data/7/share/tools/benchmarks/bonnie/Bonnias -r {} \;

File '/data/2', size: 104857600

Reading intelligently...done

Reporting... -------Sequential Output-------- ---Sequential Input-- --Random--

-Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --Seeks---

Machine MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU /sec %CPU

100 0 100.0 0 100.0 0 100.0 0 100.0 28827 35.4 0.0 100.0

File '/data/2/Bonnie.412', size: 104857600

device r/s w/s Mr/s Mw/s wait actv svc_t %w %b us sy wt id

sd0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0 14 0 86

sd6 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0

sd14 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0

sd16         0.0    0.0    0.0    0.0  0.0  0.0    0.0   0   0

sd37 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0

sd38 33.4 0.0 28.5 0.0 0.0 1.7 50.0 0 100

sd39 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0

nfs1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0

Reading on usp

find /data/2 -exec ~sukhanov/perf/Bonnias -r {} \;

File '/data/2/Bonnie.411', size: 104857600

Reading intelligently...done

Reporting... -------Sequential Output-------- ---Sequential Input-- --Random--

-Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --Seeks---

Machine MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU /sec %CPU

100 0 100.0 0 100.0 0 100.0 0 100.0 58875 0.6 0.0 100.0

File '/data/2/Bonnie.412', size: 104857600

Simultaneous writing and reading

~sukhanov/perf/Bonnias -s 1000 -w -d /data/3

File '/data/3/Bonnie.477', size: 1048576000

Writing intelligently...done

Reporting... -------Sequential Output-------- ---Sequential Input-- --Random--

-Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --Seeks---

Machine MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU /sec %CPU

1000 0 100.0 37243 3.9 0 100.0 0 100.0 0 100.0 0.0 10

device r/s w/s Mr/s Mw/s wait actv svc_t %w %b us sy wt id

sd1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0 4 96 0

sd15 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0

sd18 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0

sd30 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0

sd31 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0

sd32 2.2 46.0 0.0 35.0 0.0 1.0 21.1 0 96

nfs1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0

nfs2 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0

File '/data/2/Bonnie.419', size: 104857600

Reading intelligently...done

Reporting... -------Sequential Output-------- ---Sequential Input-- --Random--

-Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --Seeks---

Machine MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU /sec %CPU

100 0 100.0 0 100.0 0 100.0 0 100.0 28361 36.1 0.0 100.0

device r/s w/s Mr/s Mw/s wait actv svc_t %w %b us sy wt id

sd0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0 14 0 86

sd38 32.2 0.0 27.0 0.0 0.0 1.7 52.5 0 99

10/7/2002 4:55. Raw writing

Wrote a program for writing sequential files: seqio.c. It shows the similar results when used with normal files:

a.out -d /data/3/seqio.dat -s 1500 –w

When used with raw disk and data chunk of 1 MB:

./a.out -d /dev/rdsk/c1t1d3s0 -s 140000 –w

It shows almost constant writing speed of 51 MB/s, which slightly drops (to 45 MB/s) when disk is 95% full. The CPU usage is negligible 0.3%.

extended device statistics cpu

device r/s w/s Mr/s Mw/s wait actv svc_t %w %b us sy wt id

sd1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0 0 100 0

sd32 0.0 51.4 0.0 51.4 0.0 1.0 19.4 0 100

Conclusion 10/07/02

Using bonnie test program it is possible:
Write from usp to disk 3 at 40 MB/s (4% CPU usage)
And simultaneously read from disk 2 to phobosx at 28 MB/s (34 % CPU usage)
The optimal file system parameters are :
newfs -f 8192 -i 2097152 -v c1t1d2s2
mkfs -F ufs /dev/rdsk/c1t1d2s2 286709760 255 64 8192 8192 229 1 90 2097152 t 0 -1 8 128
/dev/rdsk/c1t1d2s2: 286709760 sectors in 17568 cylinders of 64 tracks, 255 sectors
139995.0MB in 326 cyl groups (54 c/g, 430.31MB/g, 256 i/g)
super-block backups (for fsck -F ufs -o b=#) at:
32, 881568, 1763104, 2644640, 3526176, 4407712, 5289248, 6170784, 7052320,
Additional configuration:
in /etc/system:
set maxphys=0x00800000
set ufs:ufs_WRITES=0
in /etc/vfstab: forcedirectio for all data disks
The sustained writing performance on usp is 42-50 MB/s (4% CPU usage)
Using raw disk writing the speed is constant, 51 MB/s and CPU usage negligible (0.3%)
That can be explained by aligned data transfers.

10/8/2002 11:05. Notes about multi-host disk IO

1) On usp: open(name,O_RDWR), write(). On phobosx: mount, od -x -N 1024 -j 1048576 /data/3/Bonnie.982
works OK.

2) If I rewrite the file on usp using the same procedure then od on usp differs from od on phobosx. Usp shows correct results phobosx – not correct.

3) Dumping of raw disk area where the file is located shows the same data on both hosts

Summary: Rewriting the file changes the file allocation.

1/27/2003 9:51. Problem: Degradation of the writing performance on phobosx

DAQ writing speed dropped from 14-18 MB/s to 10 MB/s.

‘iostat –xMc 5 ‘ shows 100 % disk busy at 10 MB/s

Messages on phobosx console:

phobosx console login: Jan 24 11:14:12 phobosx scsi: WARNING: /sbus@2,0/QLGC,isp

@1,10000 (isp0):

Jan 24 11:14:12 phobosx Target 1 reducing transfer rate

Jan 24 11:14:12 phobosx scsi: WARNING: /sbus@2,0/QLGC,isp@1,10000 (isp0):

Jan 24 11:14:12 phobosx Parity Error

Jan 25 11:04:54 phobosx scsi: WARNING: /sbus@2,0/QLGC,isp@1,10000 (isp0):

Jan 25 11:04:54 phobosx Target 1 reducing transfer rate

Jan 25 11:04:54 phobosx scsi: WARNING: /sbus@2,0/QLGC,isp@1,10000 (isp0):

Jan 25 11:04:54 phobosx Parity Error

Jan 25 11:04:54 phobosx scsi: WARNING: /sbus@2,0/QLGC,isp@1,10000 (isp0):

Jan 25 11:04:54 phobosx Target 1 disabled wide SCSI mode

syslogd: /var/log/tcpdlog: No such file or directory

Jan 26 23:05:46 phobosx su: 'su root' failed for phobos on /dev/pts/5

Jan 26 23:06:03 phobosx su: 'su root' succeeded for phobos on /dev/pts/5

Jan 27 09:30:16 phobosx su: 'su root' succeeded for sukhanov on /dev/pts/3

/usr/local/bin/scsiinfo32 -cp

/usr/local/bin/scsiinfo32: WARNING: compiled for SunOS 5.7; this is SunOS 5.8. Results may be incorrect.

isp0: QLGC ISP 1000 firmware revision 293.5

isp0: sd1,0 tgt 1 lun 0:

Synchronous(10.000MB/sec[AS1] ) Unknown CanReconnect TaggedQueuing Narrow

Non-removable Disk: AVI-S100 AVIstor AVI-S100 0312 [ST]

isp0: sd1,1 tgt 1 lun 1:

Synchronous(10.000MB/sec) Unknown CanReconnect TaggedQueuing Narrow

Non-removable Disk: AVI-S100 AVIstor AVI-S100 0312 [ST]

isp0: sd1,2 tgt 1 lun 2:

Synchronous(10.000MB/sec) Unknown CanReconnect TaggedQueuing Narrow

Non-removable Disk: AVI-S100 AVIstor AVI-S100 0312 [ST]

isp0: sd1,3 tgt 1 lun 3:

Synchronous(10.000MB/sec) Unknown CanReconnect TaggedQueuing Narrow

Non-removable Disk: AVI-S100 AVIstor AVI-S100 0312 [ST]

fas0: type 0 (FAS366) speed 40MHz

fas0: sd0,0 tgt 0 lun 0:

Synchronous(20.000MB/sec) Clean TaggedQueuing Wide

Non-removable Disk: SEAGATE ST34371W SUN4.2G 7462 [SLT]

fas0: sd6,0 tgt 6 lun 0:

Synchronous(10.000MB/sec) Clean NoTaggedQueuing Narrow

<<< SCSI probe failed: device is busy >>>

fas0: sdf,0 tgt 15 lun 0:

Synchronous(20.000MB/sec) Clean TaggedQueuing Wide

Non-removable Disk: SEAGATE ST318436LC 0010 [SLT]

On usp everything is fine:

4.7-sunos5.8-32bit -cp

glm0: type 11 (unknown) speed 160MHz

glm0: sd1,0 tgt 1 lun 0:

Synchronous(80.000MB/sec) Clean TaggedQueuing Wide

Non-removable Disk: AVI-S100 AVIstor AVI-S100 0312 [ST]

glm0: sd1,1 tgt 1 lun 1:

Synchronous(80.000MB/sec) Clean TaggedQueuing Wide

Non-removable Disk: AVI-S100 AVIstor AVI-S100 0312 [ST]

glm0: sd1,2 tgt 1 lun 2:

Synchronous(80.000MB/sec) Clean TaggedQueuing Wide

Non-removable Disk: AVI-S100 AVIstor AVI-S100 0312 [ST]

glm0: sd1,3 tgt 1 lun 3:

Synchronous(80.000MB/sec) Clean TaggedQueuing Wide

Non-removable Disk: AVI-S100 AVIstor AVI-S100 0312 [ST]

glm1: type 11 (unknown) speed 160MHz

glm1: sd0,0 tgt 0 lun 0:

Synchronous(40.000MB/sec) Clean TaggedQueuing Wide

Non-removable Disk: SEAGATE ST118273WC 6244 [SLT]

glm1: sd3,0 tgt 3 lun 0:

Synchronous(40.000MB/sec) Clean TaggedQueuing Wide

Non-removable Disk: SEAGATE ST118273WC 5764 [SLT]

Solution:

Reboot the phobosx.

After rebooting the reading rate at phobosx become 28 MB/s on disks 1,2,3 and 25 MB/s on disk0

1/29/2003 10:31. Slow reading of the data/0 from phobosx

The data/0 have been cleaned up. The performance:

#usp:~sukhanov/perf/Bonnias_100k -s 1000 -w -d /data/0

File '/data/0/Bonnie.2280', size: 1048576000

Writing intelligently...done

Reporting... -------Sequential Output-------- ---Sequential Input--

--Random--

-Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --Seeks---

Machine MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU /sec %CPU

1000 0 100.0 38380 6.0 0 100.0 0 100.0 0 100.0 0.0 10

0.0

# usp:~sukhanov/perf/Bonnias_100k -s 1000 -w -d /data/1

File '/data/1/Bonnie.2284', size: 1048576000

Writing intelligently...done

Reporting... -------Sequential Output-------- ---Sequential Input--

--Random--

-Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --Seeks---

Machine MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU /sec %CPU

1000 0 100.0 37549 5.5 0 100.0 0 100.0 0 100.0 0.0 10

0.0

# find /data/0/Bonnie.2280 -exec ~sukhanov/perf/Bonnias_100k -r {} \;

File '/data/0/Bonnie.2280', size: 104857600

Reading intelligently...done

Reporting... -------Sequential Output-------- ---Sequential Input--

--Random--

-Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --Seeks---

Machine MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU /sec %CPU

100 0 100.0 0 100.0 0 100.0 0 100.0 43776 2.4 0.0 10

0.0

Readout on usp is good = 43776 MB/s.

sukhanov@phobosx:/data/7/share/DAQ/dqin/src.MCOS > find /data/0/Bonnie.2280 -exec /data/7/share/tools/benchmarks/bonnie/Bonnias -r {} \;

File '/data/0/Bonnie.2280', size: 104857600

Reading intelligently...done

Reporting... -------Sequential Output-------- ---Sequential Input-- --Random--

-Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --Seeks---

Machine MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU /sec %CPU

100 0 100.0 0 100.0 0 100.0 0 100.0 26046 33.8 0.0 100.0

sukhanov@phobosx:/data/7/share/DAQ/dqin/src.MCOS > find /data/1/Bonnie.2284 -exec /data/7/share/tools/benchmarks/bonnie/Bonnias -r {} \;

File '/data/1/Bonnie.2284', size: 104857600

Reading intelligently...done

Reporting... -------Sequential Output-------- ---Sequential Input-- --Random--

-Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --Seeks---

Machine MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU /sec %CPU

100 0 100.0 0 100.0 0 100.0 0 100.0 28785 36.2 0.0 100.0

After changing partitions newfs -f 8192 -i 2097152 -v c1t1d0s0:

# ~sukhanov/perf/Bonnias_100k -s 1000 -w -d /data/0

File '/data/0/Bonnie.2400', size: 1048576000

Writing intelligently...done

Reporting... -------Sequential Output-------- ---Sequential Input--

--Random--

-Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --Seeks---

Machine MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU /sec %CPU

1000 0 100.0 37345 5.9 0 100.0 0 100.0 0 100.0 0.0 10

0.0

# find /data/0/Bonnie.2400 -exec ~sukhanov/perf/Bonnias_100k -r {} \;

File '/data/0/Bonnie.2400', size: 104857600

Reading intelligently...done

Reporting... -------Sequential Output-------- ---Sequential Input--

--Random--

-Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --Seeks---

Machine MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU /sec %CPU

100 0 100.0 0 100.0 0 100.0 0 100.0 44834 2.6 0.0 10

0.0

sukhanov@phobosx:/data/7/share/DAQ/dqin/src.MCOS # find /data/0/Bonnie.2400 -exec /data/7/share/tools/benchmarks/bonnie/Bonnias -r {} \;

File '/data/0/Bonnie.2400', size: 104857600

Reading intelligently...done

Reporting... -------Sequential Output-------- ---Sequential Input-- --Random--

-Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --Seeks---

Machine MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU /sec %CPU

100 0 100.0 0 100.0 0 100.0 0 100.0 28819 37.8 0.0 100.0

Summary: After changing partition map and making new file system the reading performance of the phobosx increased from 26.0 to 28.8 MB/s