Bonnie testing

From Codawiki

sitcmo

bonnie -d /coda/schnecke.lan.aulinx.de/gabriel/test/ -s 0.1 -n 1 -r 252 -u root

venus crash #1:



after restart in venus.err:
15:07:42 starting FSDB scan (250000, 6000000) (25, 75, 4)
15:07:46        (Bonnie.1935.000, 6f558048.7f000001.4b28.ad7a) found owrite object, discarding
15:10:12        (lost file data backed up to /var/lib/coda/spool/Bonnie.1935.000-0)
15:10:19        4546 cache files in table (2985890 blocks)
15:10:39        245454 cache files on free-list
15:10:39 starting HDB scan
15:10:39        0 hdb entries in table
15:10:39        0 hdb entries on free-list
15:10:39 Mounting root volume...
15:10:40 Venus starting...
15:10:40 /coda now mounted.

15:11:02 fatal error -- fsobj::dir_Lookup: (schnecke.lan.aulinx.de) no data
15:11:03 RecovTerminate: clean shutdown
Assertion failed: 0, file "fso_dir.cc", line 174
Sleeping forever.  You may use gdb to attach to process 1991

(gdb) where
#0  0x402054fb in nanosleep () from /lib/tls/libc.so.6
#1  0x40205358 in sleep () from /lib/tls/libc.so.6
#2  0x080eb7cc in coda_assert (pred=0xfffffdfc <Address 0xfffffdfc out of bounds>, file=0xfffffdfc <Address 0xfffffdfc out of bounds>, line=-516) at coda_assert.c:46
#3  0x0809a851 in choke (file=0xfffffdfc <Address 0xfffffdfc out of bounds>, line=-516, fmt=0xfffffdfc <Address 0xfffffdfc out of bounds>) at venusutil.cc:210
#4  0x0807753a in fsobj::dir_Lookup (this=0x75b67a48, Name=0x816f114 "schnecke.lan.aulinx.de", Fid=0x151afcc8, flags=-516) at fso_dir.cc:174
#5  0x08076190 in fsobj::Lookup (this=0x75b67a48, target_fso_addr=0x151afd30, inc_fid=0x151afd38, name=0x816f114 "schnecke.lan.aulinx.de", uid=0, flags=-516)
    at fso_cfscalls2.cc:507
#6  0x080c2021 in vproc::lookup (this=0x816dc40, dcp=0x151af96c, name=0x816f114 "schnecke.lan.aulinx.de", cp=0x151b1e18, flags=1) at vproc_vfscalls.cc:597
#7  0x080c7544 in worker::main (this=0x816dc40) at worker.cc:1271
#8  0x080bb516 in VprocPreamble (init_lock=0xfffffdfc) at vproc.cc:146
#9  0x4005b476 in Create_Process_Part2 () at lwp.c:796
#10 0x4005c303 in L1 () at process.S:455

next restart:
Date: Fri 06/25/2004

15:16:07 Coda Venus, version 6.0.6

15:16:07 SigInit: setpgid failed (1)
15:16:07 /var/lib/coda/LOG size is 159689728 bytes
15:16:07 /var/lib/coda/DATA size is 638753904 bytes
15:16:07 Loading RVM data
15:16:07 Last init was Wed Jun 23 13:04:54 2004
15:16:07 Last shutdown was clean
15:16:07 Starting RealmDB scan
15:16:07        Found 2 realms
15:16:07 starting VDB scan
15:16:07        4 volume replicas
15:16:07        2 replicated volumes
15:16:07        0 CML entries allocated
15:16:07        0 CML entries on free-list
15:16:07 starting FSDB scan (250000, 6000000) (25, 75, 4)
15:16:09        4545 cache files in table (2985890 blocks)
15:16:10        245455 cache files on free-list
15:16:10 starting HDB scan
15:16:10        0 hdb entries in table
15:16:10        0 hdb entries on free-list
15:16:10 Mounting root volume...
15:16:10 Venus starting...
15:16:10 /coda now mounted.

15:17:08 Fatal Signal (11); pid 2032 becoming a zombie...
15:17:08 You may use gdb to attach to 2032

(gdb) where
#0  0x401822a6 in sigsuspend () from /lib/tls/libc.so.6
#1  0x080c8738 in SigChoke (sig=354089116) at sighand.cc:241
#2  <signal handler called>
#3  0x0807509e in fsobj::Open (this=0x75b67a48, writep=0, execp=0, truncp=0, cp=0x151b1e18, uid=0) at fso.h:686
#4  0x080c1018 in vproc::open (this=0x816d6c0, cp=0x151b1e18, flags=1974893128) at vproc_vfscalls.cc:223
#5  0x080c6f03 in worker::main (this=0x816d6c0) at worker.cc:1327
#6  0x080bb516 in VprocPreamble (init_lock=0x0) at vproc.cc:146
#7  0x4005b476 in Create_Process_Part2 () at lwp.c:796
#8  0x4005c303 in L1 () at process.S:455

next one:
(gdb) where
#0  0x401822a6 in sigsuspend () from /lib/tls/libc.so.6
#1  0x080c8738 in SigChoke (sig=354089116) at sighand.cc:241
#2  <signal handler called>
#3  0x0807509e in fsobj::Open (this=0x75b67a48, writep=0, execp=0, truncp=0, cp=0x151b1e18, uid=0) at fso.h:686
#4  0x080c1018 in vproc::open (this=0x816d698, cp=0x151b1e18, flags=1974893128) at vproc_vfscalls.cc:223
#5  0x080c6f03 in worker::main (this=0x816d698) at worker.cc:1327
#6  0x080bb516 in VprocPreamble (init_lock=0x0) at vproc.cc:146
#7  0x4005b476 in Create_Process_Part2 () at lwp.c:796
#8  0x4005c303 in L1 () at process.S:455

venus -init; 
Date: Fri 06/25/2004

15:20:18 Coda Venus, version 6.0.6

15:20:18 /var/lib/coda/LOG size is 159688476 bytes
15:20:18 /var/lib/coda/DATA size is 638753904 bytes
15:20:18 Initializing RVM data...
15:20:18 ...done
15:20:18 Loading RVM data
15:20:18 Starting RealmDB scan
15:20:18        Found 1 realms
15:20:18 starting VDB scan
15:20:18        0 volume replicas
15:20:18        0 replicated volumes
15:20:19        0 CML entries allocated
15:20:19        0 CML entries on free-list
15:20:37 starting FSDB scan (250000, 6000000) (25, 75, 4)
15:20:37        0 cache files in table (0 blocks)
15:20:39        250000 cache files on free-list
15:21:22 starting HDB scan
15:21:22        0 hdb entries in table
15:21:22        0 hdb entries on free-list
15:21:22 Initial LRDB allocation
15:21:22 Mounting root volume...
15:21:23 Venus starting...
15:21:23 /coda now mounted.

/etc/init.d/coda-client restart;

bonnie -d /coda/schnecke.lan.aulinx.de/gabriel/test/ -s 0.1 -n 10 -r 252 -u root

vmstat 1 on server:
0  0      0  53940   6308 124232    0    0     0     0 1006    33  0  0 100  0
 0  0      0  53940   6308 124232    0    0     0     0 1004    29  0  0 100  0
 0  1      0  53940   6308 124232    0    0     0   200 1008    24  1  0 98  1
procs -----------memory---------- ---swap-- -----io---- --system-- ----cpu----
 r  b   swpd   free   buff  cache   si   so    bi    bo   in    cs us sy id wa
 1  0      0  53932   6308 124232    0    0     0  2968 1712  1206  7 10 71 12
 0  0      0  53932   6316 124232    0    0     4  3726 2055  1789 12 17 42 30
 0  1      0  53932   6316 124232    0    0     0  4085 1956  1618 12 15 39 34
 0  0      0  53932   6316 124232    0    0     0  3844 1762  1317 11 12 37 39
 0  1      0  53932   6316 124232    0    0     0  4490 1830  1411 12 13 48 28
 0  1      0  53932   6316 124232    0    0     0  6419 2037  1764 13 21 32 35
 0  0      0  53932   6316 124232    0    0     0  5698 1828  1430 12 16 30 42
 0  1      0  53932   6316 124232    0    0     0  6163 1837  1392 12 15 41 32
 0  1      0  53932   6316 124244    0    0     0  5857 1680  1215 10 16 24 49
 0  1      0  53932   6316 124244    0    0     0  6916 1739  1305 13 21 26 40
 0  1      0  53932   6316 124244    0    0     0  5625 1535   990  8 15 21 56
 0  1      0  53932   6316 124244    0    0     0  7707 1723  1259 13 19 33 35
 0  1      0  53932   6316 124244    0    0     0  5044 1411   781  8 15 22 55
 0  0      0  53868   6324 124244    0    0     0  8738 1768  1352 13 22 26 39
 0  1      0  53804   6324 124244    0    0     0  7045 1568  1012 11 21 16 52
 0  1      0  53740   6324 124244    0    0     0  9024 1759  1307 15 19 24 42
 0  0      0  53676   6340 124244    0    0    16  6997 1535  1246 11 17 45 27
 0  1      0  53612   6356 124252    0    0    24  8311 1683  1344 12 19 36 32
 0  0      0  53548   6388 124260    0    0    36 10867 1633  1471 14 24 20 42
 0  1      0  53484   6396 124264    0    0    12 10911 1599  1082 13 24 17 46
 0  1      0  53420   6404 124272    0    0    16 12311 1725  1516 12 25 15 47
 0  1      0  53356   6444 124280    0    0    40 11557 1672  1261 12 25 17 46
 0  1      0  53356   6460 124284    0    0    16 10945 1536  1031 12 24 17 47
 0  1      0  53292   6468 124288    0    0    12 10635 1550   980 10 23 16 50
 0  1      0  52948   6492 124296    0    0    16 11234 1574  1047 14 23 16 46
 0  1      0  52948   6520 124300    0    0    28 12766 1642  1093 12 25 21 43
 0  1      0  52948   6536 124304    0    0    20 10213 1463   911 11 21 17 51
 0  1      0  52948   6572 124312    0    0    44 11499 1583   999 12 23 28 37
 0  1      0  52884   6580 124316    0    0    12 12101 1544  1287 14 25 19 42

vmstat 1 on client:
procs -----------memory---------- ---swap-- -----io---- --system-- ----cpu----
 r  b   swpd   free   buff  cache   si   so    bi    bo   in    cs us sy id wa
 3  0 251416 181716   4560 155760    6   24   246   276 3678   705 20  6 71  3
 0  0 251416 181452   4560 156392   32    0    32  1572 1168   563 29 12 51  8
 0  0 251416 181196   4572 156400    0    0    12    12 1539   952 27  8 65  0
 2  0 251416 181132   4572 156404    0    0     0   105 1424   470 22  6 72  0
 1  0 251416 180940   4572 156412    0    0     0    40 1096   406 18  7 75  0
 0  0 251416 180748   4580 156420   64    0    72    32 1115   456 20  7 73  0
 0  0 251416 180492   4588 156752    0    0     8   436 1104   429 20  7 71  2
 0  0 251416 180300   4588 156760    0    0     0    81 1103   486 19  6 75  0
 0  0 251416 180300   4608 156768    0    0    20   137 1106   416 19  4 77  0
 0  0 251416 179660   4616 156896    0    0     8    44 1101   449 26  9 65  0
 0  0 251416 179532   4616 156904  128    0   128    32 1159   507 19  6 73  2
 0  0 251416 179276   4624 157476    0    0     8  1785 1565   751 27 14 52  7

Using uid:0, gid:0.
Create files in sequential order...Can't create file 00061264pS1
Cleaning up test directory after error.

...hmmmm

bonnie -d /coda/schnecke.lan.aulinx.de/gabriel/test/ -s 0.1 -n 1 -r 252 -u root
Using uid:0, gid:0.
Create files in sequential order...done.
Stat files in sequential order...done.
Delete files in sequential order...done.
Create files in random order...done.
Stat files in random order...done.
Delete files in random order...done.
Version  1.03       ------Sequential Create------ --------Random Create--------
venus               -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
              files  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP
                  1    53   0 +++++ +++    63   0    60   0 +++++ +++    68   0
venus,,,,,,,,,,,,,,1,53,0,+++++,+++,63,0,60,0,+++++,+++,68,0

same thing using nfs:

bonnie -d /mnt/hdd/tmp/perf/ -s 0.1 -n 1 -r 252 -u root
Using uid:0, gid:0.
Create files in sequential order...done.
Stat files in sequential order...done.
Delete files in sequential order...done.
Create files in random order...done.
Stat files in random order...done.
Delete files in random order...done.
Version  1.03       ------Sequential Create------ --------Random Create--------
venus               -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
              files  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP
                  1   562  13   703  58   523  11   582  14  1777   5   639  11
venus,,,,,,,,,,,,,,1,562,13,703,58,523,11,582,14,1777,5,639,11