2020-03-29T00:42:11.160695+01:00
WARNING: Read Failed. group:3 disk:1 AU:29 offset:0 size:4096
path:ORCL:DISK02
         incarnation:0xf0f0c113 synchronous result:'I/O error'
         subsys:/opt/oracle/extapi/64/asm/orcl/1/libasm.so krq:0x7f3df8db35b8 bufp:0x7f3df8c9c000 osderr1:0x3 osderr2:0x2e
         IO elapsed time: 0 usec Time waited on I/O: 0 usec
WARNING: cache failed reading from group=3(DATA) fn=8 blk=0 count=1 from disk=1 (DISK02) mirror=0 kfkist=0x20 status=0x02 osderr=0x3 file=kfc.c line=13317
WARNING: cache succeeded reading from group=3(DATA) fn=8 blk=0 count=1 from disk=5 (DISK06) mirror=1 kfkist=0x20 status=0x01 osderr=0x0 file=kfc.c line=13366
2020-03-29T00:42:11.195831+01:00
NOTE: repairing extent 0 of file 8 group 3
2020-03-29T00:42:11.196704+01:00
WARNING: Read Failed. group:3 disk:1 AU:29 offset:245760 size:4096
path:ORCL:DISK02
         incarnation:0xf0f0c113 synchronous result:'I/O error'
         subsys:/opt/oracle/extapi/64/asm/orcl/1/libasm.so krq:0x7f3df8db35b8 bufp:0x7f3df8c9c000 osderr1:0x3 osderr2:0x2e
         IO elapsed time: 0 usec Time waited on I/O: 0 usec
WARNING: cache failed reading from group=3(DATA) fn=8 blk=60 count=1 from disk=1 (DISK02) mirror=0 kfkist=0x20 status=0x02 osderr=0x3 file=kfc.c line=13317
2020-03-29T00:42:11.208704+01:00
Errors in file /u01/app/grid/diag/asm/+asm/+ASM1/trace/+ASM1_r000_28111.trc:
2020-03-29T00:42:11.208777+01:00
WARNING: Read Failed. group:3 disk:1 AU:0 offset:0 size:4096
path:ORCL:DISK02
         incarnation:0xf0f0c113 synchronous result:'I/O error'
         subsys:/opt/oracle/extapi/64/asm/orcl/1/libasm.so krq:0x7f10d7f19aa0 bufp:0x7f10d33ef000 osderr1:0x3 osderr2:0x2e
         IO elapsed time: 0 usec Time waited on I/O: 0 usec
WARNING: block repair initiating disk offline
NOTE: process _r000_+asm1 (28111) initiating offline of disk 1.4042309907 (DISK02) with mask 0x7e in group 3 (DATA) without client assisting
NOTE: checking PST: grp = 3
2020-03-29T00:42:11.210759+01:00
WARNING: cache succeeded reading from group=3(DATA) fn=8 blk=60 count=1 from disk=5 (DISK06) mirror=1 kfkist=0x20 status=0x01 osderr=0x0 file=kfc.c line=13366
NOTE: Suppressing further IO Read errors on group:3 disk:1
WARNING: Read Failed. group:3 disk:1 AU:29 offset:491520 size:4096
path:ORCL:DISK02
         incarnation:0xf0f0c113 synchronous result:'I/O error'
         subsys:/opt/oracle/extapi/64/asm/orcl/1/libasm.so krq:0x7f3df8db35b8 bufp:0x7f3df8c9c000 osderr1:0x3 osderr2:0x2e
         IO elapsed time: 0 usec Time waited on I/O: 0 usec
WARNING: cache failed reading from group=3(DATA) fn=8 blk=120 count=1 from disk=1 (DISK02) mirror=0 kfkist=0x20 status=0x02 osderr=0x3 file=kfc.c line=13317
WARNING: cache succeeded reading from group=3(DATA) fn=8 blk=120 count=1 from disk=5 (DISK06) mirror=1 kfkist=0x20 status=0x01 osderr=0x0 file=kfc.c line=13366
WARNING: cache failed reading from group=3(DATA) fn=8 blk=180 count=1 from disk=1 (DISK02) mirror=0 kfkist=0x20 status=0x02 osderr=0x3 file=kfc.c line=13317
WARNING: cache succeeded reading from group=3(DATA) fn=8 blk=180 count=1 from disk=5 (DISK06) mirror=1 kfkist=0x20 status=0x01 osderr=0x0 file=kfc.c line=13366
WARNING: cache failed reading from group=3(DATA) fn=8 blk=240 count=1 from disk=1 (DISK02) mirror=0 kfkist=0x20 status=0x02 osderr=0x3 file=kfc.c line=13317
WARNING: cache succeeded reading from group=3(DATA) fn=8 blk=240 count=1 from disk=5 (DISK06) mirror=1 kfkist=0x20 status=0x01 osderr=0x0 file=kfc.c line=13366
2020-03-29T00:42:11.232714+01:00
GMON checking disk modes for group 3 at 97 for pid 45, osid 28111
2020-03-29T00:42:11.233380+01:00
NOTE: checking PST for grp 3 done.
2020-03-29T00:42:11.233439+01:00
NOTE: sending set offline flag message (2572100964) to 1 disk(s) in group 3
2020-03-29T00:42:11.233801+01:00
WARNING: Disk 1 (DISK02) in group 3 mode 0x7f is now being offlined
2020-03-29T00:42:11.236461+01:00
NOTE: initiating PST update: grp 3 (DATA), dsk = 1/0xf0f0c113, mask = 0x6a, op = clear mandatory
2020-03-29T00:42:11.236636+01:00
GMON updating disk modes for group 3 at 98 for pid 45, osid 28111
2020-03-29T00:42:11.244528+01:00
NOTE: PST update grp = 3 completed successfully
NOTE: initiating PST update: grp 3 (DATA), dsk = 1/0xf0f0c113, mask = 0x7e, op = clear mandatory
2020-03-29T00:42:11.245801+01:00
GMON updating disk modes for group 3 at 99 for pid 45, osid 28111
2020-03-29T00:42:11.249605+01:00
NOTE: cache closing disk 1 of grp 3: DISK02
2020-03-29T00:42:11.251988+01:00
NOTE: cache closing disk 1 of grp 3: (not open) DISK02
2020-03-29T00:42:11.252245+01:00
NOTE: PST update grp = 3 completed successfully
SUCCESS: extent 0 of file 8 group 3 - all online mirror sides found readable, no repair required
NOTE: repairing extent 0 of file 8 group 3
SUCCESS: extent 0 of file 8 group 3 - all online mirror sides found readable, no repair required
NOTE: repairing extent 0 of file 8 group 3
SUCCESS: extent 0 of file 8 group 3 - all online mirror sides found readable, no repair required
NOTE: repairing extent 0 of file 8 group 3
SUCCESS: extent 0 of file 8 group 3 - all online mirror sides found readable, no repair required
NOTE: repairing extent 0 of file 8 group 3
SUCCESS: extent 0 of file 8 group 3 - all online mirror sides found readable, no repair required
2020-03-29T00:42:14.310289+01:00
WARNING: Started Drop Disk Timeout for Disk 1 (DISK02) in group 3 with a value 43200
WARNING: Disk 1 (DISK02) in group 3 will be dropped in: (43200) secs on ASM inst 1
cluster guid (e4db41a22bd95fc6bf79d2e2c93360c7) generated for PST Hbeat for instance 1