3par 7200 upgradecage cage0 failed, journal commit I/O error, and 12 disks are degraded

[louisji2008]

now the 12 disks led are all off, and two vv are in preserved state.

how to resolve this issue?

cli% upgradecage cage0
Upgrading cage cage0 cpuA from rev 321c to revision in file /opt/tpd/fw/cage/ebod/hp_eos_canister_local_combined_v
Upgrading cage cage0 cpuB from rev 321c to revision in file /opt/tpd/fw/cage/ebod/hp_eos_canister_local_combined_v
[87019094.379213] journal commit I/O error
[87019094.379369] journal commit I/O error

Message from syslogd@UNKNOWN at Fri Dec 17 15:29:02 2021 ...
UNKNOWN
Message from syslogd@UNKNOWN at Fri Dec 17 15:29:02 2021 ...
UNKNOWN kernel: [87019094.379369] journal commit I/O error
kernel: [87019094.379213] journal commit I/O error
Beginning test after upgrade for cage0
Test after upgrade failed:
pdid 12 state must be "valid" or "degraded" not "missing"
3par_youxin cli% showpd -c
                                 --------- Normal Chunklets ---------- ---- Spare Chunklets ----
                                 -- Used --- -------- Unused --------- - Used - ---- Unused ----
 Id CagePos Type State     Total     OK Fail  Free Uninit Unavail Fail  OK Fail Free Uninit Fail
  0 0:0:0   FC   normal      819    771    0    13      0       0    0   2    0   33      0    0
  1 0:1:0   FC   normal      819    776    0     8      0       0    0   1    0   34      0    0
  2 0:2:0   FC   normal      819    775    1     8      0       0    0   0    0   35      0    0
  3 0:3:0   FC   normal      819    775    0     9      0       0    0   3    0   32      0    0
  4 0:4:0   FC   normal      819    775    1     8      0       0    0   0    0   35      0    0
  5 0:5:0   FC   normal      819    777    0     7      0       0    0   0    0   35      0    0
  6 0:6:0   FC   normal      819    774    1    10      0       0    0   1    0   33      0    0
  7 0:7:0   FC   normal      819    776    0     9      0       0    0   2    0   32      0    0
  8 0:8:0   FC   normal      819    775    0    10      0       0    0   0    0   34      0    0
  9 0:9:0   FC   normal      819    776    0     9      0       0    0   1    0   33      0    0
 10 0:10:0  FC   normal      819    774    1    10      0       0    0   0    0   34      0    0
 11 0:11:0  FC   normal      819    775    0    10      0       0    0   2    0   32      0    0
 12 0:12:0? FC   degraded    819    761    5    11      8       0    0   0    0   34      0    0
 13 0:13:0? FC   degraded    819    771    2     9      3       0    0   0    0   34      0    0
 14 0:14:0? FC   degraded    819    772    2     8      3       0    0   0    0   34      0    0
 15 0:15:0? FC   degraded    819    718   36    10     21       0    0   0    0   34      0    0
 16 0:16:0? FC   degraded    819    729   12    13     31       0    0   0    0   34      0    0
 17 0:17:0? FC   degraded    819    767    1     8      9       0    0   0    0   34      0    0
 18 0:18:0? FC   degraded    819    770    2     8      5       0    0   0    0   34      0    0
 19 0:19:0? FC   degraded    819    770    1     8      6       0    0   0    0   34      0    0
 21 0:21:0? FC   degraded    819    771    1     9      4       0    0   0    0   34      0    0
 22 0:22:0? FC   degraded    819    717   26    10     32       0    0   0    0   34      0    0
 23 0:23:0? FC   degraded    819    772    2     9      2       0    0   0    0   34      0    0
 24 1:0:0   NL   normal     1805   1412    0   310      0       0    0   0    0   83      0    0
 25 1:1:0   NL   normal     1805   1679    0    43      0       0    0   0    0   83      0    0
 26 1:4:0   NL   normal     1805   1677    0    45      0       0    0   0    0   83      0    0
 27 1:5:0   NL   normal     1805   1410    0   312      0       0    0   0    0   83      0    0
 28 1:8:0   NL   normal     1805   1412    0   310      0       0    0   0    0   83      0    0
 29 1:9:0   NL   normal     1805   1674    0    48      0       0    0   0    0   83      0    0
 30 1:12:0  NL   normal     1805   1680    0    42      0       0    0   0    0   83      0    0
 31 1:20:0  NL   normal     1805   1678    0    44      0       0    0   0    0   83      0    0
 32 1:16:0  NL   normal     1805   1409    0   313      0       0    0   0    0   83      0    0
 33 1:17:0  NL   normal     1805   1680    0    42      0       0    0   0    0   83      0    0
 34 0:20:0? FC   degraded    819    755    6    16      8       0    0   0    0   34      0    0
 35 1:21:0  NL   normal     1805   1411    0   311      0       0    0   0    0   83      0    0
 36 2:0:0   FC   normal      819    744    0    41      0       0    0   3    0   31      0    0
 37 2:1:0   FC   normal      819    743    0    42      0       0    0   9    0   25      0    0
 38 2:2:0   FC   normal      819    742    0    43      0       0    0   5    0   29      0    0
 39 2:3:0   FC   normal      819    744    0    41      0       0    0   8    0   26      0    0
 40 2:4:0   FC   normal      819    745    0    40      0       0    0   2    0   32      0    0
 41 2:5:0   FC   normal      819    743    0    42      0       0    0   9    0   25      0    0
 42 2:6:0   FC   normal      819    743    0    42      0       0    0   4    0   30      0    0
 43 2:7:0   FC   normal      819    750    0    35      0       0    0   2    0   32      0    0
 44 2:8:0   FC   normal      819    743    0    42      0       0    0   4    0   30      0    0
 45 4:0:0   NL   normal     3611   1428    0  2017      0       0    0   0    0  166      0    0
 46 2:10:0  FC   normal      819    742    0    43      0       0    0   5    0   29      0    0
 47 2:11:0  FC   normal      819    742    0    43      0       0    0  10    0   24      0    0
 48 2:12:0  FC   normal      819    741    0    44      0       0    0   6    0   28      0    0
 49 2:13:0  FC   normal      819    743    0    42      0       0    0   9    0   25      0    0
 50 2:14:0  FC   normal      819    748    0    37      0       0    0   0    0   34      0    0
 51 2:15:0  FC   normal      819    743    0    42      0       0    0   8    0   26      0    0
 52 2:16:0  FC   normal      819    745    0    40      0       0    0   1    0   33      0    0
 53 2:17:0  FC   normal      819    742    0    43      0       0    0   9    0   25      0    0
 54 2:18:0  FC   normal      819    746    0    39      0       0    0   0    0   34      0    0
 55 2:19:0  FC   normal      819    746    0    39      0       0    0   5    0   29      0    0
 56 2:20:0  FC   normal      819    743    0    42      0       0    0   3    0   31      0    0
 57 2:21:0  FC   normal      819    743    0    42      0       0    0   8    0   26      0    0
 58 2:22:0  FC   normal      819    743    0    42      0       0    0   3    0   31      0    0
 59 2:23:0  FC   normal      819    742    0    43      0       0    0   9    0   25      0    0
 60 3:19:0  NL   normal     1805   1615    0   107      0       0    0   0    0   83      0    0
 61 3:0:0   NL   normal     1805   1408    0   314      0       0    0   1    0   82      0    0
 62 3:1:0   NL   normal     1805   1611    0   111      0       0    0   0    0   83      0    0
 63 3:2:0   NL   normal     1805   1408    0   314      0       0    0   1    0   82      0    0
 64 3:3:0   NL   normal     1805   1614    0   108      0       0    0   0    0   83      0    0
 65 3:4:0   NL   normal     1805   1615    0   107      0       0    0   0    0   83      0    0
 66 3:5:0   NL   normal     1805   1410    0   312      0       0    0   0    0   83      0    0
 67 3:6:0   NL   normal     1805   1613    0   109      0       0    0   0    0   83      0    0
 68 3:7:0   NL   normal     1805   1409    0   313      0       0    0   0    0   83      0    0
 69 3:8:0   NL   normal     1805   1408    0   314      0       0    0   1    0   82      0    0
 70 3:9:0   NL   normal     1805   1615    0   107      0       0    0   0    0   83      0    0
 71 3:10:0  NL   normal     1805   1407    0   315      0       0    0   2    0   81      0    0
 72 3:11:0  NL   normal     1805   1618    0   104      0       0    0   0    0   83      0    0
 73 3:12:0  NL   normal     1805   1610    0   112      0       0    0   1    0   82      0    0
 74 3:13:0  NL   normal     1805   1409    0   313      0       0    0   0    0   83      0    0
 75 3:14:0  NL   normal     1805   1618    0   104      0       0    0   0    0   83      0    0
 76 3:15:0  NL   normal     1805   1411    0   311      0       0    0   0    0   83      0    0
 77 3:16:0  NL   normal     1805   1408    0   313      0       0    1   1    0   82      0    0
 78 3:17:0  NL   normal     1805   1615    0   107      0       0    0   0    0   83      0    0
 79 3:18:0  NL   normal     1805   1411    0   311      0       0    0   0    0   83      0    0
 80 3:20:0  NL   normal     1805   1615    0   107      0       0    0   0    0   83      0    0
 81 3:21:0  NL   normal     1805   1410    0   312      0       0    0   0    0   83      0    0
 82 3:22:0  NL   normal     1805   1618    0   104      0       0    0   0    0   83      0    0
 83 3:23:0  NL   normal     1805   1409    0   313      0       0    0   0    0   83      0    0
 84 1:2:0   NL   normal     1805   1408    0   314      0       0    0   1    0   82      0    0
 85 1:3:0   NL   normal     1805   1681    0    41      0       0    0   0    0   83      0    0
 86 1:6:0   NL   normal     1805   1673    0    49      0       0    0   0    0   83      0    0
 87 1:7:0   NL   normal     1805   1411    0   311      0       0    0   0    0   83      0    0
 88 1:10:0  NL   normal     1805   1408    0   314      0       0    0   1    0   82      0    0
 89 1:11:0  NL   normal     1805   1683    0    39      0       0    0   0    0   83      0    0
 90 1:14:0  NL   normal     1805   1683    0    39      0       0    0   0    0   83      0    0
 91 1:15:0  NL   normal     1805   1408    0   314      0       0    0   0    0   83      0    0
 92 1:18:0  NL   normal     1805   1408    0   314      0       0    0   0    0   83      0    0
 93 1:19:0  NL   normal     1805   1679    0    43      0       0    0   0    0   83      0    0
 94 1:22:0  NL   normal     1805   1684    0    38      0       0    0   0    0   83      0    0
 95 1:23:0  NL   normal     1805   1409    0   313      0       0    0   0    0   83      0    0
 96 2:9:0   FC   normal      819    742    0    43      0       0    0   9    0   25      0    0
 97 4:1:0   NL   normal     3611    931    0  2514      0       0    0   0    0  166      0    0
 98 4:2:0   NL   normal     3611   1426    0  2019      0       0    0   0    0  166      0    0
 99 4:3:0   NL   normal     3611    931    0  2514      0       0    0   0    0  166      0    0
100 4:4:0   NL   normal     3611    929    0  2516      0       0    0   0    0  166      0    0
101 4:5:0   NL   normal     3611   1425    0  2020      0       0    0   0    0  166      0    0
102 4:6:0   NL   normal     3611    930    0  2515      0       0    0   0    0  166      0    0
103 4:7:0   NL   normal     3611   1423    0  2022      0       0    0   0    0  166      0    0
104 4:8:0   NL   normal     3611   1428    0  2017      0       0    0   0    0  166      0    0
105 4:9:0   NL   normal     3611    931    0  2514      0       0    0   0    0  166      0    0
106 4:10:0  NL   normal     3611   1426    0  2019      0       0    0   0    0  166      0    0
107 4:11:0  NL   normal     3611    929    0  2516      0       0    0   0    0  166      0    0
108 4:12:0  NL   normal     3611    932    0  2514      0       0    0   0    0  165      0    0
109 4:13:0  NL   normal     3611   1428    0  2018      0       0    0   0    0  165      0    0
110 4:14:0  NL   normal     3611    929    0  2517      0       0    0   0    0  165      0    0
111 4:15:0  NL   normal     3611   1426    0  2020      0       0    0   0    0  165      0    0
112 4:16:0  NL   normal     3611   1428    0  2018      0       0    0   0    0  165      0    0
113 4:17:0  NL   normal     3611    930    0  2516      0       0    0   0    0  165      0    0
114 4:18:0  NL   normal     3611   1423    0  2023      0       0    0   0    0  165      0    0
115 4:19:0  NL   normal     3611    929    0  2517      0       0    0   0    0  165      0    0
116 4:20:0  NL   normal     3611    930    0  2516      0       0    0   0    0  165      0    0
117 4:21:0  NL   normal     3611   1425    0  2021      0       0    0   0    0  165      0    0
118 4:22:0  NL   normal     3611    929    0  2517      0       0    0   0    0  165      0    0
119 4:23:0  NL   normal     3611   1426    0  2020      0       0    0   0    0  165      0    0
120 1:13:0  NL   normal     1805   1402    0   320      0       0    0   5    0   78      0    0
------------------------------------------------------------------------------------------------
120 total                 212616 137836  100 64953    132       0    1 157    0 9437      0    0

[support_s]

System recommended content:

1. HPE 3PAR StoreServ 7000 Storage

If the above information is helpful, then please click on "Thumbs Up/Kudo" icon.

Thank you for being a HPE community member.

[louisji2008 · Accepted solution]

Problem is resolved.

Useful command:

showpd -failed -degraded

showpd -s -failed -degraded

showpd -path -failed -degraded

cgcmd -tc tty -C cage0 -c resetdrive X -p a

showpdch -mov

showpd -c

servicemag status

checkhealth

[sbhat09]

Hello @louisji2008,

Great to know that the issue has been resolved.!

Thanks for being generous enough to share the fix.

Regards,
Srinivas Bhat

If you feel this was helpful please click the KUDOS! thumb below!
Note: All of my comments are my own and are not any official representation of HPE.