HPE Community
HPE 3PAR StoreServ Storage
1819774 Members
3430 Online
109607 Solutions
New Discussion

Re: 3par 7200 upgradecage cage0 failed, journal commit I/O error, and 12 disks are degrade

 
SOLVED
Go to solution
louisji2008
Regular Advisor

‎12-17-2021 07:36 AM - last edited on ‎12-19-2021 09:44 PM by

‎12-17-2021 07:36 AM - last edited on ‎12-19-2021 09:44 PM by

3par 7200 upgradecage cage0 failed, journal commit I/O error, and 12 disks are degraded

now the 12 disks led are all off, and two vv are in preserved state.

how to resolve this issue?

cli% upgradecage cage0
Upgrading cage cage0 cpuA from rev 321c to revision in file /opt/tpd/fw/cage/ebod/hp_eos_canister_local_combined_v
Upgrading cage cage0 cpuB from rev 321c to revision in file /opt/tpd/fw/cage/ebod/hp_eos_canister_local_combined_v
[87019094.379213] journal commit I/O error
[87019094.379369] journal commit I/O error

Message from syslogd@UNKNOWN at Fri Dec 17 15:29:02 2021 ...
UNKNOWN
Message from syslogd@UNKNOWN at Fri Dec 17 15:29:02 2021 ...
UNKNOWN kernel: [87019094.379369] journal commit I/O error
kernel: [87019094.379213] journal commit I/O error
Beginning test after upgrade for cage0
Test after upgrade failed:
pdid 12 state must be "valid" or "degraded" not "missing"
3par_youxin cli% showpd -c
                                 --------- Normal Chunklets ---------- ---- Spare Chunklets ----
                                 -- Used --- -------- Unused --------- - Used - ---- Unused ----
 Id CagePos Type State     Total     OK Fail  Free Uninit Unavail Fail  OK Fail Free Uninit Fail
  0 0:0:0   FC   normal      819    771    0    13      0       0    0   2    0   33      0    0
  1 0:1:0   FC   normal      819    776    0     8      0       0    0   1    0   34      0    0
  2 0:2:0   FC   normal      819    775    1     8      0       0    0   0    0   35      0    0
  3 0:3:0   FC   normal      819    775    0     9      0       0    0   3    0   32      0    0
  4 0:4:0   FC   normal      819    775    1     8      0       0    0   0    0   35      0    0
  5 0:5:0   FC   normal      819    777    0     7      0       0    0   0    0   35      0    0
  6 0:6:0   FC   normal      819    774    1    10      0       0    0   1    0   33      0    0
  7 0:7:0   FC   normal      819    776    0     9      0       0    0   2    0   32      0    0
  8 0:8:0   FC   normal      819    775    0    10      0       0    0   0    0   34      0    0
  9 0:9:0   FC   normal      819    776    0     9      0       0    0   1    0   33      0    0
 10 0:10:0  FC   normal      819    774    1    10      0       0    0   0    0   34      0    0
 11 0:11:0  FC   normal      819    775    0    10      0       0    0   2    0   32      0    0
 12 0:12:0? FC   degraded    819    761    5    11      8       0    0   0    0   34      0    0
 13 0:13:0? FC   degraded    819    771    2     9      3       0    0   0    0   34      0    0
 14 0:14:0? FC   degraded    819    772    2     8      3       0    0   0    0   34      0    0
 15 0:15:0? FC   degraded    819    718   36    10     21       0    0   0    0   34      0    0
 16 0:16:0? FC   degraded    819    729   12    13     31       0    0   0    0   34      0    0
 17 0:17:0? FC   degraded    819    767    1     8      9       0    0   0    0   34      0    0
 18 0:18:0? FC   degraded    819    770    2     8      5       0    0   0    0   34      0    0
 19 0:19:0? FC   degraded    819    770    1     8      6       0    0   0    0   34      0    0
 21 0:21:0? FC   degraded    819    771    1     9      4       0    0   0    0   34      0    0
 22 0:22:0? FC   degraded    819    717   26    10     32       0    0   0    0   34      0    0
 23 0:23:0? FC   degraded    819    772    2     9      2       0    0   0    0   34      0    0
 24 1:0:0   NL   normal     1805   1412    0   310      0       0    0   0    0   83      0    0
 25 1:1:0   NL   normal     1805   1679    0    43      0       0    0   0    0   83      0    0
 26 1:4:0   NL   normal     1805   1677    0    45      0       0    0   0    0   83      0    0
 27 1:5:0   NL   normal     1805   1410    0   312      0       0    0   0    0   83      0    0
 28 1:8:0   NL   normal     1805   1412    0   310      0       0    0   0    0   83      0    0
 29 1:9:0   NL   normal     1805   1674    0    48      0       0    0   0    0   83      0    0
 30 1:12:0  NL   normal     1805   1680    0    42      0       0    0   0    0   83      0    0
 31 1:20:0  NL   normal     1805   1678    0    44      0       0    0   0    0   83      0    0
 32 1:16:0  NL   normal     1805   1409    0   313      0       0    0   0    0   83      0    0
 33 1:17:0  NL   normal     1805   1680    0    42      0       0    0   0    0   83      0    0
 34 0:20:0? FC   degraded    819    755    6    16      8       0    0   0    0   34      0    0
 35 1:21:0  NL   normal     1805   1411    0   311      0       0    0   0    0   83      0    0
 36 2:0:0   FC   normal      819    744    0    41      0       0    0   3    0   31      0    0
 37 2:1:0   FC   normal      819    743    0    42      0       0    0   9    0   25      0    0
 38 2:2:0   FC   normal      819    742    0    43      0       0    0   5    0   29      0    0
 39 2:3:0   FC   normal      819    744    0    41      0       0    0   8    0   26      0    0
 40 2:4:0   FC   normal      819    745    0    40      0       0    0   2    0   32      0    0
 41 2:5:0   FC   normal      819    743    0    42      0       0    0   9    0   25      0    0
 42 2:6:0   FC   normal      819    743    0    42      0       0    0   4    0   30      0    0
 43 2:7:0   FC   normal      819    750    0    35      0       0    0   2    0   32      0    0
 44 2:8:0   FC   normal      819    743    0    42      0       0    0   4    0   30      0    0
 45 4:0:0   NL   normal     3611   1428    0  2017      0       0    0   0    0  166      0    0
 46 2:10:0  FC   normal      819    742    0    43      0       0    0   5    0   29      0    0
 47 2:11:0  FC   normal      819    742    0    43      0       0    0  10    0   24      0    0
 48 2:12:0  FC   normal      819    741    0    44      0       0    0   6    0   28      0    0
 49 2:13:0  FC   normal      819    743    0    42      0       0    0   9    0   25      0    0
 50 2:14:0  FC   normal      819    748    0    37      0       0    0   0    0   34      0    0
 51 2:15:0  FC   normal      819    743    0    42      0       0    0   8    0   26      0    0
 52 2:16:0  FC   normal      819    745    0    40      0       0    0   1    0   33      0    0
 53 2:17:0  FC   normal      819    742    0    43      0       0    0   9    0   25      0    0
 54 2:18:0  FC   normal      819    746    0    39      0       0    0   0    0   34      0    0
 55 2:19:0  FC   normal      819    746    0    39      0       0    0   5    0   29      0    0
 56 2:20:0  FC   normal      819    743    0    42      0       0    0   3    0   31      0    0
 57 2:21:0  FC   normal      819    743    0    42      0       0    0   8    0   26      0    0
 58 2:22:0  FC   normal      819    743    0    42      0       0    0   3    0   31      0    0
 59 2:23:0  FC   normal      819    742    0    43      0       0    0   9    0   25      0    0
 60 3:19:0  NL   normal     1805   1615    0   107      0       0    0   0    0   83      0    0
 61 3:0:0   NL   normal     1805   1408    0   314      0       0    0   1    0   82      0    0
 62 3:1:0   NL   normal     1805   1611    0   111      0       0    0   0    0   83      0    0
 63 3:2:0   NL   normal     1805   1408    0   314      0       0    0   1    0   82      0    0
 64 3:3:0   NL   normal     1805   1614    0   108      0       0    0   0    0   83      0    0
 65 3:4:0   NL   normal     1805   1615    0   107      0       0    0   0    0   83      0    0
 66 3:5:0   NL   normal     1805   1410    0   312      0       0    0   0    0   83      0    0
 67 3:6:0   NL   normal     1805   1613    0   109      0       0    0   0    0   83      0    0
 68 3:7:0   NL   normal     1805   1409    0   313      0       0    0   0    0   83      0    0
 69 3:8:0   NL   normal     1805   1408    0   314      0       0    0   1    0   82      0    0
 70 3:9:0   NL   normal     1805   1615    0   107      0       0    0   0    0   83      0    0
 71 3:10:0  NL   normal     1805   1407    0   315      0       0    0   2    0   81      0    0
 72 3:11:0  NL   normal     1805   1618    0   104      0       0    0   0    0   83      0    0
 73 3:12:0  NL   normal     1805   1610    0   112      0       0    0   1    0   82      0    0
 74 3:13:0  NL   normal     1805   1409    0   313      0       0    0   0    0   83      0    0
 75 3:14:0  NL   normal     1805   1618    0   104      0       0    0   0    0   83      0    0
 76 3:15:0  NL   normal     1805   1411    0   311      0       0    0   0    0   83      0    0
 77 3:16:0  NL   normal     1805   1408    0   313      0       0    1   1    0   82      0    0
 78 3:17:0  NL   normal     1805   1615    0   107      0       0    0   0    0   83      0    0
 79 3:18:0  NL   normal     1805   1411    0   311      0       0    0   0    0   83      0    0
 80 3:20:0  NL   normal     1805   1615    0   107      0       0    0   0    0   83      0    0
 81 3:21:0  NL   normal     1805   1410    0   312      0       0    0   0    0   83      0    0
 82 3:22:0  NL   normal     1805   1618    0   104      0       0    0   0    0   83      0    0
 83 3:23:0  NL   normal     1805   1409    0   313      0       0    0   0    0   83      0    0
 84 1:2:0   NL   normal     1805   1408    0   314      0       0    0   1    0   82      0    0
 85 1:3:0   NL   normal     1805   1681    0    41      0       0    0   0    0   83      0    0
 86 1:6:0   NL   normal     1805   1673    0    49      0       0    0   0    0   83      0    0
 87 1:7:0   NL   normal     1805   1411    0   311      0       0    0   0    0   83      0    0
 88 1:10:0  NL   normal     1805   1408    0   314      0       0    0   1    0   82      0    0
 89 1:11:0  NL   normal     1805   1683    0    39      0       0    0   0    0   83      0    0
 90 1:14:0  NL   normal     1805   1683    0    39      0       0    0   0    0   83      0    0
 91 1:15:0  NL   normal     1805   1408    0   314      0       0    0   0    0   83      0    0
 92 1:18:0  NL   normal     1805   1408    0   314      0       0    0   0    0   83      0    0
 93 1:19:0  NL   normal     1805   1679    0    43      0       0    0   0    0   83      0    0
 94 1:22:0  NL   normal     1805   1684    0    38      0       0    0   0    0   83      0    0
 95 1:23:0  NL   normal     1805   1409    0   313      0       0    0   0    0   83      0    0
 96 2:9:0   FC   normal      819    742    0    43      0       0    0   9    0   25      0    0
 97 4:1:0   NL   normal     3611    931    0  2514      0       0    0   0    0  166      0    0
 98 4:2:0   NL   normal     3611   1426    0  2019      0       0    0   0    0  166      0    0
 99 4:3:0   NL   normal     3611    931    0  2514      0       0    0   0    0  166      0    0
100 4:4:0   NL   normal     3611    929    0  2516      0       0    0   0    0  166      0    0
101 4:5:0   NL   normal     3611   1425    0  2020      0       0    0   0    0  166      0    0
102 4:6:0   NL   normal     3611    930    0  2515      0       0    0   0    0  166      0    0
103 4:7:0   NL   normal     3611   1423    0  2022      0       0    0   0    0  166      0    0
104 4:8:0   NL   normal     3611   1428    0  2017      0       0    0   0    0  166      0    0
105 4:9:0   NL   normal     3611    931    0  2514      0       0    0   0    0  166      0    0
106 4:10:0  NL   normal     3611   1426    0  2019      0       0    0   0    0  166      0    0
107 4:11:0  NL   normal     3611    929    0  2516      0       0    0   0    0  166      0    0
108 4:12:0  NL   normal     3611    932    0  2514      0       0    0   0    0  165      0    0
109 4:13:0  NL   normal     3611   1428    0  2018      0       0    0   0    0  165      0    0
110 4:14:0  NL   normal     3611    929    0  2517      0       0    0   0    0  165      0    0
111 4:15:0  NL   normal     3611   1426    0  2020      0       0    0   0    0  165      0    0
112 4:16:0  NL   normal     3611   1428    0  2018      0       0    0   0    0  165      0    0
113 4:17:0  NL   normal     3611    930    0  2516      0       0    0   0    0  165      0    0
114 4:18:0  NL   normal     3611   1423    0  2023      0       0    0   0    0  165      0    0
115 4:19:0  NL   normal     3611    929    0  2517      0       0    0   0    0  165      0    0
116 4:20:0  NL   normal     3611    930    0  2516      0       0    0   0    0  165      0    0
117 4:21:0  NL   normal     3611   1425    0  2021      0       0    0   0    0  165      0    0
118 4:22:0  NL   normal     3611    929    0  2517      0       0    0   0    0  165      0    0
119 4:23:0  NL   normal     3611   1426    0  2020      0       0    0   0    0  165      0    0
120 1:13:0  NL   normal     1805   1402    0   320      0       0    0   5    0   78      0    0
------------------------------------------------------------------------------------------------
120 total                 212616 137836  100 64953    132       0    1 157    0 9437      0    0

 

 


How time flies~~~
0 Kudos
Reply
3 REPLIES 3
support_s
System Recommended

‎12-17-2021 08:37 AM

‎12-17-2021 08:37 AM

Query: 3par 7200 upgradecage cage0 failed, journal commit I/O error, and 12 disks are degraded

System recommended content:

1. HPE 3PAR StoreServ 7000 Storage

 

If the above information is helpful, then please click on "Thumbs Up/Kudo" icon.

 

Thank you for being a HPE community member.


Accept or Kudo

Reply
louisji2008
Regular Advisor

‎12-19-2021 07:18 PM

‎12-19-2021 07:18 PM

Solution

Re: 3par 7200 upgradecage cage0 failed, journal commit I/O error, and 12 disks are degrade

Problem is resolved.

Useful command:

showpd -failed -degraded

showpd -s -failed -degraded

showpd -path -failed -degraded

cgcmd -tc tty -C cage0 -c resetdrive X -p a

showpdch -mov

showpd -c

servicemag status

checkhealth


How time flies~~~
Reply
sbhat09
HPE Pro

‎12-19-2021 10:20 PM

‎12-19-2021 10:20 PM

Re: 3par 7200 upgradecage cage0 failed, journal commit I/O error, and 12 disks are degrade

Hello @louisji2008,

Great to know that the issue has been resolved.!

Thanks for being generous enough to share the fix.

Regards,
Srinivas Bhat

If you feel this was helpful please click the KUDOS! thumb below!
Note: All of my comments are my own and are not any official representation of HPE.



I work at HPE
HPE Support Center offers support for your HPE services and products when and how you need it. Get started with HPE Support Center today.
[Any personal opinions expressed are mine, and not official statements on behalf of Hewlett Packard Enterprise]
Accept or Kudo
0 Kudos
Reply
The opinions expressed above are the personal opinions of the authors, not of Hewlett Packard Enterprise. By using this site, you accept the Terms of Use and Rules of Participation.