How to clear and start a faulted or partial service group in VCS ?

Today we will look at general steps how to clear and start a faulted/partial service group in VCS.

These are few steps we follow whenever a SG goes into faulted/partial state to bring it back in online state.

1. Check out the current status

ngeaix001 --> hastatus -summ

-- SYSTEM STATE
-- System               State                Frozen

A  ngeaix021             RUNNING              0
A  ngeaix001             RUNNING              0

-- GROUP STATE
-- Group           System               Probed     AutoDisabled    State

B  crmngefup_adminserver ngeaix021             Y          N               OFFLINE|FAULTED
B  crmngefup_adminserver ngeaix001             Y          N               OFFLINE|FAULTED
B  cvm             ngeaix021             Y          N               ONLINE
B  cvm             ngeaix001             Y          N               ONLINE
B  gmxngefup_adminserver ngeaix021             Y          N               OFFLINE
B  gmxngefup_adminserver ngeaix001             Y          N               PARTIAL|FAULTED
B  nfsserver       ngeaix021             Y          N               OFFLINE
B  nfsserver       ngeaix001             Y          N               ONLINE
B  spdngefup_adminserver ngeaix021             Y          N               ONLINE
B  spdngefup_adminserver ngeaix001             Y          N               OFFLINE
B  ssepd_mount     ngeaix021             Y          N               ONLINE
B  ssepd_mount     ngeaix001             Y          N               ONLINE
B  ngeres          ngeaix021             Y          N               OFFLINE
B  ngeres          ngeaix001             Y          N               ONLINE
B  ngeres_mount    ngeaix021             Y          N               ONLINE
B  ngeres_mount    ngeaix001             Y          N               ONLINE
B  vxfen           ngeaix021             Y          N               ONLINE
B  vxfen           ngeaix001             Y          N               ONLINE

-- RESOURCES FAILED
-- Group           Type                 Resource             System

D  crmngefup_adminserver Application          crmngefup_adminserver-app ngeaix021
D  crmngefup_adminserver Application          crmngefup_adminserver-app ngeaix001
D  gmxngefup_adminserver Application          gmxngefup_adminserver-app ngeaix001

 

2. Now clear the faulted resource.

ngeaix001 --> hagrp -clear gmxngefup_adminserver

 

3. Check out the resource after clearing it.

ngeaix001 --> hastatus -summ

-- SYSTEM STATE
-- System               State                Frozen

A  ngeaix021             RUNNING              0
A  ngeaix001             RUNNING              0

-- GROUP STATE
-- Group           System               Probed     AutoDisabled    State

B  crmngefup_adminserver ngeaix021             Y          N               OFFLINE|FAULTED
B  crmngefup_adminserver ngeaix001             Y          N               OFFLINE|FAULTED
B  cvm             ngeaix021             Y          N               ONLINE
B  cvm             ngeaix001             Y          N               ONLINE
B  gmxngefup_adminserver ngeaix021             Y          N               OFFLINE
B  gmxngefup_adminserver ngeaix001             Y          N               PARTIAL
B  nfsserver       ngeaix021             Y          N               OFFLINE
B  nfsserver       ngeaix001             Y          N               ONLINE
B  spdngefup_adminserver ngeaix021             Y          N               ONLINE
B  spdngefup_adminserver ngeaix001             Y          N               OFFLINE
B  ssepd_mount     ngeaix021             Y          N               ONLINE
B  ssepd_mount     ngeaix001             Y          N               ONLINE
B  ngeres          ngeaix021             Y          N               OFFLINE
B  ngeres          ngeaix001             Y          N               ONLINE
B  ngeres_mount    ngeaix021             Y          N               ONLINE
B  ngeres_mount    ngeaix001             Y          N               ONLINE
B  vxfen           ngeaix021             Y          N               ONLINE
B  vxfen           ngeaix001             Y          N               ONLINE

-- RESOURCES FAILED
-- Group           Type                 Resource             System

D  crmngefup_adminserver Application          crmngefup_adminserver-app ngeaix021
D  crmngefup_adminserver Application          crmngefup_adminserver-app ngeaix001

 

4. Clear another failed service group as well.

ngeaix001 --> hagrp -clear crmngefup_adminserver

 

5. Now check the status.

ngeaix001 --> hastatus -summ

-- SYSTEM STATE
-- System               State                Frozen

A  ngeaix021             RUNNING              0
A  ngeaix001             RUNNING              0

-- GROUP STATE
-- Group           System               Probed     AutoDisabled    State

B  crmngefup_adminserver ngeaix021             Y          N               OFFLINE
B  crmngefup_adminserver ngeaix001             Y          N               OFFLINE
B  cvm             ngeaix021             Y          N               ONLINE
B  cvm             ngeaix001             Y          N               ONLINE
B  gmxngefup_adminserver ngeaix021             Y          N               OFFLINE
B  gmxngefup_adminserver ngeaix001             Y          N               PARTIAL
B  nfsserver       ngeaix021             Y          N               OFFLINE
B  nfsserver       ngeaix001             Y          N               ONLINE
B  spdngefup_adminserver ngeaix021             Y          N               ONLINE
B  spdngefup_adminserver ngeaix001             Y          N               OFFLINE
B  ssepd_mount     ngeaix021             Y          N               ONLINE
B  ssepd_mount     ngeaix001             Y          N               ONLINE
B  ngeres          ngeaix021             Y          N               OFFLINE
B  ngeres          ngeaix001             Y          N               ONLINE
B  ngeres_mount    ngeaix021             Y          N               ONLINE
B  ngeres_mount    ngeaix001             Y          N               ONLINE
B  vxfen           ngeaix021             Y          N               ONLINE
B  vxfen           ngeaix001             Y          N               ONLINE

 

6. Now bring the service group online.

ngeaix001 --> hagrp -online crmngefup_adminserver -any
VCS NOTICE V-16-1-50735 Attempting to online group on system ngeaix001

ngeaix001 --> hagrp -online gmxngefup_adminserver -sys ngeaix001

 

7. Check the updated status now.

ngeaix001 --> hastatus -summ

-- SYSTEM STATE
-- System               State                Frozen

A  ngeaix021             RUNNING              0
A  ngeaix001             RUNNING              0

-- GROUP STATE
-- Group           System               Probed     AutoDisabled    State

B  crmngefup_adminserver ngeaix021             Y          N               OFFLINE
B  crmngefup_adminserver ngeaix001             Y          N               STARTING|PARTIAL
B  cvm             ngeaix021             Y          N               ONLINE
B  cvm             ngeaix001             Y          N               ONLINE
B  gmxngefup_adminserver ngeaix021             Y          N               OFFLINE
B  gmxngefup_adminserver ngeaix001             Y          N               STARTING|PARTIAL
B  nfsserver       ngeaix021             Y          N               OFFLINE
B  nfsserver       ngeaix001             Y          N               ONLINE
B  spdngefup_adminserver ngeaix021             Y          N               ONLINE
B  spdngefup_adminserver ngeaix001             Y          N               OFFLINE
B  ssepd_mount     ngeaix021             Y          N               ONLINE
B  ssepd_mount     ngeaix001             Y          N               ONLINE
B  ngeres          ngeaix021             Y          N               OFFLINE
B  ngeres          ngeaix001             Y          N               ONLINE
B  ngeres_mount    ngeaix021             Y          N               ONLINE
B  ngeres_mount    ngeaix001             Y          N               ONLINE
B  vxfen           ngeaix021             Y          N               ONLINE
B  vxfen           ngeaix001             Y          N               ONLINE

-- RESOURCES ONLINING
-- Group           Type            Resource             System               IState

F  crmngefup_adminserver Application     crmngefup_adminserver-app ngeaix001             W_ONLINE
F  gmxngefup_adminserver Application     gmxngefup_adminserver-app ngeaix001             W_ONLINE

Leave a Reply

Your email address will not be published.